Aug 05 17:21:28.749773 ip-10-0-136-250 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Aug 05 17:21:28.749784 ip-10-0-136-250 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Aug 05 17:21:28.749791 ip-10-0-136-250 systemd[1]: kubelet.service: Failed with result 'resources'. Aug 05 17:21:28.750023 ip-10-0-136-250 systemd[1]: Failed to start Kubernetes Kubelet. Aug 05 17:21:38.760103 ip-10-0-136-250 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Aug 05 17:21:38.760120 ip-10-0-136-250 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 28a2862982834626870b1f28e5886c10 -- Aug 05 17:23:32.108460 ip-10-0-136-250 systemd[1]: Starting Kubernetes Kubelet... Aug 05 17:23:32.533485 ip-10-0-136-250 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 05 17:23:32.533485 ip-10-0-136-250 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Aug 05 17:23:32.533485 ip-10-0-136-250 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 05 17:23:32.533485 ip-10-0-136-250 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Aug 05 17:23:32.533485 ip-10-0-136-250 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 05 17:23:32.535545 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.535433 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Aug 05 17:23:32.541173 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541153 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 17:23:32.541173 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541171 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 17:23:32.541173 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541175 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 17:23:32.541268 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541178 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 17:23:32.541268 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541181 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 17:23:32.541268 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541184 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 17:23:32.541268 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541187 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 17:23:32.541268 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541191 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 17:23:32.541268 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541194 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 17:23:32.541268 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541197 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 17:23:32.541268 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541199 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 17:23:32.541268 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541202 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 17:23:32.541268 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541205 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 17:23:32.541268 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541208 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 17:23:32.541268 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541210 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 17:23:32.541268 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541213 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 17:23:32.541268 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541215 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 17:23:32.541268 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541218 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 17:23:32.541268 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541221 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 17:23:32.541268 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541224 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 17:23:32.541268 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541227 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 17:23:32.541268 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541229 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 17:23:32.541767 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541232 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 17:23:32.541767 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541241 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 17:23:32.541767 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541244 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 17:23:32.541767 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541246 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 17:23:32.541767 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541249 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 17:23:32.541767 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541251 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 17:23:32.541767 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541254 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 17:23:32.541767 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541257 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 17:23:32.541767 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541259 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 17:23:32.541767 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541262 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 17:23:32.541767 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541265 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 17:23:32.541767 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541269 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 17:23:32.541767 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541274 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 17:23:32.541767 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541278 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 17:23:32.541767 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541281 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 17:23:32.541767 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541284 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 17:23:32.541767 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541287 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 17:23:32.541767 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541290 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 17:23:32.541767 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541292 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 17:23:32.541767 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541295 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 17:23:32.542330 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541299 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 17:23:32.542330 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541301 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 17:23:32.542330 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541304 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 17:23:32.542330 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541307 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 17:23:32.542330 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541309 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 17:23:32.542330 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541312 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 17:23:32.542330 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541315 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 17:23:32.542330 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541317 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 17:23:32.542330 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541320 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 17:23:32.542330 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541322 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 17:23:32.542330 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541325 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 17:23:32.542330 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541333 2579 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 17:23:32.542330 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541337 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 17:23:32.542330 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541339 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 17:23:32.542330 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541342 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 17:23:32.542330 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541345 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 17:23:32.542330 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541348 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 17:23:32.542330 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541350 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 17:23:32.542330 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541353 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 17:23:32.542330 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541356 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 17:23:32.542831 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541360 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 17:23:32.542831 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541363 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 17:23:32.542831 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541366 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 17:23:32.542831 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541371 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 17:23:32.542831 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541374 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 17:23:32.542831 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541377 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 17:23:32.542831 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541381 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 17:23:32.542831 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541384 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 17:23:32.542831 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541386 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 17:23:32.542831 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541389 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 17:23:32.542831 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541392 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 17:23:32.542831 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541395 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 17:23:32.542831 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541397 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 17:23:32.542831 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541400 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 17:23:32.542831 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541402 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 17:23:32.542831 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541404 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 17:23:32.542831 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541408 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 17:23:32.542831 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541412 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 17:23:32.542831 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541414 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 17:23:32.542831 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541417 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 17:23:32.543389 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541419 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 17:23:32.543389 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541422 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 17:23:32.543389 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541425 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 17:23:32.543389 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541427 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 17:23:32.543389 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541431 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 17:23:32.543389 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541434 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 17:23:32.543389 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541436 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 17:23:32.543389 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541439 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 17:23:32.543389 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541442 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 17:23:32.543389 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541444 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 17:23:32.543389 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541447 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 17:23:32.543389 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541449 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 17:23:32.543389 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541452 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 17:23:32.543389 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541454 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 17:23:32.543389 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541457 2579 feature_gate.go:328] unrecognized feature gate: Example Aug 05 17:23:32.543389 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541459 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 17:23:32.543389 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.541462 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 17:23:32.543389 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542280 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 17:23:32.543389 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542288 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 17:23:32.543853 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542292 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 17:23:32.543853 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542295 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 17:23:32.543853 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542298 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 17:23:32.543853 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542302 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 17:23:32.543853 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542305 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 17:23:32.543853 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542309 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 17:23:32.543853 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542312 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 17:23:32.543853 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542314 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 17:23:32.543853 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542318 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 17:23:32.543853 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542321 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 17:23:32.543853 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542324 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 17:23:32.543853 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542327 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 17:23:32.543853 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542329 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 17:23:32.543853 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542332 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 17:23:32.543853 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542334 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 17:23:32.543853 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542339 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 17:23:32.543853 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542342 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 17:23:32.543853 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542345 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 17:23:32.543853 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542348 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 17:23:32.544372 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542351 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 17:23:32.544372 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542354 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 17:23:32.544372 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542358 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 17:23:32.544372 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542361 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 17:23:32.544372 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542364 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 17:23:32.544372 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542367 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 17:23:32.544372 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542369 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 17:23:32.544372 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542372 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 17:23:32.544372 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542375 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 17:23:32.544372 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542377 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 17:23:32.544372 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542381 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 17:23:32.544372 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542383 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 17:23:32.544372 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542386 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 17:23:32.544372 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542388 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 17:23:32.544372 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542390 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 17:23:32.544372 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542393 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 17:23:32.544372 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542395 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 17:23:32.544372 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542398 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 17:23:32.544372 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542401 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 17:23:32.544372 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542404 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 17:23:32.544957 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542407 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 17:23:32.544957 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542409 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 17:23:32.544957 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542412 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 17:23:32.544957 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542414 2579 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 17:23:32.544957 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542417 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 17:23:32.544957 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542419 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 17:23:32.544957 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542422 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 17:23:32.544957 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542424 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 17:23:32.544957 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542427 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 17:23:32.544957 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542429 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 17:23:32.544957 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542432 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 17:23:32.544957 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542435 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 17:23:32.544957 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542440 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 17:23:32.544957 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542443 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 17:23:32.544957 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542446 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 17:23:32.544957 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542448 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 17:23:32.544957 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542451 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 17:23:32.544957 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542453 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 17:23:32.544957 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542456 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 17:23:32.544957 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542458 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 17:23:32.545508 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542461 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 17:23:32.545508 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542463 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 17:23:32.545508 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542466 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 17:23:32.545508 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542468 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 17:23:32.545508 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542471 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 17:23:32.545508 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542473 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 17:23:32.545508 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542475 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 17:23:32.545508 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542478 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 17:23:32.545508 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542480 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 17:23:32.545508 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542483 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 17:23:32.545508 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542488 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 17:23:32.545508 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542492 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 17:23:32.545508 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542495 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 17:23:32.545508 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542498 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 17:23:32.545508 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542501 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 17:23:32.545508 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542503 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 17:23:32.545508 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542506 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 17:23:32.545508 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542509 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 17:23:32.545508 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542511 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 17:23:32.545508 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542514 2579 feature_gate.go:328] unrecognized feature gate: Example Aug 05 17:23:32.546017 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542516 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 17:23:32.546017 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542519 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 17:23:32.546017 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542521 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 17:23:32.546017 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542524 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 17:23:32.546017 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542526 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 17:23:32.546017 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542530 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 17:23:32.546017 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542532 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 17:23:32.546017 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542535 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 17:23:32.546017 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542537 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 17:23:32.546017 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542540 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 17:23:32.546017 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542543 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 17:23:32.546017 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542545 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 17:23:32.546017 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542548 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 17:23:32.546017 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542550 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 17:23:32.546017 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542553 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 17:23:32.546017 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542555 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 17:23:32.546017 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542558 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 17:23:32.546017 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542560 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 17:23:32.546017 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542927 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 17:23:32.546499 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542931 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 17:23:32.546499 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542934 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 17:23:32.546499 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542937 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 17:23:32.546499 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542940 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 17:23:32.546499 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542943 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 17:23:32.546499 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542946 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 17:23:32.546499 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542949 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 17:23:32.546499 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542952 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 17:23:32.546499 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542954 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 17:23:32.546499 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542957 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 17:23:32.546499 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542960 2579 feature_gate.go:328] unrecognized feature gate: Example Aug 05 17:23:32.546499 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542962 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 17:23:32.546499 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542965 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 17:23:32.546499 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542967 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 17:23:32.546499 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542970 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 17:23:32.546499 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542972 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 17:23:32.546499 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542975 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 17:23:32.546499 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542978 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 17:23:32.546499 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542981 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 17:23:32.546499 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542984 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 17:23:32.546990 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542987 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 17:23:32.546990 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542989 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 17:23:32.546990 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542992 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 17:23:32.546990 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542994 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 17:23:32.546990 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.542998 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 17:23:32.546990 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543002 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 17:23:32.546990 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543004 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 17:23:32.546990 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543008 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 17:23:32.546990 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543012 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 17:23:32.546990 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543016 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 17:23:32.546990 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543018 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 17:23:32.546990 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543021 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 17:23:32.546990 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543024 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 17:23:32.546990 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543028 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 17:23:32.546990 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543032 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 17:23:32.546990 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543035 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 17:23:32.546990 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543038 2579 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 17:23:32.546990 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543041 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 17:23:32.547452 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543044 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 17:23:32.547452 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543046 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 17:23:32.547452 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543049 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 17:23:32.547452 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543052 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 17:23:32.547452 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543054 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 17:23:32.547452 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543057 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 17:23:32.547452 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543059 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 17:23:32.547452 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543062 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 17:23:32.547452 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543064 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 17:23:32.547452 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543067 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 17:23:32.547452 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543070 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 17:23:32.547452 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543072 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 17:23:32.547452 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543074 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 17:23:32.547452 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543077 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 17:23:32.547452 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543080 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 17:23:32.547452 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543082 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 17:23:32.547452 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543085 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 17:23:32.547452 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543088 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 17:23:32.547452 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543090 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 17:23:32.547452 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543093 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 17:23:32.547983 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543095 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 17:23:32.547983 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543098 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 17:23:32.547983 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543100 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 17:23:32.547983 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543103 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 17:23:32.547983 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543105 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 17:23:32.547983 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543108 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 17:23:32.547983 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543110 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 17:23:32.547983 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543112 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 17:23:32.547983 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543118 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 17:23:32.547983 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543121 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 17:23:32.547983 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543124 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 17:23:32.547983 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543126 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 17:23:32.547983 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543129 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 17:23:32.547983 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543132 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 17:23:32.547983 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543135 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 17:23:32.547983 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543161 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 17:23:32.547983 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543178 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 17:23:32.547983 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543181 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 17:23:32.547983 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543184 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 17:23:32.548535 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543187 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 17:23:32.548535 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543190 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 17:23:32.548535 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543192 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 17:23:32.548535 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543195 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 17:23:32.548535 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543197 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 17:23:32.548535 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543200 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 17:23:32.548535 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543203 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 17:23:32.548535 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543206 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 17:23:32.548535 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543209 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 17:23:32.548535 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543212 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 17:23:32.548535 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543214 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 17:23:32.548535 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543217 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 17:23:32.548535 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543220 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 17:23:32.548535 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543222 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 17:23:32.548535 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543225 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 17:23:32.548535 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543227 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 17:23:32.548535 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543229 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 17:23:32.548535 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543232 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 17:23:32.548535 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543234 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 17:23:32.548535 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543237 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 17:23:32.549022 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543240 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 17:23:32.549022 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543310 2579 flags.go:64] FLAG: --address="0.0.0.0" Aug 05 17:23:32.549022 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543322 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Aug 05 17:23:32.549022 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543328 2579 flags.go:64] FLAG: --anonymous-auth="true" Aug 05 17:23:32.549022 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543332 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Aug 05 17:23:32.549022 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543337 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Aug 05 17:23:32.549022 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543340 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Aug 05 17:23:32.549022 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543345 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Aug 05 17:23:32.549022 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543349 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Aug 05 17:23:32.549022 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543352 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Aug 05 17:23:32.549022 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543356 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Aug 05 17:23:32.549022 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543359 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Aug 05 17:23:32.549022 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543363 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Aug 05 17:23:32.549022 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543366 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Aug 05 17:23:32.549022 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543369 2579 flags.go:64] FLAG: --cgroup-root="" Aug 05 17:23:32.549022 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543372 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Aug 05 17:23:32.549022 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543375 2579 flags.go:64] FLAG: --client-ca-file="" Aug 05 17:23:32.549022 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543378 2579 flags.go:64] FLAG: --cloud-provider="external" Aug 05 17:23:32.549022 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543382 2579 flags.go:64] FLAG: --cluster-dns="[]" Aug 05 17:23:32.549022 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543387 2579 flags.go:64] FLAG: --cluster-domain="" Aug 05 17:23:32.549022 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543391 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Aug 05 17:23:32.549022 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543394 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Aug 05 17:23:32.549022 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543398 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Aug 05 17:23:32.549022 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543401 2579 flags.go:64] FLAG: --container-log-max-files="5" Aug 05 17:23:32.549642 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543405 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Aug 05 17:23:32.549642 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543408 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Aug 05 17:23:32.549642 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543411 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Aug 05 17:23:32.549642 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543415 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Aug 05 17:23:32.549642 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543418 2579 flags.go:64] FLAG: --contention-profiling="false" Aug 05 17:23:32.549642 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543421 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Aug 05 17:23:32.549642 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543424 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Aug 05 17:23:32.549642 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543427 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Aug 05 17:23:32.549642 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543430 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Aug 05 17:23:32.549642 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543436 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Aug 05 17:23:32.549642 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543440 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Aug 05 17:23:32.549642 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543444 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Aug 05 17:23:32.549642 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543447 2579 flags.go:64] FLAG: --enable-load-reader="false" Aug 05 17:23:32.549642 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543450 2579 flags.go:64] FLAG: --enable-server="true" Aug 05 17:23:32.549642 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543453 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Aug 05 17:23:32.549642 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543458 2579 flags.go:64] FLAG: --event-burst="100" Aug 05 17:23:32.549642 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543461 2579 flags.go:64] FLAG: --event-qps="50" Aug 05 17:23:32.549642 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543464 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Aug 05 17:23:32.549642 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543467 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Aug 05 17:23:32.549642 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543470 2579 flags.go:64] FLAG: --eviction-hard="" Aug 05 17:23:32.549642 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543474 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Aug 05 17:23:32.549642 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543477 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Aug 05 17:23:32.549642 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543480 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Aug 05 17:23:32.549642 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543483 2579 flags.go:64] FLAG: --eviction-soft="" Aug 05 17:23:32.549642 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543486 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Aug 05 17:23:32.550302 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543489 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Aug 05 17:23:32.550302 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543492 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Aug 05 17:23:32.550302 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543495 2579 flags.go:64] FLAG: --experimental-mounter-path="" Aug 05 17:23:32.550302 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543498 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Aug 05 17:23:32.550302 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543501 2579 flags.go:64] FLAG: --fail-swap-on="true" Aug 05 17:23:32.550302 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543504 2579 flags.go:64] FLAG: --feature-gates="" Aug 05 17:23:32.550302 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543507 2579 flags.go:64] FLAG: --file-check-frequency="20s" Aug 05 17:23:32.550302 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543510 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Aug 05 17:23:32.550302 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543513 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Aug 05 17:23:32.550302 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543517 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Aug 05 17:23:32.550302 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543520 2579 flags.go:64] FLAG: --healthz-port="10248" Aug 05 17:23:32.550302 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543523 2579 flags.go:64] FLAG: --help="false" Aug 05 17:23:32.550302 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543525 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-136-250.ec2.internal" Aug 05 17:23:32.550302 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543529 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Aug 05 17:23:32.550302 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543531 2579 flags.go:64] FLAG: --http-check-frequency="20s" Aug 05 17:23:32.550302 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543534 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Aug 05 17:23:32.550302 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543539 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Aug 05 17:23:32.550302 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543544 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Aug 05 17:23:32.550302 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543547 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Aug 05 17:23:32.550302 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543550 2579 flags.go:64] FLAG: --image-service-endpoint="" Aug 05 17:23:32.550302 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543553 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Aug 05 17:23:32.550302 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543556 2579 flags.go:64] FLAG: --kube-api-burst="100" Aug 05 17:23:32.550302 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543559 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Aug 05 17:23:32.550940 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543563 2579 flags.go:64] FLAG: --kube-api-qps="50" Aug 05 17:23:32.550940 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543566 2579 flags.go:64] FLAG: --kube-reserved="" Aug 05 17:23:32.550940 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543568 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Aug 05 17:23:32.550940 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543571 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Aug 05 17:23:32.550940 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543575 2579 flags.go:64] FLAG: --kubelet-cgroups="" Aug 05 17:23:32.550940 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543577 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Aug 05 17:23:32.550940 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543580 2579 flags.go:64] FLAG: --lock-file="" Aug 05 17:23:32.550940 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543583 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Aug 05 17:23:32.550940 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543586 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Aug 05 17:23:32.550940 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543588 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Aug 05 17:23:32.550940 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543594 2579 flags.go:64] FLAG: --log-json-split-stream="false" Aug 05 17:23:32.550940 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543597 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Aug 05 17:23:32.550940 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543600 2579 flags.go:64] FLAG: --log-text-split-stream="false" Aug 05 17:23:32.550940 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543603 2579 flags.go:64] FLAG: --logging-format="text" Aug 05 17:23:32.550940 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543606 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Aug 05 17:23:32.550940 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543610 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Aug 05 17:23:32.550940 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543613 2579 flags.go:64] FLAG: --manifest-url="" Aug 05 17:23:32.550940 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543616 2579 flags.go:64] FLAG: --manifest-url-header="" Aug 05 17:23:32.550940 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543620 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Aug 05 17:23:32.550940 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543623 2579 flags.go:64] FLAG: --max-open-files="1000000" Aug 05 17:23:32.550940 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543627 2579 flags.go:64] FLAG: --max-pods="110" Aug 05 17:23:32.550940 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543630 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Aug 05 17:23:32.550940 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543633 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Aug 05 17:23:32.550940 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543636 2579 flags.go:64] FLAG: --memory-manager-policy="None" Aug 05 17:23:32.550940 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543639 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Aug 05 17:23:32.551586 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543643 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Aug 05 17:23:32.551586 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543648 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Aug 05 17:23:32.551586 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543651 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Aug 05 17:23:32.551586 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543659 2579 flags.go:64] FLAG: --node-status-max-images="50" Aug 05 17:23:32.551586 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543662 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Aug 05 17:23:32.551586 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543665 2579 flags.go:64] FLAG: --oom-score-adj="-999" Aug 05 17:23:32.551586 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543668 2579 flags.go:64] FLAG: --pod-cidr="" Aug 05 17:23:32.551586 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543672 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8" Aug 05 17:23:32.551586 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543677 2579 flags.go:64] FLAG: --pod-manifest-path="" Aug 05 17:23:32.551586 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543680 2579 flags.go:64] FLAG: --pod-max-pids="-1" Aug 05 17:23:32.551586 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543683 2579 flags.go:64] FLAG: --pods-per-core="0" Aug 05 17:23:32.551586 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543685 2579 flags.go:64] FLAG: --port="10250" Aug 05 17:23:32.551586 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543688 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Aug 05 17:23:32.551586 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543691 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b0e8584520f9fb70" Aug 05 17:23:32.551586 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543695 2579 flags.go:64] FLAG: --qos-reserved="" Aug 05 17:23:32.551586 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543698 2579 flags.go:64] FLAG: --read-only-port="10255" Aug 05 17:23:32.551586 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543700 2579 flags.go:64] FLAG: --register-node="true" Aug 05 17:23:32.551586 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543703 2579 flags.go:64] FLAG: --register-with-taints="" Aug 05 17:23:32.551586 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543707 2579 flags.go:64] FLAG: --registry-burst="10" Aug 05 17:23:32.551586 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543710 2579 flags.go:64] FLAG: --registry-qps="5" Aug 05 17:23:32.551586 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543713 2579 flags.go:64] FLAG: --reserved-cpus="" Aug 05 17:23:32.551586 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543716 2579 flags.go:64] FLAG: --reserved-memory="" Aug 05 17:23:32.551586 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543724 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Aug 05 17:23:32.551586 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543727 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Aug 05 17:23:32.551586 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543730 2579 flags.go:64] FLAG: --rotate-certificates="false" Aug 05 17:23:32.552280 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543733 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Aug 05 17:23:32.552280 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543736 2579 flags.go:64] FLAG: --runonce="false" Aug 05 17:23:32.552280 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543739 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Aug 05 17:23:32.552280 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543742 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Aug 05 17:23:32.552280 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543745 2579 flags.go:64] FLAG: --seccomp-default="false" Aug 05 17:23:32.552280 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543748 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Aug 05 17:23:32.552280 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543751 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Aug 05 17:23:32.552280 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543753 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Aug 05 17:23:32.552280 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543759 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Aug 05 17:23:32.552280 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543762 2579 flags.go:64] FLAG: --storage-driver-password="root" Aug 05 17:23:32.552280 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543765 2579 flags.go:64] FLAG: --storage-driver-secure="false" Aug 05 17:23:32.552280 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543768 2579 flags.go:64] FLAG: --storage-driver-table="stats" Aug 05 17:23:32.552280 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543771 2579 flags.go:64] FLAG: --storage-driver-user="root" Aug 05 17:23:32.552280 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543773 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Aug 05 17:23:32.552280 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543777 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Aug 05 17:23:32.552280 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543780 2579 flags.go:64] FLAG: --system-cgroups="" Aug 05 17:23:32.552280 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543782 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Aug 05 17:23:32.552280 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543788 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Aug 05 17:23:32.552280 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543790 2579 flags.go:64] FLAG: --tls-cert-file="" Aug 05 17:23:32.552280 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543793 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Aug 05 17:23:32.552280 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543798 2579 flags.go:64] FLAG: --tls-min-version="" Aug 05 17:23:32.552280 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543801 2579 flags.go:64] FLAG: --tls-private-key-file="" Aug 05 17:23:32.552280 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543803 2579 flags.go:64] FLAG: --topology-manager-policy="none" Aug 05 17:23:32.552280 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543806 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Aug 05 17:23:32.552280 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543809 2579 flags.go:64] FLAG: --topology-manager-scope="container" Aug 05 17:23:32.552910 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543812 2579 flags.go:64] FLAG: --v="2" Aug 05 17:23:32.552910 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543816 2579 flags.go:64] FLAG: --version="false" Aug 05 17:23:32.552910 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543820 2579 flags.go:64] FLAG: --vmodule="" Aug 05 17:23:32.552910 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543824 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Aug 05 17:23:32.552910 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.543827 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Aug 05 17:23:32.552910 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543949 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 17:23:32.552910 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543953 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 17:23:32.552910 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543956 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 17:23:32.552910 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543959 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 17:23:32.552910 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543962 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 17:23:32.552910 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543964 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 17:23:32.552910 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543967 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 17:23:32.552910 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543970 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 17:23:32.552910 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543972 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 17:23:32.552910 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543974 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 17:23:32.552910 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543979 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 17:23:32.552910 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543982 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 17:23:32.552910 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543984 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 17:23:32.552910 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543987 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 17:23:32.552910 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543989 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 17:23:32.552910 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543992 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 17:23:32.553440 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543995 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 17:23:32.553440 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.543998 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 17:23:32.553440 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544000 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 17:23:32.553440 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544003 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 17:23:32.553440 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544006 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 17:23:32.553440 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544008 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 17:23:32.553440 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544011 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 17:23:32.553440 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544013 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 17:23:32.553440 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544016 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 17:23:32.553440 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544018 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 17:23:32.553440 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544021 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 17:23:32.553440 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544023 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 17:23:32.553440 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544026 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 17:23:32.553440 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544028 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 17:23:32.553440 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544032 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 17:23:32.553440 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544036 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 17:23:32.553440 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544039 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 17:23:32.553440 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544042 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 17:23:32.553440 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544045 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 17:23:32.553928 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544048 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 17:23:32.553928 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544050 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 17:23:32.553928 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544053 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 17:23:32.553928 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544055 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 17:23:32.553928 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544058 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 17:23:32.553928 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544061 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 17:23:32.553928 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544065 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 17:23:32.553928 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544071 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 17:23:32.553928 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544074 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 17:23:32.553928 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544077 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 17:23:32.553928 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544079 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 17:23:32.553928 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544082 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 17:23:32.553928 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544084 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 17:23:32.553928 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544087 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 17:23:32.553928 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544090 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 17:23:32.553928 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544092 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 17:23:32.553928 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544095 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 17:23:32.553928 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544098 2579 feature_gate.go:328] unrecognized feature gate: Example Aug 05 17:23:32.553928 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544100 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 17:23:32.553928 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544103 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 17:23:32.554477 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544105 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 17:23:32.554477 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544108 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 17:23:32.554477 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544110 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 17:23:32.554477 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544113 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 17:23:32.554477 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544116 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 17:23:32.554477 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544118 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 17:23:32.554477 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544120 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 17:23:32.554477 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544123 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 17:23:32.554477 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544126 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 17:23:32.554477 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544128 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 17:23:32.554477 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544131 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 17:23:32.554477 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544134 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 17:23:32.554477 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544136 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 17:23:32.554477 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544152 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 17:23:32.554477 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544154 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 17:23:32.554477 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544157 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 17:23:32.554477 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544160 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 17:23:32.554477 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544163 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 17:23:32.554477 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544166 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 17:23:32.554477 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544170 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 17:23:32.554970 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544173 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 17:23:32.554970 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544175 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 17:23:32.554970 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544178 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 17:23:32.554970 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544181 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 17:23:32.554970 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544184 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 17:23:32.554970 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544186 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 17:23:32.554970 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544189 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 17:23:32.554970 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544191 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 17:23:32.554970 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544194 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 17:23:32.554970 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544197 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 17:23:32.554970 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544201 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 17:23:32.554970 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544204 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 17:23:32.554970 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544207 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 17:23:32.554970 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544210 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 17:23:32.554970 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544213 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 17:23:32.554970 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544223 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 17:23:32.554970 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544226 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 17:23:32.554970 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544229 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 17:23:32.554970 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544232 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 17:23:32.555442 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544235 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 17:23:32.555442 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544237 2579 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 17:23:32.555442 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544240 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 17:23:32.555442 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544243 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 17:23:32.555442 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.544245 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 17:23:32.555442 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.544965 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 05 17:23:32.555442 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.551821 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Aug 05 17:23:32.555442 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.551837 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Aug 05 17:23:32.555442 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.552627 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Aug 05 17:23:32.555442 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.552638 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Aug 05 17:23:32.555442 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552719 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 17:23:32.555442 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552725 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 17:23:32.555442 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552729 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 17:23:32.555442 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552732 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 17:23:32.555442 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552735 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 17:23:32.555833 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552738 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 17:23:32.555833 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552741 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 17:23:32.555833 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552744 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 17:23:32.555833 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552747 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 17:23:32.555833 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552751 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 17:23:32.555833 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552755 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 17:23:32.555833 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552758 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 17:23:32.555833 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552761 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 17:23:32.555833 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552764 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 17:23:32.555833 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552773 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 17:23:32.555833 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552776 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 17:23:32.555833 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552779 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 17:23:32.555833 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552782 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 17:23:32.555833 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552785 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 17:23:32.555833 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552788 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 17:23:32.555833 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552791 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 17:23:32.555833 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552793 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 17:23:32.555833 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552796 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 17:23:32.555833 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552799 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 17:23:32.556343 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552801 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 17:23:32.556343 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552804 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 17:23:32.556343 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552807 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 17:23:32.556343 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552809 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 17:23:32.556343 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552812 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 17:23:32.556343 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552816 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 17:23:32.556343 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552819 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 17:23:32.556343 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552821 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 17:23:32.556343 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552825 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 17:23:32.556343 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552829 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 17:23:32.556343 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552833 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 17:23:32.556343 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552837 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 17:23:32.556343 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552840 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 17:23:32.556343 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552843 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 17:23:32.556343 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552845 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 17:23:32.556343 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552848 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 17:23:32.556343 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552851 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 17:23:32.556343 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552854 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 17:23:32.556343 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552857 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 17:23:32.556840 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552860 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 17:23:32.556840 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552862 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 17:23:32.556840 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552865 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 17:23:32.556840 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552867 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 17:23:32.556840 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552877 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 17:23:32.556840 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552880 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 17:23:32.556840 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552883 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 17:23:32.556840 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552885 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 17:23:32.556840 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552889 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 17:23:32.556840 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552891 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 17:23:32.556840 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552893 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 17:23:32.556840 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552896 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 17:23:32.556840 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552898 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 17:23:32.556840 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552901 2579 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 17:23:32.556840 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552904 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 17:23:32.556840 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552906 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 17:23:32.556840 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552909 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 17:23:32.556840 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552911 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 17:23:32.556840 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552915 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 17:23:32.557323 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552933 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 17:23:32.557323 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552937 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 17:23:32.557323 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552940 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 17:23:32.557323 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552943 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 17:23:32.557323 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552945 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 17:23:32.557323 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552948 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 17:23:32.557323 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552951 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 17:23:32.557323 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552954 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 17:23:32.557323 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552956 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 17:23:32.557323 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552959 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 17:23:32.557323 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552961 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 17:23:32.557323 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552964 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 17:23:32.557323 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552967 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 17:23:32.557323 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552969 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 17:23:32.557323 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552972 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 17:23:32.557323 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552974 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 17:23:32.557323 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552977 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 17:23:32.557323 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552979 2579 feature_gate.go:328] unrecognized feature gate: Example Aug 05 17:23:32.557323 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552988 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 17:23:32.557323 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552990 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 17:23:32.557845 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552993 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 17:23:32.557845 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552996 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 17:23:32.557845 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.552998 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 17:23:32.557845 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553001 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 17:23:32.557845 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553003 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 17:23:32.557845 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553006 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 17:23:32.557845 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553009 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 17:23:32.557845 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553011 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 17:23:32.557845 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553014 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 17:23:32.557845 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553016 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 17:23:32.557845 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553019 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 17:23:32.557845 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553023 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 17:23:32.557845 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553025 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 17:23:32.557845 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553028 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 17:23:32.557845 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553031 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 17:23:32.557845 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553033 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 17:23:32.557845 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553036 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 17:23:32.558370 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.553041 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 05 17:23:32.558370 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553204 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 17:23:32.558370 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553209 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 17:23:32.558370 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553212 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 17:23:32.558370 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553215 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 17:23:32.558370 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553218 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 17:23:32.558370 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553220 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 17:23:32.558370 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553223 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 17:23:32.558370 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553225 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 17:23:32.558370 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553228 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 17:23:32.558370 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553230 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 17:23:32.558370 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553233 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 17:23:32.558370 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553235 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 17:23:32.558370 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553238 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 17:23:32.558370 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553246 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 17:23:32.558737 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553248 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 17:23:32.558737 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553251 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 17:23:32.558737 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553253 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 17:23:32.558737 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553256 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 17:23:32.558737 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553259 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 17:23:32.558737 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553262 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 17:23:32.558737 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553264 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 17:23:32.558737 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553267 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 17:23:32.558737 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553269 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 17:23:32.558737 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553272 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 17:23:32.558737 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553274 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 17:23:32.558737 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553277 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 17:23:32.558737 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553279 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 17:23:32.558737 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553282 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 17:23:32.558737 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553284 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 17:23:32.558737 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553287 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 17:23:32.558737 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553289 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 17:23:32.558737 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553292 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 17:23:32.558737 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553295 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 17:23:32.558737 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553297 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 17:23:32.559324 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553300 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 17:23:32.559324 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553302 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 17:23:32.559324 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553305 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 17:23:32.559324 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553307 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 17:23:32.559324 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553310 2579 feature_gate.go:328] unrecognized feature gate: Example Aug 05 17:23:32.559324 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553312 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 17:23:32.559324 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553315 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 17:23:32.559324 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553317 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 17:23:32.559324 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553320 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 17:23:32.559324 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553322 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 17:23:32.559324 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553325 2579 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 17:23:32.559324 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553328 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 17:23:32.559324 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553336 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 17:23:32.559324 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553339 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 17:23:32.559324 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553341 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 17:23:32.559324 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553344 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 17:23:32.559324 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553346 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 17:23:32.559324 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553349 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 17:23:32.559324 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553351 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 17:23:32.559324 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553354 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 17:23:32.560277 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553357 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 17:23:32.560277 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553359 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 17:23:32.560277 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553362 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 17:23:32.560277 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553364 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 17:23:32.560277 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553367 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 17:23:32.560277 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553369 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 17:23:32.560277 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553371 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 17:23:32.560277 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553374 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 17:23:32.560277 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553376 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 17:23:32.560277 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553379 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 17:23:32.560277 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553381 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 17:23:32.560277 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553384 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 17:23:32.560277 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553386 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 17:23:32.560277 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553389 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 17:23:32.560277 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553391 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 17:23:32.560277 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553394 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 17:23:32.560277 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553396 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 17:23:32.560277 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553399 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 17:23:32.560277 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553401 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 17:23:32.560803 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553404 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 17:23:32.560803 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553406 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 17:23:32.560803 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553408 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 17:23:32.560803 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553412 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 17:23:32.560803 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553416 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 17:23:32.560803 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553419 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 17:23:32.560803 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553427 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 17:23:32.560803 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553430 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 17:23:32.560803 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553433 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 17:23:32.560803 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553438 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 17:23:32.560803 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553441 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 17:23:32.560803 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553445 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 17:23:32.560803 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553449 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 17:23:32.560803 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553452 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 17:23:32.560803 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553455 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 17:23:32.560803 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553458 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 17:23:32.560803 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553460 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 17:23:32.560803 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553463 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 17:23:32.560803 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553465 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 17:23:32.561420 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553468 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 17:23:32.561420 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553470 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 17:23:32.561420 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553473 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 17:23:32.561420 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553475 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 17:23:32.561420 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553478 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 17:23:32.561420 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553480 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 17:23:32.561420 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:32.553483 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 17:23:32.561420 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.553488 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 05 17:23:32.561420 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.553617 2579 server.go:962] "Client rotation is on, will bootstrap in background" Aug 05 17:23:32.561420 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.556108 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Aug 05 17:23:32.561420 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.557348 2579 server.go:1019] "Starting client certificate rotation" Aug 05 17:23:32.561420 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.557446 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Aug 05 17:23:32.561420 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.557481 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Aug 05 17:23:32.561999 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.559995 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Aug 05 17:23:32.564704 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.564684 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Aug 05 17:23:32.577635 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.577615 2579 log.go:25] "Validated CRI v1 runtime API" Aug 05 17:23:32.579948 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.579930 2579 log.go:25] "Validated CRI v1 image API" Aug 05 17:23:32.580928 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.580910 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Aug 05 17:23:32.584748 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.584721 2579 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a57498bc-9516-4a5f-b930-1673c1c1c4bc:/dev/nvme0n1p4 d0ca6027-c611-4ef1-bb82-be3ba50224b1:/dev/nvme0n1p3] Aug 05 17:23:32.584808 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.584748 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Aug 05 17:23:32.591150 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.591028 2579 manager.go:216] Machine: {Timestamp:2026-08-05 17:23:32.589428736 +0000 UTC m=+0.356808963 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3063165 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec200ff800ce60ad9f8589fc8a33b759 SystemUUID:ec200ff8-00ce-60ad-9f85-89fc8a33b759 BootID:28a28629-8283-4626-870b-1f28e5886c10 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9d:dd:d1:15:09 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9d:dd:d1:15:09 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:e5:35:35:a2:a5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Aug 05 17:23:32.591150 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.591145 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Aug 05 17:23:32.591304 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.591290 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Aug 05 17:23:32.593056 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.593038 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Aug 05 17:23:32.593935 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.593902 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Aug 05 17:23:32.594095 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.593939 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-250.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Aug 05 17:23:32.595182 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.595168 2579 topology_manager.go:138] "Creating topology manager with none policy" Aug 05 17:23:32.595237 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.595187 2579 container_manager_linux.go:309] "Creating device plugin manager" Aug 05 17:23:32.595237 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.595198 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Aug 05 17:23:32.595915 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.595903 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Aug 05 17:23:32.596730 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.596720 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Aug 05 17:23:32.600587 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.600574 2579 state_mem.go:36] "Initialized new in-memory state store" Aug 05 17:23:32.600720 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.600710 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Aug 05 17:23:32.600785 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.600775 2579 kubelet.go:486] "Attempting to sync node with API server" Aug 05 17:23:32.600830 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.600792 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Aug 05 17:23:32.600830 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.600806 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Aug 05 17:23:32.600830 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.600816 2579 kubelet.go:398] "Adding apiserver pod source" Aug 05 17:23:32.600830 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.600826 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Aug 05 17:23:32.601296 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.601284 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Aug 05 17:23:32.601359 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.601311 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Aug 05 17:23:32.604032 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.604002 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Aug 05 17:23:32.605731 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.605713 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Aug 05 17:23:32.605817 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.605756 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Aug 05 17:23:32.607078 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.607062 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Aug 05 17:23:32.607156 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.607086 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Aug 05 17:23:32.607156 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.607096 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Aug 05 17:23:32.607156 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.607106 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Aug 05 17:23:32.607156 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.607122 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Aug 05 17:23:32.607156 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.607131 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Aug 05 17:23:32.607156 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.607146 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Aug 05 17:23:32.607156 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.607156 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Aug 05 17:23:32.607433 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.607168 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Aug 05 17:23:32.607433 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.607178 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Aug 05 17:23:32.607433 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.607191 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Aug 05 17:23:32.607433 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.607201 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Aug 05 17:23:32.608012 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.607998 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Aug 05 17:23:32.608078 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.608017 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Aug 05 17:23:32.612382 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.612363 2579 server.go:1268] "Started kubelet" Aug 05 17:23:32.612580 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.612538 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Aug 05 17:23:32.612646 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.612601 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Aug 05 17:23:32.613316 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.613280 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Aug 05 17:23:32.613415 ip-10-0-136-250 systemd[1]: Started Kubernetes Kubelet. Aug 05 17:23:32.613821 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.613800 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Aug 05 17:23:32.615299 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.615282 2579 server.go:310] "Adding debug handlers to kubelet server" Aug 05 17:23:32.615549 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.615526 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-250.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Aug 05 17:23:32.615647 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:32.615524 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Aug 05 17:23:32.615698 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:32.615679 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-250.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Aug 05 17:23:32.618796 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:32.618776 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Aug 05 17:23:32.619577 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.619556 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Aug 05 17:23:32.619676 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.619575 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Aug 05 17:23:32.619676 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:32.619639 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-250.ec2.internal\" not found" Aug 05 17:23:32.620329 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.620309 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Aug 05 17:23:32.620329 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.620310 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Aug 05 17:23:32.620469 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.620340 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Aug 05 17:23:32.620520 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.620471 2579 reconstruct.go:97] "Volume reconstruction finished" Aug 05 17:23:32.620520 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.620480 2579 reconciler.go:29] "Reconciler: start to sync state" Aug 05 17:23:32.620520 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.620491 2579 factory.go:55] Registering systemd factory Aug 05 17:23:32.620520 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.620513 2579 factory.go:223] Registration of the systemd container factory successfully Aug 05 17:23:32.620863 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.620845 2579 factory.go:153] Registering CRI-O factory Aug 05 17:23:32.620939 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.620866 2579 factory.go:223] Registration of the crio container factory successfully Aug 05 17:23:32.620939 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.620919 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Aug 05 17:23:32.621063 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.620944 2579 factory.go:103] Registering Raw factory Aug 05 17:23:32.621063 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.620961 2579 manager.go:1196] Started watching for new ooms in manager Aug 05 17:23:32.621375 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.621361 2579 manager.go:349] Starting recovery of all containers Aug 05 17:23:32.622788 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:32.622754 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Aug 05 17:23:32.622904 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:32.622846 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-250.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Aug 05 17:23:32.624024 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:32.622904 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-250.ec2.internal.18c8f89eab2632a7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-250.ec2.internal,UID:ip-10-0-136-250.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-250.ec2.internal,},FirstTimestamp:2026-08-05 17:23:32.612330151 +0000 UTC m=+0.379710378,LastTimestamp:2026-08-05 17:23:32.612330151 +0000 UTC m=+0.379710378,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-250.ec2.internal,}" Aug 05 17:23:32.634657 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.634637 2579 manager.go:354] Recovery completed Aug 05 17:23:32.636070 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:32.636049 2579 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Aug 05 17:23:32.639354 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.639341 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 17:23:32.642959 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.642938 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasSufficientMemory" Aug 05 17:23:32.643042 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.642979 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 17:23:32.643042 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.642993 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasSufficientPID" Aug 05 17:23:32.643561 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.643549 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Aug 05 17:23:32.643602 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.643561 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Aug 05 17:23:32.643602 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.643566 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 17:23:32.643602 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.643578 2579 state_mem.go:36] "Initialized new in-memory state store" Aug 05 17:23:32.644850 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.644818 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasSufficientMemory" Aug 05 17:23:32.644850 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.644848 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 17:23:32.644987 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.644860 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasSufficientPID" Aug 05 17:23:32.644987 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.644938 2579 policy_none.go:49] "None policy: Start" Aug 05 17:23:32.644987 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.644955 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Aug 05 17:23:32.644987 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.644970 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Aug 05 17:23:32.645110 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:32.645013 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-250.ec2.internal.18c8f89eacf992cb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-250.ec2.internal,UID:ip-10-0-136-250.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-250.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-250.ec2.internal,},FirstTimestamp:2026-08-05 17:23:32.642960075 +0000 UTC m=+0.410340312,LastTimestamp:2026-08-05 17:23:32.642960075 +0000 UTC m=+0.410340312,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-250.ec2.internal,}" Aug 05 17:23:32.645958 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.645941 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cz7qt" Aug 05 17:23:32.646254 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.646241 2579 policy_none.go:47] "Start" Aug 05 17:23:32.652777 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.652761 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cz7qt" Aug 05 17:23:32.654566 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:32.654482 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-250.ec2.internal.18c8f89eacf9f7d0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-250.ec2.internal,UID:ip-10-0-136-250.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-250.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-250.ec2.internal,},FirstTimestamp:2026-08-05 17:23:32.642985936 +0000 UTC m=+0.410366164,LastTimestamp:2026-08-05 17:23:32.642985936 +0000 UTC m=+0.410366164,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-250.ec2.internal,}" Aug 05 17:23:32.658411 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:32.658339 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-250.ec2.internal.18c8f89eacfa27b5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-250.ec2.internal,UID:ip-10-0-136-250.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-250.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-250.ec2.internal,},FirstTimestamp:2026-08-05 17:23:32.642998197 +0000 UTC m=+0.410378424,LastTimestamp:2026-08-05 17:23:32.642998197 +0000 UTC m=+0.410378424,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-250.ec2.internal,}" Aug 05 17:23:32.682037 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.681831 2579 manager.go:337] "Starting Device Plugin manager" Aug 05 17:23:32.682131 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:32.682062 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Aug 05 17:23:32.682131 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.682074 2579 server.go:87] "Starting device plugin registration server" Aug 05 17:23:32.682410 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.682396 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Aug 05 17:23:32.682454 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.682414 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Aug 05 17:23:32.682541 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.682522 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Aug 05 17:23:32.682640 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.682623 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Aug 05 17:23:32.682640 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.682639 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Aug 05 17:23:32.683242 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:32.683219 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Aug 05 17:23:32.683314 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:32.683286 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-250.ec2.internal\" not found" Aug 05 17:23:32.762041 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.761991 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Aug 05 17:23:32.763376 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.763355 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Aug 05 17:23:32.763442 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.763407 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Aug 05 17:23:32.763442 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.763440 2579 kubelet.go:2448] "Starting kubelet main sync loop" Aug 05 17:23:32.763517 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:32.763490 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Aug 05 17:23:32.765843 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.765815 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 17:23:32.783616 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.783544 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 17:23:32.786357 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.786336 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasSufficientMemory" Aug 05 17:23:32.786426 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.786374 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 17:23:32.786426 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.786412 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasSufficientPID" Aug 05 17:23:32.786505 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.786440 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-250.ec2.internal" Aug 05 17:23:32.795815 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.795790 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-250.ec2.internal" Aug 05 17:23:32.795906 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:32.795819 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-250.ec2.internal\": node \"ip-10-0-136-250.ec2.internal\" not found" Aug 05 17:23:32.819155 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:32.819126 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-250.ec2.internal\" not found" Aug 05 17:23:32.865075 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.865010 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-250.ec2.internal"] Aug 05 17:23:32.865201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.865137 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 17:23:32.867056 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.867039 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasSufficientMemory" Aug 05 17:23:32.867135 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.867072 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 17:23:32.867135 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.867087 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasSufficientPID" Aug 05 17:23:32.868542 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.868528 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 17:23:32.868661 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.868645 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal" Aug 05 17:23:32.868720 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.868687 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 17:23:32.870773 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.870756 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasSufficientMemory" Aug 05 17:23:32.870858 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.870769 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasSufficientMemory" Aug 05 17:23:32.870858 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.870784 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 17:23:32.870858 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.870800 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasSufficientPID" Aug 05 17:23:32.870858 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.870801 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 17:23:32.870858 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.870850 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasSufficientPID" Aug 05 17:23:32.872854 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.872838 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-250.ec2.internal" Aug 05 17:23:32.872919 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.872871 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 17:23:32.873622 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.873604 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasSufficientMemory" Aug 05 17:23:32.873711 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.873636 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 17:23:32.873711 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.873654 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasSufficientPID" Aug 05 17:23:32.896944 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:32.896917 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-250.ec2.internal\" not found" node="ip-10-0-136-250.ec2.internal" Aug 05 17:23:32.901544 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:32.901526 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-250.ec2.internal\" not found" node="ip-10-0-136-250.ec2.internal" Aug 05 17:23:32.920216 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:32.920182 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-250.ec2.internal\" not found" Aug 05 17:23:32.922621 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.922601 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/079fe7f838db085085f922bdd7352b0d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal\" (UID: \"079fe7f838db085085f922bdd7352b0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal" Aug 05 17:23:32.922726 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.922638 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/079fe7f838db085085f922bdd7352b0d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal\" (UID: \"079fe7f838db085085f922bdd7352b0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal" Aug 05 17:23:32.922726 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:32.922665 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7f5bf7ebb4fbbb3822a332d0b41a4ef4-config\") pod \"kube-apiserver-proxy-ip-10-0-136-250.ec2.internal\" (UID: \"7f5bf7ebb4fbbb3822a332d0b41a4ef4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-250.ec2.internal" Aug 05 17:23:33.020877 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:33.020829 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-250.ec2.internal\" not found" Aug 05 17:23:33.023262 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:33.023245 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/079fe7f838db085085f922bdd7352b0d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal\" (UID: \"079fe7f838db085085f922bdd7352b0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal" Aug 05 17:23:33.023362 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:33.023256 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/079fe7f838db085085f922bdd7352b0d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal\" (UID: \"079fe7f838db085085f922bdd7352b0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal" Aug 05 17:23:33.023362 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:33.023283 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/079fe7f838db085085f922bdd7352b0d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal\" (UID: \"079fe7f838db085085f922bdd7352b0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal" Aug 05 17:23:33.023362 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:33.023300 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7f5bf7ebb4fbbb3822a332d0b41a4ef4-config\") pod \"kube-apiserver-proxy-ip-10-0-136-250.ec2.internal\" (UID: \"7f5bf7ebb4fbbb3822a332d0b41a4ef4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-250.ec2.internal" Aug 05 17:23:33.023362 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:33.023332 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7f5bf7ebb4fbbb3822a332d0b41a4ef4-config\") pod \"kube-apiserver-proxy-ip-10-0-136-250.ec2.internal\" (UID: \"7f5bf7ebb4fbbb3822a332d0b41a4ef4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-250.ec2.internal" Aug 05 17:23:33.023362 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:33.023324 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/079fe7f838db085085f922bdd7352b0d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal\" (UID: \"079fe7f838db085085f922bdd7352b0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal" Aug 05 17:23:33.121915 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:33.121830 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-250.ec2.internal\" not found" Aug 05 17:23:33.204512 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:33.204474 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal" Aug 05 17:23:33.205646 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:33.205629 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-250.ec2.internal" Aug 05 17:23:33.221949 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:33.221927 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-250.ec2.internal\" not found" Aug 05 17:23:33.324426 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:33.324387 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-250.ec2.internal\" not found" Aug 05 17:23:33.425123 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:33.425040 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-250.ec2.internal\" not found" Aug 05 17:23:33.525754 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:33.525713 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-250.ec2.internal\" not found" Aug 05 17:23:33.557756 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:33.557712 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Aug 05 17:23:33.558279 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:33.557909 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Aug 05 17:23:33.626391 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:33.626355 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-250.ec2.internal\" not found" Aug 05 17:23:33.657513 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:33.657462 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-04 17:18:33 +0000 UTC" deadline="2028-05-10 07:36:27.592777196 +0000 UTC" Aug 05 17:23:33.657513 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:33.657504 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15446h12m53.935276711s" Aug 05 17:23:33.702201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:33.702118 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 17:23:33.703207 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:33.703189 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasSufficientMemory" Aug 05 17:23:33.703326 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:33.703229 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 17:23:33.703326 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:33.703243 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeHasSufficientPID" Aug 05 17:23:33.727254 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:33.727224 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-250.ec2.internal\" not found" Aug 05 17:23:33.730541 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:33.730521 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 17:23:33.820505 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:33.820467 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal" Aug 05 17:23:33.835131 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:33.834758 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Aug 05 17:23:33.836764 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:33.836745 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-250.ec2.internal" Aug 05 17:23:33.846662 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:33.846634 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Aug 05 17:23:33.938731 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:33.938686 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f5bf7ebb4fbbb3822a332d0b41a4ef4.slice/crio-2511cd7d3d3f048b4fea775a0a6a8d9113caed2c2fdf525fad906f01d42618c4 WatchSource:0}: Error finding container 2511cd7d3d3f048b4fea775a0a6a8d9113caed2c2fdf525fad906f01d42618c4: Status 404 returned error can't find the container with id 2511cd7d3d3f048b4fea775a0a6a8d9113caed2c2fdf525fad906f01d42618c4 Aug 05 17:23:33.939325 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:33.939304 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod079fe7f838db085085f922bdd7352b0d.slice/crio-e6eeaa5ee351591806d649f63950bf42ad21fe359c4133f7e325fe611f3cdcaf WatchSource:0}: Error finding container e6eeaa5ee351591806d649f63950bf42ad21fe359c4133f7e325fe611f3cdcaf: Status 404 returned error can't find the container with id e6eeaa5ee351591806d649f63950bf42ad21fe359c4133f7e325fe611f3cdcaf Aug 05 17:23:33.943730 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:33.943711 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 05 17:23:34.142956 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.142869 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 17:23:34.214662 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.214574 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 17:23:34.602100 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.602016 2579 apiserver.go:52] "Watching apiserver" Aug 05 17:23:34.613307 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.613280 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Aug 05 17:23:34.613766 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.613722 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-hnz8f","openshift-network-diagnostics/network-check-target-4jrks","openshift-ovn-kubernetes/ovnkube-node-w8nvr","kube-system/konnectivity-agent-67llw","kube-system/kube-apiserver-proxy-ip-10-0-136-250.ec2.internal","openshift-image-registry/node-ca-6wt47","openshift-multus/multus-p84kb","openshift-multus/network-metrics-daemon-dmchc","openshift-network-operator/iptables-alerter-hxbq4","kube-system/global-pull-secret-syncer-dbt75","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvhgt","openshift-cluster-node-tuning-operator/tuned-b8hsg","openshift-dns/node-resolver-2dhgr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal"] Aug 05 17:23:34.615594 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.615569 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.616888 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.616865 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvhgt" Aug 05 17:23:34.618365 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.618339 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.619310 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.619244 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Aug 05 17:23:34.619420 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.619324 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5cq2q\"" Aug 05 17:23:34.619478 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.619281 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Aug 05 17:23:34.619478 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.619258 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Aug 05 17:23:34.619688 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.619668 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-67llw" Aug 05 17:23:34.619688 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.619684 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Aug 05 17:23:34.620454 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.620435 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Aug 05 17:23:34.620557 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.620457 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Aug 05 17:23:34.620557 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.620439 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Aug 05 17:23:34.620761 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.620665 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Aug 05 17:23:34.620761 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.620705 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-g5lnz\"" Aug 05 17:23:34.621201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.621179 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmchc" Aug 05 17:23:34.621303 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:34.621253 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmchc" podUID="e79bda8c-75ee-4022-a816-f55a58cec6c0" Aug 05 17:23:34.622546 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.622525 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Aug 05 17:23:34.622786 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.622768 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Aug 05 17:23:34.623151 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.623118 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2wrmg\"" Aug 05 17:23:34.623543 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.623520 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Aug 05 17:23:34.623906 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.623889 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Aug 05 17:23:34.623995 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.623945 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Aug 05 17:23:34.624105 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.624086 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Aug 05 17:23:34.624245 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.624208 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Aug 05 17:23:34.624305 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.624290 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-r72pk\"" Aug 05 17:23:34.624428 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.624410 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Aug 05 17:23:34.624572 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.624543 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6wt47" Aug 05 17:23:34.626105 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.626085 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hxbq4" Aug 05 17:23:34.627372 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.627352 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2dhgr" Aug 05 17:23:34.628020 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.627998 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Aug 05 17:23:34.628020 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.628012 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Aug 05 17:23:34.628199 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.628004 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wjfwc\"" Aug 05 17:23:34.628423 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.628404 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Aug 05 17:23:34.629488 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.629121 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jrks" Aug 05 17:23:34.629488 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:34.629206 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jrks" podUID="fefd4a72-b897-4f18-a3f2-eacedc50bfce" Aug 05 17:23:34.629488 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.629337 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Aug 05 17:23:34.629488 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.629372 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9mqf7\"" Aug 05 17:23:34.629488 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.629373 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Aug 05 17:23:34.629488 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.629373 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Aug 05 17:23:34.631296 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.630663 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8fx74\"" Aug 05 17:23:34.631296 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.630722 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Aug 05 17:23:34.631296 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.630898 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Aug 05 17:23:34.631296 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.631023 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:23:34.631296 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:34.631082 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dbt75" podUID="196cbfc1-efdb-48ef-a5ec-f99c27f2e289" Aug 05 17:23:34.632204 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.632181 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hnz8f" Aug 05 17:23:34.632633 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.632450 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-cnibin\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.632633 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.632491 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-host-var-lib-cni-bin\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.632633 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.632519 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-host-var-lib-cni-multus\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.632633 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.632545 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-host-run-multus-certs\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.632633 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.632570 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/61f78cea-8609-4a39-b274-5b47714d6d79-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lvhgt\" (UID: \"61f78cea-8609-4a39-b274-5b47714d6d79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvhgt" Aug 05 17:23:34.632633 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.632594 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-host-kubelet\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.632941 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.632638 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-systemd-units\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.632941 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.632689 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-etc-openvswitch\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.632941 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.632743 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-multus-cni-dir\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.632941 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.632800 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e6224d3-5fb6-4c8f-962b-c5864610b153-cni-binary-copy\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.632941 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.632842 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/61f78cea-8609-4a39-b274-5b47714d6d79-registration-dir\") pod \"aws-ebs-csi-driver-node-lvhgt\" (UID: \"61f78cea-8609-4a39-b274-5b47714d6d79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvhgt" Aug 05 17:23:34.632941 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.632878 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/61f78cea-8609-4a39-b274-5b47714d6d79-device-dir\") pod \"aws-ebs-csi-driver-node-lvhgt\" (UID: \"61f78cea-8609-4a39-b274-5b47714d6d79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvhgt" Aug 05 17:23:34.632941 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.632906 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/61f78cea-8609-4a39-b274-5b47714d6d79-etc-selinux\") pod \"aws-ebs-csi-driver-node-lvhgt\" (UID: \"61f78cea-8609-4a39-b274-5b47714d6d79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvhgt" Aug 05 17:23:34.632941 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.632931 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/61f78cea-8609-4a39-b274-5b47714d6d79-sys-fs\") pod \"aws-ebs-csi-driver-node-lvhgt\" (UID: \"61f78cea-8609-4a39-b274-5b47714d6d79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvhgt" Aug 05 17:23:34.633378 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.632956 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-host-run-netns\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.633378 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.632981 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-system-cni-dir\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.633378 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.633011 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-host-slash\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.633378 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.633035 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-node-log\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.633378 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.633057 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f5b9f8c-f284-4181-b324-8807188e1f06-ovn-node-metrics-cert\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.633378 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.633082 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5f5b9f8c-f284-4181-b324-8807188e1f06-ovnkube-script-lib\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.633378 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.633102 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqm98\" (UniqueName: \"kubernetes.io/projected/5f5b9f8c-f284-4181-b324-8807188e1f06-kube-api-access-vqm98\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.633378 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.633124 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e79bda8c-75ee-4022-a816-f55a58cec6c0-metrics-certs\") pod \"network-metrics-daemon-dmchc\" (UID: \"e79bda8c-75ee-4022-a816-f55a58cec6c0\") " pod="openshift-multus/network-metrics-daemon-dmchc" Aug 05 17:23:34.633378 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.633143 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-host-run-k8s-cni-cncf-io\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.633378 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.633194 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-host-var-lib-kubelet\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.633378 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.633220 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-hostroot\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.633378 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.633243 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-etc-kubernetes\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.633378 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.633266 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6qpr\" (UniqueName: \"kubernetes.io/projected/61f78cea-8609-4a39-b274-5b47714d6d79-kube-api-access-r6qpr\") pod \"aws-ebs-csi-driver-node-lvhgt\" (UID: \"61f78cea-8609-4a39-b274-5b47714d6d79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvhgt" Aug 05 17:23:34.633378 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.633284 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-run-ovn\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.633378 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.633314 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-run-openvswitch\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.633378 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.633360 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-host-run-ovn-kubernetes\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.634401 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.633388 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.634401 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.633416 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5f5b9f8c-f284-4181-b324-8807188e1f06-ovnkube-config\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.634401 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.633449 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2sbd\" (UniqueName: \"kubernetes.io/projected/e79bda8c-75ee-4022-a816-f55a58cec6c0-kube-api-access-c2sbd\") pod \"network-metrics-daemon-dmchc\" (UID: \"e79bda8c-75ee-4022-a816-f55a58cec6c0\") " pod="openshift-multus/network-metrics-daemon-dmchc" Aug 05 17:23:34.634401 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.633464 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-log-socket\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.634401 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.633483 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/26e6b157-bbde-4981-b1a8-e3665e69e83c-agent-certs\") pod \"konnectivity-agent-67llw\" (UID: \"26e6b157-bbde-4981-b1a8-e3665e69e83c\") " pod="kube-system/konnectivity-agent-67llw" Aug 05 17:23:34.634401 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.633512 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-multus-socket-dir-parent\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.634401 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.633527 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-multus-conf-dir\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.634401 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.633541 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e6224d3-5fb6-4c8f-962b-c5864610b153-multus-daemon-config\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.634401 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.633559 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/61f78cea-8609-4a39-b274-5b47714d6d79-socket-dir\") pod \"aws-ebs-csi-driver-node-lvhgt\" (UID: \"61f78cea-8609-4a39-b274-5b47714d6d79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvhgt" Aug 05 17:23:34.634401 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.633599 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5f5b9f8c-f284-4181-b324-8807188e1f06-env-overrides\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.634401 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.633617 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/26e6b157-bbde-4981-b1a8-e3665e69e83c-konnectivity-ca\") pod \"konnectivity-agent-67llw\" (UID: \"26e6b157-bbde-4981-b1a8-e3665e69e83c\") " pod="kube-system/konnectivity-agent-67llw" Aug 05 17:23:34.634401 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.633636 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-os-release\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.634401 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.633656 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-host-run-netns\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.634401 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.633678 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tb6k5\" (UniqueName: \"kubernetes.io/projected/2e6224d3-5fb6-4c8f-962b-c5864610b153-kube-api-access-tb6k5\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.634401 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.633702 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-run-systemd\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.634401 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.633748 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-var-lib-openvswitch\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.635328 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.633786 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-host-cni-bin\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.635328 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.633813 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-host-cni-netd\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.639030 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.639012 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-p4snk\"" Aug 05 17:23:34.639285 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.639263 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Aug 05 17:23:34.639403 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.639381 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Aug 05 17:23:34.639489 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.639422 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Aug 05 17:23:34.639489 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.639437 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.643115 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.643091 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Aug 05 17:23:34.643236 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.643208 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Aug 05 17:23:34.643443 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.643427 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wh6r4\"" Aug 05 17:23:34.656347 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.656319 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jxqdf" Aug 05 17:23:34.667622 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.667598 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jxqdf" Aug 05 17:23:34.722457 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.722429 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Aug 05 17:23:34.734034 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734000 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dfa0d5d1-b355-44cc-abf9-124e11c44d6b-hosts-file\") pod \"node-resolver-2dhgr\" (UID: \"dfa0d5d1-b355-44cc-abf9-124e11c44d6b\") " pod="openshift-dns/node-resolver-2dhgr" Aug 05 17:23:34.734216 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734039 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nqtg\" (UniqueName: \"kubernetes.io/projected/453d1073-3d90-4861-81d5-2c88980b98ed-kube-api-access-9nqtg\") pod \"node-ca-6wt47\" (UID: \"453d1073-3d90-4861-81d5-2c88980b98ed\") " pod="openshift-image-registry/node-ca-6wt47" Aug 05 17:23:34.734216 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734065 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14ecac34-eb47-4daa-85f4-d64dcb1a116b-cnibin\") pod \"multus-additional-cni-plugins-hnz8f\" (UID: \"14ecac34-eb47-4daa-85f4-d64dcb1a116b\") " pod="openshift-multus/multus-additional-cni-plugins-hnz8f" Aug 05 17:23:34.734216 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734088 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/14ecac34-eb47-4daa-85f4-d64dcb1a116b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hnz8f\" (UID: \"14ecac34-eb47-4daa-85f4-d64dcb1a116b\") " pod="openshift-multus/multus-additional-cni-plugins-hnz8f" Aug 05 17:23:34.734216 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734117 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-host-var-lib-cni-multus\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.734216 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734141 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-host-run-multus-certs\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.734216 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734179 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/61f78cea-8609-4a39-b274-5b47714d6d79-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lvhgt\" (UID: \"61f78cea-8609-4a39-b274-5b47714d6d79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvhgt" Aug 05 17:23:34.734216 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734202 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-host-kubelet\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.734656 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734225 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-etc-openvswitch\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.734656 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734249 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfa0d5d1-b355-44cc-abf9-124e11c44d6b-tmp-dir\") pod \"node-resolver-2dhgr\" (UID: \"dfa0d5d1-b355-44cc-abf9-124e11c44d6b\") " pod="openshift-dns/node-resolver-2dhgr" Aug 05 17:23:34.734656 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734273 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b311580b-d846-4d7f-ac07-7c28d32f2a8e-etc-sysctl-conf\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.734656 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734298 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b311580b-d846-4d7f-ac07-7c28d32f2a8e-run\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.734656 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734330 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-multus-cni-dir\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.734656 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734358 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/61f78cea-8609-4a39-b274-5b47714d6d79-registration-dir\") pod \"aws-ebs-csi-driver-node-lvhgt\" (UID: \"61f78cea-8609-4a39-b274-5b47714d6d79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvhgt" Aug 05 17:23:34.734656 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734383 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/61f78cea-8609-4a39-b274-5b47714d6d79-device-dir\") pod \"aws-ebs-csi-driver-node-lvhgt\" (UID: \"61f78cea-8609-4a39-b274-5b47714d6d79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvhgt" Aug 05 17:23:34.734656 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734397 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-etc-openvswitch\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.734656 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734414 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-host-run-netns\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.734656 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734440 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/196cbfc1-efdb-48ef-a5ec-f99c27f2e289-kubelet-config\") pod \"global-pull-secret-syncer-dbt75\" (UID: \"196cbfc1-efdb-48ef-a5ec-f99c27f2e289\") " pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:23:34.734656 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734457 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/61f78cea-8609-4a39-b274-5b47714d6d79-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lvhgt\" (UID: \"61f78cea-8609-4a39-b274-5b47714d6d79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvhgt" Aug 05 17:23:34.734656 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734462 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-host-var-lib-cni-multus\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.734656 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734465 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b311580b-d846-4d7f-ac07-7c28d32f2a8e-host\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.734656 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734441 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-host-run-multus-certs\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.734656 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734511 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f5b9f8c-f284-4181-b324-8807188e1f06-ovn-node-metrics-cert\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.734656 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734487 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-host-kubelet\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.734656 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734564 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/61f78cea-8609-4a39-b274-5b47714d6d79-registration-dir\") pod \"aws-ebs-csi-driver-node-lvhgt\" (UID: \"61f78cea-8609-4a39-b274-5b47714d6d79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvhgt" Aug 05 17:23:34.735536 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734564 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b311580b-d846-4d7f-ac07-7c28d32f2a8e-etc-sysctl-d\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.735536 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734665 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b311580b-d846-4d7f-ac07-7c28d32f2a8e-lib-modules\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.735536 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734689 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-multus-cni-dir\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.735536 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734715 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/61f78cea-8609-4a39-b274-5b47714d6d79-device-dir\") pod \"aws-ebs-csi-driver-node-lvhgt\" (UID: \"61f78cea-8609-4a39-b274-5b47714d6d79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvhgt" Aug 05 17:23:34.735536 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734739 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-host-run-netns\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.735536 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734783 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-host-var-lib-kubelet\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.735536 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734817 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-etc-kubernetes\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.735536 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734829 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-host-var-lib-kubelet\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.735536 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734867 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6qpr\" (UniqueName: \"kubernetes.io/projected/61f78cea-8609-4a39-b274-5b47714d6d79-kube-api-access-r6qpr\") pod \"aws-ebs-csi-driver-node-lvhgt\" (UID: \"61f78cea-8609-4a39-b274-5b47714d6d79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvhgt" Aug 05 17:23:34.735536 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734871 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Aug 05 17:23:34.735536 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734895 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-run-ovn\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.735536 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734941 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-etc-kubernetes\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.735536 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.734981 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-run-ovn\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.735536 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.735014 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b311580b-d846-4d7f-ac07-7c28d32f2a8e-etc-modprobe-d\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.735536 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.735046 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b311580b-d846-4d7f-ac07-7c28d32f2a8e-etc-systemd\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.735536 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.735096 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-host-run-ovn-kubernetes\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.735536 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.735190 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2sbd\" (UniqueName: \"kubernetes.io/projected/e79bda8c-75ee-4022-a816-f55a58cec6c0-kube-api-access-c2sbd\") pod \"network-metrics-daemon-dmchc\" (UID: \"e79bda8c-75ee-4022-a816-f55a58cec6c0\") " pod="openshift-multus/network-metrics-daemon-dmchc" Aug 05 17:23:34.735536 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.735206 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-host-run-ovn-kubernetes\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.736425 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.735264 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b311580b-d846-4d7f-ac07-7c28d32f2a8e-tmp\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.736425 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.735386 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9ztk\" (UniqueName: \"kubernetes.io/projected/fefd4a72-b897-4f18-a3f2-eacedc50bfce-kube-api-access-z9ztk\") pod \"network-check-target-4jrks\" (UID: \"fefd4a72-b897-4f18-a3f2-eacedc50bfce\") " pod="openshift-network-diagnostics/network-check-target-4jrks" Aug 05 17:23:34.736425 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.735423 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b311580b-d846-4d7f-ac07-7c28d32f2a8e-etc-kubernetes\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.736425 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.735453 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b311580b-d846-4d7f-ac07-7c28d32f2a8e-sys\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.736425 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.735498 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b311580b-d846-4d7f-ac07-7c28d32f2a8e-etc-tuned\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.736425 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.735531 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e6224d3-5fb6-4c8f-962b-c5864610b153-multus-daemon-config\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.736425 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.735571 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5f5b9f8c-f284-4181-b324-8807188e1f06-env-overrides\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.736425 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.735697 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/196cbfc1-efdb-48ef-a5ec-f99c27f2e289-original-pull-secret\") pod \"global-pull-secret-syncer-dbt75\" (UID: \"196cbfc1-efdb-48ef-a5ec-f99c27f2e289\") " pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:23:34.736425 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.735829 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14ecac34-eb47-4daa-85f4-d64dcb1a116b-system-cni-dir\") pod \"multus-additional-cni-plugins-hnz8f\" (UID: \"14ecac34-eb47-4daa-85f4-d64dcb1a116b\") " pod="openshift-multus/multus-additional-cni-plugins-hnz8f" Aug 05 17:23:34.736425 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.735878 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14ecac34-eb47-4daa-85f4-d64dcb1a116b-cni-binary-copy\") pod \"multus-additional-cni-plugins-hnz8f\" (UID: \"14ecac34-eb47-4daa-85f4-d64dcb1a116b\") " pod="openshift-multus/multus-additional-cni-plugins-hnz8f" Aug 05 17:23:34.736425 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.735945 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-host-run-netns\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.736425 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.735987 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tb6k5\" (UniqueName: \"kubernetes.io/projected/2e6224d3-5fb6-4c8f-962b-c5864610b153-kube-api-access-tb6k5\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.736425 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.736027 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-host-run-netns\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.736425 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.736071 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-var-lib-openvswitch\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.736425 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.736073 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5f5b9f8c-f284-4181-b324-8807188e1f06-env-overrides\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.736425 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.736106 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2e6224d3-5fb6-4c8f-962b-c5864610b153-multus-daemon-config\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.736425 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.736114 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-var-lib-openvswitch\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.737329 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.736120 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-host-cni-bin\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.737329 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.736191 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-host-cni-bin\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.737329 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.736180 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-host-cni-netd\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.737329 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.736231 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/453d1073-3d90-4861-81d5-2c88980b98ed-host\") pod \"node-ca-6wt47\" (UID: \"453d1073-3d90-4861-81d5-2c88980b98ed\") " pod="openshift-image-registry/node-ca-6wt47" Aug 05 17:23:34.737329 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.736242 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-host-cni-netd\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.737329 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.736261 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/14ecac34-eb47-4daa-85f4-d64dcb1a116b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hnz8f\" (UID: \"14ecac34-eb47-4daa-85f4-d64dcb1a116b\") " pod="openshift-multus/multus-additional-cni-plugins-hnz8f" Aug 05 17:23:34.737329 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.736290 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-cnibin\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.737329 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.736317 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-host-var-lib-cni-bin\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.737329 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.736343 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-systemd-units\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.737329 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.736371 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/172a3e18-e569-486b-8ddb-399586a67407-host-slash\") pod \"iptables-alerter-hxbq4\" (UID: \"172a3e18-e569-486b-8ddb-399586a67407\") " pod="openshift-network-operator/iptables-alerter-hxbq4" Aug 05 17:23:34.737329 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.736399 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-host-var-lib-cni-bin\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.737329 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.736396 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4ngk\" (UniqueName: \"kubernetes.io/projected/172a3e18-e569-486b-8ddb-399586a67407-kube-api-access-x4ngk\") pod \"iptables-alerter-hxbq4\" (UID: \"172a3e18-e569-486b-8ddb-399586a67407\") " pod="openshift-network-operator/iptables-alerter-hxbq4" Aug 05 17:23:34.737329 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.736418 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-cnibin\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.737329 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.736433 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-systemd-units\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.737329 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.736455 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e6224d3-5fb6-4c8f-962b-c5864610b153-cni-binary-copy\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.737329 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.736496 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/61f78cea-8609-4a39-b274-5b47714d6d79-etc-selinux\") pod \"aws-ebs-csi-driver-node-lvhgt\" (UID: \"61f78cea-8609-4a39-b274-5b47714d6d79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvhgt" Aug 05 17:23:34.737329 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.736615 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/61f78cea-8609-4a39-b274-5b47714d6d79-sys-fs\") pod \"aws-ebs-csi-driver-node-lvhgt\" (UID: \"61f78cea-8609-4a39-b274-5b47714d6d79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvhgt" Aug 05 17:23:34.738201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.736649 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-node-log\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.738201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.736695 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b311580b-d846-4d7f-ac07-7c28d32f2a8e-var-lib-kubelet\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.738201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.736724 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/453d1073-3d90-4861-81d5-2c88980b98ed-serviceca\") pod \"node-ca-6wt47\" (UID: \"453d1073-3d90-4861-81d5-2c88980b98ed\") " pod="openshift-image-registry/node-ca-6wt47" Aug 05 17:23:34.738201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.736751 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-system-cni-dir\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.738201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.736778 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-host-slash\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.738201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.736843 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-system-cni-dir\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.738201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.736877 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5f5b9f8c-f284-4181-b324-8807188e1f06-ovnkube-script-lib\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.738201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.736906 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e79bda8c-75ee-4022-a816-f55a58cec6c0-metrics-certs\") pod \"network-metrics-daemon-dmchc\" (UID: \"e79bda8c-75ee-4022-a816-f55a58cec6c0\") " pod="openshift-multus/network-metrics-daemon-dmchc" Aug 05 17:23:34.738201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.736936 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmcdf\" (UniqueName: \"kubernetes.io/projected/b311580b-d846-4d7f-ac07-7c28d32f2a8e-kube-api-access-rmcdf\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.738201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.736967 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tngj2\" (UniqueName: \"kubernetes.io/projected/14ecac34-eb47-4daa-85f4-d64dcb1a116b-kube-api-access-tngj2\") pod \"multus-additional-cni-plugins-hnz8f\" (UID: \"14ecac34-eb47-4daa-85f4-d64dcb1a116b\") " pod="openshift-multus/multus-additional-cni-plugins-hnz8f" Aug 05 17:23:34.738201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.736974 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e6224d3-5fb6-4c8f-962b-c5864610b153-cni-binary-copy\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.738201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.736998 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-host-run-k8s-cni-cncf-io\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.738201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.737037 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-host-slash\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.738201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.737081 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-hostroot\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.738201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.737105 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/196cbfc1-efdb-48ef-a5ec-f99c27f2e289-dbus\") pod \"global-pull-secret-syncer-dbt75\" (UID: \"196cbfc1-efdb-48ef-a5ec-f99c27f2e289\") " pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:23:34.738201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.737131 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14ecac34-eb47-4daa-85f4-d64dcb1a116b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hnz8f\" (UID: \"14ecac34-eb47-4daa-85f4-d64dcb1a116b\") " pod="openshift-multus/multus-additional-cni-plugins-hnz8f" Aug 05 17:23:34.738201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.737155 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-run-openvswitch\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.739288 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.737175 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-host-run-k8s-cni-cncf-io\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.739288 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.737179 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.739288 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.737225 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5f5b9f8c-f284-4181-b324-8807188e1f06-ovnkube-config\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.739288 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.737244 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.739288 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.737284 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/172a3e18-e569-486b-8ddb-399586a67407-iptables-alerter-script\") pod \"iptables-alerter-hxbq4\" (UID: \"172a3e18-e569-486b-8ddb-399586a67407\") " pod="openshift-network-operator/iptables-alerter-hxbq4" Aug 05 17:23:34.739288 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.737365 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/61f78cea-8609-4a39-b274-5b47714d6d79-etc-selinux\") pod \"aws-ebs-csi-driver-node-lvhgt\" (UID: \"61f78cea-8609-4a39-b274-5b47714d6d79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvhgt" Aug 05 17:23:34.739288 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.737408 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-node-log\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.739288 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:34.737444 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:23:34.739288 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.737461 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/61f78cea-8609-4a39-b274-5b47714d6d79-sys-fs\") pod \"aws-ebs-csi-driver-node-lvhgt\" (UID: \"61f78cea-8609-4a39-b274-5b47714d6d79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvhgt" Aug 05 17:23:34.739288 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.737505 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-hostroot\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.739288 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:34.737522 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e79bda8c-75ee-4022-a816-f55a58cec6c0-metrics-certs podName:e79bda8c-75ee-4022-a816-f55a58cec6c0 nodeName:}" failed. No retries permitted until 2026-08-05 17:23:35.237489069 +0000 UTC m=+3.004869283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e79bda8c-75ee-4022-a816-f55a58cec6c0-metrics-certs") pod "network-metrics-daemon-dmchc" (UID: "e79bda8c-75ee-4022-a816-f55a58cec6c0") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:23:34.739288 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.737546 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b311580b-d846-4d7f-ac07-7c28d32f2a8e-etc-sysconfig\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.739288 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.737577 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/14ecac34-eb47-4daa-85f4-d64dcb1a116b-os-release\") pod \"multus-additional-cni-plugins-hnz8f\" (UID: \"14ecac34-eb47-4daa-85f4-d64dcb1a116b\") " pod="openshift-multus/multus-additional-cni-plugins-hnz8f" Aug 05 17:23:34.739288 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.737609 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-log-socket\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.739288 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.737638 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/26e6b157-bbde-4981-b1a8-e3665e69e83c-agent-certs\") pod \"konnectivity-agent-67llw\" (UID: \"26e6b157-bbde-4981-b1a8-e3665e69e83c\") " pod="kube-system/konnectivity-agent-67llw" Aug 05 17:23:34.739288 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.737718 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-multus-socket-dir-parent\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.739288 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.737752 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-multus-conf-dir\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.740327 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.737785 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/61f78cea-8609-4a39-b274-5b47714d6d79-socket-dir\") pod \"aws-ebs-csi-driver-node-lvhgt\" (UID: \"61f78cea-8609-4a39-b274-5b47714d6d79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvhgt" Aug 05 17:23:34.740327 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.737813 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/26e6b157-bbde-4981-b1a8-e3665e69e83c-konnectivity-ca\") pod \"konnectivity-agent-67llw\" (UID: \"26e6b157-bbde-4981-b1a8-e3665e69e83c\") " pod="kube-system/konnectivity-agent-67llw" Aug 05 17:23:34.740327 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.737846 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg9xc\" (UniqueName: \"kubernetes.io/projected/dfa0d5d1-b355-44cc-abf9-124e11c44d6b-kube-api-access-xg9xc\") pod \"node-resolver-2dhgr\" (UID: \"dfa0d5d1-b355-44cc-abf9-124e11c44d6b\") " pod="openshift-dns/node-resolver-2dhgr" Aug 05 17:23:34.740327 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.737873 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-os-release\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.740327 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.737951 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-run-systemd\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.740327 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.737981 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqm98\" (UniqueName: \"kubernetes.io/projected/5f5b9f8c-f284-4181-b324-8807188e1f06-kube-api-access-vqm98\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.740327 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.738181 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5f5b9f8c-f284-4181-b324-8807188e1f06-ovnkube-script-lib\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.740327 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.738208 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-multus-conf-dir\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.740327 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.738263 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-log-socket\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.740327 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.738291 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-os-release\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.740327 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.738305 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-run-openvswitch\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.740327 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.738332 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/61f78cea-8609-4a39-b274-5b47714d6d79-socket-dir\") pod \"aws-ebs-csi-driver-node-lvhgt\" (UID: \"61f78cea-8609-4a39-b274-5b47714d6d79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvhgt" Aug 05 17:23:34.740327 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.738481 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2e6224d3-5fb6-4c8f-962b-c5864610b153-multus-socket-dir-parent\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.740327 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.738592 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5f5b9f8c-f284-4181-b324-8807188e1f06-run-systemd\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.740327 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.738810 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5f5b9f8c-f284-4181-b324-8807188e1f06-ovnkube-config\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.740327 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.738930 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5f5b9f8c-f284-4181-b324-8807188e1f06-ovn-node-metrics-cert\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.740327 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.738981 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/26e6b157-bbde-4981-b1a8-e3665e69e83c-konnectivity-ca\") pod \"konnectivity-agent-67llw\" (UID: \"26e6b157-bbde-4981-b1a8-e3665e69e83c\") " pod="kube-system/konnectivity-agent-67llw" Aug 05 17:23:34.741359 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.741336 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/26e6b157-bbde-4981-b1a8-e3665e69e83c-agent-certs\") pod \"konnectivity-agent-67llw\" (UID: \"26e6b157-bbde-4981-b1a8-e3665e69e83c\") " pod="kube-system/konnectivity-agent-67llw" Aug 05 17:23:34.745571 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.745550 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6qpr\" (UniqueName: \"kubernetes.io/projected/61f78cea-8609-4a39-b274-5b47714d6d79-kube-api-access-r6qpr\") pod \"aws-ebs-csi-driver-node-lvhgt\" (UID: \"61f78cea-8609-4a39-b274-5b47714d6d79\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvhgt" Aug 05 17:23:34.746027 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.746002 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tb6k5\" (UniqueName: \"kubernetes.io/projected/2e6224d3-5fb6-4c8f-962b-c5864610b153-kube-api-access-tb6k5\") pod \"multus-p84kb\" (UID: \"2e6224d3-5fb6-4c8f-962b-c5864610b153\") " pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.747760 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.747732 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2sbd\" (UniqueName: \"kubernetes.io/projected/e79bda8c-75ee-4022-a816-f55a58cec6c0-kube-api-access-c2sbd\") pod \"network-metrics-daemon-dmchc\" (UID: \"e79bda8c-75ee-4022-a816-f55a58cec6c0\") " pod="openshift-multus/network-metrics-daemon-dmchc" Aug 05 17:23:34.749471 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.749433 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqm98\" (UniqueName: \"kubernetes.io/projected/5f5b9f8c-f284-4181-b324-8807188e1f06-kube-api-access-vqm98\") pod \"ovnkube-node-w8nvr\" (UID: \"5f5b9f8c-f284-4181-b324-8807188e1f06\") " pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.769978 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.769879 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal" event={"ID":"079fe7f838db085085f922bdd7352b0d","Type":"ContainerStarted","Data":"e6eeaa5ee351591806d649f63950bf42ad21fe359c4133f7e325fe611f3cdcaf"} Aug 05 17:23:34.772696 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.772667 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-250.ec2.internal" event={"ID":"7f5bf7ebb4fbbb3822a332d0b41a4ef4","Type":"ContainerStarted","Data":"2511cd7d3d3f048b4fea775a0a6a8d9113caed2c2fdf525fad906f01d42618c4"} Aug 05 17:23:34.838453 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.838417 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmcdf\" (UniqueName: \"kubernetes.io/projected/b311580b-d846-4d7f-ac07-7c28d32f2a8e-kube-api-access-rmcdf\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.838643 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.838466 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tngj2\" (UniqueName: \"kubernetes.io/projected/14ecac34-eb47-4daa-85f4-d64dcb1a116b-kube-api-access-tngj2\") pod \"multus-additional-cni-plugins-hnz8f\" (UID: \"14ecac34-eb47-4daa-85f4-d64dcb1a116b\") " pod="openshift-multus/multus-additional-cni-plugins-hnz8f" Aug 05 17:23:34.838712 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.838680 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/196cbfc1-efdb-48ef-a5ec-f99c27f2e289-dbus\") pod \"global-pull-secret-syncer-dbt75\" (UID: \"196cbfc1-efdb-48ef-a5ec-f99c27f2e289\") " pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:23:34.838756 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.838723 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14ecac34-eb47-4daa-85f4-d64dcb1a116b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hnz8f\" (UID: \"14ecac34-eb47-4daa-85f4-d64dcb1a116b\") " pod="openshift-multus/multus-additional-cni-plugins-hnz8f" Aug 05 17:23:34.838792 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.838754 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/172a3e18-e569-486b-8ddb-399586a67407-iptables-alerter-script\") pod \"iptables-alerter-hxbq4\" (UID: \"172a3e18-e569-486b-8ddb-399586a67407\") " pod="openshift-network-operator/iptables-alerter-hxbq4" Aug 05 17:23:34.838830 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.838795 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/196cbfc1-efdb-48ef-a5ec-f99c27f2e289-dbus\") pod \"global-pull-secret-syncer-dbt75\" (UID: \"196cbfc1-efdb-48ef-a5ec-f99c27f2e289\") " pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:23:34.838866 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.838859 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b311580b-d846-4d7f-ac07-7c28d32f2a8e-etc-sysconfig\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.838901 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.838797 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b311580b-d846-4d7f-ac07-7c28d32f2a8e-etc-sysconfig\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.838901 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.838890 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/14ecac34-eb47-4daa-85f4-d64dcb1a116b-os-release\") pod \"multus-additional-cni-plugins-hnz8f\" (UID: \"14ecac34-eb47-4daa-85f4-d64dcb1a116b\") " pod="openshift-multus/multus-additional-cni-plugins-hnz8f" Aug 05 17:23:34.838970 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.838913 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg9xc\" (UniqueName: \"kubernetes.io/projected/dfa0d5d1-b355-44cc-abf9-124e11c44d6b-kube-api-access-xg9xc\") pod \"node-resolver-2dhgr\" (UID: \"dfa0d5d1-b355-44cc-abf9-124e11c44d6b\") " pod="openshift-dns/node-resolver-2dhgr" Aug 05 17:23:34.838970 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.838938 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dfa0d5d1-b355-44cc-abf9-124e11c44d6b-hosts-file\") pod \"node-resolver-2dhgr\" (UID: \"dfa0d5d1-b355-44cc-abf9-124e11c44d6b\") " pod="openshift-dns/node-resolver-2dhgr" Aug 05 17:23:34.839055 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.838966 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nqtg\" (UniqueName: \"kubernetes.io/projected/453d1073-3d90-4861-81d5-2c88980b98ed-kube-api-access-9nqtg\") pod \"node-ca-6wt47\" (UID: \"453d1073-3d90-4861-81d5-2c88980b98ed\") " pod="openshift-image-registry/node-ca-6wt47" Aug 05 17:23:34.839055 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.838992 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14ecac34-eb47-4daa-85f4-d64dcb1a116b-cnibin\") pod \"multus-additional-cni-plugins-hnz8f\" (UID: \"14ecac34-eb47-4daa-85f4-d64dcb1a116b\") " pod="openshift-multus/multus-additional-cni-plugins-hnz8f" Aug 05 17:23:34.839055 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.839018 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/14ecac34-eb47-4daa-85f4-d64dcb1a116b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hnz8f\" (UID: \"14ecac34-eb47-4daa-85f4-d64dcb1a116b\") " pod="openshift-multus/multus-additional-cni-plugins-hnz8f" Aug 05 17:23:34.839055 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.839050 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfa0d5d1-b355-44cc-abf9-124e11c44d6b-tmp-dir\") pod \"node-resolver-2dhgr\" (UID: \"dfa0d5d1-b355-44cc-abf9-124e11c44d6b\") " pod="openshift-dns/node-resolver-2dhgr" Aug 05 17:23:34.839209 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.839066 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14ecac34-eb47-4daa-85f4-d64dcb1a116b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hnz8f\" (UID: \"14ecac34-eb47-4daa-85f4-d64dcb1a116b\") " pod="openshift-multus/multus-additional-cni-plugins-hnz8f" Aug 05 17:23:34.839209 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.839076 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b311580b-d846-4d7f-ac07-7c28d32f2a8e-etc-sysctl-conf\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.839209 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.839100 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b311580b-d846-4d7f-ac07-7c28d32f2a8e-run\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.839209 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.839130 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/196cbfc1-efdb-48ef-a5ec-f99c27f2e289-kubelet-config\") pod \"global-pull-secret-syncer-dbt75\" (UID: \"196cbfc1-efdb-48ef-a5ec-f99c27f2e289\") " pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:23:34.839209 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.839151 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b311580b-d846-4d7f-ac07-7c28d32f2a8e-host\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.839209 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.839169 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b311580b-d846-4d7f-ac07-7c28d32f2a8e-etc-sysctl-d\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.839209 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.839185 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b311580b-d846-4d7f-ac07-7c28d32f2a8e-lib-modules\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.839507 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.839268 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b311580b-d846-4d7f-ac07-7c28d32f2a8e-etc-modprobe-d\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.839507 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.839295 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b311580b-d846-4d7f-ac07-7c28d32f2a8e-etc-systemd\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.839507 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.839318 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b311580b-d846-4d7f-ac07-7c28d32f2a8e-tmp\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.839507 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.839335 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9ztk\" (UniqueName: \"kubernetes.io/projected/fefd4a72-b897-4f18-a3f2-eacedc50bfce-kube-api-access-z9ztk\") pod \"network-check-target-4jrks\" (UID: \"fefd4a72-b897-4f18-a3f2-eacedc50bfce\") " pod="openshift-network-diagnostics/network-check-target-4jrks" Aug 05 17:23:34.839507 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.839350 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b311580b-d846-4d7f-ac07-7c28d32f2a8e-etc-kubernetes\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.839507 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.839366 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b311580b-d846-4d7f-ac07-7c28d32f2a8e-sys\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.839507 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.839387 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b311580b-d846-4d7f-ac07-7c28d32f2a8e-etc-tuned\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.839507 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.839417 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/196cbfc1-efdb-48ef-a5ec-f99c27f2e289-original-pull-secret\") pod \"global-pull-secret-syncer-dbt75\" (UID: \"196cbfc1-efdb-48ef-a5ec-f99c27f2e289\") " pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:23:34.839507 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.839444 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14ecac34-eb47-4daa-85f4-d64dcb1a116b-system-cni-dir\") pod \"multus-additional-cni-plugins-hnz8f\" (UID: \"14ecac34-eb47-4daa-85f4-d64dcb1a116b\") " pod="openshift-multus/multus-additional-cni-plugins-hnz8f" Aug 05 17:23:34.839507 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.839472 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14ecac34-eb47-4daa-85f4-d64dcb1a116b-cni-binary-copy\") pod \"multus-additional-cni-plugins-hnz8f\" (UID: \"14ecac34-eb47-4daa-85f4-d64dcb1a116b\") " pod="openshift-multus/multus-additional-cni-plugins-hnz8f" Aug 05 17:23:34.839507 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.839507 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/453d1073-3d90-4861-81d5-2c88980b98ed-host\") pod \"node-ca-6wt47\" (UID: \"453d1073-3d90-4861-81d5-2c88980b98ed\") " pod="openshift-image-registry/node-ca-6wt47" Aug 05 17:23:34.839972 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.839534 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/14ecac34-eb47-4daa-85f4-d64dcb1a116b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hnz8f\" (UID: \"14ecac34-eb47-4daa-85f4-d64dcb1a116b\") " pod="openshift-multus/multus-additional-cni-plugins-hnz8f" Aug 05 17:23:34.843201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.840427 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/172a3e18-e569-486b-8ddb-399586a67407-host-slash\") pod \"iptables-alerter-hxbq4\" (UID: \"172a3e18-e569-486b-8ddb-399586a67407\") " pod="openshift-network-operator/iptables-alerter-hxbq4" Aug 05 17:23:34.843201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.840469 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4ngk\" (UniqueName: \"kubernetes.io/projected/172a3e18-e569-486b-8ddb-399586a67407-kube-api-access-x4ngk\") pod \"iptables-alerter-hxbq4\" (UID: \"172a3e18-e569-486b-8ddb-399586a67407\") " pod="openshift-network-operator/iptables-alerter-hxbq4" Aug 05 17:23:34.843201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.840497 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b311580b-d846-4d7f-ac07-7c28d32f2a8e-var-lib-kubelet\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.843201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.840519 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/453d1073-3d90-4861-81d5-2c88980b98ed-serviceca\") pod \"node-ca-6wt47\" (UID: \"453d1073-3d90-4861-81d5-2c88980b98ed\") " pod="openshift-image-registry/node-ca-6wt47" Aug 05 17:23:34.843201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.840520 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/14ecac34-eb47-4daa-85f4-d64dcb1a116b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hnz8f\" (UID: \"14ecac34-eb47-4daa-85f4-d64dcb1a116b\") " pod="openshift-multus/multus-additional-cni-plugins-hnz8f" Aug 05 17:23:34.843201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.840530 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/172a3e18-e569-486b-8ddb-399586a67407-iptables-alerter-script\") pod \"iptables-alerter-hxbq4\" (UID: \"172a3e18-e569-486b-8ddb-399586a67407\") " pod="openshift-network-operator/iptables-alerter-hxbq4" Aug 05 17:23:34.843201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.841317 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14ecac34-eb47-4daa-85f4-d64dcb1a116b-cnibin\") pod \"multus-additional-cni-plugins-hnz8f\" (UID: \"14ecac34-eb47-4daa-85f4-d64dcb1a116b\") " pod="openshift-multus/multus-additional-cni-plugins-hnz8f" Aug 05 17:23:34.843201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.841308 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dfa0d5d1-b355-44cc-abf9-124e11c44d6b-hosts-file\") pod \"node-resolver-2dhgr\" (UID: \"dfa0d5d1-b355-44cc-abf9-124e11c44d6b\") " pod="openshift-dns/node-resolver-2dhgr" Aug 05 17:23:34.843201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.841367 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b311580b-d846-4d7f-ac07-7c28d32f2a8e-host\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.843201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.841393 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b311580b-d846-4d7f-ac07-7c28d32f2a8e-run\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.843201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.841583 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/14ecac34-eb47-4daa-85f4-d64dcb1a116b-os-release\") pod \"multus-additional-cni-plugins-hnz8f\" (UID: \"14ecac34-eb47-4daa-85f4-d64dcb1a116b\") " pod="openshift-multus/multus-additional-cni-plugins-hnz8f" Aug 05 17:23:34.843201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.841698 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b311580b-d846-4d7f-ac07-7c28d32f2a8e-etc-sysctl-conf\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.843201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.841762 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/196cbfc1-efdb-48ef-a5ec-f99c27f2e289-kubelet-config\") pod \"global-pull-secret-syncer-dbt75\" (UID: \"196cbfc1-efdb-48ef-a5ec-f99c27f2e289\") " pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:23:34.843201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.841807 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14ecac34-eb47-4daa-85f4-d64dcb1a116b-system-cni-dir\") pod \"multus-additional-cni-plugins-hnz8f\" (UID: \"14ecac34-eb47-4daa-85f4-d64dcb1a116b\") " pod="openshift-multus/multus-additional-cni-plugins-hnz8f" Aug 05 17:23:34.843201 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:34.841900 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 17:23:34.843201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.841902 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/14ecac34-eb47-4daa-85f4-d64dcb1a116b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hnz8f\" (UID: \"14ecac34-eb47-4daa-85f4-d64dcb1a116b\") " pod="openshift-multus/multus-additional-cni-plugins-hnz8f" Aug 05 17:23:34.843201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.841900 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b311580b-d846-4d7f-ac07-7c28d32f2a8e-var-lib-kubelet\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.843201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.841949 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/453d1073-3d90-4861-81d5-2c88980b98ed-host\") pod \"node-ca-6wt47\" (UID: \"453d1073-3d90-4861-81d5-2c88980b98ed\") " pod="openshift-image-registry/node-ca-6wt47" Aug 05 17:23:34.844255 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.841968 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b311580b-d846-4d7f-ac07-7c28d32f2a8e-etc-kubernetes\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.844255 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:34.841985 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/196cbfc1-efdb-48ef-a5ec-f99c27f2e289-original-pull-secret podName:196cbfc1-efdb-48ef-a5ec-f99c27f2e289 nodeName:}" failed. No retries permitted until 2026-08-05 17:23:35.341957709 +0000 UTC m=+3.109337926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/196cbfc1-efdb-48ef-a5ec-f99c27f2e289-original-pull-secret") pod "global-pull-secret-syncer-dbt75" (UID: "196cbfc1-efdb-48ef-a5ec-f99c27f2e289") : object "kube-system"/"original-pull-secret" not registered Aug 05 17:23:34.844255 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.842080 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b311580b-d846-4d7f-ac07-7c28d32f2a8e-lib-modules\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.844255 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.842297 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b311580b-d846-4d7f-ac07-7c28d32f2a8e-etc-systemd\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.844255 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.842323 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b311580b-d846-4d7f-ac07-7c28d32f2a8e-sys\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.844255 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.842392 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/172a3e18-e569-486b-8ddb-399586a67407-host-slash\") pod \"iptables-alerter-hxbq4\" (UID: \"172a3e18-e569-486b-8ddb-399586a67407\") " pod="openshift-network-operator/iptables-alerter-hxbq4" Aug 05 17:23:34.844255 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.842515 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b311580b-d846-4d7f-ac07-7c28d32f2a8e-etc-sysctl-d\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.844255 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.842547 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/453d1073-3d90-4861-81d5-2c88980b98ed-serviceca\") pod \"node-ca-6wt47\" (UID: \"453d1073-3d90-4861-81d5-2c88980b98ed\") " pod="openshift-image-registry/node-ca-6wt47" Aug 05 17:23:34.844255 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.842058 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b311580b-d846-4d7f-ac07-7c28d32f2a8e-etc-modprobe-d\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.844255 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.842782 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfa0d5d1-b355-44cc-abf9-124e11c44d6b-tmp-dir\") pod \"node-resolver-2dhgr\" (UID: \"dfa0d5d1-b355-44cc-abf9-124e11c44d6b\") " pod="openshift-dns/node-resolver-2dhgr" Aug 05 17:23:34.844255 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.843060 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14ecac34-eb47-4daa-85f4-d64dcb1a116b-cni-binary-copy\") pod \"multus-additional-cni-plugins-hnz8f\" (UID: \"14ecac34-eb47-4daa-85f4-d64dcb1a116b\") " pod="openshift-multus/multus-additional-cni-plugins-hnz8f" Aug 05 17:23:34.845717 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.845269 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b311580b-d846-4d7f-ac07-7c28d32f2a8e-tmp\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.850287 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.850261 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b311580b-d846-4d7f-ac07-7c28d32f2a8e-etc-tuned\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.853992 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.853907 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmcdf\" (UniqueName: \"kubernetes.io/projected/b311580b-d846-4d7f-ac07-7c28d32f2a8e-kube-api-access-rmcdf\") pod \"tuned-b8hsg\" (UID: \"b311580b-d846-4d7f-ac07-7c28d32f2a8e\") " pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:34.854096 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.854031 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tngj2\" (UniqueName: \"kubernetes.io/projected/14ecac34-eb47-4daa-85f4-d64dcb1a116b-kube-api-access-tngj2\") pod \"multus-additional-cni-plugins-hnz8f\" (UID: \"14ecac34-eb47-4daa-85f4-d64dcb1a116b\") " pod="openshift-multus/multus-additional-cni-plugins-hnz8f" Aug 05 17:23:34.854566 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:34.854544 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 17:23:34.854672 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:34.854574 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 17:23:34.854672 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:34.854590 2579 projected.go:196] Error preparing data for projected volume kube-api-access-z9ztk for pod openshift-network-diagnostics/network-check-target-4jrks: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:23:34.854672 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:34.854660 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fefd4a72-b897-4f18-a3f2-eacedc50bfce-kube-api-access-z9ztk podName:fefd4a72-b897-4f18-a3f2-eacedc50bfce nodeName:}" failed. No retries permitted until 2026-08-05 17:23:35.354641847 +0000 UTC m=+3.122022066 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-z9ztk" (UniqueName: "kubernetes.io/projected/fefd4a72-b897-4f18-a3f2-eacedc50bfce-kube-api-access-z9ztk") pod "network-check-target-4jrks" (UID: "fefd4a72-b897-4f18-a3f2-eacedc50bfce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:23:34.857390 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.857345 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4ngk\" (UniqueName: \"kubernetes.io/projected/172a3e18-e569-486b-8ddb-399586a67407-kube-api-access-x4ngk\") pod \"iptables-alerter-hxbq4\" (UID: \"172a3e18-e569-486b-8ddb-399586a67407\") " pod="openshift-network-operator/iptables-alerter-hxbq4" Aug 05 17:23:34.857802 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.857775 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nqtg\" (UniqueName: \"kubernetes.io/projected/453d1073-3d90-4861-81d5-2c88980b98ed-kube-api-access-9nqtg\") pod \"node-ca-6wt47\" (UID: \"453d1073-3d90-4861-81d5-2c88980b98ed\") " pod="openshift-image-registry/node-ca-6wt47" Aug 05 17:23:34.857901 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.857846 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg9xc\" (UniqueName: \"kubernetes.io/projected/dfa0d5d1-b355-44cc-abf9-124e11c44d6b-kube-api-access-xg9xc\") pod \"node-resolver-2dhgr\" (UID: \"dfa0d5d1-b355-44cc-abf9-124e11c44d6b\") " pod="openshift-dns/node-resolver-2dhgr" Aug 05 17:23:34.872190 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.872011 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 17:23:34.930879 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.930841 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p84kb" Aug 05 17:23:34.942807 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.942776 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvhgt" Aug 05 17:23:34.952560 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.952504 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:23:34.959975 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.959950 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-67llw" Aug 05 17:23:34.968761 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.968743 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6wt47" Aug 05 17:23:34.977639 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.977616 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hxbq4" Aug 05 17:23:34.986420 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.986393 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2dhgr" Aug 05 17:23:34.995435 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:34.995414 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hnz8f" Aug 05 17:23:35.001513 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:35.001490 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" Aug 05 17:23:35.244687 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:35.244587 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e79bda8c-75ee-4022-a816-f55a58cec6c0-metrics-certs\") pod \"network-metrics-daemon-dmchc\" (UID: \"e79bda8c-75ee-4022-a816-f55a58cec6c0\") " pod="openshift-multus/network-metrics-daemon-dmchc" Aug 05 17:23:35.244867 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:35.244738 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:23:35.244867 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:35.244834 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e79bda8c-75ee-4022-a816-f55a58cec6c0-metrics-certs podName:e79bda8c-75ee-4022-a816-f55a58cec6c0 nodeName:}" failed. No retries permitted until 2026-08-05 17:23:36.244810799 +0000 UTC m=+4.012191015 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e79bda8c-75ee-4022-a816-f55a58cec6c0-metrics-certs") pod "network-metrics-daemon-dmchc" (UID: "e79bda8c-75ee-4022-a816-f55a58cec6c0") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:23:35.345027 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:35.344988 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/196cbfc1-efdb-48ef-a5ec-f99c27f2e289-original-pull-secret\") pod \"global-pull-secret-syncer-dbt75\" (UID: \"196cbfc1-efdb-48ef-a5ec-f99c27f2e289\") " pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:23:35.345237 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:35.345160 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 17:23:35.345299 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:35.345241 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/196cbfc1-efdb-48ef-a5ec-f99c27f2e289-original-pull-secret podName:196cbfc1-efdb-48ef-a5ec-f99c27f2e289 nodeName:}" failed. No retries permitted until 2026-08-05 17:23:36.345216885 +0000 UTC m=+4.112597107 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/196cbfc1-efdb-48ef-a5ec-f99c27f2e289-original-pull-secret") pod "global-pull-secret-syncer-dbt75" (UID: "196cbfc1-efdb-48ef-a5ec-f99c27f2e289") : object "kube-system"/"original-pull-secret" not registered Aug 05 17:23:35.446256 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:35.446214 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9ztk\" (UniqueName: \"kubernetes.io/projected/fefd4a72-b897-4f18-a3f2-eacedc50bfce-kube-api-access-z9ztk\") pod \"network-check-target-4jrks\" (UID: \"fefd4a72-b897-4f18-a3f2-eacedc50bfce\") " pod="openshift-network-diagnostics/network-check-target-4jrks" Aug 05 17:23:35.446467 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:35.446401 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 17:23:35.446467 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:35.446431 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 17:23:35.446467 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:35.446446 2579 projected.go:196] Error preparing data for projected volume kube-api-access-z9ztk for pod openshift-network-diagnostics/network-check-target-4jrks: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:23:35.446623 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:35.446526 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fefd4a72-b897-4f18-a3f2-eacedc50bfce-kube-api-access-z9ztk podName:fefd4a72-b897-4f18-a3f2-eacedc50bfce nodeName:}" failed. No retries permitted until 2026-08-05 17:23:36.446504277 +0000 UTC m=+4.213884494 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-z9ztk" (UniqueName: "kubernetes.io/projected/fefd4a72-b897-4f18-a3f2-eacedc50bfce-kube-api-access-z9ztk") pod "network-check-target-4jrks" (UID: "fefd4a72-b897-4f18-a3f2-eacedc50bfce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:23:35.670461 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:35.670348 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 17:18:35 +0000 UTC" deadline="2027-12-31 20:48:16.548754377 +0000 UTC" Aug 05 17:23:35.670461 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:35.670380 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12315h24m40.878377763s" Aug 05 17:23:35.763626 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:35.763598 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmchc" Aug 05 17:23:35.763797 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:35.763723 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmchc" podUID="e79bda8c-75ee-4022-a816-f55a58cec6c0" Aug 05 17:23:35.990794 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:35.990766 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfa0d5d1_b355_44cc_abf9_124e11c44d6b.slice/crio-99284954b27ec3b4e619991bbed7a56cdaf46b3aba7c2c67eef0f4dcd9adcb7c WatchSource:0}: Error finding container 99284954b27ec3b4e619991bbed7a56cdaf46b3aba7c2c67eef0f4dcd9adcb7c: Status 404 returned error can't find the container with id 99284954b27ec3b4e619991bbed7a56cdaf46b3aba7c2c67eef0f4dcd9adcb7c Aug 05 17:23:35.992464 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:35.992419 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14ecac34_eb47_4daa_85f4_d64dcb1a116b.slice/crio-78d84c5484936f46dd89880994acafe6817ab902259203aa4c47cebdf87fd5ce WatchSource:0}: Error finding container 78d84c5484936f46dd89880994acafe6817ab902259203aa4c47cebdf87fd5ce: Status 404 returned error can't find the container with id 78d84c5484936f46dd89880994acafe6817ab902259203aa4c47cebdf87fd5ce Aug 05 17:23:35.993058 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:35.992843 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61f78cea_8609_4a39_b274_5b47714d6d79.slice/crio-620c53f6155194ab454f0f6f9baa61550a09f4eef9d2de9c2b9b41990ed0cf52 WatchSource:0}: Error finding container 620c53f6155194ab454f0f6f9baa61550a09f4eef9d2de9c2b9b41990ed0cf52: Status 404 returned error can't find the container with id 620c53f6155194ab454f0f6f9baa61550a09f4eef9d2de9c2b9b41990ed0cf52 Aug 05 17:23:35.999013 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:35.998992 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod172a3e18_e569_486b_8ddb_399586a67407.slice/crio-d67b555a0f360c43c2b6ec92e232af9e16651b13565b525e747656568427940e WatchSource:0}: Error finding container d67b555a0f360c43c2b6ec92e232af9e16651b13565b525e747656568427940e: Status 404 returned error can't find the container with id d67b555a0f360c43c2b6ec92e232af9e16651b13565b525e747656568427940e Aug 05 17:23:36.000004 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:35.999967 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod453d1073_3d90_4861_81d5_2c88980b98ed.slice/crio-6d41cf7fd5739c5142517f2acf3c4320c424515b4ecd8d6759f670a301bbfcfe WatchSource:0}: Error finding container 6d41cf7fd5739c5142517f2acf3c4320c424515b4ecd8d6759f670a301bbfcfe: Status 404 returned error can't find the container with id 6d41cf7fd5739c5142517f2acf3c4320c424515b4ecd8d6759f670a301bbfcfe Aug 05 17:23:36.001294 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:36.001161 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e6224d3_5fb6_4c8f_962b_c5864610b153.slice/crio-b652e94a7d60c5e98e05e72ca3922e25ada2c46267b11039d4b7f9c2385c5c8a WatchSource:0}: Error finding container b652e94a7d60c5e98e05e72ca3922e25ada2c46267b11039d4b7f9c2385c5c8a: Status 404 returned error can't find the container with id b652e94a7d60c5e98e05e72ca3922e25ada2c46267b11039d4b7f9c2385c5c8a Aug 05 17:23:36.001526 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:36.001502 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb311580b_d846_4d7f_ac07_7c28d32f2a8e.slice/crio-b56cfde3e6a19dab43183b483ba6d45459b054387dcedc50187dcbc1c4f1c105 WatchSource:0}: Error finding container b56cfde3e6a19dab43183b483ba6d45459b054387dcedc50187dcbc1c4f1c105: Status 404 returned error can't find the container with id b56cfde3e6a19dab43183b483ba6d45459b054387dcedc50187dcbc1c4f1c105 Aug 05 17:23:36.003682 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:23:36.003085 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f5b9f8c_f284_4181_b324_8807188e1f06.slice/crio-1463da9196ce70c55018b3d59d3759ea9b84f134e88e4b5efa14e1ff3a591b86 WatchSource:0}: Error finding container 1463da9196ce70c55018b3d59d3759ea9b84f134e88e4b5efa14e1ff3a591b86: Status 404 returned error can't find the container with id 1463da9196ce70c55018b3d59d3759ea9b84f134e88e4b5efa14e1ff3a591b86 Aug 05 17:23:36.253571 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:36.253403 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e79bda8c-75ee-4022-a816-f55a58cec6c0-metrics-certs\") pod \"network-metrics-daemon-dmchc\" (UID: \"e79bda8c-75ee-4022-a816-f55a58cec6c0\") " pod="openshift-multus/network-metrics-daemon-dmchc" Aug 05 17:23:36.253659 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:36.253588 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:23:36.253709 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:36.253665 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e79bda8c-75ee-4022-a816-f55a58cec6c0-metrics-certs podName:e79bda8c-75ee-4022-a816-f55a58cec6c0 nodeName:}" failed. No retries permitted until 2026-08-05 17:23:38.253643579 +0000 UTC m=+6.021023794 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e79bda8c-75ee-4022-a816-f55a58cec6c0-metrics-certs") pod "network-metrics-daemon-dmchc" (UID: "e79bda8c-75ee-4022-a816-f55a58cec6c0") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:23:36.354193 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:36.354144 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/196cbfc1-efdb-48ef-a5ec-f99c27f2e289-original-pull-secret\") pod \"global-pull-secret-syncer-dbt75\" (UID: \"196cbfc1-efdb-48ef-a5ec-f99c27f2e289\") " pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:23:36.354366 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:36.354298 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 17:23:36.354407 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:36.354370 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/196cbfc1-efdb-48ef-a5ec-f99c27f2e289-original-pull-secret podName:196cbfc1-efdb-48ef-a5ec-f99c27f2e289 nodeName:}" failed. No retries permitted until 2026-08-05 17:23:38.354349737 +0000 UTC m=+6.121729949 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/196cbfc1-efdb-48ef-a5ec-f99c27f2e289-original-pull-secret") pod "global-pull-secret-syncer-dbt75" (UID: "196cbfc1-efdb-48ef-a5ec-f99c27f2e289") : object "kube-system"/"original-pull-secret" not registered Aug 05 17:23:36.454679 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:36.454643 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9ztk\" (UniqueName: \"kubernetes.io/projected/fefd4a72-b897-4f18-a3f2-eacedc50bfce-kube-api-access-z9ztk\") pod \"network-check-target-4jrks\" (UID: \"fefd4a72-b897-4f18-a3f2-eacedc50bfce\") " pod="openshift-network-diagnostics/network-check-target-4jrks" Aug 05 17:23:36.454822 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:36.454771 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 17:23:36.454822 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:36.454789 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 17:23:36.454822 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:36.454798 2579 projected.go:196] Error preparing data for projected volume kube-api-access-z9ztk for pod openshift-network-diagnostics/network-check-target-4jrks: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:23:36.454936 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:36.454852 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fefd4a72-b897-4f18-a3f2-eacedc50bfce-kube-api-access-z9ztk podName:fefd4a72-b897-4f18-a3f2-eacedc50bfce nodeName:}" failed. No retries permitted until 2026-08-05 17:23:38.45483767 +0000 UTC m=+6.222217882 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-z9ztk" (UniqueName: "kubernetes.io/projected/fefd4a72-b897-4f18-a3f2-eacedc50bfce-kube-api-access-z9ztk") pod "network-check-target-4jrks" (UID: "fefd4a72-b897-4f18-a3f2-eacedc50bfce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:23:36.671117 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:36.671039 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 17:18:35 +0000 UTC" deadline="2028-01-02 01:33:48.205331496 +0000 UTC" Aug 05 17:23:36.671117 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:36.671083 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12344h10m11.534256031s" Aug 05 17:23:36.769509 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:36.769471 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jrks" Aug 05 17:23:36.769669 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:36.769628 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jrks" podUID="fefd4a72-b897-4f18-a3f2-eacedc50bfce" Aug 05 17:23:36.770065 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:36.770041 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:23:36.770174 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:36.770151 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dbt75" podUID="196cbfc1-efdb-48ef-a5ec-f99c27f2e289" Aug 05 17:23:36.789308 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:36.789237 2579 generic.go:356] "Generic (PLEG): container finished" podID="079fe7f838db085085f922bdd7352b0d" containerID="dc703a5bf57842eb94c178008f4f2c957e327b5a5a8a4ebf783721266a5ee6c1" exitCode=0 Aug 05 17:23:36.799647 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:36.796372 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal" event={"ID":"079fe7f838db085085f922bdd7352b0d","Type":"ContainerDied","Data":"dc703a5bf57842eb94c178008f4f2c957e327b5a5a8a4ebf783721266a5ee6c1"} Aug 05 17:23:36.821994 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:36.821956 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-250.ec2.internal" event={"ID":"7f5bf7ebb4fbbb3822a332d0b41a4ef4","Type":"ContainerStarted","Data":"65a09470a8d07c903fb226b4e4205811aa44ca4f139295ddd1c025524f7969ab"} Aug 05 17:23:36.835736 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:36.835703 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" event={"ID":"5f5b9f8c-f284-4181-b324-8807188e1f06","Type":"ContainerStarted","Data":"1463da9196ce70c55018b3d59d3759ea9b84f134e88e4b5efa14e1ff3a591b86"} Aug 05 17:23:36.840289 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:36.840259 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvhgt" event={"ID":"61f78cea-8609-4a39-b274-5b47714d6d79","Type":"ContainerStarted","Data":"620c53f6155194ab454f0f6f9baa61550a09f4eef9d2de9c2b9b41990ed0cf52"} Aug 05 17:23:36.846599 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:36.845546 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-250.ec2.internal" podStartSLOduration=2.845526833 podStartE2EDuration="2.845526833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:23:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:23:36.845121148 +0000 UTC m=+4.612501385" watchObservedRunningTime="2026-08-05 17:23:36.845526833 +0000 UTC m=+4.612907070" Aug 05 17:23:36.853974 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:36.853896 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnz8f" event={"ID":"14ecac34-eb47-4daa-85f4-d64dcb1a116b","Type":"ContainerStarted","Data":"78d84c5484936f46dd89880994acafe6817ab902259203aa4c47cebdf87fd5ce"} Aug 05 17:23:36.863200 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:36.863102 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2dhgr" event={"ID":"dfa0d5d1-b355-44cc-abf9-124e11c44d6b","Type":"ContainerStarted","Data":"99284954b27ec3b4e619991bbed7a56cdaf46b3aba7c2c67eef0f4dcd9adcb7c"} Aug 05 17:23:36.870599 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:36.870518 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" event={"ID":"b311580b-d846-4d7f-ac07-7c28d32f2a8e","Type":"ContainerStarted","Data":"b56cfde3e6a19dab43183b483ba6d45459b054387dcedc50187dcbc1c4f1c105"} Aug 05 17:23:36.882545 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:36.882477 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p84kb" event={"ID":"2e6224d3-5fb6-4c8f-962b-c5864610b153","Type":"ContainerStarted","Data":"b652e94a7d60c5e98e05e72ca3922e25ada2c46267b11039d4b7f9c2385c5c8a"} Aug 05 17:23:36.906549 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:36.906519 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6wt47" event={"ID":"453d1073-3d90-4861-81d5-2c88980b98ed","Type":"ContainerStarted","Data":"6d41cf7fd5739c5142517f2acf3c4320c424515b4ecd8d6759f670a301bbfcfe"} Aug 05 17:23:36.915337 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:36.915271 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hxbq4" event={"ID":"172a3e18-e569-486b-8ddb-399586a67407","Type":"ContainerStarted","Data":"d67b555a0f360c43c2b6ec92e232af9e16651b13565b525e747656568427940e"} Aug 05 17:23:36.923883 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:36.923853 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-67llw" event={"ID":"26e6b157-bbde-4981-b1a8-e3665e69e83c","Type":"ContainerStarted","Data":"6f3be14fd896de43588035fd09e08d677d95b7bc400aa67e0294800a2ec95847"} Aug 05 17:23:37.764447 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:37.764407 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmchc" Aug 05 17:23:37.765235 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:37.764570 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmchc" podUID="e79bda8c-75ee-4022-a816-f55a58cec6c0" Aug 05 17:23:37.943463 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:37.943135 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal" event={"ID":"079fe7f838db085085f922bdd7352b0d","Type":"ContainerStarted","Data":"82b5f33c424fef2b42ccda0b5766d8073ada9f391d6ac638b36f5c37683ce39a"} Aug 05 17:23:37.965953 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:37.965671 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-250.ec2.internal" podStartSLOduration=3.965649854 podStartE2EDuration="3.965649854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:23:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:23:37.964629644 +0000 UTC m=+5.732009882" watchObservedRunningTime="2026-08-05 17:23:37.965649854 +0000 UTC m=+5.733030095" Aug 05 17:23:38.272155 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:38.272074 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e79bda8c-75ee-4022-a816-f55a58cec6c0-metrics-certs\") pod \"network-metrics-daemon-dmchc\" (UID: \"e79bda8c-75ee-4022-a816-f55a58cec6c0\") " pod="openshift-multus/network-metrics-daemon-dmchc" Aug 05 17:23:38.272383 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:38.272315 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:23:38.272450 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:38.272385 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e79bda8c-75ee-4022-a816-f55a58cec6c0-metrics-certs podName:e79bda8c-75ee-4022-a816-f55a58cec6c0 nodeName:}" failed. No retries permitted until 2026-08-05 17:23:42.272365778 +0000 UTC m=+10.039746007 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e79bda8c-75ee-4022-a816-f55a58cec6c0-metrics-certs") pod "network-metrics-daemon-dmchc" (UID: "e79bda8c-75ee-4022-a816-f55a58cec6c0") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:23:38.373567 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:38.373186 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/196cbfc1-efdb-48ef-a5ec-f99c27f2e289-original-pull-secret\") pod \"global-pull-secret-syncer-dbt75\" (UID: \"196cbfc1-efdb-48ef-a5ec-f99c27f2e289\") " pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:23:38.373567 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:38.373384 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 17:23:38.373567 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:38.373442 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/196cbfc1-efdb-48ef-a5ec-f99c27f2e289-original-pull-secret podName:196cbfc1-efdb-48ef-a5ec-f99c27f2e289 nodeName:}" failed. No retries permitted until 2026-08-05 17:23:42.373423104 +0000 UTC m=+10.140803334 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/196cbfc1-efdb-48ef-a5ec-f99c27f2e289-original-pull-secret") pod "global-pull-secret-syncer-dbt75" (UID: "196cbfc1-efdb-48ef-a5ec-f99c27f2e289") : object "kube-system"/"original-pull-secret" not registered Aug 05 17:23:38.476251 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:38.474529 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9ztk\" (UniqueName: \"kubernetes.io/projected/fefd4a72-b897-4f18-a3f2-eacedc50bfce-kube-api-access-z9ztk\") pod \"network-check-target-4jrks\" (UID: \"fefd4a72-b897-4f18-a3f2-eacedc50bfce\") " pod="openshift-network-diagnostics/network-check-target-4jrks" Aug 05 17:23:38.476251 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:38.474740 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 17:23:38.476251 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:38.474768 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 17:23:38.476251 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:38.474782 2579 projected.go:196] Error preparing data for projected volume kube-api-access-z9ztk for pod openshift-network-diagnostics/network-check-target-4jrks: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:23:38.476251 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:38.474851 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fefd4a72-b897-4f18-a3f2-eacedc50bfce-kube-api-access-z9ztk podName:fefd4a72-b897-4f18-a3f2-eacedc50bfce nodeName:}" failed. No retries permitted until 2026-08-05 17:23:42.474830838 +0000 UTC m=+10.242211151 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-z9ztk" (UniqueName: "kubernetes.io/projected/fefd4a72-b897-4f18-a3f2-eacedc50bfce-kube-api-access-z9ztk") pod "network-check-target-4jrks" (UID: "fefd4a72-b897-4f18-a3f2-eacedc50bfce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:23:38.763998 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:38.763911 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jrks" Aug 05 17:23:38.764175 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:38.764059 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jrks" podUID="fefd4a72-b897-4f18-a3f2-eacedc50bfce" Aug 05 17:23:38.764303 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:38.764287 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:23:38.764417 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:38.764396 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dbt75" podUID="196cbfc1-efdb-48ef-a5ec-f99c27f2e289" Aug 05 17:23:39.764445 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:39.764406 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmchc" Aug 05 17:23:39.764968 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:39.764574 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmchc" podUID="e79bda8c-75ee-4022-a816-f55a58cec6c0" Aug 05 17:23:40.764315 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:40.764230 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jrks" Aug 05 17:23:40.764315 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:40.764270 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:23:40.764936 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:40.764374 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jrks" podUID="fefd4a72-b897-4f18-a3f2-eacedc50bfce" Aug 05 17:23:40.764936 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:40.764817 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dbt75" podUID="196cbfc1-efdb-48ef-a5ec-f99c27f2e289" Aug 05 17:23:41.764274 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:41.764228 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmchc" Aug 05 17:23:41.764453 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:41.764397 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmchc" podUID="e79bda8c-75ee-4022-a816-f55a58cec6c0" Aug 05 17:23:42.307433 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:42.307397 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e79bda8c-75ee-4022-a816-f55a58cec6c0-metrics-certs\") pod \"network-metrics-daemon-dmchc\" (UID: \"e79bda8c-75ee-4022-a816-f55a58cec6c0\") " pod="openshift-multus/network-metrics-daemon-dmchc" Aug 05 17:23:42.307951 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:42.307574 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:23:42.307951 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:42.307651 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e79bda8c-75ee-4022-a816-f55a58cec6c0-metrics-certs podName:e79bda8c-75ee-4022-a816-f55a58cec6c0 nodeName:}" failed. No retries permitted until 2026-08-05 17:23:50.307628189 +0000 UTC m=+18.075008422 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e79bda8c-75ee-4022-a816-f55a58cec6c0-metrics-certs") pod "network-metrics-daemon-dmchc" (UID: "e79bda8c-75ee-4022-a816-f55a58cec6c0") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:23:42.408288 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:42.408240 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/196cbfc1-efdb-48ef-a5ec-f99c27f2e289-original-pull-secret\") pod \"global-pull-secret-syncer-dbt75\" (UID: \"196cbfc1-efdb-48ef-a5ec-f99c27f2e289\") " pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:23:42.408478 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:42.408430 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 17:23:42.408541 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:42.408502 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/196cbfc1-efdb-48ef-a5ec-f99c27f2e289-original-pull-secret podName:196cbfc1-efdb-48ef-a5ec-f99c27f2e289 nodeName:}" failed. No retries permitted until 2026-08-05 17:23:50.408481226 +0000 UTC m=+18.175861447 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/196cbfc1-efdb-48ef-a5ec-f99c27f2e289-original-pull-secret") pod "global-pull-secret-syncer-dbt75" (UID: "196cbfc1-efdb-48ef-a5ec-f99c27f2e289") : object "kube-system"/"original-pull-secret" not registered Aug 05 17:23:42.508953 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:42.508916 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9ztk\" (UniqueName: \"kubernetes.io/projected/fefd4a72-b897-4f18-a3f2-eacedc50bfce-kube-api-access-z9ztk\") pod \"network-check-target-4jrks\" (UID: \"fefd4a72-b897-4f18-a3f2-eacedc50bfce\") " pod="openshift-network-diagnostics/network-check-target-4jrks" Aug 05 17:23:42.509283 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:42.509217 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 17:23:42.509283 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:42.509245 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 17:23:42.509283 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:42.509263 2579 projected.go:196] Error preparing data for projected volume kube-api-access-z9ztk for pod openshift-network-diagnostics/network-check-target-4jrks: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:23:42.509499 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:42.509332 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fefd4a72-b897-4f18-a3f2-eacedc50bfce-kube-api-access-z9ztk podName:fefd4a72-b897-4f18-a3f2-eacedc50bfce nodeName:}" failed. No retries permitted until 2026-08-05 17:23:50.509311392 +0000 UTC m=+18.276691606 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-z9ztk" (UniqueName: "kubernetes.io/projected/fefd4a72-b897-4f18-a3f2-eacedc50bfce-kube-api-access-z9ztk") pod "network-check-target-4jrks" (UID: "fefd4a72-b897-4f18-a3f2-eacedc50bfce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:23:42.765429 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:42.765322 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jrks" Aug 05 17:23:42.765606 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:42.765439 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jrks" podUID="fefd4a72-b897-4f18-a3f2-eacedc50bfce" Aug 05 17:23:42.765847 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:42.765829 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:23:42.765953 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:42.765932 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dbt75" podUID="196cbfc1-efdb-48ef-a5ec-f99c27f2e289" Aug 05 17:23:43.763873 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:43.763834 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmchc" Aug 05 17:23:43.764331 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:43.763974 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmchc" podUID="e79bda8c-75ee-4022-a816-f55a58cec6c0" Aug 05 17:23:44.764604 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:44.764577 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jrks" Aug 05 17:23:44.765063 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:44.764705 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jrks" podUID="fefd4a72-b897-4f18-a3f2-eacedc50bfce" Aug 05 17:23:44.765063 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:44.764848 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:23:44.765063 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:44.764932 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dbt75" podUID="196cbfc1-efdb-48ef-a5ec-f99c27f2e289" Aug 05 17:23:45.764479 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:45.764448 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmchc" Aug 05 17:23:45.764642 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:45.764587 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmchc" podUID="e79bda8c-75ee-4022-a816-f55a58cec6c0" Aug 05 17:23:46.764702 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:46.764664 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jrks" Aug 05 17:23:46.765194 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:46.764792 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jrks" podUID="fefd4a72-b897-4f18-a3f2-eacedc50bfce" Aug 05 17:23:46.765194 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:46.764849 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:23:46.765194 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:46.764941 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dbt75" podUID="196cbfc1-efdb-48ef-a5ec-f99c27f2e289" Aug 05 17:23:47.763962 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:47.763922 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmchc" Aug 05 17:23:47.764186 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:47.764054 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmchc" podUID="e79bda8c-75ee-4022-a816-f55a58cec6c0" Aug 05 17:23:48.764239 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:48.764203 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:23:48.764773 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:48.764252 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jrks" Aug 05 17:23:48.764773 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:48.764350 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dbt75" podUID="196cbfc1-efdb-48ef-a5ec-f99c27f2e289" Aug 05 17:23:48.764773 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:48.764485 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jrks" podUID="fefd4a72-b897-4f18-a3f2-eacedc50bfce" Aug 05 17:23:49.764260 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:49.764214 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmchc" Aug 05 17:23:49.764736 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:49.764374 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmchc" podUID="e79bda8c-75ee-4022-a816-f55a58cec6c0" Aug 05 17:23:50.373643 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:50.373596 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e79bda8c-75ee-4022-a816-f55a58cec6c0-metrics-certs\") pod \"network-metrics-daemon-dmchc\" (UID: \"e79bda8c-75ee-4022-a816-f55a58cec6c0\") " pod="openshift-multus/network-metrics-daemon-dmchc" Aug 05 17:23:50.373827 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:50.373741 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:23:50.373827 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:50.373813 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e79bda8c-75ee-4022-a816-f55a58cec6c0-metrics-certs podName:e79bda8c-75ee-4022-a816-f55a58cec6c0 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:06.373793988 +0000 UTC m=+34.141174202 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e79bda8c-75ee-4022-a816-f55a58cec6c0-metrics-certs") pod "network-metrics-daemon-dmchc" (UID: "e79bda8c-75ee-4022-a816-f55a58cec6c0") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:23:50.474120 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:50.474082 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/196cbfc1-efdb-48ef-a5ec-f99c27f2e289-original-pull-secret\") pod \"global-pull-secret-syncer-dbt75\" (UID: \"196cbfc1-efdb-48ef-a5ec-f99c27f2e289\") " pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:23:50.474288 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:50.474248 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 17:23:50.474328 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:50.474312 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/196cbfc1-efdb-48ef-a5ec-f99c27f2e289-original-pull-secret podName:196cbfc1-efdb-48ef-a5ec-f99c27f2e289 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:06.474296621 +0000 UTC m=+34.241676837 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/196cbfc1-efdb-48ef-a5ec-f99c27f2e289-original-pull-secret") pod "global-pull-secret-syncer-dbt75" (UID: "196cbfc1-efdb-48ef-a5ec-f99c27f2e289") : object "kube-system"/"original-pull-secret" not registered Aug 05 17:23:50.575187 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:50.575131 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9ztk\" (UniqueName: \"kubernetes.io/projected/fefd4a72-b897-4f18-a3f2-eacedc50bfce-kube-api-access-z9ztk\") pod \"network-check-target-4jrks\" (UID: \"fefd4a72-b897-4f18-a3f2-eacedc50bfce\") " pod="openshift-network-diagnostics/network-check-target-4jrks" Aug 05 17:23:50.575385 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:50.575323 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 17:23:50.575385 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:50.575349 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 17:23:50.575385 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:50.575363 2579 projected.go:196] Error preparing data for projected volume kube-api-access-z9ztk for pod openshift-network-diagnostics/network-check-target-4jrks: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:23:50.575592 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:50.575434 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fefd4a72-b897-4f18-a3f2-eacedc50bfce-kube-api-access-z9ztk podName:fefd4a72-b897-4f18-a3f2-eacedc50bfce nodeName:}" failed. No retries permitted until 2026-08-05 17:24:06.57541385 +0000 UTC m=+34.342794120 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-z9ztk" (UniqueName: "kubernetes.io/projected/fefd4a72-b897-4f18-a3f2-eacedc50bfce-kube-api-access-z9ztk") pod "network-check-target-4jrks" (UID: "fefd4a72-b897-4f18-a3f2-eacedc50bfce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:23:50.764337 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:50.764245 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jrks" Aug 05 17:23:50.764337 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:50.764266 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:23:50.764833 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:50.764375 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jrks" podUID="fefd4a72-b897-4f18-a3f2-eacedc50bfce" Aug 05 17:23:50.764833 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:50.764510 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dbt75" podUID="196cbfc1-efdb-48ef-a5ec-f99c27f2e289" Aug 05 17:23:51.763672 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:51.763641 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmchc" Aug 05 17:23:51.763847 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:51.763772 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmchc" podUID="e79bda8c-75ee-4022-a816-f55a58cec6c0" Aug 05 17:23:52.765192 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:52.765163 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jrks" Aug 05 17:23:52.765650 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:52.765270 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jrks" podUID="fefd4a72-b897-4f18-a3f2-eacedc50bfce" Aug 05 17:23:52.765650 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:52.765327 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:23:52.765650 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:52.765432 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dbt75" podUID="196cbfc1-efdb-48ef-a5ec-f99c27f2e289" Aug 05 17:23:53.764369 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:53.764336 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmchc" Aug 05 17:23:53.764556 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:53.764463 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmchc" podUID="e79bda8c-75ee-4022-a816-f55a58cec6c0" Aug 05 17:23:54.764742 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:54.764664 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:23:54.765210 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:54.764798 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dbt75" podUID="196cbfc1-efdb-48ef-a5ec-f99c27f2e289" Aug 05 17:23:54.765210 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:54.764861 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jrks" Aug 05 17:23:54.765210 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:54.764975 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jrks" podUID="fefd4a72-b897-4f18-a3f2-eacedc50bfce" Aug 05 17:23:55.764606 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:55.764313 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmchc" Aug 05 17:23:55.764787 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:55.764688 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmchc" podUID="e79bda8c-75ee-4022-a816-f55a58cec6c0" Aug 05 17:23:55.986353 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:55.986316 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p84kb" event={"ID":"2e6224d3-5fb6-4c8f-962b-c5864610b153","Type":"ContainerStarted","Data":"b9577e365c537af754423acfe723d0002b8d2abe1dacb115251bb7c1b9fb04dd"} Aug 05 17:23:55.987745 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:55.987716 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6wt47" event={"ID":"453d1073-3d90-4861-81d5-2c88980b98ed","Type":"ContainerStarted","Data":"e97d60095fb49f6321da5f5d9482aba9950e0f1f5655a2f24ab47544e4f92c18"} Aug 05 17:23:55.989120 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:55.989087 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-67llw" event={"ID":"26e6b157-bbde-4981-b1a8-e3665e69e83c","Type":"ContainerStarted","Data":"73d3a03b66fe7026eb86c268aff33461de5b808962920e743d27d24d98e7962c"} Aug 05 17:23:55.992013 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:55.991986 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" event={"ID":"5f5b9f8c-f284-4181-b324-8807188e1f06","Type":"ContainerStarted","Data":"8eaa095892b8188032b3813ed5d0e9d965b7fea8f840249824926eff3c407c39"} Aug 05 17:23:55.992114 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:55.992061 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" event={"ID":"5f5b9f8c-f284-4181-b324-8807188e1f06","Type":"ContainerStarted","Data":"cb3c90eae483554d29bb47f46dbf76da3e0b4a521dab16a26cc6110bd9ea50f4"} Aug 05 17:23:55.992181 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:55.992114 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" event={"ID":"5f5b9f8c-f284-4181-b324-8807188e1f06","Type":"ContainerStarted","Data":"e14c67e0e9bc93f74522911135ecf219352d286bca6de7113d2b2c9e3fff6505"} Aug 05 17:23:55.992226 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:55.992179 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" event={"ID":"5f5b9f8c-f284-4181-b324-8807188e1f06","Type":"ContainerStarted","Data":"d8235bdb87d7d3f3108ab20dac7d09e601cf3726f9fd304bde2dff1941c75b01"} Aug 05 17:23:55.992271 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:55.992227 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" event={"ID":"5f5b9f8c-f284-4181-b324-8807188e1f06","Type":"ContainerStarted","Data":"ffe8376ba54b0665197d2e78169bc14e287ef604863f7708c428cf2ad217a793"} Aug 05 17:23:55.992271 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:55.992262 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" event={"ID":"5f5b9f8c-f284-4181-b324-8807188e1f06","Type":"ContainerStarted","Data":"e5b350e50434461d94fe34f90c4e508dc86eabdaa034addca2b8674f190d63cc"} Aug 05 17:23:55.993437 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:55.993407 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvhgt" event={"ID":"61f78cea-8609-4a39-b274-5b47714d6d79","Type":"ContainerStarted","Data":"0262261f77a8974c45fcd001356bc1d3db3454535a14d7fd2ec055500591e947"} Aug 05 17:23:55.994942 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:55.994915 2579 generic.go:356] "Generic (PLEG): container finished" podID="14ecac34-eb47-4daa-85f4-d64dcb1a116b" containerID="98dabcd9d0356cd2de633ff308b73f802c7ba9167c911166cf7d2b159b3fbece" exitCode=0 Aug 05 17:23:55.995030 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:55.994990 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnz8f" event={"ID":"14ecac34-eb47-4daa-85f4-d64dcb1a116b","Type":"ContainerDied","Data":"98dabcd9d0356cd2de633ff308b73f802c7ba9167c911166cf7d2b159b3fbece"} Aug 05 17:23:55.996625 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:55.996601 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2dhgr" event={"ID":"dfa0d5d1-b355-44cc-abf9-124e11c44d6b","Type":"ContainerStarted","Data":"2f9d2427a0c07cd432271c588cbe30ef61cf0066d63d09744bc17ab708ddd059"} Aug 05 17:23:55.998220 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:55.998201 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" event={"ID":"b311580b-d846-4d7f-ac07-7c28d32f2a8e","Type":"ContainerStarted","Data":"f108583870e23b6772c282742956ce6e593de007c526c364e52327176f3771f2"} Aug 05 17:23:56.005342 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:56.005307 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-p84kb" podStartSLOduration=3.97573804 podStartE2EDuration="23.005296081s" totalImagesPullingTime="19.029558041s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:23:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:23:56.005054291 +0000 UTC m=+23.772434537" watchObservedRunningTime="2026-08-05 17:23:56.005296081 +0000 UTC m=+23.772676313" Aug 05 17:23:56.019852 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:56.019808 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6wt47" podStartSLOduration=4.044884533 podStartE2EDuration="23.019790121s" totalImagesPullingTime="18.974905588s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:23:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:23:56.019320811 +0000 UTC m=+23.786701044" watchObservedRunningTime="2026-08-05 17:23:56.019790121 +0000 UTC m=+23.787170357" Aug 05 17:23:56.055721 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:56.055677 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2dhgr" podStartSLOduration=4.069313195 podStartE2EDuration="23.055660988s" totalImagesPullingTime="18.986347793s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:23:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:23:56.039507206 +0000 UTC m=+23.806887439" watchObservedRunningTime="2026-08-05 17:23:56.055660988 +0000 UTC m=+23.823041221" Aug 05 17:23:56.079650 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:56.079594 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-67llw" podStartSLOduration=11.865116689 podStartE2EDuration="23.079578093s" totalImagesPullingTime="11.214461404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:23:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:23:56.055445242 +0000 UTC m=+23.822825500" watchObservedRunningTime="2026-08-05 17:23:56.079578093 +0000 UTC m=+23.846958326" Aug 05 17:23:56.101972 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:56.101925 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-b8hsg" podStartSLOduration=4.094571439 podStartE2EDuration="23.101913665s" totalImagesPullingTime="19.007342226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:23:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:23:56.101738626 +0000 UTC m=+23.869118860" watchObservedRunningTime="2026-08-05 17:23:56.101913665 +0000 UTC m=+23.869293899" Aug 05 17:23:56.764614 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:56.764568 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:23:56.765284 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:56.764687 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dbt75" podUID="196cbfc1-efdb-48ef-a5ec-f99c27f2e289" Aug 05 17:23:56.765284 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:56.764775 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jrks" Aug 05 17:23:56.765284 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:56.764886 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jrks" podUID="fefd4a72-b897-4f18-a3f2-eacedc50bfce" Aug 05 17:23:56.768756 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:56.768736 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Aug 05 17:23:57.002606 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:57.002521 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hxbq4" event={"ID":"172a3e18-e569-486b-8ddb-399586a67407","Type":"ContainerStarted","Data":"f2322cf7fe5877d4495632a0509383cb05485a337670d88615d67380d55b9458"} Aug 05 17:23:57.004958 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:57.004872 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvhgt" event={"ID":"61f78cea-8609-4a39-b274-5b47714d6d79","Type":"ContainerStarted","Data":"cf7da51592f843621d9f4835589407705176003d03d5dc3e0e93488acfa51bb6"} Aug 05 17:23:57.019096 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:57.019049 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hxbq4" podStartSLOduration=5.042725101 podStartE2EDuration="24.019033948s" totalImagesPullingTime="18.976308847s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:23:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:23:57.018923435 +0000 UTC m=+24.786303669" watchObservedRunningTime="2026-08-05 17:23:57.019033948 +0000 UTC m=+24.786414181" Aug 05 17:23:57.285003 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:57.284908 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-67llw" Aug 05 17:23:57.285688 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:57.285661 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-67llw" Aug 05 17:23:57.697452 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:57.697279 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-05T17:23:56.768751229Z","UUID":"817b20bb-25b6-4d1e-b95f-3b86a8d55632","Handler":null,"Name":"","Endpoint":""} Aug 05 17:23:57.699360 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:57.699341 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Aug 05 17:23:57.699467 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:57.699382 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Aug 05 17:23:57.764209 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:57.764181 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmchc" Aug 05 17:23:57.764353 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:57.764322 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmchc" podUID="e79bda8c-75ee-4022-a816-f55a58cec6c0" Aug 05 17:23:58.012112 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:58.012019 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" event={"ID":"5f5b9f8c-f284-4181-b324-8807188e1f06","Type":"ContainerStarted","Data":"b5ba465e0367d021b29d63b5e5f824066fca3e8476aa4d27563310a7abe83cbc"} Aug 05 17:23:58.012586 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:58.012378 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-67llw" Aug 05 17:23:58.012837 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:58.012816 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-67llw" Aug 05 17:23:58.764023 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:58.763992 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jrks" Aug 05 17:23:58.764232 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:58.763997 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:23:58.764232 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:58.764128 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jrks" podUID="fefd4a72-b897-4f18-a3f2-eacedc50bfce" Aug 05 17:23:58.764232 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:58.764210 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dbt75" podUID="196cbfc1-efdb-48ef-a5ec-f99c27f2e289" Aug 05 17:23:59.016480 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:59.016389 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvhgt" event={"ID":"61f78cea-8609-4a39-b274-5b47714d6d79","Type":"ContainerStarted","Data":"fd36758355642a0d0ce1eb2e3aab41edfd5fee3180154257f238a1d71f59b2dd"} Aug 05 17:23:59.037575 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:59.037530 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lvhgt" podStartSLOduration=4.550948519 podStartE2EDuration="26.037512213s" totalImagesPullingTime="21.486563694s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:23:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:23:59.036973895 +0000 UTC m=+26.804354132" watchObservedRunningTime="2026-08-05 17:23:59.037512213 +0000 UTC m=+26.804892445" Aug 05 17:23:59.764104 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:23:59.764056 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmchc" Aug 05 17:23:59.764297 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:23:59.764201 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmchc" podUID="e79bda8c-75ee-4022-a816-f55a58cec6c0" Aug 05 17:24:00.764320 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:00.764067 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jrks" Aug 05 17:24:00.764320 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:00.764111 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:24:00.765257 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:00.764365 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jrks" podUID="fefd4a72-b897-4f18-a3f2-eacedc50bfce" Aug 05 17:24:00.765257 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:00.764472 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dbt75" podUID="196cbfc1-efdb-48ef-a5ec-f99c27f2e289" Aug 05 17:24:01.024586 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:01.024492 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" event={"ID":"5f5b9f8c-f284-4181-b324-8807188e1f06","Type":"ContainerStarted","Data":"f48b2a5e0d8fa38921bcc2baacab023545d5395db410eff1257ad6886e80b920"} Aug 05 17:24:01.024808 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:01.024793 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:24:01.024897 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:01.024859 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:24:01.024955 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:01.024909 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:24:01.026548 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:01.026520 2579 generic.go:356] "Generic (PLEG): container finished" podID="14ecac34-eb47-4daa-85f4-d64dcb1a116b" containerID="2a650e9ccbecf2b078de5c4a910ab8e6ec2efeaec3c7f68a442492ad6aef3578" exitCode=0 Aug 05 17:24:01.026673 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:01.026564 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnz8f" event={"ID":"14ecac34-eb47-4daa-85f4-d64dcb1a116b","Type":"ContainerDied","Data":"2a650e9ccbecf2b078de5c4a910ab8e6ec2efeaec3c7f68a442492ad6aef3578"} Aug 05 17:24:01.041353 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:01.041330 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:24:01.041460 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:01.041426 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:24:01.052504 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:01.052464 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" podStartSLOduration=9.010351814 podStartE2EDuration="28.052448152s" totalImagesPullingTime="19.042096338s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:23:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:01.052366336 +0000 UTC m=+28.819746568" watchObservedRunningTime="2026-08-05 17:24:01.052448152 +0000 UTC m=+28.819828385" Aug 05 17:24:01.764248 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:01.763997 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmchc" Aug 05 17:24:01.764531 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:01.764383 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmchc" podUID="e79bda8c-75ee-4022-a816-f55a58cec6c0" Aug 05 17:24:02.031167 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:02.031050 2579 generic.go:356] "Generic (PLEG): container finished" podID="14ecac34-eb47-4daa-85f4-d64dcb1a116b" containerID="580adf584b71a4dfc04d297f92db042b2c922609901238936b7065a6aa0cd18a" exitCode=0 Aug 05 17:24:02.031167 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:02.031150 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnz8f" event={"ID":"14ecac34-eb47-4daa-85f4-d64dcb1a116b","Type":"ContainerDied","Data":"580adf584b71a4dfc04d297f92db042b2c922609901238936b7065a6aa0cd18a"} Aug 05 17:24:02.133490 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:02.133457 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dmchc"] Aug 05 17:24:02.133648 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:02.133600 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmchc" Aug 05 17:24:02.133721 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:02.133701 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmchc" podUID="e79bda8c-75ee-4022-a816-f55a58cec6c0" Aug 05 17:24:02.136753 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:02.136731 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4jrks"] Aug 05 17:24:02.136873 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:02.136824 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jrks" Aug 05 17:24:02.136916 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:02.136895 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jrks" podUID="fefd4a72-b897-4f18-a3f2-eacedc50bfce" Aug 05 17:24:02.148684 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:02.148659 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dbt75"] Aug 05 17:24:02.148789 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:02.148757 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:24:02.148854 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:02.148837 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dbt75" podUID="196cbfc1-efdb-48ef-a5ec-f99c27f2e289" Aug 05 17:24:03.763654 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:03.763621 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:24:03.764095 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:03.763721 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmchc" Aug 05 17:24:03.764095 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:03.763725 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dbt75" podUID="196cbfc1-efdb-48ef-a5ec-f99c27f2e289" Aug 05 17:24:03.764095 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:03.763725 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jrks" Aug 05 17:24:03.764095 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:03.763890 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmchc" podUID="e79bda8c-75ee-4022-a816-f55a58cec6c0" Aug 05 17:24:03.764095 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:03.763935 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jrks" podUID="fefd4a72-b897-4f18-a3f2-eacedc50bfce" Aug 05 17:24:04.038468 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:04.038380 2579 generic.go:356] "Generic (PLEG): container finished" podID="14ecac34-eb47-4daa-85f4-d64dcb1a116b" containerID="1bd2535857f95d0adc3f5a352cf9a1f9ae7990e758b2953cbed509290921ea66" exitCode=0 Aug 05 17:24:04.038468 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:04.038427 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnz8f" event={"ID":"14ecac34-eb47-4daa-85f4-d64dcb1a116b","Type":"ContainerDied","Data":"1bd2535857f95d0adc3f5a352cf9a1f9ae7990e758b2953cbed509290921ea66"} Aug 05 17:24:05.763797 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:05.763762 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:24:05.764269 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:05.763803 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmchc" Aug 05 17:24:05.764269 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:05.763878 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jrks" Aug 05 17:24:05.764269 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:05.763894 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dbt75" podUID="196cbfc1-efdb-48ef-a5ec-f99c27f2e289" Aug 05 17:24:05.764269 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:05.763984 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jrks" podUID="fefd4a72-b897-4f18-a3f2-eacedc50bfce" Aug 05 17:24:05.764269 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:05.764085 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmchc" podUID="e79bda8c-75ee-4022-a816-f55a58cec6c0" Aug 05 17:24:06.400650 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:06.400615 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e79bda8c-75ee-4022-a816-f55a58cec6c0-metrics-certs\") pod \"network-metrics-daemon-dmchc\" (UID: \"e79bda8c-75ee-4022-a816-f55a58cec6c0\") " pod="openshift-multus/network-metrics-daemon-dmchc" Aug 05 17:24:06.400853 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:06.400757 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:24:06.400853 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:06.400824 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e79bda8c-75ee-4022-a816-f55a58cec6c0-metrics-certs podName:e79bda8c-75ee-4022-a816-f55a58cec6c0 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:38.400806121 +0000 UTC m=+66.168186351 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e79bda8c-75ee-4022-a816-f55a58cec6c0-metrics-certs") pod "network-metrics-daemon-dmchc" (UID: "e79bda8c-75ee-4022-a816-f55a58cec6c0") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:24:06.501356 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:06.501320 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/196cbfc1-efdb-48ef-a5ec-f99c27f2e289-original-pull-secret\") pod \"global-pull-secret-syncer-dbt75\" (UID: \"196cbfc1-efdb-48ef-a5ec-f99c27f2e289\") " pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:24:06.501521 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:06.501439 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 17:24:06.501521 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:06.501508 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/196cbfc1-efdb-48ef-a5ec-f99c27f2e289-original-pull-secret podName:196cbfc1-efdb-48ef-a5ec-f99c27f2e289 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:38.501489697 +0000 UTC m=+66.268869909 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/196cbfc1-efdb-48ef-a5ec-f99c27f2e289-original-pull-secret") pod "global-pull-secret-syncer-dbt75" (UID: "196cbfc1-efdb-48ef-a5ec-f99c27f2e289") : object "kube-system"/"original-pull-secret" not registered Aug 05 17:24:06.601946 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:06.601901 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9ztk\" (UniqueName: \"kubernetes.io/projected/fefd4a72-b897-4f18-a3f2-eacedc50bfce-kube-api-access-z9ztk\") pod \"network-check-target-4jrks\" (UID: \"fefd4a72-b897-4f18-a3f2-eacedc50bfce\") " pod="openshift-network-diagnostics/network-check-target-4jrks" Aug 05 17:24:06.602123 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:06.602107 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 17:24:06.602196 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:06.602131 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 17:24:06.602196 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:06.602158 2579 projected.go:196] Error preparing data for projected volume kube-api-access-z9ztk for pod openshift-network-diagnostics/network-check-target-4jrks: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:24:06.602271 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:06.602234 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fefd4a72-b897-4f18-a3f2-eacedc50bfce-kube-api-access-z9ztk podName:fefd4a72-b897-4f18-a3f2-eacedc50bfce nodeName:}" failed. No retries permitted until 2026-08-05 17:24:38.602212171 +0000 UTC m=+66.369592402 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-z9ztk" (UniqueName: "kubernetes.io/projected/fefd4a72-b897-4f18-a3f2-eacedc50bfce-kube-api-access-z9ztk") pod "network-check-target-4jrks" (UID: "fefd4a72-b897-4f18-a3f2-eacedc50bfce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:24:07.763957 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:07.763872 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:24:07.764430 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:07.763888 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmchc" Aug 05 17:24:07.764430 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:07.764023 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dbt75" podUID="196cbfc1-efdb-48ef-a5ec-f99c27f2e289" Aug 05 17:24:07.764430 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:07.763896 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jrks" Aug 05 17:24:07.764430 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:07.764101 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dmchc" podUID="e79bda8c-75ee-4022-a816-f55a58cec6c0" Aug 05 17:24:07.764430 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:07.764167 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4jrks" podUID="fefd4a72-b897-4f18-a3f2-eacedc50bfce" Aug 05 17:24:08.032369 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.032293 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-250.ec2.internal" event="NodeReady" Aug 05 17:24:08.032507 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.032450 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Aug 05 17:24:08.068703 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.068668 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5966949c47-qg79w"] Aug 05 17:24:08.071287 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.071256 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:24:08.075598 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.075569 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Aug 05 17:24:08.076289 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.076025 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Aug 05 17:24:08.076289 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.076121 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kkcjr\"" Aug 05 17:24:08.076463 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.076296 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Aug 05 17:24:08.082620 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.082598 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Aug 05 17:24:08.082928 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.082914 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9z24f"] Aug 05 17:24:08.085575 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.085389 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rd22r"] Aug 05 17:24:08.085666 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.085523 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9z24f" Aug 05 17:24:08.087263 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.087241 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5966949c47-qg79w"] Aug 05 17:24:08.087350 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.087339 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rd22r" Aug 05 17:24:08.089371 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.089352 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Aug 05 17:24:08.089474 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.089353 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xx7n6\"" Aug 05 17:24:08.089474 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.089387 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Aug 05 17:24:08.089881 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.089863 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Aug 05 17:24:08.089967 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.089916 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jfmbw\"" Aug 05 17:24:08.090092 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.090078 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Aug 05 17:24:08.090354 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.090341 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Aug 05 17:24:08.095801 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.095783 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9z24f"] Aug 05 17:24:08.100665 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.100367 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rd22r"] Aug 05 17:24:08.216263 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.216232 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/373295e7-1a34-48dc-87f0-c64e319eb1e1-trusted-ca\") pod \"image-registry-5966949c47-qg79w\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:24:08.216382 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.216304 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3d48c235-6230-45af-8726-39db507d6fa3-config-volume\") pod \"dns-default-9z24f\" (UID: \"3d48c235-6230-45af-8726-39db507d6fa3\") " pod="openshift-dns/dns-default-9z24f" Aug 05 17:24:08.216453 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.216379 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-bound-sa-token\") pod \"image-registry-5966949c47-qg79w\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:24:08.216453 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.216398 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d48c235-6230-45af-8726-39db507d6fa3-tmp-dir\") pod \"dns-default-9z24f\" (UID: \"3d48c235-6230-45af-8726-39db507d6fa3\") " pod="openshift-dns/dns-default-9z24f" Aug 05 17:24:08.216453 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.216416 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlq9t\" (UniqueName: \"kubernetes.io/projected/3d48c235-6230-45af-8726-39db507d6fa3-kube-api-access-hlq9t\") pod \"dns-default-9z24f\" (UID: \"3d48c235-6230-45af-8726-39db507d6fa3\") " pod="openshift-dns/dns-default-9z24f" Aug 05 17:24:08.216453 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.216438 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk7sx\" (UniqueName: \"kubernetes.io/projected/67501f22-9897-4528-a8d0-4e55e82e41e0-kube-api-access-rk7sx\") pod \"ingress-canary-rd22r\" (UID: \"67501f22-9897-4528-a8d0-4e55e82e41e0\") " pod="openshift-ingress-canary/ingress-canary-rd22r" Aug 05 17:24:08.216611 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.216495 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwhn4\" (UniqueName: \"kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-kube-api-access-zwhn4\") pod \"image-registry-5966949c47-qg79w\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:24:08.216611 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.216539 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/373295e7-1a34-48dc-87f0-c64e319eb1e1-ca-trust-extracted\") pod \"image-registry-5966949c47-qg79w\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:24:08.216611 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.216558 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d48c235-6230-45af-8726-39db507d6fa3-metrics-tls\") pod \"dns-default-9z24f\" (UID: \"3d48c235-6230-45af-8726-39db507d6fa3\") " pod="openshift-dns/dns-default-9z24f" Aug 05 17:24:08.216611 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.216574 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67501f22-9897-4528-a8d0-4e55e82e41e0-cert\") pod \"ingress-canary-rd22r\" (UID: \"67501f22-9897-4528-a8d0-4e55e82e41e0\") " pod="openshift-ingress-canary/ingress-canary-rd22r" Aug 05 17:24:08.216801 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.216643 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/373295e7-1a34-48dc-87f0-c64e319eb1e1-installation-pull-secrets\") pod \"image-registry-5966949c47-qg79w\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:24:08.216801 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.216693 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-registry-tls\") pod \"image-registry-5966949c47-qg79w\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:24:08.216801 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.216741 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/373295e7-1a34-48dc-87f0-c64e319eb1e1-image-registry-private-configuration\") pod \"image-registry-5966949c47-qg79w\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:24:08.216801 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.216776 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/373295e7-1a34-48dc-87f0-c64e319eb1e1-registry-certificates\") pod \"image-registry-5966949c47-qg79w\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:24:08.227540 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.227507 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:08.317794 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.317712 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/373295e7-1a34-48dc-87f0-c64e319eb1e1-trusted-ca\") pod \"image-registry-5966949c47-qg79w\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:24:08.317794 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.317748 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3d48c235-6230-45af-8726-39db507d6fa3-config-volume\") pod \"dns-default-9z24f\" (UID: \"3d48c235-6230-45af-8726-39db507d6fa3\") " pod="openshift-dns/dns-default-9z24f" Aug 05 17:24:08.317794 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.317773 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-bound-sa-token\") pod \"image-registry-5966949c47-qg79w\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:24:08.317794 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.317789 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d48c235-6230-45af-8726-39db507d6fa3-tmp-dir\") pod \"dns-default-9z24f\" (UID: \"3d48c235-6230-45af-8726-39db507d6fa3\") " pod="openshift-dns/dns-default-9z24f" Aug 05 17:24:08.318113 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.317911 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlq9t\" (UniqueName: \"kubernetes.io/projected/3d48c235-6230-45af-8726-39db507d6fa3-kube-api-access-hlq9t\") pod \"dns-default-9z24f\" (UID: \"3d48c235-6230-45af-8726-39db507d6fa3\") " pod="openshift-dns/dns-default-9z24f" Aug 05 17:24:08.318113 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.317950 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk7sx\" (UniqueName: \"kubernetes.io/projected/67501f22-9897-4528-a8d0-4e55e82e41e0-kube-api-access-rk7sx\") pod \"ingress-canary-rd22r\" (UID: \"67501f22-9897-4528-a8d0-4e55e82e41e0\") " pod="openshift-ingress-canary/ingress-canary-rd22r" Aug 05 17:24:08.318113 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.317983 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwhn4\" (UniqueName: \"kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-kube-api-access-zwhn4\") pod \"image-registry-5966949c47-qg79w\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:24:08.318113 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.318030 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/373295e7-1a34-48dc-87f0-c64e319eb1e1-ca-trust-extracted\") pod \"image-registry-5966949c47-qg79w\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:24:08.318113 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.318055 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d48c235-6230-45af-8726-39db507d6fa3-metrics-tls\") pod \"dns-default-9z24f\" (UID: \"3d48c235-6230-45af-8726-39db507d6fa3\") " pod="openshift-dns/dns-default-9z24f" Aug 05 17:24:08.318113 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.318083 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67501f22-9897-4528-a8d0-4e55e82e41e0-cert\") pod \"ingress-canary-rd22r\" (UID: \"67501f22-9897-4528-a8d0-4e55e82e41e0\") " pod="openshift-ingress-canary/ingress-canary-rd22r" Aug 05 17:24:08.318423 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.318135 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/373295e7-1a34-48dc-87f0-c64e319eb1e1-installation-pull-secrets\") pod \"image-registry-5966949c47-qg79w\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:24:08.318423 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.318202 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-registry-tls\") pod \"image-registry-5966949c47-qg79w\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:24:08.318423 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:08.318233 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 17:24:08.318423 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.318243 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/373295e7-1a34-48dc-87f0-c64e319eb1e1-image-registry-private-configuration\") pod \"image-registry-5966949c47-qg79w\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:24:08.318423 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.318274 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/373295e7-1a34-48dc-87f0-c64e319eb1e1-registry-certificates\") pod \"image-registry-5966949c47-qg79w\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:24:08.318423 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:08.318309 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d48c235-6230-45af-8726-39db507d6fa3-metrics-tls podName:3d48c235-6230-45af-8726-39db507d6fa3 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:08.818288572 +0000 UTC m=+36.585668798 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d48c235-6230-45af-8726-39db507d6fa3-metrics-tls") pod "dns-default-9z24f" (UID: "3d48c235-6230-45af-8726-39db507d6fa3") : secret "dns-default-metrics-tls" not found Aug 05 17:24:08.318723 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.318516 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/373295e7-1a34-48dc-87f0-c64e319eb1e1-ca-trust-extracted\") pod \"image-registry-5966949c47-qg79w\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:24:08.318723 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:08.318529 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 05 17:24:08.318723 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:08.318544 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5966949c47-qg79w: secret "image-registry-tls" not found Aug 05 17:24:08.318723 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:08.318589 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-registry-tls podName:373295e7-1a34-48dc-87f0-c64e319eb1e1 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:08.818573966 +0000 UTC m=+36.585954196 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-registry-tls") pod "image-registry-5966949c47-qg79w" (UID: "373295e7-1a34-48dc-87f0-c64e319eb1e1") : secret "image-registry-tls" not found Aug 05 17:24:08.318902 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.318726 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3d48c235-6230-45af-8726-39db507d6fa3-config-volume\") pod \"dns-default-9z24f\" (UID: \"3d48c235-6230-45af-8726-39db507d6fa3\") " pod="openshift-dns/dns-default-9z24f" Aug 05 17:24:08.318902 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.318813 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/373295e7-1a34-48dc-87f0-c64e319eb1e1-registry-certificates\") pod \"image-registry-5966949c47-qg79w\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:24:08.318902 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.318881 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d48c235-6230-45af-8726-39db507d6fa3-tmp-dir\") pod \"dns-default-9z24f\" (UID: \"3d48c235-6230-45af-8726-39db507d6fa3\") " pod="openshift-dns/dns-default-9z24f" Aug 05 17:24:08.319048 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.318978 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/373295e7-1a34-48dc-87f0-c64e319eb1e1-trusted-ca\") pod \"image-registry-5966949c47-qg79w\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:24:08.322106 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.322077 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/373295e7-1a34-48dc-87f0-c64e319eb1e1-image-registry-private-configuration\") pod \"image-registry-5966949c47-qg79w\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:24:08.322248 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.322168 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67501f22-9897-4528-a8d0-4e55e82e41e0-cert\") pod \"ingress-canary-rd22r\" (UID: \"67501f22-9897-4528-a8d0-4e55e82e41e0\") " pod="openshift-ingress-canary/ingress-canary-rd22r" Aug 05 17:24:08.322248 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.322180 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/373295e7-1a34-48dc-87f0-c64e319eb1e1-installation-pull-secrets\") pod \"image-registry-5966949c47-qg79w\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:24:08.327438 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.327413 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk7sx\" (UniqueName: \"kubernetes.io/projected/67501f22-9897-4528-a8d0-4e55e82e41e0-kube-api-access-rk7sx\") pod \"ingress-canary-rd22r\" (UID: \"67501f22-9897-4528-a8d0-4e55e82e41e0\") " pod="openshift-ingress-canary/ingress-canary-rd22r" Aug 05 17:24:08.327676 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.327656 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-bound-sa-token\") pod \"image-registry-5966949c47-qg79w\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:24:08.328200 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.328172 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlq9t\" (UniqueName: \"kubernetes.io/projected/3d48c235-6230-45af-8726-39db507d6fa3-kube-api-access-hlq9t\") pod \"dns-default-9z24f\" (UID: \"3d48c235-6230-45af-8726-39db507d6fa3\") " pod="openshift-dns/dns-default-9z24f" Aug 05 17:24:08.328394 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.328375 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwhn4\" (UniqueName: \"kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-kube-api-access-zwhn4\") pod \"image-registry-5966949c47-qg79w\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:24:08.426547 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.426512 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rd22r" Aug 05 17:24:08.563913 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.563881 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rd22r"] Aug 05 17:24:08.567701 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:24:08.567676 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67501f22_9897_4528_a8d0_4e55e82e41e0.slice/crio-f72d995ad3bad34eb38b680e4cec3741f432ed9056412a1ec20a5a034c0a1467 WatchSource:0}: Error finding container f72d995ad3bad34eb38b680e4cec3741f432ed9056412a1ec20a5a034c0a1467: Status 404 returned error can't find the container with id f72d995ad3bad34eb38b680e4cec3741f432ed9056412a1ec20a5a034c0a1467 Aug 05 17:24:08.821842 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.821749 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d48c235-6230-45af-8726-39db507d6fa3-metrics-tls\") pod \"dns-default-9z24f\" (UID: \"3d48c235-6230-45af-8726-39db507d6fa3\") " pod="openshift-dns/dns-default-9z24f" Aug 05 17:24:08.821842 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:08.821803 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-registry-tls\") pod \"image-registry-5966949c47-qg79w\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:24:08.822603 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:08.821924 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 17:24:08.822603 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:08.821982 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 05 17:24:08.822603 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:08.821988 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d48c235-6230-45af-8726-39db507d6fa3-metrics-tls podName:3d48c235-6230-45af-8726-39db507d6fa3 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:09.821971462 +0000 UTC m=+37.589351679 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d48c235-6230-45af-8726-39db507d6fa3-metrics-tls") pod "dns-default-9z24f" (UID: "3d48c235-6230-45af-8726-39db507d6fa3") : secret "dns-default-metrics-tls" not found Aug 05 17:24:08.822603 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:08.821993 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5966949c47-qg79w: secret "image-registry-tls" not found Aug 05 17:24:08.822603 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:08.822042 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-registry-tls podName:373295e7-1a34-48dc-87f0-c64e319eb1e1 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:09.822030273 +0000 UTC m=+37.589410484 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-registry-tls") pod "image-registry-5966949c47-qg79w" (UID: "373295e7-1a34-48dc-87f0-c64e319eb1e1") : secret "image-registry-tls" not found Aug 05 17:24:09.054485 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:09.054439 2579 generic.go:356] "Generic (PLEG): container finished" podID="14ecac34-eb47-4daa-85f4-d64dcb1a116b" containerID="82042be41dd40b29c7ea38b2c604df49c6f544fdc1c8aab6947ef197711a58d2" exitCode=0 Aug 05 17:24:09.054648 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:09.054539 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnz8f" event={"ID":"14ecac34-eb47-4daa-85f4-d64dcb1a116b","Type":"ContainerDied","Data":"82042be41dd40b29c7ea38b2c604df49c6f544fdc1c8aab6947ef197711a58d2"} Aug 05 17:24:09.056524 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:09.056500 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rd22r" event={"ID":"67501f22-9897-4528-a8d0-4e55e82e41e0","Type":"ContainerStarted","Data":"f72d995ad3bad34eb38b680e4cec3741f432ed9056412a1ec20a5a034c0a1467"} Aug 05 17:24:09.590891 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:09.590716 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:09.690647 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:09.690611 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:09.763748 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:09.763705 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:24:09.763748 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:09.763734 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jrks" Aug 05 17:24:09.763748 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:09.763751 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmchc" Aug 05 17:24:09.768250 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:09.768228 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Aug 05 17:24:09.768394 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:09.768267 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5jc4t\"" Aug 05 17:24:09.768394 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:09.768352 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Aug 05 17:24:09.768394 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:09.768370 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Aug 05 17:24:09.768568 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:09.768547 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Aug 05 17:24:09.768619 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:09.768572 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jss2d\"" Aug 05 17:24:09.789851 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:09.789782 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:09.830635 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:09.830606 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d48c235-6230-45af-8726-39db507d6fa3-metrics-tls\") pod \"dns-default-9z24f\" (UID: \"3d48c235-6230-45af-8726-39db507d6fa3\") " pod="openshift-dns/dns-default-9z24f" Aug 05 17:24:09.831081 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:09.830672 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-registry-tls\") pod \"image-registry-5966949c47-qg79w\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:24:09.831081 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:09.830809 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 05 17:24:09.831081 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:09.830815 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 17:24:09.831081 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:09.830824 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5966949c47-qg79w: secret "image-registry-tls" not found Aug 05 17:24:09.831081 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:09.830882 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d48c235-6230-45af-8726-39db507d6fa3-metrics-tls podName:3d48c235-6230-45af-8726-39db507d6fa3 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:11.830862192 +0000 UTC m=+39.598242407 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d48c235-6230-45af-8726-39db507d6fa3-metrics-tls") pod "dns-default-9z24f" (UID: "3d48c235-6230-45af-8726-39db507d6fa3") : secret "dns-default-metrics-tls" not found Aug 05 17:24:09.831081 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:09.830922 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-registry-tls podName:373295e7-1a34-48dc-87f0-c64e319eb1e1 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:11.830905046 +0000 UTC m=+39.598285258 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-registry-tls") pod "image-registry-5966949c47-qg79w" (UID: "373295e7-1a34-48dc-87f0-c64e319eb1e1") : secret "image-registry-tls" not found Aug 05 17:24:09.891681 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:09.891588 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:09.991905 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:09.991870 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:10.062572 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:10.062537 2579 generic.go:356] "Generic (PLEG): container finished" podID="14ecac34-eb47-4daa-85f4-d64dcb1a116b" containerID="16a2a684654c7307cf65f2702e64c8adcaed09bc35a9709ecb2ca877b6c8b900" exitCode=0 Aug 05 17:24:10.062733 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:10.062595 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnz8f" event={"ID":"14ecac34-eb47-4daa-85f4-d64dcb1a116b","Type":"ContainerDied","Data":"16a2a684654c7307cf65f2702e64c8adcaed09bc35a9709ecb2ca877b6c8b900"} Aug 05 17:24:11.069080 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:11.069041 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hnz8f" event={"ID":"14ecac34-eb47-4daa-85f4-d64dcb1a116b","Type":"ContainerStarted","Data":"76d6940dad17aa8c5b70fb226acbaa010cb3833e7a674c22284b41d2b6aea36b"} Aug 05 17:24:11.070494 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:11.070472 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rd22r" event={"ID":"67501f22-9897-4528-a8d0-4e55e82e41e0","Type":"ContainerStarted","Data":"081382028adf738e6918108c96591816e8b7056e64a897dd88c592f3f1e3ef6b"} Aug 05 17:24:11.093856 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:11.093801 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hnz8f" podStartSLOduration=9.068363359 podStartE2EDuration="38.09378605s" totalImagesPullingTime="29.025422691s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:23:33 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:11.09188377 +0000 UTC m=+38.859264004" watchObservedRunningTime="2026-08-05 17:24:11.09378605 +0000 UTC m=+38.861166277" Aug 05 17:24:11.108258 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:11.108207 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rd22r" podStartSLOduration=0.840539933 podStartE2EDuration="3.108191131s" totalImagesPullingTime="2.267651198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:24:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:11.10759633 +0000 UTC m=+38.874976564" watchObservedRunningTime="2026-08-05 17:24:11.108191131 +0000 UTC m=+38.875571377" Aug 05 17:24:11.196477 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:11.196395 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:11.297311 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:11.297275 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:11.366860 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:11.366813 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:11.844409 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:11.844373 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d48c235-6230-45af-8726-39db507d6fa3-metrics-tls\") pod \"dns-default-9z24f\" (UID: \"3d48c235-6230-45af-8726-39db507d6fa3\") " pod="openshift-dns/dns-default-9z24f" Aug 05 17:24:11.844579 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:11.844429 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-registry-tls\") pod \"image-registry-5966949c47-qg79w\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:24:11.844579 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:11.844536 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 17:24:11.844656 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:11.844601 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d48c235-6230-45af-8726-39db507d6fa3-metrics-tls podName:3d48c235-6230-45af-8726-39db507d6fa3 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:15.844586159 +0000 UTC m=+43.611966375 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d48c235-6230-45af-8726-39db507d6fa3-metrics-tls") pod "dns-default-9z24f" (UID: "3d48c235-6230-45af-8726-39db507d6fa3") : secret "dns-default-metrics-tls" not found Aug 05 17:24:11.844656 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:11.844541 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 05 17:24:11.844656 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:11.844622 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5966949c47-qg79w: secret "image-registry-tls" not found Aug 05 17:24:11.844656 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:11.844648 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-registry-tls podName:373295e7-1a34-48dc-87f0-c64e319eb1e1 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:15.844641627 +0000 UTC m=+43.612021842 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-registry-tls") pod "image-registry-5966949c47-qg79w" (UID: "373295e7-1a34-48dc-87f0-c64e319eb1e1") : secret "image-registry-tls" not found Aug 05 17:24:11.909648 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:11.909612 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:12.288601 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:12.288565 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:12.362330 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:12.362294 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:13.360637 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:13.360601 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:13.444237 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:13.444201 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:13.500743 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:13.500708 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:15.873128 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:15.873087 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-registry-tls\") pod \"image-registry-5966949c47-qg79w\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:24:15.873534 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:15.873195 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d48c235-6230-45af-8726-39db507d6fa3-metrics-tls\") pod \"dns-default-9z24f\" (UID: \"3d48c235-6230-45af-8726-39db507d6fa3\") " pod="openshift-dns/dns-default-9z24f" Aug 05 17:24:15.873534 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:15.873250 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 05 17:24:15.873534 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:15.873274 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5966949c47-qg79w: secret "image-registry-tls" not found Aug 05 17:24:15.873534 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:15.873302 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 17:24:15.873534 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:15.873333 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-registry-tls podName:373295e7-1a34-48dc-87f0-c64e319eb1e1 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:23.873315297 +0000 UTC m=+51.640695509 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-registry-tls") pod "image-registry-5966949c47-qg79w" (UID: "373295e7-1a34-48dc-87f0-c64e319eb1e1") : secret "image-registry-tls" not found Aug 05 17:24:15.873534 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:15.873348 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d48c235-6230-45af-8726-39db507d6fa3-metrics-tls podName:3d48c235-6230-45af-8726-39db507d6fa3 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:23.873342092 +0000 UTC m=+51.640722304 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d48c235-6230-45af-8726-39db507d6fa3-metrics-tls") pod "dns-default-9z24f" (UID: "3d48c235-6230-45af-8726-39db507d6fa3") : secret "dns-default-metrics-tls" not found Aug 05 17:24:15.920063 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:15.920029 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-vgc4l"] Aug 05 17:24:15.959325 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:15.959293 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-52lff"] Aug 05 17:24:15.959474 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:15.959413 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-vgc4l" Aug 05 17:24:15.963558 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:15.963533 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-pkrt4\"" Aug 05 17:24:15.963695 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:15.963562 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Aug 05 17:24:15.965463 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:15.965444 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Aug 05 17:24:15.973531 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:15.973512 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5xnq\" (UniqueName: \"kubernetes.io/projected/63a97bae-532f-40f8-843e-00921bee6ab3-kube-api-access-v5xnq\") pod \"volume-data-source-validator-5b8776669-vgc4l\" (UID: \"63a97bae-532f-40f8-843e-00921bee6ab3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-vgc4l" Aug 05 17:24:15.974855 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:15.974841 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-vgc4l"] Aug 05 17:24:15.974915 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:15.974868 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-52lff"] Aug 05 17:24:15.974959 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:15.974946 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-52lff" Aug 05 17:24:15.977576 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:15.977559 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Aug 05 17:24:15.977675 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:15.977572 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Aug 05 17:24:15.977793 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:15.977778 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Aug 05 17:24:15.977854 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:15.977832 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-7lmwg\"" Aug 05 17:24:15.978305 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:15.978292 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Aug 05 17:24:16.029684 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.029642 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-5qdp4"] Aug 05 17:24:16.043121 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.043089 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-klw7f"] Aug 05 17:24:16.043329 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.043147 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-5qdp4" Aug 05 17:24:16.046518 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.046488 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Aug 05 17:24:16.046651 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.046493 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Aug 05 17:24:16.046651 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.046562 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Aug 05 17:24:16.047004 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.046962 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-mrnpz\"" Aug 05 17:24:16.047004 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.046965 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Aug 05 17:24:16.055880 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.055856 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5ddbb5b6b4-262r4"] Aug 05 17:24:16.056561 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.056534 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-klw7f" Aug 05 17:24:16.056931 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.056721 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Aug 05 17:24:16.059598 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.059578 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Aug 05 17:24:16.059954 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.059933 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Aug 05 17:24:16.060041 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.060024 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Aug 05 17:24:16.062514 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.062496 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-q484w\"" Aug 05 17:24:16.071247 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.071222 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-qndgm"] Aug 05 17:24:16.071455 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.071436 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" Aug 05 17:24:16.074102 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.074084 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e8e537f1-bb75-456e-973b-5ccffc3077c9-serving-cert\") pod \"console-operator-5ccd6b445f-5qdp4\" (UID: \"e8e537f1-bb75-456e-973b-5ccffc3077c9\") " pod="openshift-console-operator/console-operator-5ccd6b445f-5qdp4" Aug 05 17:24:16.074200 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.074107 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8e537f1-bb75-456e-973b-5ccffc3077c9-trusted-ca\") pod \"console-operator-5ccd6b445f-5qdp4\" (UID: \"e8e537f1-bb75-456e-973b-5ccffc3077c9\") " pod="openshift-console-operator/console-operator-5ccd6b445f-5qdp4" Aug 05 17:24:16.074200 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.074091 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Aug 05 17:24:16.074200 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.074161 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7fa167ca-16b6-4ab3-a8e2-c380b172790d-serving-cert\") pod \"service-ca-operator-784f97bcf6-52lff\" (UID: \"7fa167ca-16b6-4ab3-a8e2-c380b172790d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-52lff" Aug 05 17:24:16.074371 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.074203 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbmp2\" (UniqueName: \"kubernetes.io/projected/7fa167ca-16b6-4ab3-a8e2-c380b172790d-kube-api-access-pbmp2\") pod \"service-ca-operator-784f97bcf6-52lff\" (UID: \"7fa167ca-16b6-4ab3-a8e2-c380b172790d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-52lff" Aug 05 17:24:16.074371 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.074230 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkbt4\" (UniqueName: \"kubernetes.io/projected/2791a0a9-973e-45eb-bf3b-7a1d9b0cf605-kube-api-access-tkbt4\") pod \"cluster-samples-operator-559cbf5745-klw7f\" (UID: \"2791a0a9-973e-45eb-bf3b-7a1d9b0cf605\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-klw7f" Aug 05 17:24:16.074371 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.074332 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwph6\" (UniqueName: \"kubernetes.io/projected/e8e537f1-bb75-456e-973b-5ccffc3077c9-kube-api-access-kwph6\") pod \"console-operator-5ccd6b445f-5qdp4\" (UID: \"e8e537f1-bb75-456e-973b-5ccffc3077c9\") " pod="openshift-console-operator/console-operator-5ccd6b445f-5qdp4" Aug 05 17:24:16.074371 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.074343 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Aug 05 17:24:16.074558 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.074392 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-6lgk4\"" Aug 05 17:24:16.074558 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.074430 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5xnq\" (UniqueName: \"kubernetes.io/projected/63a97bae-532f-40f8-843e-00921bee6ab3-kube-api-access-v5xnq\") pod \"volume-data-source-validator-5b8776669-vgc4l\" (UID: \"63a97bae-532f-40f8-843e-00921bee6ab3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-vgc4l" Aug 05 17:24:16.074558 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.074397 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Aug 05 17:24:16.074558 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.074463 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2791a0a9-973e-45eb-bf3b-7a1d9b0cf605-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-klw7f\" (UID: \"2791a0a9-973e-45eb-bf3b-7a1d9b0cf605\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-klw7f" Aug 05 17:24:16.074558 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.074525 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e8e537f1-bb75-456e-973b-5ccffc3077c9-config\") pod \"console-operator-5ccd6b445f-5qdp4\" (UID: \"e8e537f1-bb75-456e-973b-5ccffc3077c9\") " pod="openshift-console-operator/console-operator-5ccd6b445f-5qdp4" Aug 05 17:24:16.074558 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.074532 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Aug 05 17:24:16.074558 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.074551 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Aug 05 17:24:16.074822 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.074570 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7fa167ca-16b6-4ab3-a8e2-c380b172790d-config\") pod \"service-ca-operator-784f97bcf6-52lff\" (UID: \"7fa167ca-16b6-4ab3-a8e2-c380b172790d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-52lff" Aug 05 17:24:16.074822 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.074590 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Aug 05 17:24:16.081380 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.081361 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-5qdp4"] Aug 05 17:24:16.081488 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.081389 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-qndgm"] Aug 05 17:24:16.081488 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.081405 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-klw7f"] Aug 05 17:24:16.081488 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.081479 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-qndgm" Aug 05 17:24:16.081618 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.081491 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5ddbb5b6b4-262r4"] Aug 05 17:24:16.084325 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.084308 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-d5crf\"" Aug 05 17:24:16.086699 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.086681 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5xnq\" (UniqueName: \"kubernetes.io/projected/63a97bae-532f-40f8-843e-00921bee6ab3-kube-api-access-v5xnq\") pod \"volume-data-source-validator-5b8776669-vgc4l\" (UID: \"63a97bae-532f-40f8-843e-00921bee6ab3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-vgc4l" Aug 05 17:24:16.147096 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.147021 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-hjdq2"] Aug 05 17:24:16.151636 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.151611 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-lpd2k"] Aug 05 17:24:16.151785 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.151704 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-hjdq2" Aug 05 17:24:16.156899 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.156878 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Aug 05 17:24:16.157830 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.157738 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-6s4mp\"" Aug 05 17:24:16.157830 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.157760 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Aug 05 17:24:16.163600 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.163581 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-vjkmk"] Aug 05 17:24:16.163710 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.163692 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-lpd2k" Aug 05 17:24:16.168814 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.168795 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-prttc\"" Aug 05 17:24:16.168814 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.168808 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Aug 05 17:24:16.169025 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.169009 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Aug 05 17:24:16.169100 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.169030 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Aug 05 17:24:16.170636 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.170617 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Aug 05 17:24:16.175163 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.175123 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwph6\" (UniqueName: \"kubernetes.io/projected/e8e537f1-bb75-456e-973b-5ccffc3077c9-kube-api-access-kwph6\") pod \"console-operator-5ccd6b445f-5qdp4\" (UID: \"e8e537f1-bb75-456e-973b-5ccffc3077c9\") " pod="openshift-console-operator/console-operator-5ccd6b445f-5qdp4" Aug 05 17:24:16.175237 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.175172 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-lpd2k\" (UID: \"fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-lpd2k" Aug 05 17:24:16.175294 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.175281 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7bee8cb-675d-4da7-a767-149f0d6e026f-metrics-certs\") pod \"router-default-5ddbb5b6b4-262r4\" (UID: \"d7bee8cb-675d-4da7-a767-149f0d6e026f\") " pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" Aug 05 17:24:16.175338 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.175323 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e8e537f1-bb75-456e-973b-5ccffc3077c9-config\") pod \"console-operator-5ccd6b445f-5qdp4\" (UID: \"e8e537f1-bb75-456e-973b-5ccffc3077c9\") " pod="openshift-console-operator/console-operator-5ccd6b445f-5qdp4" Aug 05 17:24:16.175412 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.175344 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e8e537f1-bb75-456e-973b-5ccffc3077c9-serving-cert\") pod \"console-operator-5ccd6b445f-5qdp4\" (UID: \"e8e537f1-bb75-456e-973b-5ccffc3077c9\") " pod="openshift-console-operator/console-operator-5ccd6b445f-5qdp4" Aug 05 17:24:16.175412 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.175358 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8e537f1-bb75-456e-973b-5ccffc3077c9-trusted-ca\") pod \"console-operator-5ccd6b445f-5qdp4\" (UID: \"e8e537f1-bb75-456e-973b-5ccffc3077c9\") " pod="openshift-console-operator/console-operator-5ccd6b445f-5qdp4" Aug 05 17:24:16.175412 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.175399 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7fa167ca-16b6-4ab3-a8e2-c380b172790d-serving-cert\") pod \"service-ca-operator-784f97bcf6-52lff\" (UID: \"7fa167ca-16b6-4ab3-a8e2-c380b172790d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-52lff" Aug 05 17:24:16.175553 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.175417 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbmp2\" (UniqueName: \"kubernetes.io/projected/7fa167ca-16b6-4ab3-a8e2-c380b172790d-kube-api-access-pbmp2\") pod \"service-ca-operator-784f97bcf6-52lff\" (UID: \"7fa167ca-16b6-4ab3-a8e2-c380b172790d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-52lff" Aug 05 17:24:16.175553 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.175436 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7bee8cb-675d-4da7-a767-149f0d6e026f-service-ca-bundle\") pod \"router-default-5ddbb5b6b4-262r4\" (UID: \"d7bee8cb-675d-4da7-a767-149f0d6e026f\") " pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" Aug 05 17:24:16.175553 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.175461 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkkqq\" (UniqueName: \"kubernetes.io/projected/d7bee8cb-675d-4da7-a767-149f0d6e026f-kube-api-access-nkkqq\") pod \"router-default-5ddbb5b6b4-262r4\" (UID: \"d7bee8cb-675d-4da7-a767-149f0d6e026f\") " pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" Aug 05 17:24:16.175728 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.175701 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmjl4\" (UniqueName: \"kubernetes.io/projected/fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de-kube-api-access-nmjl4\") pod \"cluster-monitoring-operator-6f55c4f58d-lpd2k\" (UID: \"fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-lpd2k" Aug 05 17:24:16.175791 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.175771 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d7bee8cb-675d-4da7-a767-149f0d6e026f-default-certificate\") pod \"router-default-5ddbb5b6b4-262r4\" (UID: \"d7bee8cb-675d-4da7-a767-149f0d6e026f\") " pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" Aug 05 17:24:16.175843 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.175814 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2791a0a9-973e-45eb-bf3b-7a1d9b0cf605-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-klw7f\" (UID: \"2791a0a9-973e-45eb-bf3b-7a1d9b0cf605\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-klw7f" Aug 05 17:24:16.175892 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.175867 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/242a220c-bc69-4451-91eb-58260fb20552-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-hjdq2\" (UID: \"242a220c-bc69-4451-91eb-58260fb20552\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-hjdq2" Aug 05 17:24:16.176302 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:16.175907 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 05 17:24:16.176302 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.175929 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7fa167ca-16b6-4ab3-a8e2-c380b172790d-config\") pod \"service-ca-operator-784f97bcf6-52lff\" (UID: \"7fa167ca-16b6-4ab3-a8e2-c380b172790d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-52lff" Aug 05 17:24:16.176302 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:16.175960 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2791a0a9-973e-45eb-bf3b-7a1d9b0cf605-samples-operator-tls podName:2791a0a9-973e-45eb-bf3b-7a1d9b0cf605 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:16.675942502 +0000 UTC m=+44.443322746 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2791a0a9-973e-45eb-bf3b-7a1d9b0cf605-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-klw7f" (UID: "2791a0a9-973e-45eb-bf3b-7a1d9b0cf605") : secret "samples-operator-tls" not found Aug 05 17:24:16.176302 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.175992 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d7bee8cb-675d-4da7-a767-149f0d6e026f-stats-auth\") pod \"router-default-5ddbb5b6b4-262r4\" (UID: \"d7bee8cb-675d-4da7-a767-149f0d6e026f\") " pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" Aug 05 17:24:16.176302 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.176029 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7mwg\" (UniqueName: \"kubernetes.io/projected/ed74188c-5baf-4e5c-b6e6-e71524f8ff3a-kube-api-access-r7mwg\") pod \"network-check-source-65bdbbff45-qndgm\" (UID: \"ed74188c-5baf-4e5c-b6e6-e71524f8ff3a\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-qndgm" Aug 05 17:24:16.176302 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.176059 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-lpd2k\" (UID: \"fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-lpd2k" Aug 05 17:24:16.176302 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.176088 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/242a220c-bc69-4451-91eb-58260fb20552-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-hjdq2\" (UID: \"242a220c-bc69-4451-91eb-58260fb20552\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-hjdq2" Aug 05 17:24:16.176302 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.176119 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkbt4\" (UniqueName: \"kubernetes.io/projected/2791a0a9-973e-45eb-bf3b-7a1d9b0cf605-kube-api-access-tkbt4\") pod \"cluster-samples-operator-559cbf5745-klw7f\" (UID: \"2791a0a9-973e-45eb-bf3b-7a1d9b0cf605\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-klw7f" Aug 05 17:24:16.176302 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.176137 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e8e537f1-bb75-456e-973b-5ccffc3077c9-config\") pod \"console-operator-5ccd6b445f-5qdp4\" (UID: \"e8e537f1-bb75-456e-973b-5ccffc3077c9\") " pod="openshift-console-operator/console-operator-5ccd6b445f-5qdp4" Aug 05 17:24:16.176729 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.176473 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7fa167ca-16b6-4ab3-a8e2-c380b172790d-config\") pod \"service-ca-operator-784f97bcf6-52lff\" (UID: \"7fa167ca-16b6-4ab3-a8e2-c380b172790d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-52lff" Aug 05 17:24:16.176729 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.176477 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e8e537f1-bb75-456e-973b-5ccffc3077c9-trusted-ca\") pod \"console-operator-5ccd6b445f-5qdp4\" (UID: \"e8e537f1-bb75-456e-973b-5ccffc3077c9\") " pod="openshift-console-operator/console-operator-5ccd6b445f-5qdp4" Aug 05 17:24:16.177865 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.177838 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e8e537f1-bb75-456e-973b-5ccffc3077c9-serving-cert\") pod \"console-operator-5ccd6b445f-5qdp4\" (UID: \"e8e537f1-bb75-456e-973b-5ccffc3077c9\") " pod="openshift-console-operator/console-operator-5ccd6b445f-5qdp4" Aug 05 17:24:16.177967 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.177936 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7fa167ca-16b6-4ab3-a8e2-c380b172790d-serving-cert\") pod \"service-ca-operator-784f97bcf6-52lff\" (UID: \"7fa167ca-16b6-4ab3-a8e2-c380b172790d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-52lff" Aug 05 17:24:16.179699 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.179678 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-77696685b-7xft8"] Aug 05 17:24:16.179818 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.179803 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-vjkmk" Aug 05 17:24:16.188094 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.188054 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-fbdnw\"" Aug 05 17:24:16.188393 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.188378 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Aug 05 17:24:16.189324 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.189300 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Aug 05 17:24:16.189627 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.189604 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Aug 05 17:24:16.189717 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.189637 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Aug 05 17:24:16.193927 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.193907 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-hjdq2"] Aug 05 17:24:16.194020 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.193937 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-lpd2k"] Aug 05 17:24:16.194020 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.193951 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-vjkmk"] Aug 05 17:24:16.194130 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.194023 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-7xft8" Aug 05 17:24:16.197595 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.197546 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Aug 05 17:24:16.197977 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.197960 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Aug 05 17:24:16.201946 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.200090 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-7xft8"] Aug 05 17:24:16.201946 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.201068 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Aug 05 17:24:16.201946 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.201372 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-2bbqb\"" Aug 05 17:24:16.201946 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.201770 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Aug 05 17:24:16.211526 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.211498 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbmp2\" (UniqueName: \"kubernetes.io/projected/7fa167ca-16b6-4ab3-a8e2-c380b172790d-kube-api-access-pbmp2\") pod \"service-ca-operator-784f97bcf6-52lff\" (UID: \"7fa167ca-16b6-4ab3-a8e2-c380b172790d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-52lff" Aug 05 17:24:16.211630 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.211613 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkbt4\" (UniqueName: \"kubernetes.io/projected/2791a0a9-973e-45eb-bf3b-7a1d9b0cf605-kube-api-access-tkbt4\") pod \"cluster-samples-operator-559cbf5745-klw7f\" (UID: \"2791a0a9-973e-45eb-bf3b-7a1d9b0cf605\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-klw7f" Aug 05 17:24:16.211711 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.211694 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Aug 05 17:24:16.219742 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.219722 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwph6\" (UniqueName: \"kubernetes.io/projected/e8e537f1-bb75-456e-973b-5ccffc3077c9-kube-api-access-kwph6\") pod \"console-operator-5ccd6b445f-5qdp4\" (UID: \"e8e537f1-bb75-456e-973b-5ccffc3077c9\") " pod="openshift-console-operator/console-operator-5ccd6b445f-5qdp4" Aug 05 17:24:16.268215 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.268184 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-vgc4l" Aug 05 17:24:16.277333 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.277284 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d7bee8cb-675d-4da7-a767-149f0d6e026f-stats-auth\") pod \"router-default-5ddbb5b6b4-262r4\" (UID: \"d7bee8cb-675d-4da7-a767-149f0d6e026f\") " pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" Aug 05 17:24:16.277405 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.277346 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fcb6cf3e-3244-471a-9780-6c3fcc157551-snapshots\") pod \"insights-operator-77696685b-7xft8\" (UID: \"fcb6cf3e-3244-471a-9780-6c3fcc157551\") " pod="openshift-insights/insights-operator-77696685b-7xft8" Aug 05 17:24:16.277405 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.277379 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7mwg\" (UniqueName: \"kubernetes.io/projected/ed74188c-5baf-4e5c-b6e6-e71524f8ff3a-kube-api-access-r7mwg\") pod \"network-check-source-65bdbbff45-qndgm\" (UID: \"ed74188c-5baf-4e5c-b6e6-e71524f8ff3a\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-qndgm" Aug 05 17:24:16.277405 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.277402 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-lpd2k\" (UID: \"fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-lpd2k" Aug 05 17:24:16.277518 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.277421 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/242a220c-bc69-4451-91eb-58260fb20552-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-hjdq2\" (UID: \"242a220c-bc69-4451-91eb-58260fb20552\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-hjdq2" Aug 05 17:24:16.277518 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.277446 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/45a097fa-7f29-42cc-b351-931955a10ccf-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-vjkmk\" (UID: \"45a097fa-7f29-42cc-b351-931955a10ccf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-vjkmk" Aug 05 17:24:16.277518 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.277495 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-lpd2k\" (UID: \"fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-lpd2k" Aug 05 17:24:16.277650 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.277522 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fcb6cf3e-3244-471a-9780-6c3fcc157551-serving-cert\") pod \"insights-operator-77696685b-7xft8\" (UID: \"fcb6cf3e-3244-471a-9780-6c3fcc157551\") " pod="openshift-insights/insights-operator-77696685b-7xft8" Aug 05 17:24:16.277650 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:16.277556 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 05 17:24:16.277650 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.277633 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7bee8cb-675d-4da7-a767-149f0d6e026f-metrics-certs\") pod \"router-default-5ddbb5b6b4-262r4\" (UID: \"d7bee8cb-675d-4da7-a767-149f0d6e026f\") " pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" Aug 05 17:24:16.277796 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.277666 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcb6cf3e-3244-471a-9780-6c3fcc157551-trusted-ca-bundle\") pod \"insights-operator-77696685b-7xft8\" (UID: \"fcb6cf3e-3244-471a-9780-6c3fcc157551\") " pod="openshift-insights/insights-operator-77696685b-7xft8" Aug 05 17:24:16.277796 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:16.277682 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de-cluster-monitoring-operator-tls podName:fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de nodeName:}" failed. No retries permitted until 2026-08-05 17:24:16.777659273 +0000 UTC m=+44.545039483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-lpd2k" (UID: "fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de") : secret "cluster-monitoring-operator-tls" not found Aug 05 17:24:16.277796 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:16.277750 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 05 17:24:16.277796 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.277770 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/45a097fa-7f29-42cc-b351-931955a10ccf-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-vjkmk\" (UID: \"45a097fa-7f29-42cc-b351-931955a10ccf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-vjkmk" Aug 05 17:24:16.277998 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:16.277810 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7bee8cb-675d-4da7-a767-149f0d6e026f-metrics-certs podName:d7bee8cb-675d-4da7-a767-149f0d6e026f nodeName:}" failed. No retries permitted until 2026-08-05 17:24:16.777794718 +0000 UTC m=+44.545174932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d7bee8cb-675d-4da7-a767-149f0d6e026f-metrics-certs") pod "router-default-5ddbb5b6b4-262r4" (UID: "d7bee8cb-675d-4da7-a767-149f0d6e026f") : secret "router-metrics-certs-default" not found Aug 05 17:24:16.277998 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.277849 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn6ck\" (UniqueName: \"kubernetes.io/projected/45a097fa-7f29-42cc-b351-931955a10ccf-kube-api-access-vn6ck\") pod \"kube-storage-version-migrator-operator-7878f4b88c-vjkmk\" (UID: \"45a097fa-7f29-42cc-b351-931955a10ccf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-vjkmk" Aug 05 17:24:16.277998 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.277879 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtzk7\" (UniqueName: \"kubernetes.io/projected/fcb6cf3e-3244-471a-9780-6c3fcc157551-kube-api-access-xtzk7\") pod \"insights-operator-77696685b-7xft8\" (UID: \"fcb6cf3e-3244-471a-9780-6c3fcc157551\") " pod="openshift-insights/insights-operator-77696685b-7xft8" Aug 05 17:24:16.277998 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.277901 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7bee8cb-675d-4da7-a767-149f0d6e026f-service-ca-bundle\") pod \"router-default-5ddbb5b6b4-262r4\" (UID: \"d7bee8cb-675d-4da7-a767-149f0d6e026f\") " pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" Aug 05 17:24:16.277998 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.277930 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkkqq\" (UniqueName: \"kubernetes.io/projected/d7bee8cb-675d-4da7-a767-149f0d6e026f-kube-api-access-nkkqq\") pod \"router-default-5ddbb5b6b4-262r4\" (UID: \"d7bee8cb-675d-4da7-a767-149f0d6e026f\") " pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" Aug 05 17:24:16.277998 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.277972 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmjl4\" (UniqueName: \"kubernetes.io/projected/fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de-kube-api-access-nmjl4\") pod \"cluster-monitoring-operator-6f55c4f58d-lpd2k\" (UID: \"fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-lpd2k" Aug 05 17:24:16.278391 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.278003 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fcb6cf3e-3244-471a-9780-6c3fcc157551-tmp\") pod \"insights-operator-77696685b-7xft8\" (UID: \"fcb6cf3e-3244-471a-9780-6c3fcc157551\") " pod="openshift-insights/insights-operator-77696685b-7xft8" Aug 05 17:24:16.278391 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:16.278037 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d7bee8cb-675d-4da7-a767-149f0d6e026f-service-ca-bundle podName:d7bee8cb-675d-4da7-a767-149f0d6e026f nodeName:}" failed. No retries permitted until 2026-08-05 17:24:16.778022466 +0000 UTC m=+44.545402694 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d7bee8cb-675d-4da7-a767-149f0d6e026f-service-ca-bundle") pod "router-default-5ddbb5b6b4-262r4" (UID: "d7bee8cb-675d-4da7-a767-149f0d6e026f") : configmap references non-existent config key: service-ca.crt Aug 05 17:24:16.278391 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.278160 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d7bee8cb-675d-4da7-a767-149f0d6e026f-default-certificate\") pod \"router-default-5ddbb5b6b4-262r4\" (UID: \"d7bee8cb-675d-4da7-a767-149f0d6e026f\") " pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" Aug 05 17:24:16.278391 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.278213 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/242a220c-bc69-4451-91eb-58260fb20552-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-hjdq2\" (UID: \"242a220c-bc69-4451-91eb-58260fb20552\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-hjdq2" Aug 05 17:24:16.278391 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.278229 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/242a220c-bc69-4451-91eb-58260fb20552-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-hjdq2\" (UID: \"242a220c-bc69-4451-91eb-58260fb20552\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-hjdq2" Aug 05 17:24:16.278391 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.278241 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcb6cf3e-3244-471a-9780-6c3fcc157551-service-ca-bundle\") pod \"insights-operator-77696685b-7xft8\" (UID: \"fcb6cf3e-3244-471a-9780-6c3fcc157551\") " pod="openshift-insights/insights-operator-77696685b-7xft8" Aug 05 17:24:16.278391 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:16.278310 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Aug 05 17:24:16.278391 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:16.278347 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/242a220c-bc69-4451-91eb-58260fb20552-networking-console-plugin-cert podName:242a220c-bc69-4451-91eb-58260fb20552 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:16.778338783 +0000 UTC m=+44.545718994 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/242a220c-bc69-4451-91eb-58260fb20552-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-hjdq2" (UID: "242a220c-bc69-4451-91eb-58260fb20552") : secret "networking-console-plugin-cert" not found Aug 05 17:24:16.278391 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.278307 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-lpd2k\" (UID: \"fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-lpd2k" Aug 05 17:24:16.279778 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.279758 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d7bee8cb-675d-4da7-a767-149f0d6e026f-stats-auth\") pod \"router-default-5ddbb5b6b4-262r4\" (UID: \"d7bee8cb-675d-4da7-a767-149f0d6e026f\") " pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" Aug 05 17:24:16.280492 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.280470 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d7bee8cb-675d-4da7-a767-149f0d6e026f-default-certificate\") pod \"router-default-5ddbb5b6b4-262r4\" (UID: \"d7bee8cb-675d-4da7-a767-149f0d6e026f\") " pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" Aug 05 17:24:16.284393 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.284367 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-52lff" Aug 05 17:24:16.294304 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.294276 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7mwg\" (UniqueName: \"kubernetes.io/projected/ed74188c-5baf-4e5c-b6e6-e71524f8ff3a-kube-api-access-r7mwg\") pod \"network-check-source-65bdbbff45-qndgm\" (UID: \"ed74188c-5baf-4e5c-b6e6-e71524f8ff3a\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-qndgm" Aug 05 17:24:16.300457 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.300429 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmjl4\" (UniqueName: \"kubernetes.io/projected/fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de-kube-api-access-nmjl4\") pod \"cluster-monitoring-operator-6f55c4f58d-lpd2k\" (UID: \"fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-lpd2k" Aug 05 17:24:16.300825 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.300808 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkkqq\" (UniqueName: \"kubernetes.io/projected/d7bee8cb-675d-4da7-a767-149f0d6e026f-kube-api-access-nkkqq\") pod \"router-default-5ddbb5b6b4-262r4\" (UID: \"d7bee8cb-675d-4da7-a767-149f0d6e026f\") " pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" Aug 05 17:24:16.353322 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.353286 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-5qdp4" Aug 05 17:24:16.379215 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.379121 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcb6cf3e-3244-471a-9780-6c3fcc157551-trusted-ca-bundle\") pod \"insights-operator-77696685b-7xft8\" (UID: \"fcb6cf3e-3244-471a-9780-6c3fcc157551\") " pod="openshift-insights/insights-operator-77696685b-7xft8" Aug 05 17:24:16.379354 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.379227 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/45a097fa-7f29-42cc-b351-931955a10ccf-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-vjkmk\" (UID: \"45a097fa-7f29-42cc-b351-931955a10ccf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-vjkmk" Aug 05 17:24:16.379354 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.379282 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn6ck\" (UniqueName: \"kubernetes.io/projected/45a097fa-7f29-42cc-b351-931955a10ccf-kube-api-access-vn6ck\") pod \"kube-storage-version-migrator-operator-7878f4b88c-vjkmk\" (UID: \"45a097fa-7f29-42cc-b351-931955a10ccf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-vjkmk" Aug 05 17:24:16.379354 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.379316 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtzk7\" (UniqueName: \"kubernetes.io/projected/fcb6cf3e-3244-471a-9780-6c3fcc157551-kube-api-access-xtzk7\") pod \"insights-operator-77696685b-7xft8\" (UID: \"fcb6cf3e-3244-471a-9780-6c3fcc157551\") " pod="openshift-insights/insights-operator-77696685b-7xft8" Aug 05 17:24:16.379576 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.379371 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fcb6cf3e-3244-471a-9780-6c3fcc157551-tmp\") pod \"insights-operator-77696685b-7xft8\" (UID: \"fcb6cf3e-3244-471a-9780-6c3fcc157551\") " pod="openshift-insights/insights-operator-77696685b-7xft8" Aug 05 17:24:16.379576 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.379441 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcb6cf3e-3244-471a-9780-6c3fcc157551-service-ca-bundle\") pod \"insights-operator-77696685b-7xft8\" (UID: \"fcb6cf3e-3244-471a-9780-6c3fcc157551\") " pod="openshift-insights/insights-operator-77696685b-7xft8" Aug 05 17:24:16.379576 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.379485 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fcb6cf3e-3244-471a-9780-6c3fcc157551-snapshots\") pod \"insights-operator-77696685b-7xft8\" (UID: \"fcb6cf3e-3244-471a-9780-6c3fcc157551\") " pod="openshift-insights/insights-operator-77696685b-7xft8" Aug 05 17:24:16.379576 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.379542 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/45a097fa-7f29-42cc-b351-931955a10ccf-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-vjkmk\" (UID: \"45a097fa-7f29-42cc-b351-931955a10ccf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-vjkmk" Aug 05 17:24:16.379750 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.379594 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fcb6cf3e-3244-471a-9780-6c3fcc157551-serving-cert\") pod \"insights-operator-77696685b-7xft8\" (UID: \"fcb6cf3e-3244-471a-9780-6c3fcc157551\") " pod="openshift-insights/insights-operator-77696685b-7xft8" Aug 05 17:24:16.380472 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.380438 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/45a097fa-7f29-42cc-b351-931955a10ccf-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-vjkmk\" (UID: \"45a097fa-7f29-42cc-b351-931955a10ccf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-vjkmk" Aug 05 17:24:16.380586 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.380501 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcb6cf3e-3244-471a-9780-6c3fcc157551-service-ca-bundle\") pod \"insights-operator-77696685b-7xft8\" (UID: \"fcb6cf3e-3244-471a-9780-6c3fcc157551\") " pod="openshift-insights/insights-operator-77696685b-7xft8" Aug 05 17:24:16.380888 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.380744 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fcb6cf3e-3244-471a-9780-6c3fcc157551-tmp\") pod \"insights-operator-77696685b-7xft8\" (UID: \"fcb6cf3e-3244-471a-9780-6c3fcc157551\") " pod="openshift-insights/insights-operator-77696685b-7xft8" Aug 05 17:24:16.381091 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.380985 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcb6cf3e-3244-471a-9780-6c3fcc157551-trusted-ca-bundle\") pod \"insights-operator-77696685b-7xft8\" (UID: \"fcb6cf3e-3244-471a-9780-6c3fcc157551\") " pod="openshift-insights/insights-operator-77696685b-7xft8" Aug 05 17:24:16.381560 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.381524 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fcb6cf3e-3244-471a-9780-6c3fcc157551-snapshots\") pod \"insights-operator-77696685b-7xft8\" (UID: \"fcb6cf3e-3244-471a-9780-6c3fcc157551\") " pod="openshift-insights/insights-operator-77696685b-7xft8" Aug 05 17:24:16.383134 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.383092 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/45a097fa-7f29-42cc-b351-931955a10ccf-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-vjkmk\" (UID: \"45a097fa-7f29-42cc-b351-931955a10ccf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-vjkmk" Aug 05 17:24:16.383234 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.383156 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fcb6cf3e-3244-471a-9780-6c3fcc157551-serving-cert\") pod \"insights-operator-77696685b-7xft8\" (UID: \"fcb6cf3e-3244-471a-9780-6c3fcc157551\") " pod="openshift-insights/insights-operator-77696685b-7xft8" Aug 05 17:24:16.390056 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.390026 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:16.392434 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.392405 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn6ck\" (UniqueName: \"kubernetes.io/projected/45a097fa-7f29-42cc-b351-931955a10ccf-kube-api-access-vn6ck\") pod \"kube-storage-version-migrator-operator-7878f4b88c-vjkmk\" (UID: \"45a097fa-7f29-42cc-b351-931955a10ccf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-vjkmk" Aug 05 17:24:16.392547 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.392511 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtzk7\" (UniqueName: \"kubernetes.io/projected/fcb6cf3e-3244-471a-9780-6c3fcc157551-kube-api-access-xtzk7\") pod \"insights-operator-77696685b-7xft8\" (UID: \"fcb6cf3e-3244-471a-9780-6c3fcc157551\") " pod="openshift-insights/insights-operator-77696685b-7xft8" Aug 05 17:24:16.394068 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.394046 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-qndgm" Aug 05 17:24:16.430847 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.430727 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-vgc4l"] Aug 05 17:24:16.462858 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.462810 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-52lff"] Aug 05 17:24:16.464007 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.463927 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:16.470283 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:24:16.469927 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fa167ca_16b6_4ab3_a8e2_c380b172790d.slice/crio-7eb6387773df3ad43115e5651fda9993cd0255795ab4bad152f4676d97d77c6d WatchSource:0}: Error finding container 7eb6387773df3ad43115e5651fda9993cd0255795ab4bad152f4676d97d77c6d: Status 404 returned error can't find the container with id 7eb6387773df3ad43115e5651fda9993cd0255795ab4bad152f4676d97d77c6d Aug 05 17:24:16.495745 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.495716 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-vjkmk" Aug 05 17:24:16.506495 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.506459 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-7xft8" Aug 05 17:24:16.522852 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.522818 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-5qdp4"] Aug 05 17:24:16.527911 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:24:16.527879 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8e537f1_bb75_456e_973b_5ccffc3077c9.slice/crio-124fb1d6cba6af57e79f3674d69f8b04ed089838c8d16d98fb67ae7b9b9dd172 WatchSource:0}: Error finding container 124fb1d6cba6af57e79f3674d69f8b04ed089838c8d16d98fb67ae7b9b9dd172: Status 404 returned error can't find the container with id 124fb1d6cba6af57e79f3674d69f8b04ed089838c8d16d98fb67ae7b9b9dd172 Aug 05 17:24:16.550537 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.550506 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-qndgm"] Aug 05 17:24:16.553720 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:24:16.553690 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded74188c_5baf_4e5c_b6e6_e71524f8ff3a.slice/crio-87247a05c9579e486c4aabb3541aa822a1554d4119cfab7f980e4328c3708990 WatchSource:0}: Error finding container 87247a05c9579e486c4aabb3541aa822a1554d4119cfab7f980e4328c3708990: Status 404 returned error can't find the container with id 87247a05c9579e486c4aabb3541aa822a1554d4119cfab7f980e4328c3708990 Aug 05 17:24:16.669126 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.669038 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-vjkmk"] Aug 05 17:24:16.671985 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:24:16.671954 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45a097fa_7f29_42cc_b351_931955a10ccf.slice/crio-631c655555b120b7738a736b37ed3382f3413ce3a126d11ed69cd5d0de1098ef WatchSource:0}: Error finding container 631c655555b120b7738a736b37ed3382f3413ce3a126d11ed69cd5d0de1098ef: Status 404 returned error can't find the container with id 631c655555b120b7738a736b37ed3382f3413ce3a126d11ed69cd5d0de1098ef Aug 05 17:24:16.683295 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.683265 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2791a0a9-973e-45eb-bf3b-7a1d9b0cf605-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-klw7f\" (UID: \"2791a0a9-973e-45eb-bf3b-7a1d9b0cf605\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-klw7f" Aug 05 17:24:16.683432 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:16.683414 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 05 17:24:16.683493 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:16.683476 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2791a0a9-973e-45eb-bf3b-7a1d9b0cf605-samples-operator-tls podName:2791a0a9-973e-45eb-bf3b-7a1d9b0cf605 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:17.683460321 +0000 UTC m=+45.450840535 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2791a0a9-973e-45eb-bf3b-7a1d9b0cf605-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-klw7f" (UID: "2791a0a9-973e-45eb-bf3b-7a1d9b0cf605") : secret "samples-operator-tls" not found Aug 05 17:24:16.691956 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.691901 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-7xft8"] Aug 05 17:24:16.695822 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:24:16.695800 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcb6cf3e_3244_471a_9780_6c3fcc157551.slice/crio-c002747877762e15dccb8ebe24fa4bc22a7acf5adefd0496fc3575546b9775b9 WatchSource:0}: Error finding container c002747877762e15dccb8ebe24fa4bc22a7acf5adefd0496fc3575546b9775b9: Status 404 returned error can't find the container with id c002747877762e15dccb8ebe24fa4bc22a7acf5adefd0496fc3575546b9775b9 Aug 05 17:24:16.784262 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.784228 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7bee8cb-675d-4da7-a767-149f0d6e026f-metrics-certs\") pod \"router-default-5ddbb5b6b4-262r4\" (UID: \"d7bee8cb-675d-4da7-a767-149f0d6e026f\") " pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" Aug 05 17:24:16.784429 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.784289 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7bee8cb-675d-4da7-a767-149f0d6e026f-service-ca-bundle\") pod \"router-default-5ddbb5b6b4-262r4\" (UID: \"d7bee8cb-675d-4da7-a767-149f0d6e026f\") " pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" Aug 05 17:24:16.784429 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.784340 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/242a220c-bc69-4451-91eb-58260fb20552-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-hjdq2\" (UID: \"242a220c-bc69-4451-91eb-58260fb20552\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-hjdq2" Aug 05 17:24:16.784429 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:16.784376 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 05 17:24:16.784613 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:16.784437 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7bee8cb-675d-4da7-a767-149f0d6e026f-metrics-certs podName:d7bee8cb-675d-4da7-a767-149f0d6e026f nodeName:}" failed. No retries permitted until 2026-08-05 17:24:17.784422048 +0000 UTC m=+45.551802282 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d7bee8cb-675d-4da7-a767-149f0d6e026f-metrics-certs") pod "router-default-5ddbb5b6b4-262r4" (UID: "d7bee8cb-675d-4da7-a767-149f0d6e026f") : secret "router-metrics-certs-default" not found Aug 05 17:24:16.784613 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:16.784457 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Aug 05 17:24:16.784613 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:16.784379 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-lpd2k\" (UID: \"fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-lpd2k" Aug 05 17:24:16.784613 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:16.784482 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d7bee8cb-675d-4da7-a767-149f0d6e026f-service-ca-bundle podName:d7bee8cb-675d-4da7-a767-149f0d6e026f nodeName:}" failed. No retries permitted until 2026-08-05 17:24:17.784464585 +0000 UTC m=+45.551844811 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d7bee8cb-675d-4da7-a767-149f0d6e026f-service-ca-bundle") pod "router-default-5ddbb5b6b4-262r4" (UID: "d7bee8cb-675d-4da7-a767-149f0d6e026f") : configmap references non-existent config key: service-ca.crt Aug 05 17:24:16.784613 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:16.784457 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 05 17:24:16.784613 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:16.784517 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/242a220c-bc69-4451-91eb-58260fb20552-networking-console-plugin-cert podName:242a220c-bc69-4451-91eb-58260fb20552 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:17.784505525 +0000 UTC m=+45.551885742 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/242a220c-bc69-4451-91eb-58260fb20552-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-hjdq2" (UID: "242a220c-bc69-4451-91eb-58260fb20552") : secret "networking-console-plugin-cert" not found Aug 05 17:24:16.784613 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:16.784538 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de-cluster-monitoring-operator-tls podName:fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de nodeName:}" failed. No retries permitted until 2026-08-05 17:24:17.784528023 +0000 UTC m=+45.551908234 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-lpd2k" (UID: "fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de") : secret "cluster-monitoring-operator-tls" not found Aug 05 17:24:17.086373 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:17.086312 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-qndgm" event={"ID":"ed74188c-5baf-4e5c-b6e6-e71524f8ff3a","Type":"ContainerStarted","Data":"87247a05c9579e486c4aabb3541aa822a1554d4119cfab7f980e4328c3708990"} Aug 05 17:24:17.087800 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:17.087755 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-vjkmk" event={"ID":"45a097fa-7f29-42cc-b351-931955a10ccf","Type":"ContainerStarted","Data":"631c655555b120b7738a736b37ed3382f3413ce3a126d11ed69cd5d0de1098ef"} Aug 05 17:24:17.089197 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:17.089172 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-5qdp4" event={"ID":"e8e537f1-bb75-456e-973b-5ccffc3077c9","Type":"ContainerStarted","Data":"124fb1d6cba6af57e79f3674d69f8b04ed089838c8d16d98fb67ae7b9b9dd172"} Aug 05 17:24:17.090508 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:17.090464 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-vgc4l" event={"ID":"63a97bae-532f-40f8-843e-00921bee6ab3","Type":"ContainerStarted","Data":"60c2726c327eaf8b044e537930a21d0429c46511ddc58b2e364d832d60d94cb3"} Aug 05 17:24:17.092088 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:17.092061 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-7xft8" event={"ID":"fcb6cf3e-3244-471a-9780-6c3fcc157551","Type":"ContainerStarted","Data":"c002747877762e15dccb8ebe24fa4bc22a7acf5adefd0496fc3575546b9775b9"} Aug 05 17:24:17.093409 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:17.093385 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-52lff" event={"ID":"7fa167ca-16b6-4ab3-a8e2-c380b172790d","Type":"ContainerStarted","Data":"7eb6387773df3ad43115e5651fda9993cd0255795ab4bad152f4676d97d77c6d"} Aug 05 17:24:17.693694 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:17.693655 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2791a0a9-973e-45eb-bf3b-7a1d9b0cf605-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-klw7f\" (UID: \"2791a0a9-973e-45eb-bf3b-7a1d9b0cf605\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-klw7f" Aug 05 17:24:17.693982 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:17.693896 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 05 17:24:17.693982 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:17.693969 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2791a0a9-973e-45eb-bf3b-7a1d9b0cf605-samples-operator-tls podName:2791a0a9-973e-45eb-bf3b-7a1d9b0cf605 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:19.693946575 +0000 UTC m=+47.461326789 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2791a0a9-973e-45eb-bf3b-7a1d9b0cf605-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-klw7f" (UID: "2791a0a9-973e-45eb-bf3b-7a1d9b0cf605") : secret "samples-operator-tls" not found Aug 05 17:24:17.794353 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:17.794312 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7bee8cb-675d-4da7-a767-149f0d6e026f-service-ca-bundle\") pod \"router-default-5ddbb5b6b4-262r4\" (UID: \"d7bee8cb-675d-4da7-a767-149f0d6e026f\") " pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" Aug 05 17:24:17.794545 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:17.794446 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/242a220c-bc69-4451-91eb-58260fb20552-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-hjdq2\" (UID: \"242a220c-bc69-4451-91eb-58260fb20552\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-hjdq2" Aug 05 17:24:17.794545 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:17.794517 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-lpd2k\" (UID: \"fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-lpd2k" Aug 05 17:24:17.794660 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:17.794572 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7bee8cb-675d-4da7-a767-149f0d6e026f-metrics-certs\") pod \"router-default-5ddbb5b6b4-262r4\" (UID: \"d7bee8cb-675d-4da7-a767-149f0d6e026f\") " pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" Aug 05 17:24:17.794802 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:17.794759 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 05 17:24:17.794870 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:17.794834 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7bee8cb-675d-4da7-a767-149f0d6e026f-metrics-certs podName:d7bee8cb-675d-4da7-a767-149f0d6e026f nodeName:}" failed. No retries permitted until 2026-08-05 17:24:19.794814282 +0000 UTC m=+47.562194509 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d7bee8cb-675d-4da7-a767-149f0d6e026f-metrics-certs") pod "router-default-5ddbb5b6b4-262r4" (UID: "d7bee8cb-675d-4da7-a767-149f0d6e026f") : secret "router-metrics-certs-default" not found Aug 05 17:24:17.795425 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:17.795367 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d7bee8cb-675d-4da7-a767-149f0d6e026f-service-ca-bundle podName:d7bee8cb-675d-4da7-a767-149f0d6e026f nodeName:}" failed. No retries permitted until 2026-08-05 17:24:19.795348509 +0000 UTC m=+47.562728724 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d7bee8cb-675d-4da7-a767-149f0d6e026f-service-ca-bundle") pod "router-default-5ddbb5b6b4-262r4" (UID: "d7bee8cb-675d-4da7-a767-149f0d6e026f") : configmap references non-existent config key: service-ca.crt Aug 05 17:24:17.795518 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:17.795454 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Aug 05 17:24:17.795518 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:17.795497 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/242a220c-bc69-4451-91eb-58260fb20552-networking-console-plugin-cert podName:242a220c-bc69-4451-91eb-58260fb20552 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:19.79548105 +0000 UTC m=+47.562861265 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/242a220c-bc69-4451-91eb-58260fb20552-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-hjdq2" (UID: "242a220c-bc69-4451-91eb-58260fb20552") : secret "networking-console-plugin-cert" not found Aug 05 17:24:17.795615 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:17.795574 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 05 17:24:17.795615 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:17.795609 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de-cluster-monitoring-operator-tls podName:fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de nodeName:}" failed. No retries permitted until 2026-08-05 17:24:19.795598033 +0000 UTC m=+47.562978247 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-lpd2k" (UID: "fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de") : secret "cluster-monitoring-operator-tls" not found Aug 05 17:24:19.715046 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:19.715001 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2791a0a9-973e-45eb-bf3b-7a1d9b0cf605-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-klw7f\" (UID: \"2791a0a9-973e-45eb-bf3b-7a1d9b0cf605\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-klw7f" Aug 05 17:24:19.715447 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:19.715172 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 05 17:24:19.715447 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:19.715243 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2791a0a9-973e-45eb-bf3b-7a1d9b0cf605-samples-operator-tls podName:2791a0a9-973e-45eb-bf3b-7a1d9b0cf605 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:23.715226193 +0000 UTC m=+51.482606404 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2791a0a9-973e-45eb-bf3b-7a1d9b0cf605-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-klw7f" (UID: "2791a0a9-973e-45eb-bf3b-7a1d9b0cf605") : secret "samples-operator-tls" not found Aug 05 17:24:19.815516 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:19.815478 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7bee8cb-675d-4da7-a767-149f0d6e026f-service-ca-bundle\") pod \"router-default-5ddbb5b6b4-262r4\" (UID: \"d7bee8cb-675d-4da7-a767-149f0d6e026f\") " pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" Aug 05 17:24:19.815672 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:19.815616 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/242a220c-bc69-4451-91eb-58260fb20552-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-hjdq2\" (UID: \"242a220c-bc69-4451-91eb-58260fb20552\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-hjdq2" Aug 05 17:24:19.815672 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:19.815643 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d7bee8cb-675d-4da7-a767-149f0d6e026f-service-ca-bundle podName:d7bee8cb-675d-4da7-a767-149f0d6e026f nodeName:}" failed. No retries permitted until 2026-08-05 17:24:23.815625025 +0000 UTC m=+51.583005240 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d7bee8cb-675d-4da7-a767-149f0d6e026f-service-ca-bundle") pod "router-default-5ddbb5b6b4-262r4" (UID: "d7bee8cb-675d-4da7-a767-149f0d6e026f") : configmap references non-existent config key: service-ca.crt Aug 05 17:24:19.815759 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:19.815702 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Aug 05 17:24:19.815759 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:19.815709 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-lpd2k\" (UID: \"fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-lpd2k" Aug 05 17:24:19.815759 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:19.815748 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7bee8cb-675d-4da7-a767-149f0d6e026f-metrics-certs\") pod \"router-default-5ddbb5b6b4-262r4\" (UID: \"d7bee8cb-675d-4da7-a767-149f0d6e026f\") " pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" Aug 05 17:24:19.815759 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:19.815760 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/242a220c-bc69-4451-91eb-58260fb20552-networking-console-plugin-cert podName:242a220c-bc69-4451-91eb-58260fb20552 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:23.81574601 +0000 UTC m=+51.583126225 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/242a220c-bc69-4451-91eb-58260fb20552-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-hjdq2" (UID: "242a220c-bc69-4451-91eb-58260fb20552") : secret "networking-console-plugin-cert" not found Aug 05 17:24:19.815915 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:19.815801 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 05 17:24:19.815915 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:19.815832 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7bee8cb-675d-4da7-a767-149f0d6e026f-metrics-certs podName:d7bee8cb-675d-4da7-a767-149f0d6e026f nodeName:}" failed. No retries permitted until 2026-08-05 17:24:23.815823972 +0000 UTC m=+51.583204183 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d7bee8cb-675d-4da7-a767-149f0d6e026f-metrics-certs") pod "router-default-5ddbb5b6b4-262r4" (UID: "d7bee8cb-675d-4da7-a767-149f0d6e026f") : secret "router-metrics-certs-default" not found Aug 05 17:24:19.815915 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:19.815853 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 05 17:24:19.815915 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:19.815901 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de-cluster-monitoring-operator-tls podName:fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de nodeName:}" failed. No retries permitted until 2026-08-05 17:24:23.815887624 +0000 UTC m=+51.583267840 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-lpd2k" (UID: "fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de") : secret "cluster-monitoring-operator-tls" not found Aug 05 17:24:21.505124 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:21.505089 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:21.582196 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:21.582155 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:21.750533 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:21.750444 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:22.013623 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:22.013583 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:22.079721 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:22.079655 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:23.115504 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.115408 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-qndgm" event={"ID":"ed74188c-5baf-4e5c-b6e6-e71524f8ff3a","Type":"ContainerStarted","Data":"483ec8e2ce19325de2ea6837fbdcc83f3bac38cc71dcbfdd8ebd3eca8bb063c7"} Aug 05 17:24:23.117963 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.117909 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-vjkmk" event={"ID":"45a097fa-7f29-42cc-b351-931955a10ccf","Type":"ContainerStarted","Data":"f5fa12db5d9ea3813b2e666876c02c9d2b2da4b2b4840aaf74fbe067aecac23f"} Aug 05 17:24:23.119697 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.119674 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-5qdp4_e8e537f1-bb75-456e-973b-5ccffc3077c9/console-operator/0.log" Aug 05 17:24:23.119813 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.119713 2579 generic.go:356] "Generic (PLEG): container finished" podID="e8e537f1-bb75-456e-973b-5ccffc3077c9" containerID="a8bcb3bbd694aea8650e0131b6405c15ac86a363bc66163c7f33f34356cbc5d1" exitCode=255 Aug 05 17:24:23.119876 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.119810 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-5qdp4" event={"ID":"e8e537f1-bb75-456e-973b-5ccffc3077c9","Type":"ContainerDied","Data":"a8bcb3bbd694aea8650e0131b6405c15ac86a363bc66163c7f33f34356cbc5d1"} Aug 05 17:24:23.120061 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.120043 2579 scope.go:117] "RemoveContainer" containerID="a8bcb3bbd694aea8650e0131b6405c15ac86a363bc66163c7f33f34356cbc5d1" Aug 05 17:24:23.121673 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.121630 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-vgc4l" event={"ID":"63a97bae-532f-40f8-843e-00921bee6ab3","Type":"ContainerStarted","Data":"5ff44660a021770d3d874a75abadba02512ac647a272a7c57a367e0eed523d08"} Aug 05 17:24:23.123816 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.123793 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-7xft8" event={"ID":"fcb6cf3e-3244-471a-9780-6c3fcc157551","Type":"ContainerStarted","Data":"50e34ccf1ad2a718fe3b2660d0d7e10e4fd8dab944f5559c369a5008865537bd"} Aug 05 17:24:23.125625 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.125603 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-52lff" event={"ID":"7fa167ca-16b6-4ab3-a8e2-c380b172790d","Type":"ContainerStarted","Data":"3f53a510dd6f136f83bfaaa0d56c0fdfdcc2605621254c80649fdc6183607bba"} Aug 05 17:24:23.131401 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.131363 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-qndgm" podStartSLOduration=1.04385804 podStartE2EDuration="7.131350699s" totalImagesPullingTime="6.087492659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:23.131026199 +0000 UTC m=+50.898406436" watchObservedRunningTime="2026-08-05 17:24:23.131350699 +0000 UTC m=+50.898730932" Aug 05 17:24:23.150557 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.150503 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-vgc4l" podStartSLOduration=2.255513405 podStartE2EDuration="8.150489684s" totalImagesPullingTime="5.894976279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:24:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:23.150342828 +0000 UTC m=+50.917723063" watchObservedRunningTime="2026-08-05 17:24:23.150489684 +0000 UTC m=+50.917869918" Aug 05 17:24:23.170840 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.170785 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-vjkmk" podStartSLOduration=1.211213399 podStartE2EDuration="7.170764299s" totalImagesPullingTime="5.9595509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:23.168676094 +0000 UTC m=+50.936056328" watchObservedRunningTime="2026-08-05 17:24:23.170764299 +0000 UTC m=+50.938144534" Aug 05 17:24:23.189157 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.188818 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-77696685b-7xft8" podStartSLOduration=1.252622094 podStartE2EDuration="7.188784179s" totalImagesPullingTime="5.936162085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:23.186979832 +0000 UTC m=+50.954360068" watchObservedRunningTime="2026-08-05 17:24:23.188784179 +0000 UTC m=+50.956164393" Aug 05 17:24:23.204316 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.204268 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-52lff" podStartSLOduration=2.042478067 podStartE2EDuration="8.204249971s" totalImagesPullingTime="6.161771904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:24:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:23.202753566 +0000 UTC m=+50.970133800" watchObservedRunningTime="2026-08-05 17:24:23.204249971 +0000 UTC m=+50.971630182" Aug 05 17:24:23.237341 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.237315 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:23.337568 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.337534 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:23.720096 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.720060 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dnlk4"] Aug 05 17:24:23.729016 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.728982 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:23.741440 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.741411 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dnlk4"] Aug 05 17:24:23.741599 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.741484 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dnlk4" Aug 05 17:24:23.744666 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.744647 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Aug 05 17:24:23.744666 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.744660 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7lm82\"" Aug 05 17:24:23.744841 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.744647 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Aug 05 17:24:23.758893 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.758842 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2791a0a9-973e-45eb-bf3b-7a1d9b0cf605-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-klw7f\" (UID: \"2791a0a9-973e-45eb-bf3b-7a1d9b0cf605\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-klw7f" Aug 05 17:24:23.759056 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:23.759017 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 05 17:24:23.759123 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:23.759113 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2791a0a9-973e-45eb-bf3b-7a1d9b0cf605-samples-operator-tls podName:2791a0a9-973e-45eb-bf3b-7a1d9b0cf605 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:31.7590887 +0000 UTC m=+59.526468912 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/2791a0a9-973e-45eb-bf3b-7a1d9b0cf605-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-klw7f" (UID: "2791a0a9-973e-45eb-bf3b-7a1d9b0cf605") : secret "samples-operator-tls" not found Aug 05 17:24:23.860102 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.860067 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-lpd2k\" (UID: \"fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-lpd2k" Aug 05 17:24:23.860300 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.860137 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7bee8cb-675d-4da7-a767-149f0d6e026f-metrics-certs\") pod \"router-default-5ddbb5b6b4-262r4\" (UID: \"d7bee8cb-675d-4da7-a767-149f0d6e026f\") " pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" Aug 05 17:24:23.860300 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.860188 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1244d989-fade-4f1b-82f7-9799752149f6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dnlk4\" (UID: \"1244d989-fade-4f1b-82f7-9799752149f6\") " pod="openshift-insights/insights-runtime-extractor-dnlk4" Aug 05 17:24:23.860300 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.860232 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1244d989-fade-4f1b-82f7-9799752149f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dnlk4\" (UID: \"1244d989-fade-4f1b-82f7-9799752149f6\") " pod="openshift-insights/insights-runtime-extractor-dnlk4" Aug 05 17:24:23.860300 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:23.860288 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 05 17:24:23.860495 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.860332 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7bee8cb-675d-4da7-a767-149f0d6e026f-service-ca-bundle\") pod \"router-default-5ddbb5b6b4-262r4\" (UID: \"d7bee8cb-675d-4da7-a767-149f0d6e026f\") " pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" Aug 05 17:24:23.860495 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:23.860360 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7bee8cb-675d-4da7-a767-149f0d6e026f-metrics-certs podName:d7bee8cb-675d-4da7-a767-149f0d6e026f nodeName:}" failed. No retries permitted until 2026-08-05 17:24:31.860339973 +0000 UTC m=+59.627720187 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d7bee8cb-675d-4da7-a767-149f0d6e026f-metrics-certs") pod "router-default-5ddbb5b6b4-262r4" (UID: "d7bee8cb-675d-4da7-a767-149f0d6e026f") : secret "router-metrics-certs-default" not found Aug 05 17:24:23.860495 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:23.860296 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 05 17:24:23.860495 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:23.860434 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d7bee8cb-675d-4da7-a767-149f0d6e026f-service-ca-bundle podName:d7bee8cb-675d-4da7-a767-149f0d6e026f nodeName:}" failed. No retries permitted until 2026-08-05 17:24:31.860418959 +0000 UTC m=+59.627799185 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d7bee8cb-675d-4da7-a767-149f0d6e026f-service-ca-bundle") pod "router-default-5ddbb5b6b4-262r4" (UID: "d7bee8cb-675d-4da7-a767-149f0d6e026f") : configmap references non-existent config key: service-ca.crt Aug 05 17:24:23.860495 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.860455 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65mcc\" (UniqueName: \"kubernetes.io/projected/1244d989-fade-4f1b-82f7-9799752149f6-kube-api-access-65mcc\") pod \"insights-runtime-extractor-dnlk4\" (UID: \"1244d989-fade-4f1b-82f7-9799752149f6\") " pod="openshift-insights/insights-runtime-extractor-dnlk4" Aug 05 17:24:23.860495 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:23.860461 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de-cluster-monitoring-operator-tls podName:fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de nodeName:}" failed. No retries permitted until 2026-08-05 17:24:31.860445592 +0000 UTC m=+59.627825819 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-lpd2k" (UID: "fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de") : secret "cluster-monitoring-operator-tls" not found Aug 05 17:24:23.860495 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.860493 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1244d989-fade-4f1b-82f7-9799752149f6-data-volume\") pod \"insights-runtime-extractor-dnlk4\" (UID: \"1244d989-fade-4f1b-82f7-9799752149f6\") " pod="openshift-insights/insights-runtime-extractor-dnlk4" Aug 05 17:24:23.860813 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.860536 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/242a220c-bc69-4451-91eb-58260fb20552-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-hjdq2\" (UID: \"242a220c-bc69-4451-91eb-58260fb20552\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-hjdq2" Aug 05 17:24:23.860813 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.860589 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1244d989-fade-4f1b-82f7-9799752149f6-crio-socket\") pod \"insights-runtime-extractor-dnlk4\" (UID: \"1244d989-fade-4f1b-82f7-9799752149f6\") " pod="openshift-insights/insights-runtime-extractor-dnlk4" Aug 05 17:24:23.860813 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:23.860613 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Aug 05 17:24:23.860813 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:23.860646 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/242a220c-bc69-4451-91eb-58260fb20552-networking-console-plugin-cert podName:242a220c-bc69-4451-91eb-58260fb20552 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:31.860636168 +0000 UTC m=+59.628016384 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/242a220c-bc69-4451-91eb-58260fb20552-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-hjdq2" (UID: "242a220c-bc69-4451-91eb-58260fb20552") : secret "networking-console-plugin-cert" not found Aug 05 17:24:23.870628 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.870598 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:23.961514 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.961413 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1244d989-fade-4f1b-82f7-9799752149f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dnlk4\" (UID: \"1244d989-fade-4f1b-82f7-9799752149f6\") " pod="openshift-insights/insights-runtime-extractor-dnlk4" Aug 05 17:24:23.961682 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.961535 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65mcc\" (UniqueName: \"kubernetes.io/projected/1244d989-fade-4f1b-82f7-9799752149f6-kube-api-access-65mcc\") pod \"insights-runtime-extractor-dnlk4\" (UID: \"1244d989-fade-4f1b-82f7-9799752149f6\") " pod="openshift-insights/insights-runtime-extractor-dnlk4" Aug 05 17:24:23.961682 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.961567 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1244d989-fade-4f1b-82f7-9799752149f6-data-volume\") pod \"insights-runtime-extractor-dnlk4\" (UID: \"1244d989-fade-4f1b-82f7-9799752149f6\") " pod="openshift-insights/insights-runtime-extractor-dnlk4" Aug 05 17:24:23.961682 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:23.961580 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 17:24:23.961682 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.961619 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-registry-tls\") pod \"image-registry-5966949c47-qg79w\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:24:23.961682 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:23.961656 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1244d989-fade-4f1b-82f7-9799752149f6-insights-runtime-extractor-tls podName:1244d989-fade-4f1b-82f7-9799752149f6 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:24.461635755 +0000 UTC m=+52.229015976 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1244d989-fade-4f1b-82f7-9799752149f6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dnlk4" (UID: "1244d989-fade-4f1b-82f7-9799752149f6") : secret "insights-runtime-extractor-tls" not found Aug 05 17:24:23.961910 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.961681 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1244d989-fade-4f1b-82f7-9799752149f6-crio-socket\") pod \"insights-runtime-extractor-dnlk4\" (UID: \"1244d989-fade-4f1b-82f7-9799752149f6\") " pod="openshift-insights/insights-runtime-extractor-dnlk4" Aug 05 17:24:23.961910 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:23.961710 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 05 17:24:23.961910 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:23.961724 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5966949c47-qg79w: secret "image-registry-tls" not found Aug 05 17:24:23.961910 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:23.961769 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-registry-tls podName:373295e7-1a34-48dc-87f0-c64e319eb1e1 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:39.961753226 +0000 UTC m=+67.729133440 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-registry-tls") pod "image-registry-5966949c47-qg79w" (UID: "373295e7-1a34-48dc-87f0-c64e319eb1e1") : secret "image-registry-tls" not found Aug 05 17:24:23.961910 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.961766 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1244d989-fade-4f1b-82f7-9799752149f6-crio-socket\") pod \"insights-runtime-extractor-dnlk4\" (UID: \"1244d989-fade-4f1b-82f7-9799752149f6\") " pod="openshift-insights/insights-runtime-extractor-dnlk4" Aug 05 17:24:23.961910 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.961787 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d48c235-6230-45af-8726-39db507d6fa3-metrics-tls\") pod \"dns-default-9z24f\" (UID: \"3d48c235-6230-45af-8726-39db507d6fa3\") " pod="openshift-dns/dns-default-9z24f" Aug 05 17:24:23.961910 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.961845 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1244d989-fade-4f1b-82f7-9799752149f6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dnlk4\" (UID: \"1244d989-fade-4f1b-82f7-9799752149f6\") " pod="openshift-insights/insights-runtime-extractor-dnlk4" Aug 05 17:24:23.961910 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:23.961852 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 17:24:23.962233 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:23.961914 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 05 17:24:23.962233 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:23.961939 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d48c235-6230-45af-8726-39db507d6fa3-metrics-tls podName:3d48c235-6230-45af-8726-39db507d6fa3 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:39.96192321 +0000 UTC m=+67.729303429 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d48c235-6230-45af-8726-39db507d6fa3-metrics-tls") pod "dns-default-9z24f" (UID: "3d48c235-6230-45af-8726-39db507d6fa3") : secret "dns-default-metrics-tls" not found Aug 05 17:24:23.962233 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:23.961956 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1244d989-fade-4f1b-82f7-9799752149f6-kube-rbac-proxy-cm podName:1244d989-fade-4f1b-82f7-9799752149f6 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:24.461946656 +0000 UTC m=+52.229326874 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1244d989-fade-4f1b-82f7-9799752149f6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dnlk4" (UID: "1244d989-fade-4f1b-82f7-9799752149f6") : configmap "kube-rbac-proxy" not found Aug 05 17:24:23.962233 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.961986 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1244d989-fade-4f1b-82f7-9799752149f6-data-volume\") pod \"insights-runtime-extractor-dnlk4\" (UID: \"1244d989-fade-4f1b-82f7-9799752149f6\") " pod="openshift-insights/insights-runtime-extractor-dnlk4" Aug 05 17:24:23.971069 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.970657 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65mcc\" (UniqueName: \"kubernetes.io/projected/1244d989-fade-4f1b-82f7-9799752149f6-kube-api-access-65mcc\") pod \"insights-runtime-extractor-dnlk4\" (UID: \"1244d989-fade-4f1b-82f7-9799752149f6\") " pod="openshift-insights/insights-runtime-extractor-dnlk4" Aug 05 17:24:23.976861 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:23.976068 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:24.131368 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:24.131334 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-5qdp4_e8e537f1-bb75-456e-973b-5ccffc3077c9/console-operator/1.log" Aug 05 17:24:24.131881 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:24.131860 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-5qdp4_e8e537f1-bb75-456e-973b-5ccffc3077c9/console-operator/0.log" Aug 05 17:24:24.131953 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:24.131904 2579 generic.go:356] "Generic (PLEG): container finished" podID="e8e537f1-bb75-456e-973b-5ccffc3077c9" containerID="132bb5ab871051e0cf7d99d113489c0b2e9d8dd185351169eb6df1ded84e5697" exitCode=255 Aug 05 17:24:24.132459 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:24.132388 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-5qdp4" event={"ID":"e8e537f1-bb75-456e-973b-5ccffc3077c9","Type":"ContainerDied","Data":"132bb5ab871051e0cf7d99d113489c0b2e9d8dd185351169eb6df1ded84e5697"} Aug 05 17:24:24.132594 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:24.132541 2579 scope.go:117] "RemoveContainer" containerID="a8bcb3bbd694aea8650e0131b6405c15ac86a363bc66163c7f33f34356cbc5d1" Aug 05 17:24:24.132890 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:24.132811 2579 scope.go:117] "RemoveContainer" containerID="132bb5ab871051e0cf7d99d113489c0b2e9d8dd185351169eb6df1ded84e5697" Aug 05 17:24:24.133022 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:24.132998 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-5qdp4_openshift-console-operator(e8e537f1-bb75-456e-973b-5ccffc3077c9)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-5qdp4" podUID="e8e537f1-bb75-456e-973b-5ccffc3077c9" Aug 05 17:24:24.395462 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:24.395425 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:24.463540 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:24.463498 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:24.466536 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:24.466504 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1244d989-fade-4f1b-82f7-9799752149f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dnlk4\" (UID: \"1244d989-fade-4f1b-82f7-9799752149f6\") " pod="openshift-insights/insights-runtime-extractor-dnlk4" Aug 05 17:24:24.466667 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:24.466653 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 17:24:24.466724 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:24.466706 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1244d989-fade-4f1b-82f7-9799752149f6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dnlk4\" (UID: \"1244d989-fade-4f1b-82f7-9799752149f6\") " pod="openshift-insights/insights-runtime-extractor-dnlk4" Aug 05 17:24:24.466761 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:24.466725 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1244d989-fade-4f1b-82f7-9799752149f6-insights-runtime-extractor-tls podName:1244d989-fade-4f1b-82f7-9799752149f6 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:25.466705958 +0000 UTC m=+53.234086184 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1244d989-fade-4f1b-82f7-9799752149f6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dnlk4" (UID: "1244d989-fade-4f1b-82f7-9799752149f6") : secret "insights-runtime-extractor-tls" not found Aug 05 17:24:24.466802 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:24.466784 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 05 17:24:24.466840 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:24.466831 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1244d989-fade-4f1b-82f7-9799752149f6-kube-rbac-proxy-cm podName:1244d989-fade-4f1b-82f7-9799752149f6 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:25.466816533 +0000 UTC m=+53.234196745 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1244d989-fade-4f1b-82f7-9799752149f6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dnlk4" (UID: "1244d989-fade-4f1b-82f7-9799752149f6") : configmap "kube-rbac-proxy" not found Aug 05 17:24:24.749122 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:24.749032 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:24.821876 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:24.821838 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:24.877584 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:24.877550 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:25.113570 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:25.113534 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:25.136790 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:25.136765 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-5qdp4_e8e537f1-bb75-456e-973b-5ccffc3077c9/console-operator/1.log" Aug 05 17:24:25.137203 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:25.137088 2579 scope.go:117] "RemoveContainer" containerID="132bb5ab871051e0cf7d99d113489c0b2e9d8dd185351169eb6df1ded84e5697" Aug 05 17:24:25.137272 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:25.137254 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-5qdp4_openshift-console-operator(e8e537f1-bb75-456e-973b-5ccffc3077c9)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-5qdp4" podUID="e8e537f1-bb75-456e-973b-5ccffc3077c9" Aug 05 17:24:25.174563 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:25.174529 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:25.474609 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:25.474534 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1244d989-fade-4f1b-82f7-9799752149f6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dnlk4\" (UID: \"1244d989-fade-4f1b-82f7-9799752149f6\") " pod="openshift-insights/insights-runtime-extractor-dnlk4" Aug 05 17:24:25.474609 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:25.474582 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1244d989-fade-4f1b-82f7-9799752149f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dnlk4\" (UID: \"1244d989-fade-4f1b-82f7-9799752149f6\") " pod="openshift-insights/insights-runtime-extractor-dnlk4" Aug 05 17:24:25.474834 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:25.474697 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 17:24:25.474834 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:25.474754 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1244d989-fade-4f1b-82f7-9799752149f6-insights-runtime-extractor-tls podName:1244d989-fade-4f1b-82f7-9799752149f6 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:27.474737972 +0000 UTC m=+55.242118182 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1244d989-fade-4f1b-82f7-9799752149f6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dnlk4" (UID: "1244d989-fade-4f1b-82f7-9799752149f6") : secret "insights-runtime-extractor-tls" not found Aug 05 17:24:25.475044 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:25.475026 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1244d989-fade-4f1b-82f7-9799752149f6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dnlk4\" (UID: \"1244d989-fade-4f1b-82f7-9799752149f6\") " pod="openshift-insights/insights-runtime-extractor-dnlk4" Aug 05 17:24:25.484307 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:25.484285 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2dhgr_dfa0d5d1-b355-44cc-abf9-124e11c44d6b/dns-node-resolver/0.log" Aug 05 17:24:25.604578 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:25.604543 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:25.705037 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:25.705008 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:25.806391 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:25.806299 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:26.347479 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:26.347438 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:26.353842 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:26.353819 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-5qdp4" Aug 05 17:24:26.353961 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:26.353913 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-5qdp4" Aug 05 17:24:26.354321 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:26.354305 2579 scope.go:117] "RemoveContainer" containerID="132bb5ab871051e0cf7d99d113489c0b2e9d8dd185351169eb6df1ded84e5697" Aug 05 17:24:26.354545 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:26.354515 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-5qdp4_openshift-console-operator(e8e537f1-bb75-456e-973b-5ccffc3077c9)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-5qdp4" podUID="e8e537f1-bb75-456e-973b-5ccffc3077c9" Aug 05 17:24:26.480681 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:26.480654 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6wt47_453d1073-3d90-4861-81d5-2c88980b98ed/node-ca/0.log" Aug 05 17:24:26.619066 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:26.618978 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:26.708501 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:26.708462 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:26.764276 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:26.764236 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:27.493066 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:27.493035 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1244d989-fade-4f1b-82f7-9799752149f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dnlk4\" (UID: \"1244d989-fade-4f1b-82f7-9799752149f6\") " pod="openshift-insights/insights-runtime-extractor-dnlk4" Aug 05 17:24:27.493466 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:27.493212 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 17:24:27.493466 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:27.493277 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1244d989-fade-4f1b-82f7-9799752149f6-insights-runtime-extractor-tls podName:1244d989-fade-4f1b-82f7-9799752149f6 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:31.493261006 +0000 UTC m=+59.260641217 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1244d989-fade-4f1b-82f7-9799752149f6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dnlk4" (UID: "1244d989-fade-4f1b-82f7-9799752149f6") : secret "insights-runtime-extractor-tls" not found Aug 05 17:24:27.512296 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:27.512265 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:27.681741 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:27.681715 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rd22r_67501f22-9897-4528-a8d0-4e55e82e41e0/serve-healthcheck-canary/0.log" Aug 05 17:24:30.676079 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:30.676049 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:30.777231 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:30.777192 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:30.895639 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:30.895599 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:30.995008 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:30.994906 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:31.102572 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:31.102534 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:31.426480 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:31.426447 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:31.529831 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:31.529785 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1244d989-fade-4f1b-82f7-9799752149f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dnlk4\" (UID: \"1244d989-fade-4f1b-82f7-9799752149f6\") " pod="openshift-insights/insights-runtime-extractor-dnlk4" Aug 05 17:24:31.530012 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:31.529934 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 17:24:31.530055 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:31.530015 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1244d989-fade-4f1b-82f7-9799752149f6-insights-runtime-extractor-tls podName:1244d989-fade-4f1b-82f7-9799752149f6 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:39.529999195 +0000 UTC m=+67.297379407 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1244d989-fade-4f1b-82f7-9799752149f6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dnlk4" (UID: "1244d989-fade-4f1b-82f7-9799752149f6") : secret "insights-runtime-extractor-tls" not found Aug 05 17:24:31.832551 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:31.832520 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2791a0a9-973e-45eb-bf3b-7a1d9b0cf605-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-klw7f\" (UID: \"2791a0a9-973e-45eb-bf3b-7a1d9b0cf605\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-klw7f" Aug 05 17:24:31.834919 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:31.834889 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/2791a0a9-973e-45eb-bf3b-7a1d9b0cf605-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-klw7f\" (UID: \"2791a0a9-973e-45eb-bf3b-7a1d9b0cf605\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-klw7f" Aug 05 17:24:31.933331 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:31.933289 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/242a220c-bc69-4451-91eb-58260fb20552-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-hjdq2\" (UID: \"242a220c-bc69-4451-91eb-58260fb20552\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-hjdq2" Aug 05 17:24:31.933540 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:31.933366 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-lpd2k\" (UID: \"fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-lpd2k" Aug 05 17:24:31.933540 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:31.933400 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7bee8cb-675d-4da7-a767-149f0d6e026f-metrics-certs\") pod \"router-default-5ddbb5b6b4-262r4\" (UID: \"d7bee8cb-675d-4da7-a767-149f0d6e026f\") " pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" Aug 05 17:24:31.933540 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:31.933450 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7bee8cb-675d-4da7-a767-149f0d6e026f-service-ca-bundle\") pod \"router-default-5ddbb5b6b4-262r4\" (UID: \"d7bee8cb-675d-4da7-a767-149f0d6e026f\") " pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" Aug 05 17:24:31.933540 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:31.933474 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Aug 05 17:24:31.933540 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:31.933511 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Aug 05 17:24:31.933540 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:31.933525 2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 05 17:24:31.933786 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:31.933555 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/242a220c-bc69-4451-91eb-58260fb20552-networking-console-plugin-cert podName:242a220c-bc69-4451-91eb-58260fb20552 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:47.933534796 +0000 UTC m=+75.700915024 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/242a220c-bc69-4451-91eb-58260fb20552-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-hjdq2" (UID: "242a220c-bc69-4451-91eb-58260fb20552") : secret "networking-console-plugin-cert" not found Aug 05 17:24:31.933786 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:31.933576 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de-cluster-monitoring-operator-tls podName:fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de nodeName:}" failed. No retries permitted until 2026-08-05 17:24:47.933566131 +0000 UTC m=+75.700946342 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-lpd2k" (UID: "fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de") : secret "cluster-monitoring-operator-tls" not found Aug 05 17:24:31.933786 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:31.933593 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d7bee8cb-675d-4da7-a767-149f0d6e026f-service-ca-bundle podName:d7bee8cb-675d-4da7-a767-149f0d6e026f nodeName:}" failed. No retries permitted until 2026-08-05 17:24:47.933583889 +0000 UTC m=+75.700964106 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d7bee8cb-675d-4da7-a767-149f0d6e026f-service-ca-bundle") pod "router-default-5ddbb5b6b4-262r4" (UID: "d7bee8cb-675d-4da7-a767-149f0d6e026f") : configmap references non-existent config key: service-ca.crt Aug 05 17:24:31.933786 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:31.933610 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7bee8cb-675d-4da7-a767-149f0d6e026f-metrics-certs podName:d7bee8cb-675d-4da7-a767-149f0d6e026f nodeName:}" failed. No retries permitted until 2026-08-05 17:24:47.933599806 +0000 UTC m=+75.700980018 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d7bee8cb-675d-4da7-a767-149f0d6e026f-metrics-certs") pod "router-default-5ddbb5b6b4-262r4" (UID: "d7bee8cb-675d-4da7-a767-149f0d6e026f") : secret "router-metrics-certs-default" not found Aug 05 17:24:31.967656 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:31.967620 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-klw7f" Aug 05 17:24:32.107391 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:32.107310 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-klw7f"] Aug 05 17:24:32.162626 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:32.162597 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-klw7f" event={"ID":"2791a0a9-973e-45eb-bf3b-7a1d9b0cf605","Type":"ContainerStarted","Data":"b60090c470cb4c1da238e8b2adb5718e71d4005483729b7c6278bb81de6e358e"} Aug 05 17:24:32.337310 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:32.337271 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:32.621822 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:32.621789 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:32.777205 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:32.777166 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:32.977763 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:32.977672 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:33.046436 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:33.046409 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w8nvr" Aug 05 17:24:33.172492 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:33.172456 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:33.384257 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:33.384227 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:34.170490 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:34.170407 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-klw7f" event={"ID":"2791a0a9-973e-45eb-bf3b-7a1d9b0cf605","Type":"ContainerStarted","Data":"fdaebbe3b82e213ff563ea4e2fae96ddb2b80e6c90aeb294bdedf9808984b09a"} Aug 05 17:24:34.170490 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:34.170456 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-klw7f" event={"ID":"2791a0a9-973e-45eb-bf3b-7a1d9b0cf605","Type":"ContainerStarted","Data":"7829304c04339afff90772257fb3c58e9dfe0d12e1c2a1f63fc3e6c051552175"} Aug 05 17:24:34.190234 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:34.190185 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-klw7f" podStartSLOduration=16.52304392 podStartE2EDuration="18.190167734s" totalImagesPullingTime="1.667123814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:34.189526002 +0000 UTC m=+61.956906235" watchObservedRunningTime="2026-08-05 17:24:34.190167734 +0000 UTC m=+61.957547961" Aug 05 17:24:34.237736 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:34.237678 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:34.384975 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:34.384916 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:34.569577 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:34.569497 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:34.775123 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:34.775091 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:34.982909 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:34.982876 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:35.178531 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:35.178483 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:35.369828 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:35.369798 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:36.465947 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:36.465912 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:36.523744 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:36.523699 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:36.581997 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:36.581957 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:36.764664 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:36.764590 2579 scope.go:117] "RemoveContainer" containerID="132bb5ab871051e0cf7d99d113489c0b2e9d8dd185351169eb6df1ded84e5697" Aug 05 17:24:36.778825 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:36.778803 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:37.016917 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:37.016833 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:37.181628 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:37.181597 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-5qdp4_e8e537f1-bb75-456e-973b-5ccffc3077c9/console-operator/2.log" Aug 05 17:24:37.182009 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:37.181993 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-5qdp4_e8e537f1-bb75-456e-973b-5ccffc3077c9/console-operator/1.log" Aug 05 17:24:37.182081 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:37.182024 2579 generic.go:356] "Generic (PLEG): container finished" podID="e8e537f1-bb75-456e-973b-5ccffc3077c9" containerID="0f7eed3fd9b5f57ed32470c87432153b67c8dac6a9229e5a213bf3d71304fba0" exitCode=255 Aug 05 17:24:37.182116 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:37.182083 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-5qdp4" event={"ID":"e8e537f1-bb75-456e-973b-5ccffc3077c9","Type":"ContainerDied","Data":"0f7eed3fd9b5f57ed32470c87432153b67c8dac6a9229e5a213bf3d71304fba0"} Aug 05 17:24:37.182166 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:37.182130 2579 scope.go:117] "RemoveContainer" containerID="132bb5ab871051e0cf7d99d113489c0b2e9d8dd185351169eb6df1ded84e5697" Aug 05 17:24:37.182467 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:37.182440 2579 scope.go:117] "RemoveContainer" containerID="0f7eed3fd9b5f57ed32470c87432153b67c8dac6a9229e5a213bf3d71304fba0" Aug 05 17:24:37.182629 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:37.182609 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5ccd6b445f-5qdp4_openshift-console-operator(e8e537f1-bb75-456e-973b-5ccffc3077c9)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-5qdp4" podUID="e8e537f1-bb75-456e-973b-5ccffc3077c9" Aug 05 17:24:37.214035 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:37.213997 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:37.379931 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:37.379896 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:38.187193 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:38.187169 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-5qdp4_e8e537f1-bb75-456e-973b-5ccffc3077c9/console-operator/2.log" Aug 05 17:24:38.415933 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:38.415901 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:38.493441 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:38.493342 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e79bda8c-75ee-4022-a816-f55a58cec6c0-metrics-certs\") pod \"network-metrics-daemon-dmchc\" (UID: \"e79bda8c-75ee-4022-a816-f55a58cec6c0\") " pod="openshift-multus/network-metrics-daemon-dmchc" Aug 05 17:24:38.496335 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:38.496319 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Aug 05 17:24:38.506163 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:38.506128 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e79bda8c-75ee-4022-a816-f55a58cec6c0-metrics-certs\") pod \"network-metrics-daemon-dmchc\" (UID: \"e79bda8c-75ee-4022-a816-f55a58cec6c0\") " pod="openshift-multus/network-metrics-daemon-dmchc" Aug 05 17:24:38.588938 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:38.588911 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jss2d\"" Aug 05 17:24:38.598478 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:38.598438 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dmchc" Aug 05 17:24:38.598977 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:38.598600 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/196cbfc1-efdb-48ef-a5ec-f99c27f2e289-original-pull-secret\") pod \"global-pull-secret-syncer-dbt75\" (UID: \"196cbfc1-efdb-48ef-a5ec-f99c27f2e289\") " pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:24:38.601954 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:38.601938 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Aug 05 17:24:38.612099 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:38.612067 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/196cbfc1-efdb-48ef-a5ec-f99c27f2e289-original-pull-secret\") pod \"global-pull-secret-syncer-dbt75\" (UID: \"196cbfc1-efdb-48ef-a5ec-f99c27f2e289\") " pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:24:38.699871 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:38.699840 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9ztk\" (UniqueName: \"kubernetes.io/projected/fefd4a72-b897-4f18-a3f2-eacedc50bfce-kube-api-access-z9ztk\") pod \"network-check-target-4jrks\" (UID: \"fefd4a72-b897-4f18-a3f2-eacedc50bfce\") " pod="openshift-network-diagnostics/network-check-target-4jrks" Aug 05 17:24:38.702648 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:38.702623 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9ztk\" (UniqueName: \"kubernetes.io/projected/fefd4a72-b897-4f18-a3f2-eacedc50bfce-kube-api-access-z9ztk\") pod \"network-check-target-4jrks\" (UID: \"fefd4a72-b897-4f18-a3f2-eacedc50bfce\") " pod="openshift-network-diagnostics/network-check-target-4jrks" Aug 05 17:24:38.725126 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:38.725106 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dmchc"] Aug 05 17:24:38.727481 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:24:38.727456 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode79bda8c_75ee_4022_a816_f55a58cec6c0.slice/crio-1cc6adf3427eae753b115f505de5fe0ea42857fd12a57d099d201bfaf98b7ce1 WatchSource:0}: Error finding container 1cc6adf3427eae753b115f505de5fe0ea42857fd12a57d099d201bfaf98b7ce1: Status 404 returned error can't find the container with id 1cc6adf3427eae753b115f505de5fe0ea42857fd12a57d099d201bfaf98b7ce1 Aug 05 17:24:38.786973 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:38.786887 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:38.847309 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:38.847276 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:38.875632 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:38.875604 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dbt75" Aug 05 17:24:38.885293 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:38.885273 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5jc4t\"" Aug 05 17:24:38.892889 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:38.892867 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4jrks" Aug 05 17:24:38.977450 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:38.977194 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:39.008807 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:39.008664 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dbt75"] Aug 05 17:24:39.011365 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:24:39.011340 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod196cbfc1_efdb_48ef_a5ec_f99c27f2e289.slice/crio-7fa98e350ae8e1899805b1e9c91a98121861e4b15e629de75afbd053ab5ca96c WatchSource:0}: Error finding container 7fa98e350ae8e1899805b1e9c91a98121861e4b15e629de75afbd053ab5ca96c: Status 404 returned error can't find the container with id 7fa98e350ae8e1899805b1e9c91a98121861e4b15e629de75afbd053ab5ca96c Aug 05 17:24:39.022596 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:39.022539 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4jrks"] Aug 05 17:24:39.024788 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:24:39.024768 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfefd4a72_b897_4f18_a3f2_eacedc50bfce.slice/crio-cd85b8ca96bbfeda5aba07e7a74f0153f2423c354d3b9e56d70d7181a6c8e54c WatchSource:0}: Error finding container cd85b8ca96bbfeda5aba07e7a74f0153f2423c354d3b9e56d70d7181a6c8e54c: Status 404 returned error can't find the container with id cd85b8ca96bbfeda5aba07e7a74f0153f2423c354d3b9e56d70d7181a6c8e54c Aug 05 17:24:39.174183 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:39.174136 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:39.192691 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:39.192656 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dbt75" event={"ID":"196cbfc1-efdb-48ef-a5ec-f99c27f2e289","Type":"ContainerStarted","Data":"7fa98e350ae8e1899805b1e9c91a98121861e4b15e629de75afbd053ab5ca96c"} Aug 05 17:24:39.194369 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:39.194342 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4jrks" event={"ID":"fefd4a72-b897-4f18-a3f2-eacedc50bfce","Type":"ContainerStarted","Data":"5f5f6e290b730f901f4995d98a63113e4687e805e2bb7187ddbb4a69f48ce89e"} Aug 05 17:24:39.194498 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:39.194390 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4jrks" event={"ID":"fefd4a72-b897-4f18-a3f2-eacedc50bfce","Type":"ContainerStarted","Data":"cd85b8ca96bbfeda5aba07e7a74f0153f2423c354d3b9e56d70d7181a6c8e54c"} Aug 05 17:24:39.194498 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:39.194448 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4jrks" Aug 05 17:24:39.195739 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:39.195713 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dmchc" event={"ID":"e79bda8c-75ee-4022-a816-f55a58cec6c0","Type":"ContainerStarted","Data":"1cc6adf3427eae753b115f505de5fe0ea42857fd12a57d099d201bfaf98b7ce1"} Aug 05 17:24:39.213261 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:39.213204 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4jrks" podStartSLOduration=66.213183265 podStartE2EDuration="1m6.213183265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:23:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:39.212749637 +0000 UTC m=+66.980129871" watchObservedRunningTime="2026-08-05 17:24:39.213183265 +0000 UTC m=+66.980563499" Aug 05 17:24:39.569713 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:39.569672 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:39.608055 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:39.608015 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1244d989-fade-4f1b-82f7-9799752149f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dnlk4\" (UID: \"1244d989-fade-4f1b-82f7-9799752149f6\") " pod="openshift-insights/insights-runtime-extractor-dnlk4" Aug 05 17:24:39.610340 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:39.610312 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1244d989-fade-4f1b-82f7-9799752149f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dnlk4\" (UID: \"1244d989-fade-4f1b-82f7-9799752149f6\") " pod="openshift-insights/insights-runtime-extractor-dnlk4" Aug 05 17:24:39.656568 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:39.656542 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7lm82\"" Aug 05 17:24:39.663436 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:39.663417 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dnlk4" Aug 05 17:24:39.811770 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:39.811744 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dnlk4"] Aug 05 17:24:39.971358 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:39.971319 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:39.975448 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:24:39.975420 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1244d989_fade_4f1b_82f7_9799752149f6.slice/crio-62514293effeca79a7db2b6fd6663a34fd4f31901d768ecc674755c475d23108 WatchSource:0}: Error finding container 62514293effeca79a7db2b6fd6663a34fd4f31901d768ecc674755c475d23108: Status 404 returned error can't find the container with id 62514293effeca79a7db2b6fd6663a34fd4f31901d768ecc674755c475d23108 Aug 05 17:24:40.012352 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:40.012216 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-registry-tls\") pod \"image-registry-5966949c47-qg79w\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:24:40.012481 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:40.012439 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d48c235-6230-45af-8726-39db507d6fa3-metrics-tls\") pod \"dns-default-9z24f\" (UID: \"3d48c235-6230-45af-8726-39db507d6fa3\") " pod="openshift-dns/dns-default-9z24f" Aug 05 17:24:40.014995 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:40.014972 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d48c235-6230-45af-8726-39db507d6fa3-metrics-tls\") pod \"dns-default-9z24f\" (UID: \"3d48c235-6230-45af-8726-39db507d6fa3\") " pod="openshift-dns/dns-default-9z24f" Aug 05 17:24:40.015100 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:40.015077 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-registry-tls\") pod \"image-registry-5966949c47-qg79w\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:24:40.187990 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:40.187868 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kkcjr\"" Aug 05 17:24:40.195988 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:40.195959 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:24:40.202818 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:40.202785 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dmchc" event={"ID":"e79bda8c-75ee-4022-a816-f55a58cec6c0","Type":"ContainerStarted","Data":"c7de2b7120ca71871f4ba00e44eb92045f6a0f9554a3fbb1de76ccbf762a0426"} Aug 05 17:24:40.204849 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:40.204742 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dnlk4" event={"ID":"1244d989-fade-4f1b-82f7-9799752149f6","Type":"ContainerStarted","Data":"e6fbeecac15c5c0e8726ef45c42a60d28333a066a25ecdb5607011fcfcde8628"} Aug 05 17:24:40.204849 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:40.204808 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dnlk4" event={"ID":"1244d989-fade-4f1b-82f7-9799752149f6","Type":"ContainerStarted","Data":"62514293effeca79a7db2b6fd6663a34fd4f31901d768ecc674755c475d23108"} Aug 05 17:24:40.225436 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:40.225369 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xx7n6\"" Aug 05 17:24:40.232849 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:40.232824 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9z24f" Aug 05 17:24:40.386350 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:40.386317 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5966949c47-qg79w"] Aug 05 17:24:40.389594 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:24:40.389562 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod373295e7_1a34_48dc_87f0_c64e319eb1e1.slice/crio-16182f9c379daab264aa437dc80bc1c775867358d9fd955db7c6b127724ac654 WatchSource:0}: Error finding container 16182f9c379daab264aa437dc80bc1c775867358d9fd955db7c6b127724ac654: Status 404 returned error can't find the container with id 16182f9c379daab264aa437dc80bc1c775867358d9fd955db7c6b127724ac654 Aug 05 17:24:40.430323 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:40.430293 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9z24f"] Aug 05 17:24:40.433811 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:24:40.433782 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d48c235_6230_45af_8726_39db507d6fa3.slice/crio-422467209b18cd712d6a30f18f0c8a45a9f84ef3000e7415b8fe97f074e0b4d5 WatchSource:0}: Error finding container 422467209b18cd712d6a30f18f0c8a45a9f84ef3000e7415b8fe97f074e0b4d5: Status 404 returned error can't find the container with id 422467209b18cd712d6a30f18f0c8a45a9f84ef3000e7415b8fe97f074e0b4d5 Aug 05 17:24:40.577844 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:40.577814 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:40.970969 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:40.970909 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:41.175887 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:41.175853 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:41.211372 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:41.211314 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dmchc" event={"ID":"e79bda8c-75ee-4022-a816-f55a58cec6c0","Type":"ContainerStarted","Data":"f483119ec1c6da6e564b38ee226fcb5aeccadbc003ad4671cd10743315a68160"} Aug 05 17:24:41.212740 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:41.212708 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9z24f" event={"ID":"3d48c235-6230-45af-8726-39db507d6fa3","Type":"ContainerStarted","Data":"422467209b18cd712d6a30f18f0c8a45a9f84ef3000e7415b8fe97f074e0b4d5"} Aug 05 17:24:41.214401 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:41.214377 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5966949c47-qg79w" event={"ID":"373295e7-1a34-48dc-87f0-c64e319eb1e1","Type":"ContainerStarted","Data":"9de2b2a1b4829ee25f2221b3336e680c63a1f72b4ff512293c274551a82a717c"} Aug 05 17:24:41.214519 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:41.214427 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5966949c47-qg79w" event={"ID":"373295e7-1a34-48dc-87f0-c64e319eb1e1","Type":"ContainerStarted","Data":"16182f9c379daab264aa437dc80bc1c775867358d9fd955db7c6b127724ac654"} Aug 05 17:24:41.214519 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:41.214457 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:24:41.216389 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:41.216365 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dnlk4" event={"ID":"1244d989-fade-4f1b-82f7-9799752149f6","Type":"ContainerStarted","Data":"2664bbacd59a99443749f8b8070bff7c9c3ae2c6043c7b9c310013d0391f1b35"} Aug 05 17:24:41.228435 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:41.228333 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dmchc" podStartSLOduration=66.961612313 podStartE2EDuration="1m8.228316095s" totalImagesPullingTime="1.266703782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:23:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:41.227939484 +0000 UTC m=+68.995319717" watchObservedRunningTime="2026-08-05 17:24:41.228316095 +0000 UTC m=+68.995696329" Aug 05 17:24:41.249136 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:41.249078 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5966949c47-qg79w" podStartSLOduration=68.249057669 podStartE2EDuration="1m8.249057669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:23:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:41.248284331 +0000 UTC m=+69.015664566" watchObservedRunningTime="2026-08-05 17:24:41.249057669 +0000 UTC m=+69.016437906" Aug 05 17:24:41.372768 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:41.372683 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:44.229370 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:44.229279 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dbt75" event={"ID":"196cbfc1-efdb-48ef-a5ec-f99c27f2e289","Type":"ContainerStarted","Data":"22098cc05794dbed1b3bb6bf05efd10a21452cbbbaea9fa274d95bf7063bf562"} Aug 05 17:24:44.231508 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:44.231478 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dnlk4" event={"ID":"1244d989-fade-4f1b-82f7-9799752149f6","Type":"ContainerStarted","Data":"bf2abcdd7bdd034a024c677392e4da54f1bc00fd03a09369f010cad3528b2d72"} Aug 05 17:24:44.233484 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:44.233462 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9z24f" event={"ID":"3d48c235-6230-45af-8726-39db507d6fa3","Type":"ContainerStarted","Data":"111a179cb6de544f86c76e2745d3d36a9c767fb0f5334bc7fd842f2679872354"} Aug 05 17:24:44.233598 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:44.233499 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9z24f" event={"ID":"3d48c235-6230-45af-8726-39db507d6fa3","Type":"ContainerStarted","Data":"0eec6de3257c7488c95e4fa270020edf3fed4d909ede225719f61ca8a1edc339"} Aug 05 17:24:44.233598 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:44.233532 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9z24f" Aug 05 17:24:44.244101 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:44.244051 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dbt75" podStartSLOduration=66.256219234 podStartE2EDuration="1m11.244036562s" totalImagesPullingTime="4.987817328s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:23:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:44.243758959 +0000 UTC m=+72.011139193" watchObservedRunningTime="2026-08-05 17:24:44.244036562 +0000 UTC m=+72.011416773" Aug 05 17:24:44.262901 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:44.262843 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dnlk4" podStartSLOduration=17.510712852 podStartE2EDuration="21.262824681s" totalImagesPullingTime="3.752111829s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:24:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:44.262671048 +0000 UTC m=+72.030051291" watchObservedRunningTime="2026-08-05 17:24:44.262824681 +0000 UTC m=+72.030204916" Aug 05 17:24:44.280970 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:44.280916 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9z24f" podStartSLOduration=32.730881231 podStartE2EDuration="36.28089744s" totalImagesPullingTime="3.550016209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:24:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:44.279272554 +0000 UTC m=+72.046652787" watchObservedRunningTime="2026-08-05 17:24:44.28089744 +0000 UTC m=+72.048277674" Aug 05 17:24:46.354366 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:46.354326 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-5qdp4" Aug 05 17:24:46.354856 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:46.354395 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-5qdp4" Aug 05 17:24:46.354856 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:46.354823 2579 scope.go:117] "RemoveContainer" containerID="0f7eed3fd9b5f57ed32470c87432153b67c8dac6a9229e5a213bf3d71304fba0" Aug 05 17:24:46.355047 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:24:46.355022 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5ccd6b445f-5qdp4_openshift-console-operator(e8e537f1-bb75-456e-973b-5ccffc3077c9)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-5qdp4" podUID="e8e537f1-bb75-456e-973b-5ccffc3077c9" Aug 05 17:24:47.978855 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:47.978812 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/242a220c-bc69-4451-91eb-58260fb20552-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-hjdq2\" (UID: \"242a220c-bc69-4451-91eb-58260fb20552\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-hjdq2" Aug 05 17:24:47.979379 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:47.978870 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-lpd2k\" (UID: \"fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-lpd2k" Aug 05 17:24:47.979379 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:47.979048 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7bee8cb-675d-4da7-a767-149f0d6e026f-metrics-certs\") pod \"router-default-5ddbb5b6b4-262r4\" (UID: \"d7bee8cb-675d-4da7-a767-149f0d6e026f\") " pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" Aug 05 17:24:47.979379 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:47.979109 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7bee8cb-675d-4da7-a767-149f0d6e026f-service-ca-bundle\") pod \"router-default-5ddbb5b6b4-262r4\" (UID: \"d7bee8cb-675d-4da7-a767-149f0d6e026f\") " pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" Aug 05 17:24:47.979803 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:47.979781 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7bee8cb-675d-4da7-a767-149f0d6e026f-service-ca-bundle\") pod \"router-default-5ddbb5b6b4-262r4\" (UID: \"d7bee8cb-675d-4da7-a767-149f0d6e026f\") " pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" Aug 05 17:24:47.981341 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:47.981313 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/242a220c-bc69-4451-91eb-58260fb20552-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-hjdq2\" (UID: \"242a220c-bc69-4451-91eb-58260fb20552\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-hjdq2" Aug 05 17:24:47.981341 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:47.981327 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d7bee8cb-675d-4da7-a767-149f0d6e026f-metrics-certs\") pod \"router-default-5ddbb5b6b4-262r4\" (UID: \"d7bee8cb-675d-4da7-a767-149f0d6e026f\") " pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" Aug 05 17:24:47.981480 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:47.981465 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-lpd2k\" (UID: \"fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-lpd2k" Aug 05 17:24:48.182512 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:48.182480 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-6lgk4\"" Aug 05 17:24:48.190177 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:48.190133 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" Aug 05 17:24:48.263075 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:48.263045 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-6s4mp\"" Aug 05 17:24:48.270431 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:48.270369 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-hjdq2" Aug 05 17:24:48.274341 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:48.274307 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-prttc\"" Aug 05 17:24:48.281768 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:48.281746 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-lpd2k" Aug 05 17:24:48.322826 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:48.322742 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5ddbb5b6b4-262r4"] Aug 05 17:24:48.327929 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:24:48.327897 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7bee8cb_675d_4da7_a767_149f0d6e026f.slice/crio-140b690b88dfde40e766c0387e4d590c25015951222aeede8cd32ed04e48823e WatchSource:0}: Error finding container 140b690b88dfde40e766c0387e4d590c25015951222aeede8cd32ed04e48823e: Status 404 returned error can't find the container with id 140b690b88dfde40e766c0387e4d590c25015951222aeede8cd32ed04e48823e Aug 05 17:24:48.416645 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:48.416612 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-hjdq2"] Aug 05 17:24:48.419416 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:24:48.419391 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod242a220c_bc69_4451_91eb_58260fb20552.slice/crio-aa2d38be6022aa355d74dcf631f85cd7edc0e2ad680d931be1857df3984d918a WatchSource:0}: Error finding container aa2d38be6022aa355d74dcf631f85cd7edc0e2ad680d931be1857df3984d918a: Status 404 returned error can't find the container with id aa2d38be6022aa355d74dcf631f85cd7edc0e2ad680d931be1857df3984d918a Aug 05 17:24:48.440280 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:48.440255 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-lpd2k"] Aug 05 17:24:48.442647 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:24:48.442614 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc02435a_c76d_4a87_b5c8_c3f2a1d2e9de.slice/crio-e5e53b9defef967eef94994cfef0e93d7d2145afa8b1f07421515a1299159ae2 WatchSource:0}: Error finding container e5e53b9defef967eef94994cfef0e93d7d2145afa8b1f07421515a1299159ae2: Status 404 returned error can't find the container with id e5e53b9defef967eef94994cfef0e93d7d2145afa8b1f07421515a1299159ae2 Aug 05 17:24:49.253378 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:49.253336 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-hjdq2" event={"ID":"242a220c-bc69-4451-91eb-58260fb20552","Type":"ContainerStarted","Data":"aa2d38be6022aa355d74dcf631f85cd7edc0e2ad680d931be1857df3984d918a"} Aug 05 17:24:49.255045 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:49.255018 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" event={"ID":"d7bee8cb-675d-4da7-a767-149f0d6e026f","Type":"ContainerStarted","Data":"30c37273c6d2a5b36d4239206d85a8beedaf11227e924ba782a2de0dacec3ad1"} Aug 05 17:24:49.255199 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:49.255063 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" event={"ID":"d7bee8cb-675d-4da7-a767-149f0d6e026f","Type":"ContainerStarted","Data":"140b690b88dfde40e766c0387e4d590c25015951222aeede8cd32ed04e48823e"} Aug 05 17:24:49.256351 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:49.256325 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-lpd2k" event={"ID":"fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de","Type":"ContainerStarted","Data":"e5e53b9defef967eef94994cfef0e93d7d2145afa8b1f07421515a1299159ae2"} Aug 05 17:24:49.282080 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:49.282023 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" podStartSLOduration=33.282007913 podStartE2EDuration="33.282007913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:24:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:49.2806853 +0000 UTC m=+77.048065537" watchObservedRunningTime="2026-08-05 17:24:49.282007913 +0000 UTC m=+77.049388146" Aug 05 17:24:50.190729 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:50.190680 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" Aug 05 17:24:50.193672 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:50.193649 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" Aug 05 17:24:50.262574 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:50.262537 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-hjdq2" event={"ID":"242a220c-bc69-4451-91eb-58260fb20552","Type":"ContainerStarted","Data":"ae89724bb40a8d3cf80f476843657a24b8f1605a0ac7498ad553dc731220aa92"} Aug 05 17:24:50.263058 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:50.262623 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" Aug 05 17:24:50.264036 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:50.264005 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5ddbb5b6b4-262r4" Aug 05 17:24:50.279567 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:50.279512 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-f77f48c6d-hjdq2" podStartSLOduration=33.19905628 podStartE2EDuration="34.279494351s" totalImagesPullingTime="1.080438071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:50.278721678 +0000 UTC m=+78.046101934" watchObservedRunningTime="2026-08-05 17:24:50.279494351 +0000 UTC m=+78.046874591" Aug 05 17:24:50.674105 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:50.674063 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:50.829565 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:50.829528 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:51.222981 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:51.222945 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:51.270217 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:51.270179 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-lpd2k" event={"ID":"fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de","Type":"ContainerStarted","Data":"6eecb9c944ab19c77a7966b419a1bdbe75bbba5372cdcb6394eb323904b9a943"} Aug 05 17:24:51.286270 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:51.286223 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-lpd2k" podStartSLOduration=33.3644167 podStartE2EDuration="35.28620857s" totalImagesPullingTime="1.92179187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:51.28544243 +0000 UTC m=+79.052822657" watchObservedRunningTime="2026-08-05 17:24:51.28620857 +0000 UTC m=+79.053588802" Aug 05 17:24:51.499652 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:51.499561 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:51.558596 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:51.558571 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:52.921564 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:52.921526 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:53.011682 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:53.011648 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:53.131365 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:53.131329 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:53.230199 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:53.230167 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:53.330773 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:53.330743 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:54.240701 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:54.240673 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9z24f" Aug 05 17:24:57.256934 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:57.256893 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:57.355892 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:57.355855 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:57.763897 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:57.763865 2579 scope.go:117] "RemoveContainer" containerID="0f7eed3fd9b5f57ed32470c87432153b67c8dac6a9229e5a213bf3d71304fba0" Aug 05 17:24:58.298177 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:58.298133 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-5qdp4_e8e537f1-bb75-456e-973b-5ccffc3077c9/console-operator/2.log" Aug 05 17:24:58.298685 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:58.298197 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-5qdp4" event={"ID":"e8e537f1-bb75-456e-973b-5ccffc3077c9","Type":"ContainerStarted","Data":"eb19a1cb18413ca5e0dcc5d332713905748193ffd563edef233f3ade229a6bb3"} Aug 05 17:24:58.298685 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:58.298429 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-5qdp4" Aug 05 17:24:58.303069 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:58.303046 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5ccd6b445f-5qdp4" Aug 05 17:24:58.326844 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:58.326804 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:58.327804 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:58.327760 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5ccd6b445f-5qdp4" podStartSLOduration=36.224847191 podStartE2EDuration="42.327745376s" totalImagesPullingTime="6.102898185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:24:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:24:58.327375205 +0000 UTC m=+86.094755438" watchObservedRunningTime="2026-08-05 17:24:58.327745376 +0000 UTC m=+86.095125609" Aug 05 17:24:58.420647 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:58.420616 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:58.519792 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:58.519761 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:58.818395 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:58.818364 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:58.999077 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:58.999048 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:59.099890 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:59.099860 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:59.797057 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:59.797018 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:59.897935 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:59.897905 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:59.999536 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:24:59.999502 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:00.099635 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:00.099608 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:00.201285 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:00.201249 2579 patch_prober.go:28] interesting pod/image-registry-5966949c47-qg79w container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Aug 05 17:25:00.201451 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:00.201304 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5966949c47-qg79w" podUID="373295e7-1a34-48dc-87f0-c64e319eb1e1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:25:00.208319 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:00.208288 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:00.631741 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:00.631702 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:00.968927 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:00.968857 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:01.827934 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:01.827899 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:01.931046 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:01.931011 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:02.225064 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:02.224987 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:25:02.496823 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:02.496734 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:02.606961 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:02.606927 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:03.733794 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:03.733757 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:03.833524 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:03.833494 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:04.269194 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:04.269132 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:06.329788 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:06.329762 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-lpd2k_fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de/cluster-monitoring-operator/0.log" Aug 05 17:25:06.330273 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:06.329799 2579 generic.go:356] "Generic (PLEG): container finished" podID="fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de" containerID="6eecb9c944ab19c77a7966b419a1bdbe75bbba5372cdcb6394eb323904b9a943" exitCode=2 Aug 05 17:25:06.330273 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:06.329863 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-lpd2k" event={"ID":"fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de","Type":"ContainerDied","Data":"6eecb9c944ab19c77a7966b419a1bdbe75bbba5372cdcb6394eb323904b9a943"} Aug 05 17:25:06.330273 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:06.330201 2579 scope.go:117] "RemoveContainer" containerID="6eecb9c944ab19c77a7966b419a1bdbe75bbba5372cdcb6394eb323904b9a943" Aug 05 17:25:06.373071 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:06.373021 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:06.445317 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:06.445283 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:07.336158 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:07.336123 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-lpd2k_fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de/cluster-monitoring-operator/0.log" Aug 05 17:25:07.336600 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:07.336240 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-lpd2k" event={"ID":"fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de","Type":"ContainerStarted","Data":"c56290965d20bff2aaf3048868e9a0d2767469a36713b6b1ef417cf6643b50a1"} Aug 05 17:25:09.520562 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:09.520531 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d65dd5c8d-7qk95"] Aug 05 17:25:09.524239 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:09.524218 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d65dd5c8d-7qk95" Aug 05 17:25:09.527400 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:09.527377 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Aug 05 17:25:09.527535 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:09.527399 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Aug 05 17:25:09.527535 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:09.527377 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Aug 05 17:25:09.528520 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:09.528504 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Aug 05 17:25:09.528632 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:09.528618 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-x867d\"" Aug 05 17:25:09.528690 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:09.528643 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Aug 05 17:25:09.528950 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:09.528931 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Aug 05 17:25:09.529033 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:09.528981 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Aug 05 17:25:09.533405 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:09.533386 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d65dd5c8d-7qk95"] Aug 05 17:25:09.643533 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:09.643500 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9fded585-1ec7-4183-8c35-cb8dda0bfc18-service-ca\") pod \"console-5d65dd5c8d-7qk95\" (UID: \"9fded585-1ec7-4183-8c35-cb8dda0bfc18\") " pod="openshift-console/console-5d65dd5c8d-7qk95" Aug 05 17:25:09.643680 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:09.643563 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fded585-1ec7-4183-8c35-cb8dda0bfc18-console-serving-cert\") pod \"console-5d65dd5c8d-7qk95\" (UID: \"9fded585-1ec7-4183-8c35-cb8dda0bfc18\") " pod="openshift-console/console-5d65dd5c8d-7qk95" Aug 05 17:25:09.643680 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:09.643598 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9fded585-1ec7-4183-8c35-cb8dda0bfc18-console-oauth-config\") pod \"console-5d65dd5c8d-7qk95\" (UID: \"9fded585-1ec7-4183-8c35-cb8dda0bfc18\") " pod="openshift-console/console-5d65dd5c8d-7qk95" Aug 05 17:25:09.643680 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:09.643630 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpcct\" (UniqueName: \"kubernetes.io/projected/9fded585-1ec7-4183-8c35-cb8dda0bfc18-kube-api-access-wpcct\") pod \"console-5d65dd5c8d-7qk95\" (UID: \"9fded585-1ec7-4183-8c35-cb8dda0bfc18\") " pod="openshift-console/console-5d65dd5c8d-7qk95" Aug 05 17:25:09.643680 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:09.643669 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9fded585-1ec7-4183-8c35-cb8dda0bfc18-console-config\") pod \"console-5d65dd5c8d-7qk95\" (UID: \"9fded585-1ec7-4183-8c35-cb8dda0bfc18\") " pod="openshift-console/console-5d65dd5c8d-7qk95" Aug 05 17:25:09.643853 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:09.643688 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9fded585-1ec7-4183-8c35-cb8dda0bfc18-oauth-serving-cert\") pod \"console-5d65dd5c8d-7qk95\" (UID: \"9fded585-1ec7-4183-8c35-cb8dda0bfc18\") " pod="openshift-console/console-5d65dd5c8d-7qk95" Aug 05 17:25:09.744510 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:09.744473 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fded585-1ec7-4183-8c35-cb8dda0bfc18-console-serving-cert\") pod \"console-5d65dd5c8d-7qk95\" (UID: \"9fded585-1ec7-4183-8c35-cb8dda0bfc18\") " pod="openshift-console/console-5d65dd5c8d-7qk95" Aug 05 17:25:09.744690 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:09.744526 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9fded585-1ec7-4183-8c35-cb8dda0bfc18-console-oauth-config\") pod \"console-5d65dd5c8d-7qk95\" (UID: \"9fded585-1ec7-4183-8c35-cb8dda0bfc18\") " pod="openshift-console/console-5d65dd5c8d-7qk95" Aug 05 17:25:09.744690 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:09.744566 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpcct\" (UniqueName: \"kubernetes.io/projected/9fded585-1ec7-4183-8c35-cb8dda0bfc18-kube-api-access-wpcct\") pod \"console-5d65dd5c8d-7qk95\" (UID: \"9fded585-1ec7-4183-8c35-cb8dda0bfc18\") " pod="openshift-console/console-5d65dd5c8d-7qk95" Aug 05 17:25:09.744690 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:09.744629 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9fded585-1ec7-4183-8c35-cb8dda0bfc18-console-config\") pod \"console-5d65dd5c8d-7qk95\" (UID: \"9fded585-1ec7-4183-8c35-cb8dda0bfc18\") " pod="openshift-console/console-5d65dd5c8d-7qk95" Aug 05 17:25:09.744690 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:09.744654 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9fded585-1ec7-4183-8c35-cb8dda0bfc18-oauth-serving-cert\") pod \"console-5d65dd5c8d-7qk95\" (UID: \"9fded585-1ec7-4183-8c35-cb8dda0bfc18\") " pod="openshift-console/console-5d65dd5c8d-7qk95" Aug 05 17:25:09.744690 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:09.744678 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9fded585-1ec7-4183-8c35-cb8dda0bfc18-service-ca\") pod \"console-5d65dd5c8d-7qk95\" (UID: \"9fded585-1ec7-4183-8c35-cb8dda0bfc18\") " pod="openshift-console/console-5d65dd5c8d-7qk95" Aug 05 17:25:09.745439 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:09.745411 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9fded585-1ec7-4183-8c35-cb8dda0bfc18-console-config\") pod \"console-5d65dd5c8d-7qk95\" (UID: \"9fded585-1ec7-4183-8c35-cb8dda0bfc18\") " pod="openshift-console/console-5d65dd5c8d-7qk95" Aug 05 17:25:09.745581 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:09.745419 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9fded585-1ec7-4183-8c35-cb8dda0bfc18-service-ca\") pod \"console-5d65dd5c8d-7qk95\" (UID: \"9fded585-1ec7-4183-8c35-cb8dda0bfc18\") " pod="openshift-console/console-5d65dd5c8d-7qk95" Aug 05 17:25:09.745858 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:09.745841 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9fded585-1ec7-4183-8c35-cb8dda0bfc18-oauth-serving-cert\") pod \"console-5d65dd5c8d-7qk95\" (UID: \"9fded585-1ec7-4183-8c35-cb8dda0bfc18\") " pod="openshift-console/console-5d65dd5c8d-7qk95" Aug 05 17:25:09.747185 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:09.747155 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fded585-1ec7-4183-8c35-cb8dda0bfc18-console-serving-cert\") pod \"console-5d65dd5c8d-7qk95\" (UID: \"9fded585-1ec7-4183-8c35-cb8dda0bfc18\") " pod="openshift-console/console-5d65dd5c8d-7qk95" Aug 05 17:25:09.747292 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:09.747214 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9fded585-1ec7-4183-8c35-cb8dda0bfc18-console-oauth-config\") pod \"console-5d65dd5c8d-7qk95\" (UID: \"9fded585-1ec7-4183-8c35-cb8dda0bfc18\") " pod="openshift-console/console-5d65dd5c8d-7qk95" Aug 05 17:25:09.755319 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:09.755297 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpcct\" (UniqueName: \"kubernetes.io/projected/9fded585-1ec7-4183-8c35-cb8dda0bfc18-kube-api-access-wpcct\") pod \"console-5d65dd5c8d-7qk95\" (UID: \"9fded585-1ec7-4183-8c35-cb8dda0bfc18\") " pod="openshift-console/console-5d65dd5c8d-7qk95" Aug 05 17:25:09.782448 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:09.782378 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:09.833342 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:09.833312 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d65dd5c8d-7qk95" Aug 05 17:25:09.941279 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:09.941236 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:09.977233 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:09.977201 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d65dd5c8d-7qk95"] Aug 05 17:25:09.980094 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:25:09.980057 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fded585_1ec7_4183_8c35_cb8dda0bfc18.slice/crio-cfe5572f979cfa3fdddca11ab1818093a5382be81a230f5b5f552ff8c7c24306 WatchSource:0}: Error finding container cfe5572f979cfa3fdddca11ab1818093a5382be81a230f5b5f552ff8c7c24306: Status 404 returned error can't find the container with id cfe5572f979cfa3fdddca11ab1818093a5382be81a230f5b5f552ff8c7c24306 Aug 05 17:25:10.076037 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.075999 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:10.103941 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.103911 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-bdmg5"] Aug 05 17:25:10.107424 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.107392 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7vpss"] Aug 05 17:25:10.107549 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.107521 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-bdmg5" Aug 05 17:25:10.109756 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.109735 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7vpss" Aug 05 17:25:10.110331 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.110315 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Aug 05 17:25:10.112716 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.112681 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Aug 05 17:25:10.112716 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.112693 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Aug 05 17:25:10.112871 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.112693 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Aug 05 17:25:10.112871 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.112727 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Aug 05 17:25:10.112871 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.112681 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-cjnkg\"" Aug 05 17:25:10.113064 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.113050 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Aug 05 17:25:10.113114 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.113095 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Aug 05 17:25:10.113337 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.113323 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-z2l68\"" Aug 05 17:25:10.123651 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.123626 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-bdmg5"] Aug 05 17:25:10.146923 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.146895 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d8a8e5dd-1531-4487-8805-1bd38fffeb29-node-exporter-accelerators-collector-config\") pod \"node-exporter-7vpss\" (UID: \"d8a8e5dd-1531-4487-8805-1bd38fffeb29\") " pod="openshift-monitoring/node-exporter-7vpss" Aug 05 17:25:10.147049 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.146937 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d8a8e5dd-1531-4487-8805-1bd38fffeb29-node-exporter-wtmp\") pod \"node-exporter-7vpss\" (UID: \"d8a8e5dd-1531-4487-8805-1bd38fffeb29\") " pod="openshift-monitoring/node-exporter-7vpss" Aug 05 17:25:10.147049 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.146964 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-bdmg5\" (UID: \"b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-bdmg5" Aug 05 17:25:10.147116 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.147042 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8a8e5dd-1531-4487-8805-1bd38fffeb29-metrics-client-ca\") pod \"node-exporter-7vpss\" (UID: \"d8a8e5dd-1531-4487-8805-1bd38fffeb29\") " pod="openshift-monitoring/node-exporter-7vpss" Aug 05 17:25:10.147116 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.147074 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-bdmg5\" (UID: \"b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-bdmg5" Aug 05 17:25:10.147116 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.147109 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d8a8e5dd-1531-4487-8805-1bd38fffeb29-node-exporter-textfile\") pod \"node-exporter-7vpss\" (UID: \"d8a8e5dd-1531-4487-8805-1bd38fffeb29\") " pod="openshift-monitoring/node-exporter-7vpss" Aug 05 17:25:10.147264 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.147168 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8a8e5dd-1531-4487-8805-1bd38fffeb29-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7vpss\" (UID: \"d8a8e5dd-1531-4487-8805-1bd38fffeb29\") " pod="openshift-monitoring/node-exporter-7vpss" Aug 05 17:25:10.147264 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.147202 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8a8e5dd-1531-4487-8805-1bd38fffeb29-sys\") pod \"node-exporter-7vpss\" (UID: \"d8a8e5dd-1531-4487-8805-1bd38fffeb29\") " pod="openshift-monitoring/node-exporter-7vpss" Aug 05 17:25:10.147264 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.147221 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs64t\" (UniqueName: \"kubernetes.io/projected/b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc-kube-api-access-bs64t\") pod \"kube-state-metrics-6bd9664c4-bdmg5\" (UID: \"b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-bdmg5" Aug 05 17:25:10.147264 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.147237 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmzs9\" (UniqueName: \"kubernetes.io/projected/d8a8e5dd-1531-4487-8805-1bd38fffeb29-kube-api-access-wmzs9\") pod \"node-exporter-7vpss\" (UID: \"d8a8e5dd-1531-4487-8805-1bd38fffeb29\") " pod="openshift-monitoring/node-exporter-7vpss" Aug 05 17:25:10.147264 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.147252 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-bdmg5\" (UID: \"b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-bdmg5" Aug 05 17:25:10.147412 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.147292 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d8a8e5dd-1531-4487-8805-1bd38fffeb29-node-exporter-tls\") pod \"node-exporter-7vpss\" (UID: \"d8a8e5dd-1531-4487-8805-1bd38fffeb29\") " pod="openshift-monitoring/node-exporter-7vpss" Aug 05 17:25:10.147412 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.147324 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-bdmg5\" (UID: \"b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-bdmg5" Aug 05 17:25:10.147412 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.147347 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d8a8e5dd-1531-4487-8805-1bd38fffeb29-root\") pod \"node-exporter-7vpss\" (UID: \"d8a8e5dd-1531-4487-8805-1bd38fffeb29\") " pod="openshift-monitoring/node-exporter-7vpss" Aug 05 17:25:10.147412 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.147366 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-bdmg5\" (UID: \"b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-bdmg5" Aug 05 17:25:10.179723 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.179694 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:10.207582 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.207551 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4jrks" Aug 05 17:25:10.248069 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.248040 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmzs9\" (UniqueName: \"kubernetes.io/projected/d8a8e5dd-1531-4487-8805-1bd38fffeb29-kube-api-access-wmzs9\") pod \"node-exporter-7vpss\" (UID: \"d8a8e5dd-1531-4487-8805-1bd38fffeb29\") " pod="openshift-monitoring/node-exporter-7vpss" Aug 05 17:25:10.248069 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.248074 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-bdmg5\" (UID: \"b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-bdmg5" Aug 05 17:25:10.248285 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.248179 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d8a8e5dd-1531-4487-8805-1bd38fffeb29-node-exporter-tls\") pod \"node-exporter-7vpss\" (UID: \"d8a8e5dd-1531-4487-8805-1bd38fffeb29\") " pod="openshift-monitoring/node-exporter-7vpss" Aug 05 17:25:10.248285 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.248215 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-bdmg5\" (UID: \"b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-bdmg5" Aug 05 17:25:10.248285 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.248243 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d8a8e5dd-1531-4487-8805-1bd38fffeb29-root\") pod \"node-exporter-7vpss\" (UID: \"d8a8e5dd-1531-4487-8805-1bd38fffeb29\") " pod="openshift-monitoring/node-exporter-7vpss" Aug 05 17:25:10.248285 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.248269 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-bdmg5\" (UID: \"b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-bdmg5" Aug 05 17:25:10.248487 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.248304 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d8a8e5dd-1531-4487-8805-1bd38fffeb29-node-exporter-accelerators-collector-config\") pod \"node-exporter-7vpss\" (UID: \"d8a8e5dd-1531-4487-8805-1bd38fffeb29\") " pod="openshift-monitoring/node-exporter-7vpss" Aug 05 17:25:10.248487 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.248332 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d8a8e5dd-1531-4487-8805-1bd38fffeb29-node-exporter-wtmp\") pod \"node-exporter-7vpss\" (UID: \"d8a8e5dd-1531-4487-8805-1bd38fffeb29\") " pod="openshift-monitoring/node-exporter-7vpss" Aug 05 17:25:10.248487 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.248360 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-bdmg5\" (UID: \"b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-bdmg5" Aug 05 17:25:10.248487 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:25:10.248422 2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Aug 05 17:25:10.248664 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.248511 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d8a8e5dd-1531-4487-8805-1bd38fffeb29-node-exporter-wtmp\") pod \"node-exporter-7vpss\" (UID: \"d8a8e5dd-1531-4487-8805-1bd38fffeb29\") " pod="openshift-monitoring/node-exporter-7vpss" Aug 05 17:25:10.248664 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:25:10.248519 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8a8e5dd-1531-4487-8805-1bd38fffeb29-node-exporter-tls podName:d8a8e5dd-1531-4487-8805-1bd38fffeb29 nodeName:}" failed. No retries permitted until 2026-08-05 17:25:10.748495256 +0000 UTC m=+98.515875469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d8a8e5dd-1531-4487-8805-1bd38fffeb29-node-exporter-tls") pod "node-exporter-7vpss" (UID: "d8a8e5dd-1531-4487-8805-1bd38fffeb29") : secret "node-exporter-tls" not found Aug 05 17:25:10.248780 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.248682 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d8a8e5dd-1531-4487-8805-1bd38fffeb29-root\") pod \"node-exporter-7vpss\" (UID: \"d8a8e5dd-1531-4487-8805-1bd38fffeb29\") " pod="openshift-monitoring/node-exporter-7vpss" Aug 05 17:25:10.248835 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.248806 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8a8e5dd-1531-4487-8805-1bd38fffeb29-metrics-client-ca\") pod \"node-exporter-7vpss\" (UID: \"d8a8e5dd-1531-4487-8805-1bd38fffeb29\") " pod="openshift-monitoring/node-exporter-7vpss" Aug 05 17:25:10.248889 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.248873 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-bdmg5\" (UID: \"b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-bdmg5" Aug 05 17:25:10.248974 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.248959 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d8a8e5dd-1531-4487-8805-1bd38fffeb29-node-exporter-textfile\") pod \"node-exporter-7vpss\" (UID: \"d8a8e5dd-1531-4487-8805-1bd38fffeb29\") " pod="openshift-monitoring/node-exporter-7vpss" Aug 05 17:25:10.249035 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.248985 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d8a8e5dd-1531-4487-8805-1bd38fffeb29-node-exporter-accelerators-collector-config\") pod \"node-exporter-7vpss\" (UID: \"d8a8e5dd-1531-4487-8805-1bd38fffeb29\") " pod="openshift-monitoring/node-exporter-7vpss" Aug 05 17:25:10.249035 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.248990 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8a8e5dd-1531-4487-8805-1bd38fffeb29-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7vpss\" (UID: \"d8a8e5dd-1531-4487-8805-1bd38fffeb29\") " pod="openshift-monitoring/node-exporter-7vpss" Aug 05 17:25:10.249132 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.249069 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8a8e5dd-1531-4487-8805-1bd38fffeb29-sys\") pod \"node-exporter-7vpss\" (UID: \"d8a8e5dd-1531-4487-8805-1bd38fffeb29\") " pod="openshift-monitoring/node-exporter-7vpss" Aug 05 17:25:10.249197 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.249164 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs64t\" (UniqueName: \"kubernetes.io/projected/b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc-kube-api-access-bs64t\") pod \"kube-state-metrics-6bd9664c4-bdmg5\" (UID: \"b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-bdmg5" Aug 05 17:25:10.249336 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.249309 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-bdmg5\" (UID: \"b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-bdmg5" Aug 05 17:25:10.249409 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.249363 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-bdmg5\" (UID: \"b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-bdmg5" Aug 05 17:25:10.249527 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.249447 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-bdmg5\" (UID: \"b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-bdmg5" Aug 05 17:25:10.249527 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.249472 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8a8e5dd-1531-4487-8805-1bd38fffeb29-sys\") pod \"node-exporter-7vpss\" (UID: \"d8a8e5dd-1531-4487-8805-1bd38fffeb29\") " pod="openshift-monitoring/node-exporter-7vpss" Aug 05 17:25:10.249806 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.249754 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d8a8e5dd-1531-4487-8805-1bd38fffeb29-node-exporter-textfile\") pod \"node-exporter-7vpss\" (UID: \"d8a8e5dd-1531-4487-8805-1bd38fffeb29\") " pod="openshift-monitoring/node-exporter-7vpss" Aug 05 17:25:10.249806 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.249776 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8a8e5dd-1531-4487-8805-1bd38fffeb29-metrics-client-ca\") pod \"node-exporter-7vpss\" (UID: \"d8a8e5dd-1531-4487-8805-1bd38fffeb29\") " pod="openshift-monitoring/node-exporter-7vpss" Aug 05 17:25:10.251010 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.250990 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-bdmg5\" (UID: \"b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-bdmg5" Aug 05 17:25:10.251430 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.251413 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8a8e5dd-1531-4487-8805-1bd38fffeb29-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7vpss\" (UID: \"d8a8e5dd-1531-4487-8805-1bd38fffeb29\") " pod="openshift-monitoring/node-exporter-7vpss" Aug 05 17:25:10.251965 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.251949 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-bdmg5\" (UID: \"b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-bdmg5" Aug 05 17:25:10.260843 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.260820 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:10.263090 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.263045 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmzs9\" (UniqueName: \"kubernetes.io/projected/d8a8e5dd-1531-4487-8805-1bd38fffeb29-kube-api-access-wmzs9\") pod \"node-exporter-7vpss\" (UID: \"d8a8e5dd-1531-4487-8805-1bd38fffeb29\") " pod="openshift-monitoring/node-exporter-7vpss" Aug 05 17:25:10.263401 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.263375 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs64t\" (UniqueName: \"kubernetes.io/projected/b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc-kube-api-access-bs64t\") pod \"kube-state-metrics-6bd9664c4-bdmg5\" (UID: \"b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-bdmg5" Aug 05 17:25:10.348623 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.348535 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d65dd5c8d-7qk95" event={"ID":"9fded585-1ec7-4183-8c35-cb8dda0bfc18","Type":"ContainerStarted","Data":"cfe5572f979cfa3fdddca11ab1818093a5382be81a230f5b5f552ff8c7c24306"} Aug 05 17:25:10.360715 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.360681 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:10.418633 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.418593 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-bdmg5" Aug 05 17:25:10.459153 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.459058 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:10.571378 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.571352 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-bdmg5"] Aug 05 17:25:10.574078 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:25:10.574048 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8d6f8ec_49d7_4c33_9ea8_42787dc60cfc.slice/crio-3c41a127d04cc29e1bf07bec8e6f32934353482b1fdc6e6b754c1647dd467911 WatchSource:0}: Error finding container 3c41a127d04cc29e1bf07bec8e6f32934353482b1fdc6e6b754c1647dd467911: Status 404 returned error can't find the container with id 3c41a127d04cc29e1bf07bec8e6f32934353482b1fdc6e6b754c1647dd467911 Aug 05 17:25:10.753708 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.753531 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d8a8e5dd-1531-4487-8805-1bd38fffeb29-node-exporter-tls\") pod \"node-exporter-7vpss\" (UID: \"d8a8e5dd-1531-4487-8805-1bd38fffeb29\") " pod="openshift-monitoring/node-exporter-7vpss" Aug 05 17:25:10.756416 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.756388 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d8a8e5dd-1531-4487-8805-1bd38fffeb29-node-exporter-tls\") pod \"node-exporter-7vpss\" (UID: \"d8a8e5dd-1531-4487-8805-1bd38fffeb29\") " pod="openshift-monitoring/node-exporter-7vpss" Aug 05 17:25:10.866972 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.866932 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:10.972200 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:10.972162 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:11.025090 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.025001 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7vpss" Aug 05 17:25:11.040171 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:25:11.040004 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8a8e5dd_1531_4487_8805_1bd38fffeb29.slice/crio-4ad9d842733edd8f5e0957ccd8e6b42f8dbcf2341f98358170254de7059be6c9 WatchSource:0}: Error finding container 4ad9d842733edd8f5e0957ccd8e6b42f8dbcf2341f98358170254de7059be6c9: Status 404 returned error can't find the container with id 4ad9d842733edd8f5e0957ccd8e6b42f8dbcf2341f98358170254de7059be6c9 Aug 05 17:25:11.069948 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.069913 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:11.139463 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.139311 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 05 17:25:11.142699 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.142677 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.145176 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.145087 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:11.146224 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.146202 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Aug 05 17:25:11.146737 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.146364 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Aug 05 17:25:11.146737 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.146688 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Aug 05 17:25:11.146737 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.146706 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Aug 05 17:25:11.146969 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.146740 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Aug 05 17:25:11.146969 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.146834 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2h5z5\"" Aug 05 17:25:11.146969 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.146863 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Aug 05 17:25:11.147134 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.147003 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Aug 05 17:25:11.147134 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.147104 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Aug 05 17:25:11.147266 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.147222 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Aug 05 17:25:11.163959 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.163870 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 05 17:25:11.257309 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.257092 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.257309 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.257130 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.257309 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.257192 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.257309 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.257226 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/67ecab95-76c6-4203-a79a-5136e97a1344-tls-assets\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.257309 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.257248 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-config-volume\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.257309 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.257274 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67ecab95-76c6-4203-a79a-5136e97a1344-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.257309 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.257315 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/67ecab95-76c6-4203-a79a-5136e97a1344-config-out\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.257819 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.257363 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-web-config\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.257819 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.257426 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.257819 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.257451 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.257819 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.257531 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/67ecab95-76c6-4203-a79a-5136e97a1344-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.257819 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.257580 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67ecab95-76c6-4203-a79a-5136e97a1344-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.257819 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.257631 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f8dl\" (UniqueName: \"kubernetes.io/projected/67ecab95-76c6-4203-a79a-5136e97a1344-kube-api-access-2f8dl\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.355854 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.355806 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-bdmg5" event={"ID":"b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc","Type":"ContainerStarted","Data":"3c41a127d04cc29e1bf07bec8e6f32934353482b1fdc6e6b754c1647dd467911"} Aug 05 17:25:11.357170 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.357107 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7vpss" event={"ID":"d8a8e5dd-1531-4487-8805-1bd38fffeb29","Type":"ContainerStarted","Data":"4ad9d842733edd8f5e0957ccd8e6b42f8dbcf2341f98358170254de7059be6c9"} Aug 05 17:25:11.358650 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.358613 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.358757 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.358667 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.358757 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.358705 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.358757 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.358742 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/67ecab95-76c6-4203-a79a-5136e97a1344-tls-assets\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.358909 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.358771 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-config-volume\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.358909 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:25:11.358779 2579 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Aug 05 17:25:11.358909 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.358796 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67ecab95-76c6-4203-a79a-5136e97a1344-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.358909 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.358823 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/67ecab95-76c6-4203-a79a-5136e97a1344-config-out\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.358909 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:25:11.358846 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-secret-alertmanager-main-tls podName:67ecab95-76c6-4203-a79a-5136e97a1344 nodeName:}" failed. No retries permitted until 2026-08-05 17:25:11.858824911 +0000 UTC m=+99.626205159 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "67ecab95-76c6-4203-a79a-5136e97a1344") : secret "alertmanager-main-tls" not found Aug 05 17:25:11.358909 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.358884 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-web-config\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.359387 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.358953 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.359387 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.358981 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.359387 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.359031 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/67ecab95-76c6-4203-a79a-5136e97a1344-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.359387 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.359092 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67ecab95-76c6-4203-a79a-5136e97a1344-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.359387 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.359131 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f8dl\" (UniqueName: \"kubernetes.io/projected/67ecab95-76c6-4203-a79a-5136e97a1344-kube-api-access-2f8dl\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.360174 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.359767 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/67ecab95-76c6-4203-a79a-5136e97a1344-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.360174 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:25:11.359879 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/67ecab95-76c6-4203-a79a-5136e97a1344-alertmanager-trusted-ca-bundle podName:67ecab95-76c6-4203-a79a-5136e97a1344 nodeName:}" failed. No retries permitted until 2026-08-05 17:25:11.859862977 +0000 UTC m=+99.627243203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/67ecab95-76c6-4203-a79a-5136e97a1344-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "67ecab95-76c6-4203-a79a-5136e97a1344") : configmap references non-existent config key: ca-bundle.crt Aug 05 17:25:11.360174 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.360071 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67ecab95-76c6-4203-a79a-5136e97a1344-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.364203 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.363871 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-config-volume\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.364203 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.363875 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.364203 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.363992 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.364533 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.364469 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.364915 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.364891 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/67ecab95-76c6-4203-a79a-5136e97a1344-tls-assets\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.365133 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.365112 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/67ecab95-76c6-4203-a79a-5136e97a1344-config-out\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.366026 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.365969 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.367339 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.367300 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-web-config\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.368104 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.368051 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f8dl\" (UniqueName: \"kubernetes.io/projected/67ecab95-76c6-4203-a79a-5136e97a1344-kube-api-access-2f8dl\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.667236 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.667084 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:11.865225 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.865181 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.865414 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.865355 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67ecab95-76c6-4203-a79a-5136e97a1344-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.866182 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.866115 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67ecab95-76c6-4203-a79a-5136e97a1344-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:11.868181 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:11.868157 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:12.056043 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:12.055956 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:25:13.068332 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:13.068293 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:13.156653 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:13.156609 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:13.356047 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:13.354944 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 05 17:25:13.358594 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:25:13.358372 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67ecab95_76c6_4203_a79a_5136e97a1344.slice/crio-4fd2417a6d3cc2044f93c58d7bfe5f7098bba12075c3934674d46f94dd5edf15 WatchSource:0}: Error finding container 4fd2417a6d3cc2044f93c58d7bfe5f7098bba12075c3934674d46f94dd5edf15: Status 404 returned error can't find the container with id 4fd2417a6d3cc2044f93c58d7bfe5f7098bba12075c3934674d46f94dd5edf15 Aug 05 17:25:13.374406 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:13.374375 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-bdmg5" event={"ID":"b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc","Type":"ContainerStarted","Data":"37663257a133975e05a932be4dc43e071fcc0c125163acf83f87024df7fd8089"} Aug 05 17:25:13.374624 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:13.374602 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-bdmg5" event={"ID":"b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc","Type":"ContainerStarted","Data":"e51eec7c4e9ea40370fbcd0db8ca04994cb2f6f8185bb0026230ad6c3cfd021d"} Aug 05 17:25:13.378574 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:13.378505 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d65dd5c8d-7qk95" event={"ID":"9fded585-1ec7-4183-8c35-cb8dda0bfc18","Type":"ContainerStarted","Data":"3496eb747e9d0a1d4f610d4c172d499a69a3539264ed586ffd261908841fcbef"} Aug 05 17:25:13.382279 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:13.382181 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"67ecab95-76c6-4203-a79a-5136e97a1344","Type":"ContainerStarted","Data":"4fd2417a6d3cc2044f93c58d7bfe5f7098bba12075c3934674d46f94dd5edf15"} Aug 05 17:25:13.385619 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:13.385593 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7vpss" event={"ID":"d8a8e5dd-1531-4487-8805-1bd38fffeb29","Type":"ContainerStarted","Data":"d9a0b1f3a9d49196dedf80bef668e34b12996d17f3f0f244e038b10829adebad"} Aug 05 17:25:13.402178 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:13.401983 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d65dd5c8d-7qk95" podStartSLOduration=1.189085623 podStartE2EDuration="4.401959542s" totalImagesPullingTime="3.212873919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:25:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:25:13.400340525 +0000 UTC m=+101.167720761" watchObservedRunningTime="2026-08-05 17:25:13.401959542 +0000 UTC m=+101.169339778" Aug 05 17:25:13.472621 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:13.472590 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:13.573778 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:13.573745 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:13.846061 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:13.846027 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:14.395509 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:14.395466 2579 generic.go:356] "Generic (PLEG): container finished" podID="d8a8e5dd-1531-4487-8805-1bd38fffeb29" containerID="d9a0b1f3a9d49196dedf80bef668e34b12996d17f3f0f244e038b10829adebad" exitCode=0 Aug 05 17:25:14.395970 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:14.395562 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7vpss" event={"ID":"d8a8e5dd-1531-4487-8805-1bd38fffeb29","Type":"ContainerDied","Data":"d9a0b1f3a9d49196dedf80bef668e34b12996d17f3f0f244e038b10829adebad"} Aug 05 17:25:14.398453 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:14.398429 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-bdmg5" event={"ID":"b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc","Type":"ContainerStarted","Data":"3b3306893c13ceec27e718fdafeff631143a20dd1f1d12b7ce50d4e51c7dd4e1"} Aug 05 17:25:14.437211 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:14.437154 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-bdmg5" podStartSLOduration=1.826626381 podStartE2EDuration="4.437121546s" totalImagesPullingTime="2.610495165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:25:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:25:14.436355121 +0000 UTC m=+102.203735354" watchObservedRunningTime="2026-08-05 17:25:14.437121546 +0000 UTC m=+102.204501778" Aug 05 17:25:14.641494 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:14.641462 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5966949c47-qg79w"] Aug 05 17:25:14.730652 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:14.730619 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:14.791420 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:14.791384 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-8nr5p"] Aug 05 17:25:14.809019 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:14.808987 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:14.814322 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:14.814299 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-8nr5p"] Aug 05 17:25:14.814466 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:14.814428 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8nr5p" Aug 05 17:25:14.817223 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:14.817198 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Aug 05 17:25:14.817372 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:14.817205 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-t586n\"" Aug 05 17:25:14.890566 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:14.890472 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb65m\" (UniqueName: \"kubernetes.io/projected/0fc16714-38ce-478c-b691-484feb90f184-kube-api-access-fb65m\") pod \"monitoring-plugin-6dffbbd67-8nr5p\" (UID: \"0fc16714-38ce-478c-b691-484feb90f184\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8nr5p" Aug 05 17:25:14.890566 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:14.890511 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0fc16714-38ce-478c-b691-484feb90f184-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-8nr5p\" (UID: \"0fc16714-38ce-478c-b691-484feb90f184\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8nr5p" Aug 05 17:25:14.940578 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:14.940538 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:14.991316 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:14.991289 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb65m\" (UniqueName: \"kubernetes.io/projected/0fc16714-38ce-478c-b691-484feb90f184-kube-api-access-fb65m\") pod \"monitoring-plugin-6dffbbd67-8nr5p\" (UID: \"0fc16714-38ce-478c-b691-484feb90f184\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8nr5p" Aug 05 17:25:14.991479 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:14.991325 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0fc16714-38ce-478c-b691-484feb90f184-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-8nr5p\" (UID: \"0fc16714-38ce-478c-b691-484feb90f184\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8nr5p" Aug 05 17:25:14.991479 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:25:14.991438 2579 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Aug 05 17:25:14.991598 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:25:14.991498 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fc16714-38ce-478c-b691-484feb90f184-monitoring-plugin-cert podName:0fc16714-38ce-478c-b691-484feb90f184 nodeName:}" failed. No retries permitted until 2026-08-05 17:25:15.491480631 +0000 UTC m=+103.258860843 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/0fc16714-38ce-478c-b691-484feb90f184-monitoring-plugin-cert") pod "monitoring-plugin-6dffbbd67-8nr5p" (UID: "0fc16714-38ce-478c-b691-484feb90f184") : secret "monitoring-plugin-cert" not found Aug 05 17:25:15.000546 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:15.000528 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb65m\" (UniqueName: \"kubernetes.io/projected/0fc16714-38ce-478c-b691-484feb90f184-kube-api-access-fb65m\") pod \"monitoring-plugin-6dffbbd67-8nr5p\" (UID: \"0fc16714-38ce-478c-b691-484feb90f184\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8nr5p" Aug 05 17:25:15.043522 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:15.043478 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:15.140913 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:15.140833 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:15.403323 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:15.403236 2579 generic.go:356] "Generic (PLEG): container finished" podID="67ecab95-76c6-4203-a79a-5136e97a1344" containerID="2cb22cf206c7fdb696b42f7f79b4031890a3edc3d07b6aa5921be9fe91b4347d" exitCode=0 Aug 05 17:25:15.403765 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:15.403321 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"67ecab95-76c6-4203-a79a-5136e97a1344","Type":"ContainerDied","Data":"2cb22cf206c7fdb696b42f7f79b4031890a3edc3d07b6aa5921be9fe91b4347d"} Aug 05 17:25:15.405751 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:15.405725 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7vpss" event={"ID":"d8a8e5dd-1531-4487-8805-1bd38fffeb29","Type":"ContainerStarted","Data":"37596386e54a131e03c83a78aef014f9277577cb2c01812cce452338774529dc"} Aug 05 17:25:15.405852 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:15.405777 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7vpss" event={"ID":"d8a8e5dd-1531-4487-8805-1bd38fffeb29","Type":"ContainerStarted","Data":"caf84fce5881eef245894b1d65b66a6b3ba4d0d1020261413b0695302a43bdf1"} Aug 05 17:25:15.463408 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:15.463352 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7vpss" podStartSLOduration=3.214187377 podStartE2EDuration="5.463336336s" totalImagesPullingTime="2.143431335s" totalInitContainerRuntime="105.717624ms" isStatefulPod=true podCreationTimestamp="2026-08-05 17:25:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:25:15.462624147 +0000 UTC m=+103.230004381" watchObservedRunningTime="2026-08-05 17:25:15.463336336 +0000 UTC m=+103.230716568" Aug 05 17:25:15.495818 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:15.495779 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0fc16714-38ce-478c-b691-484feb90f184-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-8nr5p\" (UID: \"0fc16714-38ce-478c-b691-484feb90f184\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8nr5p" Aug 05 17:25:15.498516 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:15.498490 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0fc16714-38ce-478c-b691-484feb90f184-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-8nr5p\" (UID: \"0fc16714-38ce-478c-b691-484feb90f184\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8nr5p" Aug 05 17:25:15.723715 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:15.723621 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8nr5p" Aug 05 17:25:15.882073 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:15.882037 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-8nr5p"] Aug 05 17:25:15.885540 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:25:15.885510 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fc16714_38ce_478c_b691_484feb90f184.slice/crio-179ec3b658faf9e9d090d05b61b9794f0048e962d2724b141fdce9c7d24761de WatchSource:0}: Error finding container 179ec3b658faf9e9d090d05b61b9794f0048e962d2724b141fdce9c7d24761de: Status 404 returned error can't find the container with id 179ec3b658faf9e9d090d05b61b9794f0048e962d2724b141fdce9c7d24761de Aug 05 17:25:16.313066 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:16.313033 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:16.412827 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:16.412755 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8nr5p" event={"ID":"0fc16714-38ce-478c-b691-484feb90f184","Type":"ContainerStarted","Data":"179ec3b658faf9e9d090d05b61b9794f0048e962d2724b141fdce9c7d24761de"} Aug 05 17:25:16.570470 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:16.570377 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:16.671907 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:16.671804 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:18.425085 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:18.425047 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8nr5p" event={"ID":"0fc16714-38ce-478c-b691-484feb90f184","Type":"ContainerStarted","Data":"08a61e0b823eeac86a31632e3a802563e994c21dba6f3e3fe8ea7d416839ee68"} Aug 05 17:25:18.425636 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:18.425109 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8nr5p" Aug 05 17:25:18.428734 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:18.428707 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"67ecab95-76c6-4203-a79a-5136e97a1344","Type":"ContainerStarted","Data":"4ca19b54120d5a54acda3819c9e180bffc184790f507ac73cd163baf917d5153"} Aug 05 17:25:18.428854 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:18.428816 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"67ecab95-76c6-4203-a79a-5136e97a1344","Type":"ContainerStarted","Data":"cbc093adae876475276759b1ca4aa5d207353c48f34ad6618adb9126f6f83f10"} Aug 05 17:25:18.428896 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:18.428860 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"67ecab95-76c6-4203-a79a-5136e97a1344","Type":"ContainerStarted","Data":"7bd3b91aa974760f6ca3b8be894d351b5bf46c006e1b9633d3187ecbe8a2d41f"} Aug 05 17:25:18.428929 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:18.428899 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"67ecab95-76c6-4203-a79a-5136e97a1344","Type":"ContainerStarted","Data":"459b2c2ed27aedcd4de0a2460895529a5fc992a0e94fc18218606f0ebce1727f"} Aug 05 17:25:18.428962 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:18.428933 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"67ecab95-76c6-4203-a79a-5136e97a1344","Type":"ContainerStarted","Data":"37153cd1b0e3ea9cfb81b53d5e7aae9fbadec038c5e6ae85de2142e9bc19ca26"} Aug 05 17:25:18.430745 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:18.430722 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8nr5p" Aug 05 17:25:18.442798 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:18.442756 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-8nr5p" podStartSLOduration=2.884468411 podStartE2EDuration="4.442741702s" totalImagesPullingTime="1.558273291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:25:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:25:18.44225174 +0000 UTC m=+106.209631972" watchObservedRunningTime="2026-08-05 17:25:18.442741702 +0000 UTC m=+106.210121935" Aug 05 17:25:18.829058 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:18.829027 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65bb9d74b9-4l7gq"] Aug 05 17:25:18.831609 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:18.831589 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65bb9d74b9-4l7gq" Aug 05 17:25:18.840562 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:18.840541 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Aug 05 17:25:18.844375 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:18.844351 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65bb9d74b9-4l7gq"] Aug 05 17:25:18.876090 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:18.876063 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:18.928551 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:18.928519 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfvmx\" (UniqueName: \"kubernetes.io/projected/4df28aa6-6341-4656-af9a-4bf71ba3d7df-kube-api-access-tfvmx\") pod \"console-65bb9d74b9-4l7gq\" (UID: \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\") " pod="openshift-console/console-65bb9d74b9-4l7gq" Aug 05 17:25:18.928688 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:18.928567 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4df28aa6-6341-4656-af9a-4bf71ba3d7df-trusted-ca-bundle\") pod \"console-65bb9d74b9-4l7gq\" (UID: \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\") " pod="openshift-console/console-65bb9d74b9-4l7gq" Aug 05 17:25:18.928688 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:18.928588 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4df28aa6-6341-4656-af9a-4bf71ba3d7df-console-serving-cert\") pod \"console-65bb9d74b9-4l7gq\" (UID: \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\") " pod="openshift-console/console-65bb9d74b9-4l7gq" Aug 05 17:25:18.928688 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:18.928606 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4df28aa6-6341-4656-af9a-4bf71ba3d7df-console-oauth-config\") pod \"console-65bb9d74b9-4l7gq\" (UID: \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\") " pod="openshift-console/console-65bb9d74b9-4l7gq" Aug 05 17:25:18.928688 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:18.928657 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4df28aa6-6341-4656-af9a-4bf71ba3d7df-console-config\") pod \"console-65bb9d74b9-4l7gq\" (UID: \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\") " pod="openshift-console/console-65bb9d74b9-4l7gq" Aug 05 17:25:18.928688 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:18.928675 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4df28aa6-6341-4656-af9a-4bf71ba3d7df-service-ca\") pod \"console-65bb9d74b9-4l7gq\" (UID: \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\") " pod="openshift-console/console-65bb9d74b9-4l7gq" Aug 05 17:25:18.928889 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:18.928707 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4df28aa6-6341-4656-af9a-4bf71ba3d7df-oauth-serving-cert\") pod \"console-65bb9d74b9-4l7gq\" (UID: \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\") " pod="openshift-console/console-65bb9d74b9-4l7gq" Aug 05 17:25:18.931585 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:18.931552 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:19.029508 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:19.029475 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4df28aa6-6341-4656-af9a-4bf71ba3d7df-trusted-ca-bundle\") pod \"console-65bb9d74b9-4l7gq\" (UID: \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\") " pod="openshift-console/console-65bb9d74b9-4l7gq" Aug 05 17:25:19.029653 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:19.029512 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4df28aa6-6341-4656-af9a-4bf71ba3d7df-console-serving-cert\") pod \"console-65bb9d74b9-4l7gq\" (UID: \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\") " pod="openshift-console/console-65bb9d74b9-4l7gq" Aug 05 17:25:19.029653 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:19.029535 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4df28aa6-6341-4656-af9a-4bf71ba3d7df-console-oauth-config\") pod \"console-65bb9d74b9-4l7gq\" (UID: \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\") " pod="openshift-console/console-65bb9d74b9-4l7gq" Aug 05 17:25:19.029653 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:19.029588 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4df28aa6-6341-4656-af9a-4bf71ba3d7df-console-config\") pod \"console-65bb9d74b9-4l7gq\" (UID: \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\") " pod="openshift-console/console-65bb9d74b9-4l7gq" Aug 05 17:25:19.029653 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:19.029608 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4df28aa6-6341-4656-af9a-4bf71ba3d7df-service-ca\") pod \"console-65bb9d74b9-4l7gq\" (UID: \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\") " pod="openshift-console/console-65bb9d74b9-4l7gq" Aug 05 17:25:19.029653 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:19.029627 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4df28aa6-6341-4656-af9a-4bf71ba3d7df-oauth-serving-cert\") pod \"console-65bb9d74b9-4l7gq\" (UID: \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\") " pod="openshift-console/console-65bb9d74b9-4l7gq" Aug 05 17:25:19.029911 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:19.029694 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfvmx\" (UniqueName: \"kubernetes.io/projected/4df28aa6-6341-4656-af9a-4bf71ba3d7df-kube-api-access-tfvmx\") pod \"console-65bb9d74b9-4l7gq\" (UID: \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\") " pod="openshift-console/console-65bb9d74b9-4l7gq" Aug 05 17:25:19.030447 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:19.030421 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4df28aa6-6341-4656-af9a-4bf71ba3d7df-service-ca\") pod \"console-65bb9d74b9-4l7gq\" (UID: \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\") " pod="openshift-console/console-65bb9d74b9-4l7gq" Aug 05 17:25:19.030447 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:19.030442 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4df28aa6-6341-4656-af9a-4bf71ba3d7df-console-config\") pod \"console-65bb9d74b9-4l7gq\" (UID: \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\") " pod="openshift-console/console-65bb9d74b9-4l7gq" Aug 05 17:25:19.030604 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:19.030531 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4df28aa6-6341-4656-af9a-4bf71ba3d7df-oauth-serving-cert\") pod \"console-65bb9d74b9-4l7gq\" (UID: \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\") " pod="openshift-console/console-65bb9d74b9-4l7gq" Aug 05 17:25:19.030768 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:19.030747 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4df28aa6-6341-4656-af9a-4bf71ba3d7df-trusted-ca-bundle\") pod \"console-65bb9d74b9-4l7gq\" (UID: \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\") " pod="openshift-console/console-65bb9d74b9-4l7gq" Aug 05 17:25:19.032057 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:19.032032 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4df28aa6-6341-4656-af9a-4bf71ba3d7df-console-oauth-config\") pod \"console-65bb9d74b9-4l7gq\" (UID: \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\") " pod="openshift-console/console-65bb9d74b9-4l7gq" Aug 05 17:25:19.032191 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:19.032167 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4df28aa6-6341-4656-af9a-4bf71ba3d7df-console-serving-cert\") pod \"console-65bb9d74b9-4l7gq\" (UID: \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\") " pod="openshift-console/console-65bb9d74b9-4l7gq" Aug 05 17:25:19.037976 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:19.037953 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfvmx\" (UniqueName: \"kubernetes.io/projected/4df28aa6-6341-4656-af9a-4bf71ba3d7df-kube-api-access-tfvmx\") pod \"console-65bb9d74b9-4l7gq\" (UID: \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\") " pod="openshift-console/console-65bb9d74b9-4l7gq" Aug 05 17:25:19.164312 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:19.164274 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65bb9d74b9-4l7gq" Aug 05 17:25:19.308621 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:19.308589 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65bb9d74b9-4l7gq"] Aug 05 17:25:19.318010 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:25:19.317985 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4df28aa6_6341_4656_af9a_4bf71ba3d7df.slice/crio-be9ae54a24be6504fb86c1d0212cda8c14912e87f553a18f291351a63333bed7 WatchSource:0}: Error finding container be9ae54a24be6504fb86c1d0212cda8c14912e87f553a18f291351a63333bed7: Status 404 returned error can't find the container with id be9ae54a24be6504fb86c1d0212cda8c14912e87f553a18f291351a63333bed7 Aug 05 17:25:19.437337 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:19.437243 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"67ecab95-76c6-4203-a79a-5136e97a1344","Type":"ContainerStarted","Data":"1f78fbc8a9ffde5c41bb33dff83d3773bacae64fb740b1d95e82784c025e323b"} Aug 05 17:25:19.439032 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:19.439004 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65bb9d74b9-4l7gq" event={"ID":"4df28aa6-6341-4656-af9a-4bf71ba3d7df","Type":"ContainerStarted","Data":"ec379aa4a901412406a04ba6f1ce45c37c9fd2d160326fd5da39a091d422ba2a"} Aug 05 17:25:19.439195 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:19.439046 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65bb9d74b9-4l7gq" event={"ID":"4df28aa6-6341-4656-af9a-4bf71ba3d7df","Type":"ContainerStarted","Data":"be9ae54a24be6504fb86c1d0212cda8c14912e87f553a18f291351a63333bed7"} Aug 05 17:25:19.468001 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:19.467956 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.74355702 podStartE2EDuration="8.467938729s" totalImagesPullingTime="4.70403951s" totalInitContainerRuntime="20.342199ms" isStatefulPod=false podCreationTimestamp="2026-08-05 17:25:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:25:19.464954808 +0000 UTC m=+107.232335038" watchObservedRunningTime="2026-08-05 17:25:19.467938729 +0000 UTC m=+107.235318983" Aug 05 17:25:19.483439 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:19.483379 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65bb9d74b9-4l7gq" podStartSLOduration=1.483357771 podStartE2EDuration="1.483357771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:25:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:25:19.481844623 +0000 UTC m=+107.249224858" watchObservedRunningTime="2026-08-05 17:25:19.483357771 +0000 UTC m=+107.250738071" Aug 05 17:25:19.833718 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:19.833685 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d65dd5c8d-7qk95" Aug 05 17:25:19.833904 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:19.833754 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d65dd5c8d-7qk95" Aug 05 17:25:19.838749 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:19.838721 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d65dd5c8d-7qk95" Aug 05 17:25:20.125823 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:20.125736 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:20.227014 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:20.226975 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:20.447521 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:20.447435 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d65dd5c8d-7qk95" Aug 05 17:25:21.508684 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:21.508655 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:21.599436 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:21.599398 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:23.068589 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:23.068559 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:23.130456 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:23.130422 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:28.487461 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:28.487417 2579 generic.go:356] "Generic (PLEG): container finished" podID="45a097fa-7f29-42cc-b351-931955a10ccf" containerID="f5fa12db5d9ea3813b2e666876c02c9d2b2da4b2b4840aaf74fbe067aecac23f" exitCode=0 Aug 05 17:25:28.487891 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:28.487489 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-vjkmk" event={"ID":"45a097fa-7f29-42cc-b351-931955a10ccf","Type":"ContainerDied","Data":"f5fa12db5d9ea3813b2e666876c02c9d2b2da4b2b4840aaf74fbe067aecac23f"} Aug 05 17:25:28.487891 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:28.487834 2579 scope.go:117] "RemoveContainer" containerID="f5fa12db5d9ea3813b2e666876c02c9d2b2da4b2b4840aaf74fbe067aecac23f" Aug 05 17:25:28.489057 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:28.489034 2579 generic.go:356] "Generic (PLEG): container finished" podID="7fa167ca-16b6-4ab3-a8e2-c380b172790d" containerID="3f53a510dd6f136f83bfaaa0d56c0fdfdcc2605621254c80649fdc6183607bba" exitCode=0 Aug 05 17:25:28.489178 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:28.489091 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-52lff" event={"ID":"7fa167ca-16b6-4ab3-a8e2-c380b172790d","Type":"ContainerDied","Data":"3f53a510dd6f136f83bfaaa0d56c0fdfdcc2605621254c80649fdc6183607bba"} Aug 05 17:25:28.489420 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:28.489406 2579 scope.go:117] "RemoveContainer" containerID="3f53a510dd6f136f83bfaaa0d56c0fdfdcc2605621254c80649fdc6183607bba" Aug 05 17:25:29.165280 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:29.165242 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65bb9d74b9-4l7gq" Aug 05 17:25:29.165467 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:29.165385 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65bb9d74b9-4l7gq" Aug 05 17:25:29.170098 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:29.170072 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65bb9d74b9-4l7gq" Aug 05 17:25:29.494483 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:29.494384 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-vjkmk" event={"ID":"45a097fa-7f29-42cc-b351-931955a10ccf","Type":"ContainerStarted","Data":"0f4609a93659efef2d24caa1f36ce51b24be7992b72b4cdc337e3df27f1dc634"} Aug 05 17:25:29.496162 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:29.496107 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-52lff" event={"ID":"7fa167ca-16b6-4ab3-a8e2-c380b172790d","Type":"ContainerStarted","Data":"c5c22d642c9e6dffe17b9edb96499c669f1139ea9cf9a4310b8b9a10a2012113"} Aug 05 17:25:29.500050 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:29.500030 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65bb9d74b9-4l7gq" Aug 05 17:25:29.568098 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:29.568067 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d65dd5c8d-7qk95"] Aug 05 17:25:31.632518 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:31.632474 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:31.705123 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:31.705087 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:35.024266 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:35.024225 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:35.125259 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:35.125223 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:35.635887 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:35.635860 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:35.693833 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:35.693798 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:36.543050 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:36.543017 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:36.606281 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:36.606238 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:39.674364 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:39.674325 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5966949c47-qg79w" podUID="373295e7-1a34-48dc-87f0-c64e319eb1e1" containerName="registry" containerID="cri-o://9de2b2a1b4829ee25f2221b3336e680c63a1f72b4ff512293c274551a82a717c" gracePeriod=30 Aug 05 17:25:39.916377 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:39.916349 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:25:40.024416 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:40.024333 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/373295e7-1a34-48dc-87f0-c64e319eb1e1-image-registry-private-configuration\") pod \"373295e7-1a34-48dc-87f0-c64e319eb1e1\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " Aug 05 17:25:40.024416 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:40.024404 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/373295e7-1a34-48dc-87f0-c64e319eb1e1-registry-certificates\") pod \"373295e7-1a34-48dc-87f0-c64e319eb1e1\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " Aug 05 17:25:40.024618 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:40.024450 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-registry-tls\") pod \"373295e7-1a34-48dc-87f0-c64e319eb1e1\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " Aug 05 17:25:40.024618 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:40.024476 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/373295e7-1a34-48dc-87f0-c64e319eb1e1-trusted-ca\") pod \"373295e7-1a34-48dc-87f0-c64e319eb1e1\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " Aug 05 17:25:40.024618 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:40.024593 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/373295e7-1a34-48dc-87f0-c64e319eb1e1-ca-trust-extracted\") pod \"373295e7-1a34-48dc-87f0-c64e319eb1e1\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " Aug 05 17:25:40.024772 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:40.024641 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-bound-sa-token\") pod \"373295e7-1a34-48dc-87f0-c64e319eb1e1\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " Aug 05 17:25:40.024772 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:40.024680 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwhn4\" (UniqueName: \"kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-kube-api-access-zwhn4\") pod \"373295e7-1a34-48dc-87f0-c64e319eb1e1\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " Aug 05 17:25:40.024772 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:40.024710 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/373295e7-1a34-48dc-87f0-c64e319eb1e1-installation-pull-secrets\") pod \"373295e7-1a34-48dc-87f0-c64e319eb1e1\" (UID: \"373295e7-1a34-48dc-87f0-c64e319eb1e1\") " Aug 05 17:25:40.025246 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:40.024951 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/373295e7-1a34-48dc-87f0-c64e319eb1e1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "373295e7-1a34-48dc-87f0-c64e319eb1e1" (UID: "373295e7-1a34-48dc-87f0-c64e319eb1e1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:25:40.025246 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:40.024967 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/373295e7-1a34-48dc-87f0-c64e319eb1e1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "373295e7-1a34-48dc-87f0-c64e319eb1e1" (UID: "373295e7-1a34-48dc-87f0-c64e319eb1e1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:25:40.025246 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:40.025024 2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/373295e7-1a34-48dc-87f0-c64e319eb1e1-registry-certificates\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:25:40.025246 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:40.025042 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/373295e7-1a34-48dc-87f0-c64e319eb1e1-trusted-ca\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:25:40.027006 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:40.026978 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/373295e7-1a34-48dc-87f0-c64e319eb1e1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "373295e7-1a34-48dc-87f0-c64e319eb1e1" (UID: "373295e7-1a34-48dc-87f0-c64e319eb1e1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:25:40.027202 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:40.027173 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "373295e7-1a34-48dc-87f0-c64e319eb1e1" (UID: "373295e7-1a34-48dc-87f0-c64e319eb1e1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:25:40.027304 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:40.027246 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "373295e7-1a34-48dc-87f0-c64e319eb1e1" (UID: "373295e7-1a34-48dc-87f0-c64e319eb1e1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:25:40.027608 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:40.027585 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-kube-api-access-zwhn4" (OuterVolumeSpecName: "kube-api-access-zwhn4") pod "373295e7-1a34-48dc-87f0-c64e319eb1e1" (UID: "373295e7-1a34-48dc-87f0-c64e319eb1e1"). InnerVolumeSpecName "kube-api-access-zwhn4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:25:40.027850 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:40.027828 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/373295e7-1a34-48dc-87f0-c64e319eb1e1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "373295e7-1a34-48dc-87f0-c64e319eb1e1" (UID: "373295e7-1a34-48dc-87f0-c64e319eb1e1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:25:40.032757 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:40.032729 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/373295e7-1a34-48dc-87f0-c64e319eb1e1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "373295e7-1a34-48dc-87f0-c64e319eb1e1" (UID: "373295e7-1a34-48dc-87f0-c64e319eb1e1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:25:40.126465 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:40.126428 2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-bound-sa-token\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:25:40.126465 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:40.126458 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwhn4\" (UniqueName: \"kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-kube-api-access-zwhn4\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:25:40.126465 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:40.126471 2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/373295e7-1a34-48dc-87f0-c64e319eb1e1-installation-pull-secrets\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:25:40.126696 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:40.126484 2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/373295e7-1a34-48dc-87f0-c64e319eb1e1-image-registry-private-configuration\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:25:40.126696 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:40.126497 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/373295e7-1a34-48dc-87f0-c64e319eb1e1-registry-tls\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:25:40.126696 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:40.126508 2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/373295e7-1a34-48dc-87f0-c64e319eb1e1-ca-trust-extracted\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:25:40.542671 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:40.542641 2579 generic.go:356] "Generic (PLEG): container finished" podID="373295e7-1a34-48dc-87f0-c64e319eb1e1" containerID="9de2b2a1b4829ee25f2221b3336e680c63a1f72b4ff512293c274551a82a717c" exitCode=0 Aug 05 17:25:40.542837 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:40.542693 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5966949c47-qg79w" Aug 05 17:25:40.542837 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:40.542698 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5966949c47-qg79w" event={"ID":"373295e7-1a34-48dc-87f0-c64e319eb1e1","Type":"ContainerDied","Data":"9de2b2a1b4829ee25f2221b3336e680c63a1f72b4ff512293c274551a82a717c"} Aug 05 17:25:40.542837 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:40.542795 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5966949c47-qg79w" event={"ID":"373295e7-1a34-48dc-87f0-c64e319eb1e1","Type":"ContainerDied","Data":"16182f9c379daab264aa437dc80bc1c775867358d9fd955db7c6b127724ac654"} Aug 05 17:25:40.542837 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:40.542814 2579 scope.go:117] "RemoveContainer" containerID="9de2b2a1b4829ee25f2221b3336e680c63a1f72b4ff512293c274551a82a717c" Aug 05 17:25:40.557626 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:40.557605 2579 scope.go:117] "RemoveContainer" containerID="9de2b2a1b4829ee25f2221b3336e680c63a1f72b4ff512293c274551a82a717c" Aug 05 17:25:40.557937 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:25:40.557913 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9de2b2a1b4829ee25f2221b3336e680c63a1f72b4ff512293c274551a82a717c\": container with ID starting with 9de2b2a1b4829ee25f2221b3336e680c63a1f72b4ff512293c274551a82a717c not found: ID does not exist" containerID="9de2b2a1b4829ee25f2221b3336e680c63a1f72b4ff512293c274551a82a717c" Aug 05 17:25:40.557984 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:40.557947 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9de2b2a1b4829ee25f2221b3336e680c63a1f72b4ff512293c274551a82a717c"} err="failed to get container status \"9de2b2a1b4829ee25f2221b3336e680c63a1f72b4ff512293c274551a82a717c\": rpc error: code = NotFound desc = could not find container \"9de2b2a1b4829ee25f2221b3336e680c63a1f72b4ff512293c274551a82a717c\": container with ID starting with 9de2b2a1b4829ee25f2221b3336e680c63a1f72b4ff512293c274551a82a717c not found: ID does not exist" Aug 05 17:25:40.570470 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:40.570446 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5966949c47-qg79w"] Aug 05 17:25:40.574780 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:40.574756 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5966949c47-qg79w"] Aug 05 17:25:40.769550 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:40.769515 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="373295e7-1a34-48dc-87f0-c64e319eb1e1" path="/var/lib/kubelet/pods/373295e7-1a34-48dc-87f0-c64e319eb1e1/volumes" Aug 05 17:25:46.127091 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:46.127061 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:46.290208 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:46.290166 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:46.401452 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:46.401368 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:48.579204 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:48.579169 2579 generic.go:356] "Generic (PLEG): container finished" podID="fcb6cf3e-3244-471a-9780-6c3fcc157551" containerID="50e34ccf1ad2a718fe3b2660d0d7e10e4fd8dab944f5559c369a5008865537bd" exitCode=0 Aug 05 17:25:48.579691 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:48.579232 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-7xft8" event={"ID":"fcb6cf3e-3244-471a-9780-6c3fcc157551","Type":"ContainerDied","Data":"50e34ccf1ad2a718fe3b2660d0d7e10e4fd8dab944f5559c369a5008865537bd"} Aug 05 17:25:48.579761 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:48.579696 2579 scope.go:117] "RemoveContainer" containerID="50e34ccf1ad2a718fe3b2660d0d7e10e4fd8dab944f5559c369a5008865537bd" Aug 05 17:25:49.585418 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:49.585383 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-7xft8" event={"ID":"fcb6cf3e-3244-471a-9780-6c3fcc157551","Type":"ContainerStarted","Data":"e971fcb22417449d051927cddaab1cd5a23fde4115dee89cd8400d5ec015f122"} Aug 05 17:25:51.504311 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:51.504273 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:51.571260 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:51.571221 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:25:54.589286 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:54.589228 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5d65dd5c8d-7qk95" podUID="9fded585-1ec7-4183-8c35-cb8dda0bfc18" containerName="console" containerID="cri-o://3496eb747e9d0a1d4f610d4c172d499a69a3539264ed586ffd261908841fcbef" gracePeriod=15 Aug 05 17:25:54.828610 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:54.828585 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d65dd5c8d-7qk95" Aug 05 17:25:54.938705 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:54.938612 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9fded585-1ec7-4183-8c35-cb8dda0bfc18-oauth-serving-cert\") pod \"9fded585-1ec7-4183-8c35-cb8dda0bfc18\" (UID: \"9fded585-1ec7-4183-8c35-cb8dda0bfc18\") " Aug 05 17:25:54.938705 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:54.938674 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9fded585-1ec7-4183-8c35-cb8dda0bfc18-console-oauth-config\") pod \"9fded585-1ec7-4183-8c35-cb8dda0bfc18\" (UID: \"9fded585-1ec7-4183-8c35-cb8dda0bfc18\") " Aug 05 17:25:54.938929 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:54.938708 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpcct\" (UniqueName: \"kubernetes.io/projected/9fded585-1ec7-4183-8c35-cb8dda0bfc18-kube-api-access-wpcct\") pod \"9fded585-1ec7-4183-8c35-cb8dda0bfc18\" (UID: \"9fded585-1ec7-4183-8c35-cb8dda0bfc18\") " Aug 05 17:25:54.938929 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:54.938747 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9fded585-1ec7-4183-8c35-cb8dda0bfc18-console-config\") pod \"9fded585-1ec7-4183-8c35-cb8dda0bfc18\" (UID: \"9fded585-1ec7-4183-8c35-cb8dda0bfc18\") " Aug 05 17:25:54.938929 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:54.938770 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9fded585-1ec7-4183-8c35-cb8dda0bfc18-service-ca\") pod \"9fded585-1ec7-4183-8c35-cb8dda0bfc18\" (UID: \"9fded585-1ec7-4183-8c35-cb8dda0bfc18\") " Aug 05 17:25:54.938929 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:54.938815 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fded585-1ec7-4183-8c35-cb8dda0bfc18-console-serving-cert\") pod \"9fded585-1ec7-4183-8c35-cb8dda0bfc18\" (UID: \"9fded585-1ec7-4183-8c35-cb8dda0bfc18\") " Aug 05 17:25:54.939182 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:54.939107 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fded585-1ec7-4183-8c35-cb8dda0bfc18-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9fded585-1ec7-4183-8c35-cb8dda0bfc18" (UID: "9fded585-1ec7-4183-8c35-cb8dda0bfc18"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:25:54.939182 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:54.939134 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fded585-1ec7-4183-8c35-cb8dda0bfc18-console-config" (OuterVolumeSpecName: "console-config") pod "9fded585-1ec7-4183-8c35-cb8dda0bfc18" (UID: "9fded585-1ec7-4183-8c35-cb8dda0bfc18"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:25:54.939335 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:54.939188 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fded585-1ec7-4183-8c35-cb8dda0bfc18-service-ca" (OuterVolumeSpecName: "service-ca") pod "9fded585-1ec7-4183-8c35-cb8dda0bfc18" (UID: "9fded585-1ec7-4183-8c35-cb8dda0bfc18"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:25:54.941061 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:54.941031 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fded585-1ec7-4183-8c35-cb8dda0bfc18-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9fded585-1ec7-4183-8c35-cb8dda0bfc18" (UID: "9fded585-1ec7-4183-8c35-cb8dda0bfc18"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:25:54.941061 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:54.941036 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fded585-1ec7-4183-8c35-cb8dda0bfc18-kube-api-access-wpcct" (OuterVolumeSpecName: "kube-api-access-wpcct") pod "9fded585-1ec7-4183-8c35-cb8dda0bfc18" (UID: "9fded585-1ec7-4183-8c35-cb8dda0bfc18"). InnerVolumeSpecName "kube-api-access-wpcct". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:25:54.941205 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:54.941057 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fded585-1ec7-4183-8c35-cb8dda0bfc18-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9fded585-1ec7-4183-8c35-cb8dda0bfc18" (UID: "9fded585-1ec7-4183-8c35-cb8dda0bfc18"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:25:55.040381 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:55.040338 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fded585-1ec7-4183-8c35-cb8dda0bfc18-console-serving-cert\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:25:55.040381 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:55.040369 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9fded585-1ec7-4183-8c35-cb8dda0bfc18-oauth-serving-cert\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:25:55.040381 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:55.040378 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9fded585-1ec7-4183-8c35-cb8dda0bfc18-console-oauth-config\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:25:55.040381 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:55.040387 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpcct\" (UniqueName: \"kubernetes.io/projected/9fded585-1ec7-4183-8c35-cb8dda0bfc18-kube-api-access-wpcct\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:25:55.040639 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:55.040397 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9fded585-1ec7-4183-8c35-cb8dda0bfc18-console-config\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:25:55.040639 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:55.040406 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9fded585-1ec7-4183-8c35-cb8dda0bfc18-service-ca\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:25:55.609881 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:55.609839 2579 generic.go:356] "Generic (PLEG): container finished" podID="9fded585-1ec7-4183-8c35-cb8dda0bfc18" containerID="3496eb747e9d0a1d4f610d4c172d499a69a3539264ed586ffd261908841fcbef" exitCode=0 Aug 05 17:25:55.609881 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:55.609881 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d65dd5c8d-7qk95" Aug 05 17:25:55.610377 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:55.609896 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d65dd5c8d-7qk95" event={"ID":"9fded585-1ec7-4183-8c35-cb8dda0bfc18","Type":"ContainerDied","Data":"3496eb747e9d0a1d4f610d4c172d499a69a3539264ed586ffd261908841fcbef"} Aug 05 17:25:55.610377 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:55.609942 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d65dd5c8d-7qk95" event={"ID":"9fded585-1ec7-4183-8c35-cb8dda0bfc18","Type":"ContainerDied","Data":"cfe5572f979cfa3fdddca11ab1818093a5382be81a230f5b5f552ff8c7c24306"} Aug 05 17:25:55.610377 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:55.609965 2579 scope.go:117] "RemoveContainer" containerID="3496eb747e9d0a1d4f610d4c172d499a69a3539264ed586ffd261908841fcbef" Aug 05 17:25:55.618727 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:55.618709 2579 scope.go:117] "RemoveContainer" containerID="3496eb747e9d0a1d4f610d4c172d499a69a3539264ed586ffd261908841fcbef" Aug 05 17:25:55.618968 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:25:55.618952 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3496eb747e9d0a1d4f610d4c172d499a69a3539264ed586ffd261908841fcbef\": container with ID starting with 3496eb747e9d0a1d4f610d4c172d499a69a3539264ed586ffd261908841fcbef not found: ID does not exist" containerID="3496eb747e9d0a1d4f610d4c172d499a69a3539264ed586ffd261908841fcbef" Aug 05 17:25:55.619018 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:55.618975 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3496eb747e9d0a1d4f610d4c172d499a69a3539264ed586ffd261908841fcbef"} err="failed to get container status \"3496eb747e9d0a1d4f610d4c172d499a69a3539264ed586ffd261908841fcbef\": rpc error: code = NotFound desc = could not find container \"3496eb747e9d0a1d4f610d4c172d499a69a3539264ed586ffd261908841fcbef\": container with ID starting with 3496eb747e9d0a1d4f610d4c172d499a69a3539264ed586ffd261908841fcbef not found: ID does not exist" Aug 05 17:25:55.632394 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:55.632358 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d65dd5c8d-7qk95"] Aug 05 17:25:55.634418 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:55.634394 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d65dd5c8d-7qk95"] Aug 05 17:25:56.768915 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:25:56.768879 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fded585-1ec7-4183-8c35-cb8dda0bfc18" path="/var/lib/kubelet/pods/9fded585-1ec7-4183-8c35-cb8dda0bfc18/volumes" Aug 05 17:26:06.743824 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:06.743779 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:26:29.331220 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:29.331117 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:26:29.747895 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:29.747799 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:26:30.387544 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:30.387512 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 05 17:26:30.387961 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:30.387828 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="67ecab95-76c6-4203-a79a-5136e97a1344" containerName="alertmanager" containerID="cri-o://37153cd1b0e3ea9cfb81b53d5e7aae9fbadec038c5e6ae85de2142e9bc19ca26" gracePeriod=120 Aug 05 17:26:30.387961 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:30.387859 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="67ecab95-76c6-4203-a79a-5136e97a1344" containerName="kube-rbac-proxy-metric" containerID="cri-o://4ca19b54120d5a54acda3819c9e180bffc184790f507ac73cd163baf917d5153" gracePeriod=120 Aug 05 17:26:30.387961 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:30.387894 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="67ecab95-76c6-4203-a79a-5136e97a1344" containerName="config-reloader" containerID="cri-o://459b2c2ed27aedcd4de0a2460895529a5fc992a0e94fc18218606f0ebce1727f" gracePeriod=120 Aug 05 17:26:30.387961 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:30.387911 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="67ecab95-76c6-4203-a79a-5136e97a1344" containerName="prom-label-proxy" containerID="cri-o://1f78fbc8a9ffde5c41bb33dff83d3773bacae64fb740b1d95e82784c025e323b" gracePeriod=120 Aug 05 17:26:30.388224 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:30.387870 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="67ecab95-76c6-4203-a79a-5136e97a1344" containerName="kube-rbac-proxy-web" containerID="cri-o://7bd3b91aa974760f6ca3b8be894d351b5bf46c006e1b9633d3187ecbe8a2d41f" gracePeriod=120 Aug 05 17:26:30.388224 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:30.387873 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="67ecab95-76c6-4203-a79a-5136e97a1344" containerName="kube-rbac-proxy" containerID="cri-o://cbc093adae876475276759b1ca4aa5d207353c48f34ad6618adb9126f6f83f10" gracePeriod=120 Aug 05 17:26:30.760872 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:30.760788 2579 generic.go:356] "Generic (PLEG): container finished" podID="67ecab95-76c6-4203-a79a-5136e97a1344" containerID="1f78fbc8a9ffde5c41bb33dff83d3773bacae64fb740b1d95e82784c025e323b" exitCode=0 Aug 05 17:26:30.760872 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:30.760814 2579 generic.go:356] "Generic (PLEG): container finished" podID="67ecab95-76c6-4203-a79a-5136e97a1344" containerID="cbc093adae876475276759b1ca4aa5d207353c48f34ad6618adb9126f6f83f10" exitCode=0 Aug 05 17:26:30.760872 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:30.760821 2579 generic.go:356] "Generic (PLEG): container finished" podID="67ecab95-76c6-4203-a79a-5136e97a1344" containerID="459b2c2ed27aedcd4de0a2460895529a5fc992a0e94fc18218606f0ebce1727f" exitCode=0 Aug 05 17:26:30.760872 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:30.760827 2579 generic.go:356] "Generic (PLEG): container finished" podID="67ecab95-76c6-4203-a79a-5136e97a1344" containerID="37153cd1b0e3ea9cfb81b53d5e7aae9fbadec038c5e6ae85de2142e9bc19ca26" exitCode=0 Aug 05 17:26:30.760872 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:30.760857 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"67ecab95-76c6-4203-a79a-5136e97a1344","Type":"ContainerDied","Data":"1f78fbc8a9ffde5c41bb33dff83d3773bacae64fb740b1d95e82784c025e323b"} Aug 05 17:26:30.761133 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:30.760924 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"67ecab95-76c6-4203-a79a-5136e97a1344","Type":"ContainerDied","Data":"cbc093adae876475276759b1ca4aa5d207353c48f34ad6618adb9126f6f83f10"} Aug 05 17:26:30.761133 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:30.760949 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"67ecab95-76c6-4203-a79a-5136e97a1344","Type":"ContainerDied","Data":"459b2c2ed27aedcd4de0a2460895529a5fc992a0e94fc18218606f0ebce1727f"} Aug 05 17:26:30.761133 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:30.760974 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"67ecab95-76c6-4203-a79a-5136e97a1344","Type":"ContainerDied","Data":"37153cd1b0e3ea9cfb81b53d5e7aae9fbadec038c5e6ae85de2142e9bc19ca26"} Aug 05 17:26:31.640361 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.640335 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:31.749652 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.749570 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-config-volume\") pod \"67ecab95-76c6-4203-a79a-5136e97a1344\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " Aug 05 17:26:31.749652 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.749635 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2f8dl\" (UniqueName: \"kubernetes.io/projected/67ecab95-76c6-4203-a79a-5136e97a1344-kube-api-access-2f8dl\") pod \"67ecab95-76c6-4203-a79a-5136e97a1344\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " Aug 05 17:26:31.749855 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.749675 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67ecab95-76c6-4203-a79a-5136e97a1344-metrics-client-ca\") pod \"67ecab95-76c6-4203-a79a-5136e97a1344\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " Aug 05 17:26:31.749855 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.749703 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/67ecab95-76c6-4203-a79a-5136e97a1344-tls-assets\") pod \"67ecab95-76c6-4203-a79a-5136e97a1344\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " Aug 05 17:26:31.749855 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.749721 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-secret-alertmanager-kube-rbac-proxy-metric\") pod \"67ecab95-76c6-4203-a79a-5136e97a1344\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " Aug 05 17:26:31.749855 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.749753 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67ecab95-76c6-4203-a79a-5136e97a1344-alertmanager-trusted-ca-bundle\") pod \"67ecab95-76c6-4203-a79a-5136e97a1344\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " Aug 05 17:26:31.749855 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.749831 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-secret-alertmanager-main-tls\") pod \"67ecab95-76c6-4203-a79a-5136e97a1344\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " Aug 05 17:26:31.750120 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.749881 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-web-config\") pod \"67ecab95-76c6-4203-a79a-5136e97a1344\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " Aug 05 17:26:31.750120 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.749917 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-secret-alertmanager-kube-rbac-proxy\") pod \"67ecab95-76c6-4203-a79a-5136e97a1344\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " Aug 05 17:26:31.750120 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.749960 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-secret-alertmanager-kube-rbac-proxy-web\") pod \"67ecab95-76c6-4203-a79a-5136e97a1344\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " Aug 05 17:26:31.750120 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.749988 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-cluster-tls-config\") pod \"67ecab95-76c6-4203-a79a-5136e97a1344\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " Aug 05 17:26:31.750120 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.750032 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/67ecab95-76c6-4203-a79a-5136e97a1344-config-out\") pod \"67ecab95-76c6-4203-a79a-5136e97a1344\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " Aug 05 17:26:31.750120 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.750088 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/67ecab95-76c6-4203-a79a-5136e97a1344-alertmanager-main-db\") pod \"67ecab95-76c6-4203-a79a-5136e97a1344\" (UID: \"67ecab95-76c6-4203-a79a-5136e97a1344\") " Aug 05 17:26:31.750474 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.750159 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67ecab95-76c6-4203-a79a-5136e97a1344-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "67ecab95-76c6-4203-a79a-5136e97a1344" (UID: "67ecab95-76c6-4203-a79a-5136e97a1344"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:26:31.750474 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.750167 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67ecab95-76c6-4203-a79a-5136e97a1344-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "67ecab95-76c6-4203-a79a-5136e97a1344" (UID: "67ecab95-76c6-4203-a79a-5136e97a1344"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:26:31.750474 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.750375 2579 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67ecab95-76c6-4203-a79a-5136e97a1344-metrics-client-ca\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:26:31.750474 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.750397 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67ecab95-76c6-4203-a79a-5136e97a1344-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:26:31.750743 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.750723 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67ecab95-76c6-4203-a79a-5136e97a1344-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "67ecab95-76c6-4203-a79a-5136e97a1344" (UID: "67ecab95-76c6-4203-a79a-5136e97a1344"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:26:31.752562 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.752533 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67ecab95-76c6-4203-a79a-5136e97a1344-kube-api-access-2f8dl" (OuterVolumeSpecName: "kube-api-access-2f8dl") pod "67ecab95-76c6-4203-a79a-5136e97a1344" (UID: "67ecab95-76c6-4203-a79a-5136e97a1344"). InnerVolumeSpecName "kube-api-access-2f8dl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:26:31.753045 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.753018 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67ecab95-76c6-4203-a79a-5136e97a1344-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "67ecab95-76c6-4203-a79a-5136e97a1344" (UID: "67ecab95-76c6-4203-a79a-5136e97a1344"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:26:31.753284 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.753248 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "67ecab95-76c6-4203-a79a-5136e97a1344" (UID: "67ecab95-76c6-4203-a79a-5136e97a1344"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:26:31.753430 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.753387 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-config-volume" (OuterVolumeSpecName: "config-volume") pod "67ecab95-76c6-4203-a79a-5136e97a1344" (UID: "67ecab95-76c6-4203-a79a-5136e97a1344"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:26:31.753510 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.753483 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "67ecab95-76c6-4203-a79a-5136e97a1344" (UID: "67ecab95-76c6-4203-a79a-5136e97a1344"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:26:31.753888 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.753866 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "67ecab95-76c6-4203-a79a-5136e97a1344" (UID: "67ecab95-76c6-4203-a79a-5136e97a1344"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:26:31.753962 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.753884 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "67ecab95-76c6-4203-a79a-5136e97a1344" (UID: "67ecab95-76c6-4203-a79a-5136e97a1344"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:26:31.754022 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.754005 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67ecab95-76c6-4203-a79a-5136e97a1344-config-out" (OuterVolumeSpecName: "config-out") pod "67ecab95-76c6-4203-a79a-5136e97a1344" (UID: "67ecab95-76c6-4203-a79a-5136e97a1344"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:26:31.757044 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.757025 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "67ecab95-76c6-4203-a79a-5136e97a1344" (UID: "67ecab95-76c6-4203-a79a-5136e97a1344"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:26:31.765419 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.765394 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-web-config" (OuterVolumeSpecName: "web-config") pod "67ecab95-76c6-4203-a79a-5136e97a1344" (UID: "67ecab95-76c6-4203-a79a-5136e97a1344"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:26:31.769169 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.769128 2579 generic.go:356] "Generic (PLEG): container finished" podID="67ecab95-76c6-4203-a79a-5136e97a1344" containerID="4ca19b54120d5a54acda3819c9e180bffc184790f507ac73cd163baf917d5153" exitCode=0 Aug 05 17:26:31.769169 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.769166 2579 generic.go:356] "Generic (PLEG): container finished" podID="67ecab95-76c6-4203-a79a-5136e97a1344" containerID="7bd3b91aa974760f6ca3b8be894d351b5bf46c006e1b9633d3187ecbe8a2d41f" exitCode=0 Aug 05 17:26:31.769340 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.769191 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"67ecab95-76c6-4203-a79a-5136e97a1344","Type":"ContainerDied","Data":"4ca19b54120d5a54acda3819c9e180bffc184790f507ac73cd163baf917d5153"} Aug 05 17:26:31.769340 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.769235 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:31.769340 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.769253 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"67ecab95-76c6-4203-a79a-5136e97a1344","Type":"ContainerDied","Data":"7bd3b91aa974760f6ca3b8be894d351b5bf46c006e1b9633d3187ecbe8a2d41f"} Aug 05 17:26:31.769340 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.769281 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"67ecab95-76c6-4203-a79a-5136e97a1344","Type":"ContainerDied","Data":"4fd2417a6d3cc2044f93c58d7bfe5f7098bba12075c3934674d46f94dd5edf15"} Aug 05 17:26:31.769340 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.769310 2579 scope.go:117] "RemoveContainer" containerID="1f78fbc8a9ffde5c41bb33dff83d3773bacae64fb740b1d95e82784c025e323b" Aug 05 17:26:31.780356 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.777867 2579 scope.go:117] "RemoveContainer" containerID="4ca19b54120d5a54acda3819c9e180bffc184790f507ac73cd163baf917d5153" Aug 05 17:26:31.786749 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.786731 2579 scope.go:117] "RemoveContainer" containerID="cbc093adae876475276759b1ca4aa5d207353c48f34ad6618adb9126f6f83f10" Aug 05 17:26:31.793986 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.793967 2579 scope.go:117] "RemoveContainer" containerID="7bd3b91aa974760f6ca3b8be894d351b5bf46c006e1b9633d3187ecbe8a2d41f" Aug 05 17:26:31.800746 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.800726 2579 scope.go:117] "RemoveContainer" containerID="459b2c2ed27aedcd4de0a2460895529a5fc992a0e94fc18218606f0ebce1727f" Aug 05 17:26:31.804782 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.804757 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 05 17:26:31.811175 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.808551 2579 scope.go:117] "RemoveContainer" containerID="37153cd1b0e3ea9cfb81b53d5e7aae9fbadec038c5e6ae85de2142e9bc19ca26" Aug 05 17:26:31.812953 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.811916 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 05 17:26:31.819286 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.819263 2579 scope.go:117] "RemoveContainer" containerID="2cb22cf206c7fdb696b42f7f79b4031890a3edc3d07b6aa5921be9fe91b4347d" Aug 05 17:26:31.826484 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.826468 2579 scope.go:117] "RemoveContainer" containerID="1f78fbc8a9ffde5c41bb33dff83d3773bacae64fb740b1d95e82784c025e323b" Aug 05 17:26:31.826764 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:26:31.826744 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f78fbc8a9ffde5c41bb33dff83d3773bacae64fb740b1d95e82784c025e323b\": container with ID starting with 1f78fbc8a9ffde5c41bb33dff83d3773bacae64fb740b1d95e82784c025e323b not found: ID does not exist" containerID="1f78fbc8a9ffde5c41bb33dff83d3773bacae64fb740b1d95e82784c025e323b" Aug 05 17:26:31.826857 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.826772 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f78fbc8a9ffde5c41bb33dff83d3773bacae64fb740b1d95e82784c025e323b"} err="failed to get container status \"1f78fbc8a9ffde5c41bb33dff83d3773bacae64fb740b1d95e82784c025e323b\": rpc error: code = NotFound desc = could not find container \"1f78fbc8a9ffde5c41bb33dff83d3773bacae64fb740b1d95e82784c025e323b\": container with ID starting with 1f78fbc8a9ffde5c41bb33dff83d3773bacae64fb740b1d95e82784c025e323b not found: ID does not exist" Aug 05 17:26:31.826857 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.826791 2579 scope.go:117] "RemoveContainer" containerID="4ca19b54120d5a54acda3819c9e180bffc184790f507ac73cd163baf917d5153" Aug 05 17:26:31.827029 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:26:31.827012 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ca19b54120d5a54acda3819c9e180bffc184790f507ac73cd163baf917d5153\": container with ID starting with 4ca19b54120d5a54acda3819c9e180bffc184790f507ac73cd163baf917d5153 not found: ID does not exist" containerID="4ca19b54120d5a54acda3819c9e180bffc184790f507ac73cd163baf917d5153" Aug 05 17:26:31.827090 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.827039 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ca19b54120d5a54acda3819c9e180bffc184790f507ac73cd163baf917d5153"} err="failed to get container status \"4ca19b54120d5a54acda3819c9e180bffc184790f507ac73cd163baf917d5153\": rpc error: code = NotFound desc = could not find container \"4ca19b54120d5a54acda3819c9e180bffc184790f507ac73cd163baf917d5153\": container with ID starting with 4ca19b54120d5a54acda3819c9e180bffc184790f507ac73cd163baf917d5153 not found: ID does not exist" Aug 05 17:26:31.827090 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.827061 2579 scope.go:117] "RemoveContainer" containerID="cbc093adae876475276759b1ca4aa5d207353c48f34ad6618adb9126f6f83f10" Aug 05 17:26:31.827341 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:26:31.827322 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbc093adae876475276759b1ca4aa5d207353c48f34ad6618adb9126f6f83f10\": container with ID starting with cbc093adae876475276759b1ca4aa5d207353c48f34ad6618adb9126f6f83f10 not found: ID does not exist" containerID="cbc093adae876475276759b1ca4aa5d207353c48f34ad6618adb9126f6f83f10" Aug 05 17:26:31.827411 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.827345 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbc093adae876475276759b1ca4aa5d207353c48f34ad6618adb9126f6f83f10"} err="failed to get container status \"cbc093adae876475276759b1ca4aa5d207353c48f34ad6618adb9126f6f83f10\": rpc error: code = NotFound desc = could not find container \"cbc093adae876475276759b1ca4aa5d207353c48f34ad6618adb9126f6f83f10\": container with ID starting with cbc093adae876475276759b1ca4aa5d207353c48f34ad6618adb9126f6f83f10 not found: ID does not exist" Aug 05 17:26:31.827411 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.827361 2579 scope.go:117] "RemoveContainer" containerID="7bd3b91aa974760f6ca3b8be894d351b5bf46c006e1b9633d3187ecbe8a2d41f" Aug 05 17:26:31.827588 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:26:31.827571 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bd3b91aa974760f6ca3b8be894d351b5bf46c006e1b9633d3187ecbe8a2d41f\": container with ID starting with 7bd3b91aa974760f6ca3b8be894d351b5bf46c006e1b9633d3187ecbe8a2d41f not found: ID does not exist" containerID="7bd3b91aa974760f6ca3b8be894d351b5bf46c006e1b9633d3187ecbe8a2d41f" Aug 05 17:26:31.827630 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.827593 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bd3b91aa974760f6ca3b8be894d351b5bf46c006e1b9633d3187ecbe8a2d41f"} err="failed to get container status \"7bd3b91aa974760f6ca3b8be894d351b5bf46c006e1b9633d3187ecbe8a2d41f\": rpc error: code = NotFound desc = could not find container \"7bd3b91aa974760f6ca3b8be894d351b5bf46c006e1b9633d3187ecbe8a2d41f\": container with ID starting with 7bd3b91aa974760f6ca3b8be894d351b5bf46c006e1b9633d3187ecbe8a2d41f not found: ID does not exist" Aug 05 17:26:31.827630 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.827617 2579 scope.go:117] "RemoveContainer" containerID="459b2c2ed27aedcd4de0a2460895529a5fc992a0e94fc18218606f0ebce1727f" Aug 05 17:26:31.827859 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:26:31.827843 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"459b2c2ed27aedcd4de0a2460895529a5fc992a0e94fc18218606f0ebce1727f\": container with ID starting with 459b2c2ed27aedcd4de0a2460895529a5fc992a0e94fc18218606f0ebce1727f not found: ID does not exist" containerID="459b2c2ed27aedcd4de0a2460895529a5fc992a0e94fc18218606f0ebce1727f" Aug 05 17:26:31.827923 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.827866 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"459b2c2ed27aedcd4de0a2460895529a5fc992a0e94fc18218606f0ebce1727f"} err="failed to get container status \"459b2c2ed27aedcd4de0a2460895529a5fc992a0e94fc18218606f0ebce1727f\": rpc error: code = NotFound desc = could not find container \"459b2c2ed27aedcd4de0a2460895529a5fc992a0e94fc18218606f0ebce1727f\": container with ID starting with 459b2c2ed27aedcd4de0a2460895529a5fc992a0e94fc18218606f0ebce1727f not found: ID does not exist" Aug 05 17:26:31.827923 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.827884 2579 scope.go:117] "RemoveContainer" containerID="37153cd1b0e3ea9cfb81b53d5e7aae9fbadec038c5e6ae85de2142e9bc19ca26" Aug 05 17:26:31.828129 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:26:31.828114 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37153cd1b0e3ea9cfb81b53d5e7aae9fbadec038c5e6ae85de2142e9bc19ca26\": container with ID starting with 37153cd1b0e3ea9cfb81b53d5e7aae9fbadec038c5e6ae85de2142e9bc19ca26 not found: ID does not exist" containerID="37153cd1b0e3ea9cfb81b53d5e7aae9fbadec038c5e6ae85de2142e9bc19ca26" Aug 05 17:26:31.828215 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.828135 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37153cd1b0e3ea9cfb81b53d5e7aae9fbadec038c5e6ae85de2142e9bc19ca26"} err="failed to get container status \"37153cd1b0e3ea9cfb81b53d5e7aae9fbadec038c5e6ae85de2142e9bc19ca26\": rpc error: code = NotFound desc = could not find container \"37153cd1b0e3ea9cfb81b53d5e7aae9fbadec038c5e6ae85de2142e9bc19ca26\": container with ID starting with 37153cd1b0e3ea9cfb81b53d5e7aae9fbadec038c5e6ae85de2142e9bc19ca26 not found: ID does not exist" Aug 05 17:26:31.828215 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.828165 2579 scope.go:117] "RemoveContainer" containerID="2cb22cf206c7fdb696b42f7f79b4031890a3edc3d07b6aa5921be9fe91b4347d" Aug 05 17:26:31.828384 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:26:31.828368 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cb22cf206c7fdb696b42f7f79b4031890a3edc3d07b6aa5921be9fe91b4347d\": container with ID starting with 2cb22cf206c7fdb696b42f7f79b4031890a3edc3d07b6aa5921be9fe91b4347d not found: ID does not exist" containerID="2cb22cf206c7fdb696b42f7f79b4031890a3edc3d07b6aa5921be9fe91b4347d" Aug 05 17:26:31.828448 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.828391 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cb22cf206c7fdb696b42f7f79b4031890a3edc3d07b6aa5921be9fe91b4347d"} err="failed to get container status \"2cb22cf206c7fdb696b42f7f79b4031890a3edc3d07b6aa5921be9fe91b4347d\": rpc error: code = NotFound desc = could not find container \"2cb22cf206c7fdb696b42f7f79b4031890a3edc3d07b6aa5921be9fe91b4347d\": container with ID starting with 2cb22cf206c7fdb696b42f7f79b4031890a3edc3d07b6aa5921be9fe91b4347d not found: ID does not exist" Aug 05 17:26:31.828448 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.828408 2579 scope.go:117] "RemoveContainer" containerID="1f78fbc8a9ffde5c41bb33dff83d3773bacae64fb740b1d95e82784c025e323b" Aug 05 17:26:31.828616 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.828600 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f78fbc8a9ffde5c41bb33dff83d3773bacae64fb740b1d95e82784c025e323b"} err="failed to get container status \"1f78fbc8a9ffde5c41bb33dff83d3773bacae64fb740b1d95e82784c025e323b\": rpc error: code = NotFound desc = could not find container \"1f78fbc8a9ffde5c41bb33dff83d3773bacae64fb740b1d95e82784c025e323b\": container with ID starting with 1f78fbc8a9ffde5c41bb33dff83d3773bacae64fb740b1d95e82784c025e323b not found: ID does not exist" Aug 05 17:26:31.828681 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.828617 2579 scope.go:117] "RemoveContainer" containerID="4ca19b54120d5a54acda3819c9e180bffc184790f507ac73cd163baf917d5153" Aug 05 17:26:31.828840 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.828822 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ca19b54120d5a54acda3819c9e180bffc184790f507ac73cd163baf917d5153"} err="failed to get container status \"4ca19b54120d5a54acda3819c9e180bffc184790f507ac73cd163baf917d5153\": rpc error: code = NotFound desc = could not find container \"4ca19b54120d5a54acda3819c9e180bffc184790f507ac73cd163baf917d5153\": container with ID starting with 4ca19b54120d5a54acda3819c9e180bffc184790f507ac73cd163baf917d5153 not found: ID does not exist" Aug 05 17:26:31.828885 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.828842 2579 scope.go:117] "RemoveContainer" containerID="cbc093adae876475276759b1ca4aa5d207353c48f34ad6618adb9126f6f83f10" Aug 05 17:26:31.829054 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.829035 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbc093adae876475276759b1ca4aa5d207353c48f34ad6618adb9126f6f83f10"} err="failed to get container status \"cbc093adae876475276759b1ca4aa5d207353c48f34ad6618adb9126f6f83f10\": rpc error: code = NotFound desc = could not find container \"cbc093adae876475276759b1ca4aa5d207353c48f34ad6618adb9126f6f83f10\": container with ID starting with cbc093adae876475276759b1ca4aa5d207353c48f34ad6618adb9126f6f83f10 not found: ID does not exist" Aug 05 17:26:31.829121 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.829055 2579 scope.go:117] "RemoveContainer" containerID="7bd3b91aa974760f6ca3b8be894d351b5bf46c006e1b9633d3187ecbe8a2d41f" Aug 05 17:26:31.829286 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.829265 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bd3b91aa974760f6ca3b8be894d351b5bf46c006e1b9633d3187ecbe8a2d41f"} err="failed to get container status \"7bd3b91aa974760f6ca3b8be894d351b5bf46c006e1b9633d3187ecbe8a2d41f\": rpc error: code = NotFound desc = could not find container \"7bd3b91aa974760f6ca3b8be894d351b5bf46c006e1b9633d3187ecbe8a2d41f\": container with ID starting with 7bd3b91aa974760f6ca3b8be894d351b5bf46c006e1b9633d3187ecbe8a2d41f not found: ID does not exist" Aug 05 17:26:31.829336 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.829289 2579 scope.go:117] "RemoveContainer" containerID="459b2c2ed27aedcd4de0a2460895529a5fc992a0e94fc18218606f0ebce1727f" Aug 05 17:26:31.829483 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.829466 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"459b2c2ed27aedcd4de0a2460895529a5fc992a0e94fc18218606f0ebce1727f"} err="failed to get container status \"459b2c2ed27aedcd4de0a2460895529a5fc992a0e94fc18218606f0ebce1727f\": rpc error: code = NotFound desc = could not find container \"459b2c2ed27aedcd4de0a2460895529a5fc992a0e94fc18218606f0ebce1727f\": container with ID starting with 459b2c2ed27aedcd4de0a2460895529a5fc992a0e94fc18218606f0ebce1727f not found: ID does not exist" Aug 05 17:26:31.829523 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.829484 2579 scope.go:117] "RemoveContainer" containerID="37153cd1b0e3ea9cfb81b53d5e7aae9fbadec038c5e6ae85de2142e9bc19ca26" Aug 05 17:26:31.829707 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.829690 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37153cd1b0e3ea9cfb81b53d5e7aae9fbadec038c5e6ae85de2142e9bc19ca26"} err="failed to get container status \"37153cd1b0e3ea9cfb81b53d5e7aae9fbadec038c5e6ae85de2142e9bc19ca26\": rpc error: code = NotFound desc = could not find container \"37153cd1b0e3ea9cfb81b53d5e7aae9fbadec038c5e6ae85de2142e9bc19ca26\": container with ID starting with 37153cd1b0e3ea9cfb81b53d5e7aae9fbadec038c5e6ae85de2142e9bc19ca26 not found: ID does not exist" Aug 05 17:26:31.829774 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.829708 2579 scope.go:117] "RemoveContainer" containerID="2cb22cf206c7fdb696b42f7f79b4031890a3edc3d07b6aa5921be9fe91b4347d" Aug 05 17:26:31.829925 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.829909 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cb22cf206c7fdb696b42f7f79b4031890a3edc3d07b6aa5921be9fe91b4347d"} err="failed to get container status \"2cb22cf206c7fdb696b42f7f79b4031890a3edc3d07b6aa5921be9fe91b4347d\": rpc error: code = NotFound desc = could not find container \"2cb22cf206c7fdb696b42f7f79b4031890a3edc3d07b6aa5921be9fe91b4347d\": container with ID starting with 2cb22cf206c7fdb696b42f7f79b4031890a3edc3d07b6aa5921be9fe91b4347d not found: ID does not exist" Aug 05 17:26:31.843055 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.843033 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 05 17:26:31.843386 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.843372 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67ecab95-76c6-4203-a79a-5136e97a1344" containerName="kube-rbac-proxy-metric" Aug 05 17:26:31.843444 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.843388 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="67ecab95-76c6-4203-a79a-5136e97a1344" containerName="kube-rbac-proxy-metric" Aug 05 17:26:31.843444 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.843409 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fded585-1ec7-4183-8c35-cb8dda0bfc18" containerName="console" Aug 05 17:26:31.843444 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.843415 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fded585-1ec7-4183-8c35-cb8dda0bfc18" containerName="console" Aug 05 17:26:31.843444 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.843424 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67ecab95-76c6-4203-a79a-5136e97a1344" containerName="init-config-reloader" Aug 05 17:26:31.843444 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.843430 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="67ecab95-76c6-4203-a79a-5136e97a1344" containerName="init-config-reloader" Aug 05 17:26:31.843444 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.843437 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67ecab95-76c6-4203-a79a-5136e97a1344" containerName="alertmanager" Aug 05 17:26:31.843444 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.843442 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="67ecab95-76c6-4203-a79a-5136e97a1344" containerName="alertmanager" Aug 05 17:26:31.843645 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.843449 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67ecab95-76c6-4203-a79a-5136e97a1344" containerName="prom-label-proxy" Aug 05 17:26:31.843645 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.843456 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="67ecab95-76c6-4203-a79a-5136e97a1344" containerName="prom-label-proxy" Aug 05 17:26:31.843645 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.843463 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67ecab95-76c6-4203-a79a-5136e97a1344" containerName="kube-rbac-proxy-web" Aug 05 17:26:31.843645 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.843468 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="67ecab95-76c6-4203-a79a-5136e97a1344" containerName="kube-rbac-proxy-web" Aug 05 17:26:31.843645 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.843476 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="373295e7-1a34-48dc-87f0-c64e319eb1e1" containerName="registry" Aug 05 17:26:31.843645 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.843481 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="373295e7-1a34-48dc-87f0-c64e319eb1e1" containerName="registry" Aug 05 17:26:31.843645 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.843489 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67ecab95-76c6-4203-a79a-5136e97a1344" containerName="config-reloader" Aug 05 17:26:31.843645 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.843494 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="67ecab95-76c6-4203-a79a-5136e97a1344" containerName="config-reloader" Aug 05 17:26:31.843645 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.843502 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67ecab95-76c6-4203-a79a-5136e97a1344" containerName="kube-rbac-proxy" Aug 05 17:26:31.843645 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.843506 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="67ecab95-76c6-4203-a79a-5136e97a1344" containerName="kube-rbac-proxy" Aug 05 17:26:31.843645 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.843551 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="67ecab95-76c6-4203-a79a-5136e97a1344" containerName="kube-rbac-proxy-web" Aug 05 17:26:31.843645 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.843558 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="67ecab95-76c6-4203-a79a-5136e97a1344" containerName="prom-label-proxy" Aug 05 17:26:31.843645 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.843563 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="67ecab95-76c6-4203-a79a-5136e97a1344" containerName="alertmanager" Aug 05 17:26:31.843645 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.843571 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="67ecab95-76c6-4203-a79a-5136e97a1344" containerName="kube-rbac-proxy" Aug 05 17:26:31.843645 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.843577 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="67ecab95-76c6-4203-a79a-5136e97a1344" containerName="config-reloader" Aug 05 17:26:31.843645 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.843582 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="67ecab95-76c6-4203-a79a-5136e97a1344" containerName="kube-rbac-proxy-metric" Aug 05 17:26:31.843645 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.843588 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="373295e7-1a34-48dc-87f0-c64e319eb1e1" containerName="registry" Aug 05 17:26:31.843645 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.843593 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fded585-1ec7-4183-8c35-cb8dda0bfc18" containerName="console" Aug 05 17:26:31.848030 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.848014 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:31.850982 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.850963 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2f8dl\" (UniqueName: \"kubernetes.io/projected/67ecab95-76c6-4203-a79a-5136e97a1344-kube-api-access-2f8dl\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:26:31.851071 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.850983 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/67ecab95-76c6-4203-a79a-5136e97a1344-tls-assets\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:26:31.851071 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.850995 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:26:31.851071 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.851003 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-secret-alertmanager-main-tls\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:26:31.851071 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.851030 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-web-config\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:26:31.851071 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.851039 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:26:31.851071 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.851048 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:26:31.851071 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.851056 2579 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-cluster-tls-config\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:26:31.851071 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.851065 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/67ecab95-76c6-4203-a79a-5136e97a1344-config-out\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:26:31.851071 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.851072 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/67ecab95-76c6-4203-a79a-5136e97a1344-alertmanager-main-db\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:26:31.851384 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.851080 2579 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/67ecab95-76c6-4203-a79a-5136e97a1344-config-volume\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:26:31.851620 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.851606 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2h5z5\"" Aug 05 17:26:31.852233 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.852213 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Aug 05 17:26:31.852338 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.852244 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Aug 05 17:26:31.852338 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.852219 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Aug 05 17:26:31.852863 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.852847 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Aug 05 17:26:31.852930 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.852852 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Aug 05 17:26:31.853003 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.852987 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Aug 05 17:26:31.853060 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.853040 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Aug 05 17:26:31.853220 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.853208 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Aug 05 17:26:31.860685 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.860666 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Aug 05 17:26:31.867961 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.867939 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 05 17:26:31.951922 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.951882 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1ce2ac0e-ff60-44b9-9341-6c785227197c-config-volume\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:31.951922 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.951927 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ce2ac0e-ff60-44b9-9341-6c785227197c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:31.952137 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.951948 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvbfm\" (UniqueName: \"kubernetes.io/projected/1ce2ac0e-ff60-44b9-9341-6c785227197c-kube-api-access-kvbfm\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:31.952137 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.951965 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ce2ac0e-ff60-44b9-9341-6c785227197c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:31.952137 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.952006 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1ce2ac0e-ff60-44b9-9341-6c785227197c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:31.952137 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.952091 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1ce2ac0e-ff60-44b9-9341-6c785227197c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:31.952137 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.952131 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ce2ac0e-ff60-44b9-9341-6c785227197c-config-out\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:31.952336 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.952174 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1ce2ac0e-ff60-44b9-9341-6c785227197c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:31.952336 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.952194 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ce2ac0e-ff60-44b9-9341-6c785227197c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:31.952336 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.952221 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ce2ac0e-ff60-44b9-9341-6c785227197c-web-config\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:31.952336 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.952247 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ce2ac0e-ff60-44b9-9341-6c785227197c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:31.952336 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.952278 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ce2ac0e-ff60-44b9-9341-6c785227197c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:31.952336 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:31.952297 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1ce2ac0e-ff60-44b9-9341-6c785227197c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:32.053281 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:32.053201 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ce2ac0e-ff60-44b9-9341-6c785227197c-web-config\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:32.053281 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:32.053238 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ce2ac0e-ff60-44b9-9341-6c785227197c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:32.053281 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:32.053265 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ce2ac0e-ff60-44b9-9341-6c785227197c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:32.053510 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:32.053287 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1ce2ac0e-ff60-44b9-9341-6c785227197c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:32.053510 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:32.053317 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1ce2ac0e-ff60-44b9-9341-6c785227197c-config-volume\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:32.053510 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:32.053342 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ce2ac0e-ff60-44b9-9341-6c785227197c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:32.053510 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:32.053359 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvbfm\" (UniqueName: \"kubernetes.io/projected/1ce2ac0e-ff60-44b9-9341-6c785227197c-kube-api-access-kvbfm\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:32.053510 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:32.053438 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ce2ac0e-ff60-44b9-9341-6c785227197c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:32.053510 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:32.053485 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1ce2ac0e-ff60-44b9-9341-6c785227197c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:32.053759 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:32.053732 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1ce2ac0e-ff60-44b9-9341-6c785227197c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:32.054029 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:32.054003 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1ce2ac0e-ff60-44b9-9341-6c785227197c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:32.054029 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:32.054017 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ce2ac0e-ff60-44b9-9341-6c785227197c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:32.054276 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:32.054094 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ce2ac0e-ff60-44b9-9341-6c785227197c-config-out\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:32.054276 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:32.054122 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1ce2ac0e-ff60-44b9-9341-6c785227197c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:32.054276 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:32.054176 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ce2ac0e-ff60-44b9-9341-6c785227197c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:32.054809 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:32.054784 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ce2ac0e-ff60-44b9-9341-6c785227197c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:32.056696 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:32.056459 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1ce2ac0e-ff60-44b9-9341-6c785227197c-config-volume\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:32.056696 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:32.056640 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1ce2ac0e-ff60-44b9-9341-6c785227197c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:32.056696 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:32.056677 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ce2ac0e-ff60-44b9-9341-6c785227197c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:32.056925 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:32.056856 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ce2ac0e-ff60-44b9-9341-6c785227197c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:32.056925 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:32.056886 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ce2ac0e-ff60-44b9-9341-6c785227197c-web-config\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:32.056925 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:32.056910 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ce2ac0e-ff60-44b9-9341-6c785227197c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:32.057174 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:32.057128 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ce2ac0e-ff60-44b9-9341-6c785227197c-config-out\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:32.057357 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:32.057340 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1ce2ac0e-ff60-44b9-9341-6c785227197c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:32.058111 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:32.058094 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1ce2ac0e-ff60-44b9-9341-6c785227197c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:32.063095 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:32.063076 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvbfm\" (UniqueName: \"kubernetes.io/projected/1ce2ac0e-ff60-44b9-9341-6c785227197c-kube-api-access-kvbfm\") pod \"alertmanager-main-0\" (UID: \"1ce2ac0e-ff60-44b9-9341-6c785227197c\") " pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:32.158584 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:32.158549 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Aug 05 17:26:32.301976 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:32.301948 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 05 17:26:32.305060 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:26:32.305009 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ce2ac0e_ff60_44b9_9341_6c785227197c.slice/crio-61cef97d481c6a0595aa55d05de684359f00ed0ca0ff52fc7aba809a0bc07ece WatchSource:0}: Error finding container 61cef97d481c6a0595aa55d05de684359f00ed0ca0ff52fc7aba809a0bc07ece: Status 404 returned error can't find the container with id 61cef97d481c6a0595aa55d05de684359f00ed0ca0ff52fc7aba809a0bc07ece Aug 05 17:26:32.770538 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:32.770509 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67ecab95-76c6-4203-a79a-5136e97a1344" path="/var/lib/kubelet/pods/67ecab95-76c6-4203-a79a-5136e97a1344/volumes" Aug 05 17:26:32.774472 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:32.774446 2579 generic.go:356] "Generic (PLEG): container finished" podID="1ce2ac0e-ff60-44b9-9341-6c785227197c" containerID="7d355a56b2261b4b89239ffb2b2acc419f298067ca436c17f5b1ced04ea31086" exitCode=0 Aug 05 17:26:32.774576 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:32.774522 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ce2ac0e-ff60-44b9-9341-6c785227197c","Type":"ContainerDied","Data":"7d355a56b2261b4b89239ffb2b2acc419f298067ca436c17f5b1ced04ea31086"} Aug 05 17:26:32.774626 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:32.774581 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ce2ac0e-ff60-44b9-9341-6c785227197c","Type":"ContainerStarted","Data":"61cef97d481c6a0595aa55d05de684359f00ed0ca0ff52fc7aba809a0bc07ece"} Aug 05 17:26:33.781774 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:33.781731 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ce2ac0e-ff60-44b9-9341-6c785227197c","Type":"ContainerStarted","Data":"56a75bd75df3ed0dc96877428f63c4da5f08339a3604ed053a3aaf51b4bfb942"} Aug 05 17:26:33.782197 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:33.781818 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ce2ac0e-ff60-44b9-9341-6c785227197c","Type":"ContainerStarted","Data":"8efaa40f02ae8d9b69f2251fc09ccc1f6fe8a96bfc0588aa263b45e76640350c"} Aug 05 17:26:33.782197 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:33.781862 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ce2ac0e-ff60-44b9-9341-6c785227197c","Type":"ContainerStarted","Data":"30f9d6cd6749ea30270a45edc57e92b3a8113ef97a78a2fb0ce7191721eaa462"} Aug 05 17:26:33.782197 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:33.781904 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ce2ac0e-ff60-44b9-9341-6c785227197c","Type":"ContainerStarted","Data":"78319743552f0fc753648bf3b91b83edd76af26d8288e3c3ddd6c5312e41912c"} Aug 05 17:26:33.782197 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:33.781939 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ce2ac0e-ff60-44b9-9341-6c785227197c","Type":"ContainerStarted","Data":"cdecb8dc5c7dbfbac0615cc4d8a6ce4a763ae2e31d404487505c0b91dc318223"} Aug 05 17:26:33.782197 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:33.781974 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ce2ac0e-ff60-44b9-9341-6c785227197c","Type":"ContainerStarted","Data":"1f84ef0b6444148bb7ae25d532cfd60dc55758f6dc5fd11c65fb558c53b062f4"} Aug 05 17:26:33.810557 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:33.810490 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.794818849 podStartE2EDuration="2.810469099s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.65025ms" isStatefulPod=false podCreationTimestamp="2026-08-05 17:26:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:26:33.808120408 +0000 UTC m=+181.575500643" watchObservedRunningTime="2026-08-05 17:26:33.810469099 +0000 UTC m=+181.577849333" Aug 05 17:26:34.406068 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.406028 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-65d9d4b8bd-xc8b5"] Aug 05 17:26:34.409555 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.409533 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-65d9d4b8bd-xc8b5" Aug 05 17:26:34.412618 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.412592 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Aug 05 17:26:34.412618 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.412595 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Aug 05 17:26:34.413300 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.413279 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Aug 05 17:26:34.413389 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.413313 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Aug 05 17:26:34.413389 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.413367 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-8nnvj\"" Aug 05 17:26:34.413748 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.413733 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Aug 05 17:26:34.419886 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.419869 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Aug 05 17:26:34.424191 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.424168 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-65d9d4b8bd-xc8b5"] Aug 05 17:26:34.576185 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.576136 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1-telemeter-client-tls\") pod \"telemeter-client-65d9d4b8bd-xc8b5\" (UID: \"d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1\") " pod="openshift-monitoring/telemeter-client-65d9d4b8bd-xc8b5" Aug 05 17:26:34.576349 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.576206 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1-metrics-client-ca\") pod \"telemeter-client-65d9d4b8bd-xc8b5\" (UID: \"d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1\") " pod="openshift-monitoring/telemeter-client-65d9d4b8bd-xc8b5" Aug 05 17:26:34.576349 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.576232 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1-secret-telemeter-client\") pod \"telemeter-client-65d9d4b8bd-xc8b5\" (UID: \"d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1\") " pod="openshift-monitoring/telemeter-client-65d9d4b8bd-xc8b5" Aug 05 17:26:34.576349 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.576250 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgff5\" (UniqueName: \"kubernetes.io/projected/d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1-kube-api-access-xgff5\") pod \"telemeter-client-65d9d4b8bd-xc8b5\" (UID: \"d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1\") " pod="openshift-monitoring/telemeter-client-65d9d4b8bd-xc8b5" Aug 05 17:26:34.576349 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.576270 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1-serving-certs-ca-bundle\") pod \"telemeter-client-65d9d4b8bd-xc8b5\" (UID: \"d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1\") " pod="openshift-monitoring/telemeter-client-65d9d4b8bd-xc8b5" Aug 05 17:26:34.576349 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.576289 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-65d9d4b8bd-xc8b5\" (UID: \"d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1\") " pod="openshift-monitoring/telemeter-client-65d9d4b8bd-xc8b5" Aug 05 17:26:34.576349 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.576320 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-65d9d4b8bd-xc8b5\" (UID: \"d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1\") " pod="openshift-monitoring/telemeter-client-65d9d4b8bd-xc8b5" Aug 05 17:26:34.576349 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.576349 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1-federate-client-tls\") pod \"telemeter-client-65d9d4b8bd-xc8b5\" (UID: \"d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1\") " pod="openshift-monitoring/telemeter-client-65d9d4b8bd-xc8b5" Aug 05 17:26:34.677259 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.677168 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1-secret-telemeter-client\") pod \"telemeter-client-65d9d4b8bd-xc8b5\" (UID: \"d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1\") " pod="openshift-monitoring/telemeter-client-65d9d4b8bd-xc8b5" Aug 05 17:26:34.677259 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.677208 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgff5\" (UniqueName: \"kubernetes.io/projected/d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1-kube-api-access-xgff5\") pod \"telemeter-client-65d9d4b8bd-xc8b5\" (UID: \"d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1\") " pod="openshift-monitoring/telemeter-client-65d9d4b8bd-xc8b5" Aug 05 17:26:34.677259 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.677229 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1-serving-certs-ca-bundle\") pod \"telemeter-client-65d9d4b8bd-xc8b5\" (UID: \"d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1\") " pod="openshift-monitoring/telemeter-client-65d9d4b8bd-xc8b5" Aug 05 17:26:34.677259 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.677255 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-65d9d4b8bd-xc8b5\" (UID: \"d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1\") " pod="openshift-monitoring/telemeter-client-65d9d4b8bd-xc8b5" Aug 05 17:26:34.677642 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.677285 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-65d9d4b8bd-xc8b5\" (UID: \"d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1\") " pod="openshift-monitoring/telemeter-client-65d9d4b8bd-xc8b5" Aug 05 17:26:34.677642 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.677331 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1-federate-client-tls\") pod \"telemeter-client-65d9d4b8bd-xc8b5\" (UID: \"d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1\") " pod="openshift-monitoring/telemeter-client-65d9d4b8bd-xc8b5" Aug 05 17:26:34.677642 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.677406 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1-telemeter-client-tls\") pod \"telemeter-client-65d9d4b8bd-xc8b5\" (UID: \"d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1\") " pod="openshift-monitoring/telemeter-client-65d9d4b8bd-xc8b5" Aug 05 17:26:34.677642 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.677456 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1-metrics-client-ca\") pod \"telemeter-client-65d9d4b8bd-xc8b5\" (UID: \"d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1\") " pod="openshift-monitoring/telemeter-client-65d9d4b8bd-xc8b5" Aug 05 17:26:34.678106 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.678075 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1-serving-certs-ca-bundle\") pod \"telemeter-client-65d9d4b8bd-xc8b5\" (UID: \"d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1\") " pod="openshift-monitoring/telemeter-client-65d9d4b8bd-xc8b5" Aug 05 17:26:34.678310 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.678173 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1-metrics-client-ca\") pod \"telemeter-client-65d9d4b8bd-xc8b5\" (UID: \"d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1\") " pod="openshift-monitoring/telemeter-client-65d9d4b8bd-xc8b5" Aug 05 17:26:34.678310 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.678209 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-65d9d4b8bd-xc8b5\" (UID: \"d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1\") " pod="openshift-monitoring/telemeter-client-65d9d4b8bd-xc8b5" Aug 05 17:26:34.679780 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.679754 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-65d9d4b8bd-xc8b5\" (UID: \"d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1\") " pod="openshift-monitoring/telemeter-client-65d9d4b8bd-xc8b5" Aug 05 17:26:34.679962 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.679943 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1-telemeter-client-tls\") pod \"telemeter-client-65d9d4b8bd-xc8b5\" (UID: \"d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1\") " pod="openshift-monitoring/telemeter-client-65d9d4b8bd-xc8b5" Aug 05 17:26:34.680156 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.680123 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1-federate-client-tls\") pod \"telemeter-client-65d9d4b8bd-xc8b5\" (UID: \"d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1\") " pod="openshift-monitoring/telemeter-client-65d9d4b8bd-xc8b5" Aug 05 17:26:34.680297 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.680275 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1-secret-telemeter-client\") pod \"telemeter-client-65d9d4b8bd-xc8b5\" (UID: \"d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1\") " pod="openshift-monitoring/telemeter-client-65d9d4b8bd-xc8b5" Aug 05 17:26:34.685702 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.685685 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgff5\" (UniqueName: \"kubernetes.io/projected/d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1-kube-api-access-xgff5\") pod \"telemeter-client-65d9d4b8bd-xc8b5\" (UID: \"d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1\") " pod="openshift-monitoring/telemeter-client-65d9d4b8bd-xc8b5" Aug 05 17:26:34.720659 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.720625 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-65d9d4b8bd-xc8b5" Aug 05 17:26:34.863544 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:34.863519 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-65d9d4b8bd-xc8b5"] Aug 05 17:26:34.865942 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:26:34.865914 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2e72b6c_2f8a_4ade_a5e6_188af1a9e4a1.slice/crio-79a54d0b967d4f7376e5792866495be74963648b6f376f0ea16591ba6760e2ec WatchSource:0}: Error finding container 79a54d0b967d4f7376e5792866495be74963648b6f376f0ea16591ba6760e2ec: Status 404 returned error can't find the container with id 79a54d0b967d4f7376e5792866495be74963648b6f376f0ea16591ba6760e2ec Aug 05 17:26:35.791829 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:35.791788 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65d9d4b8bd-xc8b5" event={"ID":"d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1","Type":"ContainerStarted","Data":"79a54d0b967d4f7376e5792866495be74963648b6f376f0ea16591ba6760e2ec"} Aug 05 17:26:36.798637 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:36.798549 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65d9d4b8bd-xc8b5" event={"ID":"d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1","Type":"ContainerStarted","Data":"f43bd142533a23718f3b775874f86a0e512b4d05e1df26d0f1b2e33dce6bfdbe"} Aug 05 17:26:36.798637 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:36.798615 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65d9d4b8bd-xc8b5" event={"ID":"d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1","Type":"ContainerStarted","Data":"aa9326f6d06b7616608b36741dffda715949e715752eb04dbc7019d37e7fe6d4"} Aug 05 17:26:36.799033 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:36.798648 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65d9d4b8bd-xc8b5" event={"ID":"d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1","Type":"ContainerStarted","Data":"31f108eec072424cc87e7a1686789413f81ad7eed5181f73b1da2e7ca7bc224d"} Aug 05 17:26:36.827180 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:36.827117 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-65d9d4b8bd-xc8b5" podStartSLOduration=1.264530683 podStartE2EDuration="2.827101172s" totalImagesPullingTime="1.562570489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:26:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:26:36.825876008 +0000 UTC m=+184.593256241" watchObservedRunningTime="2026-08-05 17:26:36.827101172 +0000 UTC m=+184.594481404" Aug 05 17:26:36.907349 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:36.907318 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76f7b96f7c-c76jw"] Aug 05 17:26:36.911344 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:36.911318 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76f7b96f7c-c76jw" Aug 05 17:26:36.922623 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:36.922594 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76f7b96f7c-c76jw"] Aug 05 17:26:36.956780 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:36.956744 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:26:36.999032 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:36.998999 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c816bd40-cda2-44cc-af59-6668c9fc58c1-service-ca\") pod \"console-76f7b96f7c-c76jw\" (UID: \"c816bd40-cda2-44cc-af59-6668c9fc58c1\") " pod="openshift-console/console-76f7b96f7c-c76jw" Aug 05 17:26:36.999187 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:36.999042 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c816bd40-cda2-44cc-af59-6668c9fc58c1-trusted-ca-bundle\") pod \"console-76f7b96f7c-c76jw\" (UID: \"c816bd40-cda2-44cc-af59-6668c9fc58c1\") " pod="openshift-console/console-76f7b96f7c-c76jw" Aug 05 17:26:36.999187 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:36.999155 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c816bd40-cda2-44cc-af59-6668c9fc58c1-console-oauth-config\") pod \"console-76f7b96f7c-c76jw\" (UID: \"c816bd40-cda2-44cc-af59-6668c9fc58c1\") " pod="openshift-console/console-76f7b96f7c-c76jw" Aug 05 17:26:36.999259 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:36.999205 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c816bd40-cda2-44cc-af59-6668c9fc58c1-console-serving-cert\") pod \"console-76f7b96f7c-c76jw\" (UID: \"c816bd40-cda2-44cc-af59-6668c9fc58c1\") " pod="openshift-console/console-76f7b96f7c-c76jw" Aug 05 17:26:36.999259 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:36.999227 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl9vd\" (UniqueName: \"kubernetes.io/projected/c816bd40-cda2-44cc-af59-6668c9fc58c1-kube-api-access-bl9vd\") pod \"console-76f7b96f7c-c76jw\" (UID: \"c816bd40-cda2-44cc-af59-6668c9fc58c1\") " pod="openshift-console/console-76f7b96f7c-c76jw" Aug 05 17:26:36.999325 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:36.999295 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c816bd40-cda2-44cc-af59-6668c9fc58c1-console-config\") pod \"console-76f7b96f7c-c76jw\" (UID: \"c816bd40-cda2-44cc-af59-6668c9fc58c1\") " pod="openshift-console/console-76f7b96f7c-c76jw" Aug 05 17:26:36.999325 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:36.999320 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c816bd40-cda2-44cc-af59-6668c9fc58c1-oauth-serving-cert\") pod \"console-76f7b96f7c-c76jw\" (UID: \"c816bd40-cda2-44cc-af59-6668c9fc58c1\") " pod="openshift-console/console-76f7b96f7c-c76jw" Aug 05 17:26:37.012491 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:37.012462 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:26:37.100560 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:37.100521 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c816bd40-cda2-44cc-af59-6668c9fc58c1-oauth-serving-cert\") pod \"console-76f7b96f7c-c76jw\" (UID: \"c816bd40-cda2-44cc-af59-6668c9fc58c1\") " pod="openshift-console/console-76f7b96f7c-c76jw" Aug 05 17:26:37.100779 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:37.100568 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c816bd40-cda2-44cc-af59-6668c9fc58c1-service-ca\") pod \"console-76f7b96f7c-c76jw\" (UID: \"c816bd40-cda2-44cc-af59-6668c9fc58c1\") " pod="openshift-console/console-76f7b96f7c-c76jw" Aug 05 17:26:37.100779 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:37.100596 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c816bd40-cda2-44cc-af59-6668c9fc58c1-trusted-ca-bundle\") pod \"console-76f7b96f7c-c76jw\" (UID: \"c816bd40-cda2-44cc-af59-6668c9fc58c1\") " pod="openshift-console/console-76f7b96f7c-c76jw" Aug 05 17:26:37.100779 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:37.100630 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c816bd40-cda2-44cc-af59-6668c9fc58c1-console-oauth-config\") pod \"console-76f7b96f7c-c76jw\" (UID: \"c816bd40-cda2-44cc-af59-6668c9fc58c1\") " pod="openshift-console/console-76f7b96f7c-c76jw" Aug 05 17:26:37.100779 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:37.100660 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c816bd40-cda2-44cc-af59-6668c9fc58c1-console-serving-cert\") pod \"console-76f7b96f7c-c76jw\" (UID: \"c816bd40-cda2-44cc-af59-6668c9fc58c1\") " pod="openshift-console/console-76f7b96f7c-c76jw" Aug 05 17:26:37.100779 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:37.100693 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl9vd\" (UniqueName: \"kubernetes.io/projected/c816bd40-cda2-44cc-af59-6668c9fc58c1-kube-api-access-bl9vd\") pod \"console-76f7b96f7c-c76jw\" (UID: \"c816bd40-cda2-44cc-af59-6668c9fc58c1\") " pod="openshift-console/console-76f7b96f7c-c76jw" Aug 05 17:26:37.100779 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:37.100778 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c816bd40-cda2-44cc-af59-6668c9fc58c1-console-config\") pod \"console-76f7b96f7c-c76jw\" (UID: \"c816bd40-cda2-44cc-af59-6668c9fc58c1\") " pod="openshift-console/console-76f7b96f7c-c76jw" Aug 05 17:26:37.101422 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:37.101393 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c816bd40-cda2-44cc-af59-6668c9fc58c1-service-ca\") pod \"console-76f7b96f7c-c76jw\" (UID: \"c816bd40-cda2-44cc-af59-6668c9fc58c1\") " pod="openshift-console/console-76f7b96f7c-c76jw" Aug 05 17:26:37.101422 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:37.101412 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c816bd40-cda2-44cc-af59-6668c9fc58c1-oauth-serving-cert\") pod \"console-76f7b96f7c-c76jw\" (UID: \"c816bd40-cda2-44cc-af59-6668c9fc58c1\") " pod="openshift-console/console-76f7b96f7c-c76jw" Aug 05 17:26:37.101554 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:37.101505 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c816bd40-cda2-44cc-af59-6668c9fc58c1-console-config\") pod \"console-76f7b96f7c-c76jw\" (UID: \"c816bd40-cda2-44cc-af59-6668c9fc58c1\") " pod="openshift-console/console-76f7b96f7c-c76jw" Aug 05 17:26:37.101621 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:37.101603 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c816bd40-cda2-44cc-af59-6668c9fc58c1-trusted-ca-bundle\") pod \"console-76f7b96f7c-c76jw\" (UID: \"c816bd40-cda2-44cc-af59-6668c9fc58c1\") " pod="openshift-console/console-76f7b96f7c-c76jw" Aug 05 17:26:37.103265 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:37.103237 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c816bd40-cda2-44cc-af59-6668c9fc58c1-console-oauth-config\") pod \"console-76f7b96f7c-c76jw\" (UID: \"c816bd40-cda2-44cc-af59-6668c9fc58c1\") " pod="openshift-console/console-76f7b96f7c-c76jw" Aug 05 17:26:37.103349 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:37.103243 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c816bd40-cda2-44cc-af59-6668c9fc58c1-console-serving-cert\") pod \"console-76f7b96f7c-c76jw\" (UID: \"c816bd40-cda2-44cc-af59-6668c9fc58c1\") " pod="openshift-console/console-76f7b96f7c-c76jw" Aug 05 17:26:37.109851 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:37.109828 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl9vd\" (UniqueName: \"kubernetes.io/projected/c816bd40-cda2-44cc-af59-6668c9fc58c1-kube-api-access-bl9vd\") pod \"console-76f7b96f7c-c76jw\" (UID: \"c816bd40-cda2-44cc-af59-6668c9fc58c1\") " pod="openshift-console/console-76f7b96f7c-c76jw" Aug 05 17:26:37.223167 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:37.223111 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76f7b96f7c-c76jw" Aug 05 17:26:37.355035 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:37.354843 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76f7b96f7c-c76jw"] Aug 05 17:26:37.357556 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:26:37.357534 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc816bd40_cda2_44cc_af59_6668c9fc58c1.slice/crio-78ebf67e9aef1996ef56f1f60a24868dd50f2c383087998b25994eb638f9c244 WatchSource:0}: Error finding container 78ebf67e9aef1996ef56f1f60a24868dd50f2c383087998b25994eb638f9c244: Status 404 returned error can't find the container with id 78ebf67e9aef1996ef56f1f60a24868dd50f2c383087998b25994eb638f9c244 Aug 05 17:26:37.804045 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:37.803953 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76f7b96f7c-c76jw" event={"ID":"c816bd40-cda2-44cc-af59-6668c9fc58c1","Type":"ContainerStarted","Data":"cbf5712ca3b62a7956d6ff843ab2340ab72db82c8d44dc7ac59951a91b979e75"} Aug 05 17:26:37.804045 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:37.804002 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76f7b96f7c-c76jw" event={"ID":"c816bd40-cda2-44cc-af59-6668c9fc58c1","Type":"ContainerStarted","Data":"78ebf67e9aef1996ef56f1f60a24868dd50f2c383087998b25994eb638f9c244"} Aug 05 17:26:37.823780 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:37.823733 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76f7b96f7c-c76jw" podStartSLOduration=1.8237153240000001 podStartE2EDuration="1.823715324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:26:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:26:37.822379644 +0000 UTC m=+185.589759879" watchObservedRunningTime="2026-08-05 17:26:37.823715324 +0000 UTC m=+185.591095556" Aug 05 17:26:47.223402 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:47.223347 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76f7b96f7c-c76jw" Aug 05 17:26:47.223826 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:47.223418 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76f7b96f7c-c76jw" Aug 05 17:26:47.228415 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:47.228392 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76f7b96f7c-c76jw" Aug 05 17:26:47.859279 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:47.859249 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76f7b96f7c-c76jw" Aug 05 17:26:47.913702 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:47.913667 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65bb9d74b9-4l7gq"] Aug 05 17:26:48.038065 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:48.038027 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:26:48.138495 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:48.138395 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:26:48.197843 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:48.197811 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:26:59.214700 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:59.214666 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:26:59.270439 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:26:59.270406 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:27:12.935371 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:12.935323 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-65bb9d74b9-4l7gq" podUID="4df28aa6-6341-4656-af9a-4bf71ba3d7df" containerName="console" containerID="cri-o://ec379aa4a901412406a04ba6f1ce45c37c9fd2d160326fd5da39a091d422ba2a" gracePeriod=15 Aug 05 17:27:13.176368 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:13.176342 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65bb9d74b9-4l7gq" Aug 05 17:27:13.324128 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:13.324098 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfvmx\" (UniqueName: \"kubernetes.io/projected/4df28aa6-6341-4656-af9a-4bf71ba3d7df-kube-api-access-tfvmx\") pod \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\" (UID: \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\") " Aug 05 17:27:13.324361 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:13.324199 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4df28aa6-6341-4656-af9a-4bf71ba3d7df-console-config\") pod \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\" (UID: \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\") " Aug 05 17:27:13.324361 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:13.324303 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4df28aa6-6341-4656-af9a-4bf71ba3d7df-service-ca\") pod \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\" (UID: \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\") " Aug 05 17:27:13.324361 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:13.324345 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4df28aa6-6341-4656-af9a-4bf71ba3d7df-oauth-serving-cert\") pod \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\" (UID: \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\") " Aug 05 17:27:13.324536 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:13.324387 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4df28aa6-6341-4656-af9a-4bf71ba3d7df-console-serving-cert\") pod \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\" (UID: \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\") " Aug 05 17:27:13.324536 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:13.324426 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4df28aa6-6341-4656-af9a-4bf71ba3d7df-trusted-ca-bundle\") pod \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\" (UID: \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\") " Aug 05 17:27:13.324536 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:13.324462 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4df28aa6-6341-4656-af9a-4bf71ba3d7df-console-oauth-config\") pod \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\" (UID: \"4df28aa6-6341-4656-af9a-4bf71ba3d7df\") " Aug 05 17:27:13.324675 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:13.324595 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4df28aa6-6341-4656-af9a-4bf71ba3d7df-console-config" (OuterVolumeSpecName: "console-config") pod "4df28aa6-6341-4656-af9a-4bf71ba3d7df" (UID: "4df28aa6-6341-4656-af9a-4bf71ba3d7df"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:27:13.324786 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:13.324757 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4df28aa6-6341-4656-af9a-4bf71ba3d7df-service-ca" (OuterVolumeSpecName: "service-ca") pod "4df28aa6-6341-4656-af9a-4bf71ba3d7df" (UID: "4df28aa6-6341-4656-af9a-4bf71ba3d7df"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:27:13.324879 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:13.324846 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4df28aa6-6341-4656-af9a-4bf71ba3d7df-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4df28aa6-6341-4656-af9a-4bf71ba3d7df" (UID: "4df28aa6-6341-4656-af9a-4bf71ba3d7df"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:27:13.324879 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:13.324860 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4df28aa6-6341-4656-af9a-4bf71ba3d7df-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4df28aa6-6341-4656-af9a-4bf71ba3d7df" (UID: "4df28aa6-6341-4656-af9a-4bf71ba3d7df"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:27:13.325001 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:13.324871 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4df28aa6-6341-4656-af9a-4bf71ba3d7df-console-config\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:27:13.325001 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:13.324914 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4df28aa6-6341-4656-af9a-4bf71ba3d7df-service-ca\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:27:13.326434 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:13.326406 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4df28aa6-6341-4656-af9a-4bf71ba3d7df-kube-api-access-tfvmx" (OuterVolumeSpecName: "kube-api-access-tfvmx") pod "4df28aa6-6341-4656-af9a-4bf71ba3d7df" (UID: "4df28aa6-6341-4656-af9a-4bf71ba3d7df"). InnerVolumeSpecName "kube-api-access-tfvmx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:27:13.326555 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:13.326540 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4df28aa6-6341-4656-af9a-4bf71ba3d7df-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4df28aa6-6341-4656-af9a-4bf71ba3d7df" (UID: "4df28aa6-6341-4656-af9a-4bf71ba3d7df"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:27:13.326603 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:13.326549 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4df28aa6-6341-4656-af9a-4bf71ba3d7df-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4df28aa6-6341-4656-af9a-4bf71ba3d7df" (UID: "4df28aa6-6341-4656-af9a-4bf71ba3d7df"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:27:13.425363 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:13.425329 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4df28aa6-6341-4656-af9a-4bf71ba3d7df-oauth-serving-cert\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:27:13.425363 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:13.425359 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4df28aa6-6341-4656-af9a-4bf71ba3d7df-console-serving-cert\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:27:13.425363 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:13.425368 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4df28aa6-6341-4656-af9a-4bf71ba3d7df-trusted-ca-bundle\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:27:13.425363 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:13.425376 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4df28aa6-6341-4656-af9a-4bf71ba3d7df-console-oauth-config\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:27:13.425630 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:13.425384 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfvmx\" (UniqueName: \"kubernetes.io/projected/4df28aa6-6341-4656-af9a-4bf71ba3d7df-kube-api-access-tfvmx\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:27:13.969657 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:13.969620 2579 generic.go:356] "Generic (PLEG): container finished" podID="4df28aa6-6341-4656-af9a-4bf71ba3d7df" containerID="ec379aa4a901412406a04ba6f1ce45c37c9fd2d160326fd5da39a091d422ba2a" exitCode=0 Aug 05 17:27:13.970105 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:13.969666 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65bb9d74b9-4l7gq" Aug 05 17:27:13.970105 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:13.969679 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65bb9d74b9-4l7gq" event={"ID":"4df28aa6-6341-4656-af9a-4bf71ba3d7df","Type":"ContainerDied","Data":"ec379aa4a901412406a04ba6f1ce45c37c9fd2d160326fd5da39a091d422ba2a"} Aug 05 17:27:13.970105 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:13.969737 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65bb9d74b9-4l7gq" event={"ID":"4df28aa6-6341-4656-af9a-4bf71ba3d7df","Type":"ContainerDied","Data":"be9ae54a24be6504fb86c1d0212cda8c14912e87f553a18f291351a63333bed7"} Aug 05 17:27:13.970105 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:13.969766 2579 scope.go:117] "RemoveContainer" containerID="ec379aa4a901412406a04ba6f1ce45c37c9fd2d160326fd5da39a091d422ba2a" Aug 05 17:27:13.978727 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:13.978710 2579 scope.go:117] "RemoveContainer" containerID="ec379aa4a901412406a04ba6f1ce45c37c9fd2d160326fd5da39a091d422ba2a" Aug 05 17:27:13.978999 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:27:13.978981 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec379aa4a901412406a04ba6f1ce45c37c9fd2d160326fd5da39a091d422ba2a\": container with ID starting with ec379aa4a901412406a04ba6f1ce45c37c9fd2d160326fd5da39a091d422ba2a not found: ID does not exist" containerID="ec379aa4a901412406a04ba6f1ce45c37c9fd2d160326fd5da39a091d422ba2a" Aug 05 17:27:13.979065 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:13.979009 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec379aa4a901412406a04ba6f1ce45c37c9fd2d160326fd5da39a091d422ba2a"} err="failed to get container status \"ec379aa4a901412406a04ba6f1ce45c37c9fd2d160326fd5da39a091d422ba2a\": rpc error: code = NotFound desc = could not find container \"ec379aa4a901412406a04ba6f1ce45c37c9fd2d160326fd5da39a091d422ba2a\": container with ID starting with ec379aa4a901412406a04ba6f1ce45c37c9fd2d160326fd5da39a091d422ba2a not found: ID does not exist" Aug 05 17:27:13.991195 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:13.991167 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65bb9d74b9-4l7gq"] Aug 05 17:27:13.994552 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:13.994529 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65bb9d74b9-4l7gq"] Aug 05 17:27:14.769640 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:14.769599 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4df28aa6-6341-4656-af9a-4bf71ba3d7df" path="/var/lib/kubelet/pods/4df28aa6-6341-4656-af9a-4bf71ba3d7df/volumes" Aug 05 17:27:19.668690 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:19.668644 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:27:44.561791 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:44.561755 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:27:44.881453 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:44.881416 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:27:56.498201 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:56.498114 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:27:56.548689 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:56.548658 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:27:58.525753 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:58.525714 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5768d8f559-6pzk8"] Aug 05 17:27:58.526117 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:58.526028 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4df28aa6-6341-4656-af9a-4bf71ba3d7df" containerName="console" Aug 05 17:27:58.526117 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:58.526039 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4df28aa6-6341-4656-af9a-4bf71ba3d7df" containerName="console" Aug 05 17:27:58.526247 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:58.526165 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4df28aa6-6341-4656-af9a-4bf71ba3d7df" containerName="console" Aug 05 17:27:58.528053 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:58.528033 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5768d8f559-6pzk8" Aug 05 17:27:58.551962 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:58.551937 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5768d8f559-6pzk8"] Aug 05 17:27:58.599262 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:58.599233 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f5a21ba1-306d-44e7-99e5-363af52cf24f-console-serving-cert\") pod \"console-5768d8f559-6pzk8\" (UID: \"f5a21ba1-306d-44e7-99e5-363af52cf24f\") " pod="openshift-console/console-5768d8f559-6pzk8" Aug 05 17:27:58.599454 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:58.599269 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f5a21ba1-306d-44e7-99e5-363af52cf24f-console-oauth-config\") pod \"console-5768d8f559-6pzk8\" (UID: \"f5a21ba1-306d-44e7-99e5-363af52cf24f\") " pod="openshift-console/console-5768d8f559-6pzk8" Aug 05 17:27:58.599454 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:58.599296 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f5a21ba1-306d-44e7-99e5-363af52cf24f-service-ca\") pod \"console-5768d8f559-6pzk8\" (UID: \"f5a21ba1-306d-44e7-99e5-363af52cf24f\") " pod="openshift-console/console-5768d8f559-6pzk8" Aug 05 17:27:58.599454 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:58.599328 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f5a21ba1-306d-44e7-99e5-363af52cf24f-console-config\") pod \"console-5768d8f559-6pzk8\" (UID: \"f5a21ba1-306d-44e7-99e5-363af52cf24f\") " pod="openshift-console/console-5768d8f559-6pzk8" Aug 05 17:27:58.599454 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:58.599350 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2slh2\" (UniqueName: \"kubernetes.io/projected/f5a21ba1-306d-44e7-99e5-363af52cf24f-kube-api-access-2slh2\") pod \"console-5768d8f559-6pzk8\" (UID: \"f5a21ba1-306d-44e7-99e5-363af52cf24f\") " pod="openshift-console/console-5768d8f559-6pzk8" Aug 05 17:27:58.599621 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:58.599449 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5a21ba1-306d-44e7-99e5-363af52cf24f-trusted-ca-bundle\") pod \"console-5768d8f559-6pzk8\" (UID: \"f5a21ba1-306d-44e7-99e5-363af52cf24f\") " pod="openshift-console/console-5768d8f559-6pzk8" Aug 05 17:27:58.599621 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:58.599482 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f5a21ba1-306d-44e7-99e5-363af52cf24f-oauth-serving-cert\") pod \"console-5768d8f559-6pzk8\" (UID: \"f5a21ba1-306d-44e7-99e5-363af52cf24f\") " pod="openshift-console/console-5768d8f559-6pzk8" Aug 05 17:27:58.601474 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:58.601448 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:27:58.700375 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:58.700334 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5a21ba1-306d-44e7-99e5-363af52cf24f-trusted-ca-bundle\") pod \"console-5768d8f559-6pzk8\" (UID: \"f5a21ba1-306d-44e7-99e5-363af52cf24f\") " pod="openshift-console/console-5768d8f559-6pzk8" Aug 05 17:27:58.700375 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:58.700372 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f5a21ba1-306d-44e7-99e5-363af52cf24f-oauth-serving-cert\") pod \"console-5768d8f559-6pzk8\" (UID: \"f5a21ba1-306d-44e7-99e5-363af52cf24f\") " pod="openshift-console/console-5768d8f559-6pzk8" Aug 05 17:27:58.700612 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:58.700416 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f5a21ba1-306d-44e7-99e5-363af52cf24f-console-serving-cert\") pod \"console-5768d8f559-6pzk8\" (UID: \"f5a21ba1-306d-44e7-99e5-363af52cf24f\") " pod="openshift-console/console-5768d8f559-6pzk8" Aug 05 17:27:58.700612 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:58.700432 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f5a21ba1-306d-44e7-99e5-363af52cf24f-console-oauth-config\") pod \"console-5768d8f559-6pzk8\" (UID: \"f5a21ba1-306d-44e7-99e5-363af52cf24f\") " pod="openshift-console/console-5768d8f559-6pzk8" Aug 05 17:27:58.700612 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:58.700449 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f5a21ba1-306d-44e7-99e5-363af52cf24f-service-ca\") pod \"console-5768d8f559-6pzk8\" (UID: \"f5a21ba1-306d-44e7-99e5-363af52cf24f\") " pod="openshift-console/console-5768d8f559-6pzk8" Aug 05 17:27:58.700612 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:58.700474 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f5a21ba1-306d-44e7-99e5-363af52cf24f-console-config\") pod \"console-5768d8f559-6pzk8\" (UID: \"f5a21ba1-306d-44e7-99e5-363af52cf24f\") " pod="openshift-console/console-5768d8f559-6pzk8" Aug 05 17:27:58.700612 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:58.700498 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2slh2\" (UniqueName: \"kubernetes.io/projected/f5a21ba1-306d-44e7-99e5-363af52cf24f-kube-api-access-2slh2\") pod \"console-5768d8f559-6pzk8\" (UID: \"f5a21ba1-306d-44e7-99e5-363af52cf24f\") " pod="openshift-console/console-5768d8f559-6pzk8" Aug 05 17:27:58.701266 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:58.701239 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f5a21ba1-306d-44e7-99e5-363af52cf24f-oauth-serving-cert\") pod \"console-5768d8f559-6pzk8\" (UID: \"f5a21ba1-306d-44e7-99e5-363af52cf24f\") " pod="openshift-console/console-5768d8f559-6pzk8" Aug 05 17:27:58.701456 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:58.701307 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f5a21ba1-306d-44e7-99e5-363af52cf24f-service-ca\") pod \"console-5768d8f559-6pzk8\" (UID: \"f5a21ba1-306d-44e7-99e5-363af52cf24f\") " pod="openshift-console/console-5768d8f559-6pzk8" Aug 05 17:27:58.701577 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:58.701333 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f5a21ba1-306d-44e7-99e5-363af52cf24f-console-config\") pod \"console-5768d8f559-6pzk8\" (UID: \"f5a21ba1-306d-44e7-99e5-363af52cf24f\") " pod="openshift-console/console-5768d8f559-6pzk8" Aug 05 17:27:58.701701 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:58.701624 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5a21ba1-306d-44e7-99e5-363af52cf24f-trusted-ca-bundle\") pod \"console-5768d8f559-6pzk8\" (UID: \"f5a21ba1-306d-44e7-99e5-363af52cf24f\") " pod="openshift-console/console-5768d8f559-6pzk8" Aug 05 17:27:58.702971 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:58.702939 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:27:58.703239 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:58.703219 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f5a21ba1-306d-44e7-99e5-363af52cf24f-console-serving-cert\") pod \"console-5768d8f559-6pzk8\" (UID: \"f5a21ba1-306d-44e7-99e5-363af52cf24f\") " pod="openshift-console/console-5768d8f559-6pzk8" Aug 05 17:27:58.703465 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:58.703442 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f5a21ba1-306d-44e7-99e5-363af52cf24f-console-oauth-config\") pod \"console-5768d8f559-6pzk8\" (UID: \"f5a21ba1-306d-44e7-99e5-363af52cf24f\") " pod="openshift-console/console-5768d8f559-6pzk8" Aug 05 17:27:58.708318 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:58.708295 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2slh2\" (UniqueName: \"kubernetes.io/projected/f5a21ba1-306d-44e7-99e5-363af52cf24f-kube-api-access-2slh2\") pod \"console-5768d8f559-6pzk8\" (UID: \"f5a21ba1-306d-44e7-99e5-363af52cf24f\") " pod="openshift-console/console-5768d8f559-6pzk8" Aug 05 17:27:58.840155 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:58.840120 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5768d8f559-6pzk8" Aug 05 17:27:58.968625 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:58.968603 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5768d8f559-6pzk8"] Aug 05 17:27:58.970631 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:27:58.970595 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5a21ba1_306d_44e7_99e5_363af52cf24f.slice/crio-f3b0f31fdf2ad1747eb98a956d6831c4bce295d5be8b90f7a5dcde281b453e58 WatchSource:0}: Error finding container f3b0f31fdf2ad1747eb98a956d6831c4bce295d5be8b90f7a5dcde281b453e58: Status 404 returned error can't find the container with id f3b0f31fdf2ad1747eb98a956d6831c4bce295d5be8b90f7a5dcde281b453e58 Aug 05 17:27:59.151180 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:59.151076 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5768d8f559-6pzk8" event={"ID":"f5a21ba1-306d-44e7-99e5-363af52cf24f","Type":"ContainerStarted","Data":"2a2a0f71c093f71347221d4939cb84f2d6f2c3ee9f8733d7452af18c19a88ed4"} Aug 05 17:27:59.151180 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:59.151131 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5768d8f559-6pzk8" event={"ID":"f5a21ba1-306d-44e7-99e5-363af52cf24f","Type":"ContainerStarted","Data":"f3b0f31fdf2ad1747eb98a956d6831c4bce295d5be8b90f7a5dcde281b453e58"} Aug 05 17:27:59.171439 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:27:59.171389 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5768d8f559-6pzk8" podStartSLOduration=1.171373389 podStartE2EDuration="1.171373389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:27:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:27:59.171274919 +0000 UTC m=+266.938655153" watchObservedRunningTime="2026-08-05 17:27:59.171373389 +0000 UTC m=+266.938753601" Aug 05 17:28:06.507289 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:06.507249 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:28:06.608454 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:06.608417 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:28:08.840407 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:08.840369 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5768d8f559-6pzk8" Aug 05 17:28:08.840804 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:08.840431 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5768d8f559-6pzk8" Aug 05 17:28:08.845262 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:08.845242 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5768d8f559-6pzk8" Aug 05 17:28:09.194367 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:09.194287 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5768d8f559-6pzk8" Aug 05 17:28:09.239830 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:09.239800 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76f7b96f7c-c76jw"] Aug 05 17:28:09.338273 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:09.338242 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:28:09.403573 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:09.403539 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:28:09.454828 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:09.454733 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:28:13.829792 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:13.829756 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:28:32.631468 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:32.631439 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-lpd2k_fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de/cluster-monitoring-operator/0.log" Aug 05 17:28:32.633859 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:32.633838 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-lpd2k_fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de/cluster-monitoring-operator/0.log" Aug 05 17:28:32.636773 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:32.636757 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-5qdp4_e8e537f1-bb75-456e-973b-5ccffc3077c9/console-operator/2.log" Aug 05 17:28:32.639711 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:32.639693 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-5qdp4_e8e537f1-bb75-456e-973b-5ccffc3077c9/console-operator/2.log" Aug 05 17:28:32.648387 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:32.648364 2579 kubelet.go:1648] "Image garbage collection succeeded" Aug 05 17:28:34.263397 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:34.263332 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-76f7b96f7c-c76jw" podUID="c816bd40-cda2-44cc-af59-6668c9fc58c1" containerName="console" containerID="cri-o://cbf5712ca3b62a7956d6ff843ab2340ab72db82c8d44dc7ac59951a91b979e75" gracePeriod=15 Aug 05 17:28:34.506939 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:34.506912 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76f7b96f7c-c76jw" Aug 05 17:28:34.609318 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:34.609277 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c816bd40-cda2-44cc-af59-6668c9fc58c1-console-serving-cert\") pod \"c816bd40-cda2-44cc-af59-6668c9fc58c1\" (UID: \"c816bd40-cda2-44cc-af59-6668c9fc58c1\") " Aug 05 17:28:34.609318 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:34.609320 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c816bd40-cda2-44cc-af59-6668c9fc58c1-service-ca\") pod \"c816bd40-cda2-44cc-af59-6668c9fc58c1\" (UID: \"c816bd40-cda2-44cc-af59-6668c9fc58c1\") " Aug 05 17:28:34.609553 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:34.609369 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c816bd40-cda2-44cc-af59-6668c9fc58c1-trusted-ca-bundle\") pod \"c816bd40-cda2-44cc-af59-6668c9fc58c1\" (UID: \"c816bd40-cda2-44cc-af59-6668c9fc58c1\") " Aug 05 17:28:34.609553 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:34.609392 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c816bd40-cda2-44cc-af59-6668c9fc58c1-console-config\") pod \"c816bd40-cda2-44cc-af59-6668c9fc58c1\" (UID: \"c816bd40-cda2-44cc-af59-6668c9fc58c1\") " Aug 05 17:28:34.609553 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:34.609419 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c816bd40-cda2-44cc-af59-6668c9fc58c1-oauth-serving-cert\") pod \"c816bd40-cda2-44cc-af59-6668c9fc58c1\" (UID: \"c816bd40-cda2-44cc-af59-6668c9fc58c1\") " Aug 05 17:28:34.609553 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:34.609463 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bl9vd\" (UniqueName: \"kubernetes.io/projected/c816bd40-cda2-44cc-af59-6668c9fc58c1-kube-api-access-bl9vd\") pod \"c816bd40-cda2-44cc-af59-6668c9fc58c1\" (UID: \"c816bd40-cda2-44cc-af59-6668c9fc58c1\") " Aug 05 17:28:34.609553 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:34.609506 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c816bd40-cda2-44cc-af59-6668c9fc58c1-console-oauth-config\") pod \"c816bd40-cda2-44cc-af59-6668c9fc58c1\" (UID: \"c816bd40-cda2-44cc-af59-6668c9fc58c1\") " Aug 05 17:28:34.609881 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:34.609835 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c816bd40-cda2-44cc-af59-6668c9fc58c1-service-ca" (OuterVolumeSpecName: "service-ca") pod "c816bd40-cda2-44cc-af59-6668c9fc58c1" (UID: "c816bd40-cda2-44cc-af59-6668c9fc58c1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:28:34.610005 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:34.609911 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c816bd40-cda2-44cc-af59-6668c9fc58c1-console-config" (OuterVolumeSpecName: "console-config") pod "c816bd40-cda2-44cc-af59-6668c9fc58c1" (UID: "c816bd40-cda2-44cc-af59-6668c9fc58c1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:28:34.610005 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:34.609930 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c816bd40-cda2-44cc-af59-6668c9fc58c1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c816bd40-cda2-44cc-af59-6668c9fc58c1" (UID: "c816bd40-cda2-44cc-af59-6668c9fc58c1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:28:34.610005 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:34.609956 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c816bd40-cda2-44cc-af59-6668c9fc58c1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c816bd40-cda2-44cc-af59-6668c9fc58c1" (UID: "c816bd40-cda2-44cc-af59-6668c9fc58c1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:28:34.611644 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:34.611610 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c816bd40-cda2-44cc-af59-6668c9fc58c1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c816bd40-cda2-44cc-af59-6668c9fc58c1" (UID: "c816bd40-cda2-44cc-af59-6668c9fc58c1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:28:34.611745 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:34.611654 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c816bd40-cda2-44cc-af59-6668c9fc58c1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c816bd40-cda2-44cc-af59-6668c9fc58c1" (UID: "c816bd40-cda2-44cc-af59-6668c9fc58c1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:28:34.611745 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:34.611692 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c816bd40-cda2-44cc-af59-6668c9fc58c1-kube-api-access-bl9vd" (OuterVolumeSpecName: "kube-api-access-bl9vd") pod "c816bd40-cda2-44cc-af59-6668c9fc58c1" (UID: "c816bd40-cda2-44cc-af59-6668c9fc58c1"). InnerVolumeSpecName "kube-api-access-bl9vd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:28:34.710485 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:34.710442 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c816bd40-cda2-44cc-af59-6668c9fc58c1-trusted-ca-bundle\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:28:34.710485 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:34.710475 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c816bd40-cda2-44cc-af59-6668c9fc58c1-console-config\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:28:34.710485 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:34.710484 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c816bd40-cda2-44cc-af59-6668c9fc58c1-oauth-serving-cert\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:28:34.710485 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:34.710492 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bl9vd\" (UniqueName: \"kubernetes.io/projected/c816bd40-cda2-44cc-af59-6668c9fc58c1-kube-api-access-bl9vd\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:28:34.710760 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:34.710502 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c816bd40-cda2-44cc-af59-6668c9fc58c1-console-oauth-config\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:28:34.710760 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:34.710510 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c816bd40-cda2-44cc-af59-6668c9fc58c1-console-serving-cert\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:28:34.710760 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:34.710519 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c816bd40-cda2-44cc-af59-6668c9fc58c1-service-ca\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:28:35.298312 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:35.298277 2579 generic.go:356] "Generic (PLEG): container finished" podID="c816bd40-cda2-44cc-af59-6668c9fc58c1" containerID="cbf5712ca3b62a7956d6ff843ab2340ab72db82c8d44dc7ac59951a91b979e75" exitCode=0 Aug 05 17:28:35.298312 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:35.298315 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76f7b96f7c-c76jw" Aug 05 17:28:35.298805 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:35.298327 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76f7b96f7c-c76jw" event={"ID":"c816bd40-cda2-44cc-af59-6668c9fc58c1","Type":"ContainerDied","Data":"cbf5712ca3b62a7956d6ff843ab2340ab72db82c8d44dc7ac59951a91b979e75"} Aug 05 17:28:35.298805 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:35.298373 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76f7b96f7c-c76jw" event={"ID":"c816bd40-cda2-44cc-af59-6668c9fc58c1","Type":"ContainerDied","Data":"78ebf67e9aef1996ef56f1f60a24868dd50f2c383087998b25994eb638f9c244"} Aug 05 17:28:35.298805 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:35.298395 2579 scope.go:117] "RemoveContainer" containerID="cbf5712ca3b62a7956d6ff843ab2340ab72db82c8d44dc7ac59951a91b979e75" Aug 05 17:28:35.306844 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:35.306825 2579 scope.go:117] "RemoveContainer" containerID="cbf5712ca3b62a7956d6ff843ab2340ab72db82c8d44dc7ac59951a91b979e75" Aug 05 17:28:35.307130 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:28:35.307112 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbf5712ca3b62a7956d6ff843ab2340ab72db82c8d44dc7ac59951a91b979e75\": container with ID starting with cbf5712ca3b62a7956d6ff843ab2340ab72db82c8d44dc7ac59951a91b979e75 not found: ID does not exist" containerID="cbf5712ca3b62a7956d6ff843ab2340ab72db82c8d44dc7ac59951a91b979e75" Aug 05 17:28:35.307200 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:35.307154 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbf5712ca3b62a7956d6ff843ab2340ab72db82c8d44dc7ac59951a91b979e75"} err="failed to get container status \"cbf5712ca3b62a7956d6ff843ab2340ab72db82c8d44dc7ac59951a91b979e75\": rpc error: code = NotFound desc = could not find container \"cbf5712ca3b62a7956d6ff843ab2340ab72db82c8d44dc7ac59951a91b979e75\": container with ID starting with cbf5712ca3b62a7956d6ff843ab2340ab72db82c8d44dc7ac59951a91b979e75 not found: ID does not exist" Aug 05 17:28:35.315918 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:35.315891 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76f7b96f7c-c76jw"] Aug 05 17:28:35.319387 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:35.319368 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76f7b96f7c-c76jw"] Aug 05 17:28:36.774345 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:28:36.774310 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c816bd40-cda2-44cc-af59-6668c9fc58c1" path="/var/lib/kubelet/pods/c816bd40-cda2-44cc-af59-6668c9fc58c1/volumes" Aug 05 17:29:18.929164 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:18.929109 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:29:19.683938 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:19.683905 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhvr9"] Aug 05 17:29:19.684404 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:19.684381 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c816bd40-cda2-44cc-af59-6668c9fc58c1" containerName="console" Aug 05 17:29:19.684404 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:19.684405 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c816bd40-cda2-44cc-af59-6668c9fc58c1" containerName="console" Aug 05 17:29:19.684578 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:19.684502 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c816bd40-cda2-44cc-af59-6668c9fc58c1" containerName="console" Aug 05 17:29:19.686612 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:19.686589 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhvr9" Aug 05 17:29:19.695217 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:19.690121 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Aug 05 17:29:19.695217 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:19.690124 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Aug 05 17:29:19.695217 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:19.690831 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hhv6f\"" Aug 05 17:29:19.698656 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:19.698630 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhvr9"] Aug 05 17:29:19.792370 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:19.792323 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0c52e8b-2263-4cef-8f47-95dc5c9e508a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhvr9\" (UID: \"b0c52e8b-2263-4cef-8f47-95dc5c9e508a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhvr9" Aug 05 17:29:19.792552 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:19.792383 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xflw\" (UniqueName: \"kubernetes.io/projected/b0c52e8b-2263-4cef-8f47-95dc5c9e508a-kube-api-access-4xflw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhvr9\" (UID: \"b0c52e8b-2263-4cef-8f47-95dc5c9e508a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhvr9" Aug 05 17:29:19.792552 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:19.792448 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0c52e8b-2263-4cef-8f47-95dc5c9e508a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhvr9\" (UID: \"b0c52e8b-2263-4cef-8f47-95dc5c9e508a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhvr9" Aug 05 17:29:19.893050 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:19.893010 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0c52e8b-2263-4cef-8f47-95dc5c9e508a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhvr9\" (UID: \"b0c52e8b-2263-4cef-8f47-95dc5c9e508a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhvr9" Aug 05 17:29:19.893263 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:19.893093 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xflw\" (UniqueName: \"kubernetes.io/projected/b0c52e8b-2263-4cef-8f47-95dc5c9e508a-kube-api-access-4xflw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhvr9\" (UID: \"b0c52e8b-2263-4cef-8f47-95dc5c9e508a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhvr9" Aug 05 17:29:19.893322 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:19.893301 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0c52e8b-2263-4cef-8f47-95dc5c9e508a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhvr9\" (UID: \"b0c52e8b-2263-4cef-8f47-95dc5c9e508a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhvr9" Aug 05 17:29:19.893485 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:19.893464 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0c52e8b-2263-4cef-8f47-95dc5c9e508a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhvr9\" (UID: \"b0c52e8b-2263-4cef-8f47-95dc5c9e508a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhvr9" Aug 05 17:29:19.893596 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:19.893579 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0c52e8b-2263-4cef-8f47-95dc5c9e508a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhvr9\" (UID: \"b0c52e8b-2263-4cef-8f47-95dc5c9e508a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhvr9" Aug 05 17:29:19.904170 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:19.904128 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xflw\" (UniqueName: \"kubernetes.io/projected/b0c52e8b-2263-4cef-8f47-95dc5c9e508a-kube-api-access-4xflw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhvr9\" (UID: \"b0c52e8b-2263-4cef-8f47-95dc5c9e508a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhvr9" Aug 05 17:29:20.004324 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:20.004220 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhvr9" Aug 05 17:29:20.132772 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:20.132748 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhvr9"] Aug 05 17:29:20.135223 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:29:20.135198 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0c52e8b_2263_4cef_8f47_95dc5c9e508a.slice/crio-48264d6498ad6a718ce8f5c240098cb90c93c90cce66e625dc2d5337b1372540 WatchSource:0}: Error finding container 48264d6498ad6a718ce8f5c240098cb90c93c90cce66e625dc2d5337b1372540: Status 404 returned error can't find the container with id 48264d6498ad6a718ce8f5c240098cb90c93c90cce66e625dc2d5337b1372540 Aug 05 17:29:20.137654 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:20.137628 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 05 17:29:20.481979 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:20.481946 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhvr9" event={"ID":"b0c52e8b-2263-4cef-8f47-95dc5c9e508a","Type":"ContainerStarted","Data":"48264d6498ad6a718ce8f5c240098cb90c93c90cce66e625dc2d5337b1372540"} Aug 05 17:29:20.606739 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:20.606707 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:29:25.508724 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:25.508626 2579 generic.go:356] "Generic (PLEG): container finished" podID="b0c52e8b-2263-4cef-8f47-95dc5c9e508a" containerID="6778b03de4f2f4bca1712a52c86c0633b72990c42a352201c8103e104c3605cc" exitCode=0 Aug 05 17:29:25.509189 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:25.508718 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhvr9" event={"ID":"b0c52e8b-2263-4cef-8f47-95dc5c9e508a","Type":"ContainerDied","Data":"6778b03de4f2f4bca1712a52c86c0633b72990c42a352201c8103e104c3605cc"} Aug 05 17:29:28.525547 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:28.525516 2579 generic.go:356] "Generic (PLEG): container finished" podID="b0c52e8b-2263-4cef-8f47-95dc5c9e508a" containerID="fe4ff6a90c4bb7721344a3e65d44f6dac57db8fe130840011d647c1e0b1696a9" exitCode=0 Aug 05 17:29:28.525913 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:28.525602 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhvr9" event={"ID":"b0c52e8b-2263-4cef-8f47-95dc5c9e508a","Type":"ContainerDied","Data":"fe4ff6a90c4bb7721344a3e65d44f6dac57db8fe130840011d647c1e0b1696a9"} Aug 05 17:29:35.566261 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:35.566223 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhvr9" event={"ID":"b0c52e8b-2263-4cef-8f47-95dc5c9e508a","Type":"ContainerStarted","Data":"a9abe2eff9d114bc1e6a5f5e9a10ce4506c431d303aa081f7c2ca33241e98f72"} Aug 05 17:29:35.587518 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:35.587463 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhvr9" podStartSLOduration=2.490634241 podStartE2EDuration="16.587445616s" totalImagesPullingTime="14.096811375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:29:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:29:35.585798549 +0000 UTC m=+363.353178795" watchObservedRunningTime="2026-08-05 17:29:35.587445616 +0000 UTC m=+363.354825848" Aug 05 17:29:36.572119 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:36.572085 2579 generic.go:356] "Generic (PLEG): container finished" podID="b0c52e8b-2263-4cef-8f47-95dc5c9e508a" containerID="a9abe2eff9d114bc1e6a5f5e9a10ce4506c431d303aa081f7c2ca33241e98f72" exitCode=0 Aug 05 17:29:36.572503 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:36.572171 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhvr9" event={"ID":"b0c52e8b-2263-4cef-8f47-95dc5c9e508a","Type":"ContainerDied","Data":"a9abe2eff9d114bc1e6a5f5e9a10ce4506c431d303aa081f7c2ca33241e98f72"} Aug 05 17:29:37.699583 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:37.699558 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhvr9" Aug 05 17:29:37.749779 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:37.749750 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0c52e8b-2263-4cef-8f47-95dc5c9e508a-bundle\") pod \"b0c52e8b-2263-4cef-8f47-95dc5c9e508a\" (UID: \"b0c52e8b-2263-4cef-8f47-95dc5c9e508a\") " Aug 05 17:29:37.749955 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:37.749793 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xflw\" (UniqueName: \"kubernetes.io/projected/b0c52e8b-2263-4cef-8f47-95dc5c9e508a-kube-api-access-4xflw\") pod \"b0c52e8b-2263-4cef-8f47-95dc5c9e508a\" (UID: \"b0c52e8b-2263-4cef-8f47-95dc5c9e508a\") " Aug 05 17:29:37.749955 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:37.749846 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0c52e8b-2263-4cef-8f47-95dc5c9e508a-util\") pod \"b0c52e8b-2263-4cef-8f47-95dc5c9e508a\" (UID: \"b0c52e8b-2263-4cef-8f47-95dc5c9e508a\") " Aug 05 17:29:37.750453 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:37.750427 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0c52e8b-2263-4cef-8f47-95dc5c9e508a-bundle" (OuterVolumeSpecName: "bundle") pod "b0c52e8b-2263-4cef-8f47-95dc5c9e508a" (UID: "b0c52e8b-2263-4cef-8f47-95dc5c9e508a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:29:37.752022 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:37.752002 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0c52e8b-2263-4cef-8f47-95dc5c9e508a-kube-api-access-4xflw" (OuterVolumeSpecName: "kube-api-access-4xflw") pod "b0c52e8b-2263-4cef-8f47-95dc5c9e508a" (UID: "b0c52e8b-2263-4cef-8f47-95dc5c9e508a"). InnerVolumeSpecName "kube-api-access-4xflw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:29:37.754069 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:37.754048 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0c52e8b-2263-4cef-8f47-95dc5c9e508a-util" (OuterVolumeSpecName: "util") pod "b0c52e8b-2263-4cef-8f47-95dc5c9e508a" (UID: "b0c52e8b-2263-4cef-8f47-95dc5c9e508a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:29:37.851297 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:37.851202 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0c52e8b-2263-4cef-8f47-95dc5c9e508a-bundle\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:29:37.851297 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:37.851243 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xflw\" (UniqueName: \"kubernetes.io/projected/b0c52e8b-2263-4cef-8f47-95dc5c9e508a-kube-api-access-4xflw\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:29:37.851297 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:37.851253 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0c52e8b-2263-4cef-8f47-95dc5c9e508a-util\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:29:38.581446 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:38.581418 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhvr9" Aug 05 17:29:38.581614 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:38.581422 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mhvr9" event={"ID":"b0c52e8b-2263-4cef-8f47-95dc5c9e508a","Type":"ContainerDied","Data":"48264d6498ad6a718ce8f5c240098cb90c93c90cce66e625dc2d5337b1372540"} Aug 05 17:29:38.581614 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:38.581533 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="48264d6498ad6a718ce8f5c240098cb90c93c90cce66e625dc2d5337b1372540" Aug 05 17:29:40.671365 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:40.671321 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:29:41.490858 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:41.490821 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:29:42.674111 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:42.674079 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sdcpn"] Aug 05 17:29:42.674539 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:42.674436 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0c52e8b-2263-4cef-8f47-95dc5c9e508a" containerName="util" Aug 05 17:29:42.674539 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:42.674449 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0c52e8b-2263-4cef-8f47-95dc5c9e508a" containerName="util" Aug 05 17:29:42.674539 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:42.674461 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0c52e8b-2263-4cef-8f47-95dc5c9e508a" containerName="extract" Aug 05 17:29:42.674539 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:42.674467 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0c52e8b-2263-4cef-8f47-95dc5c9e508a" containerName="extract" Aug 05 17:29:42.674539 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:42.674475 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0c52e8b-2263-4cef-8f47-95dc5c9e508a" containerName="pull" Aug 05 17:29:42.674539 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:42.674480 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0c52e8b-2263-4cef-8f47-95dc5c9e508a" containerName="pull" Aug 05 17:29:42.674539 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:42.674532 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0c52e8b-2263-4cef-8f47-95dc5c9e508a" containerName="extract" Aug 05 17:29:42.700629 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:42.700601 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sdcpn"] Aug 05 17:29:42.700771 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:42.700691 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sdcpn" Aug 05 17:29:42.707344 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:42.707315 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Aug 05 17:29:42.707618 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:42.707592 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Aug 05 17:29:42.707618 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:42.707606 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-jtkph\"" Aug 05 17:29:42.797058 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:42.797026 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntfcq\" (UniqueName: \"kubernetes.io/projected/a5493fbd-f224-4bc0-93bb-5728170c31a7-kube-api-access-ntfcq\") pod \"cert-manager-operator-controller-manager-55c444bf86-sdcpn\" (UID: \"a5493fbd-f224-4bc0-93bb-5728170c31a7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sdcpn" Aug 05 17:29:42.797237 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:42.797078 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5493fbd-f224-4bc0-93bb-5728170c31a7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-sdcpn\" (UID: \"a5493fbd-f224-4bc0-93bb-5728170c31a7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sdcpn" Aug 05 17:29:42.897550 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:42.897507 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntfcq\" (UniqueName: \"kubernetes.io/projected/a5493fbd-f224-4bc0-93bb-5728170c31a7-kube-api-access-ntfcq\") pod \"cert-manager-operator-controller-manager-55c444bf86-sdcpn\" (UID: \"a5493fbd-f224-4bc0-93bb-5728170c31a7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sdcpn" Aug 05 17:29:42.897761 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:42.897585 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5493fbd-f224-4bc0-93bb-5728170c31a7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-sdcpn\" (UID: \"a5493fbd-f224-4bc0-93bb-5728170c31a7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sdcpn" Aug 05 17:29:42.897994 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:42.897972 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5493fbd-f224-4bc0-93bb-5728170c31a7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-sdcpn\" (UID: \"a5493fbd-f224-4bc0-93bb-5728170c31a7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sdcpn" Aug 05 17:29:42.906051 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:42.906022 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntfcq\" (UniqueName: \"kubernetes.io/projected/a5493fbd-f224-4bc0-93bb-5728170c31a7-kube-api-access-ntfcq\") pod \"cert-manager-operator-controller-manager-55c444bf86-sdcpn\" (UID: \"a5493fbd-f224-4bc0-93bb-5728170c31a7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sdcpn" Aug 05 17:29:43.016273 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:43.016179 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sdcpn" Aug 05 17:29:43.167421 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:43.167391 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sdcpn"] Aug 05 17:29:43.172092 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:29:43.172061 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5493fbd_f224_4bc0_93bb_5728170c31a7.slice/crio-079caa7d34614888f28be7348567368769018fc9e1638e73c99f7c95901efbc0 WatchSource:0}: Error finding container 079caa7d34614888f28be7348567368769018fc9e1638e73c99f7c95901efbc0: Status 404 returned error can't find the container with id 079caa7d34614888f28be7348567368769018fc9e1638e73c99f7c95901efbc0 Aug 05 17:29:43.606738 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:43.606698 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sdcpn" event={"ID":"a5493fbd-f224-4bc0-93bb-5728170c31a7","Type":"ContainerStarted","Data":"079caa7d34614888f28be7348567368769018fc9e1638e73c99f7c95901efbc0"} Aug 05 17:29:44.325188 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:44.325131 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:29:44.425071 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:44.424993 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:29:45.618027 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:45.617989 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sdcpn" event={"ID":"a5493fbd-f224-4bc0-93bb-5728170c31a7","Type":"ContainerStarted","Data":"41df5061e94fa035d0bb7dcb68732f9b47fe06f2c43dcb6cf668bab8fb46ca7e"} Aug 05 17:29:45.640039 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:45.639836 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sdcpn" podStartSLOduration=1.3912257270000001 podStartE2EDuration="3.639814965s" totalImagesPullingTime="2.248589238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:29:45.637933127 +0000 UTC m=+373.405313361" watchObservedRunningTime="2026-08-05 17:29:45.639814965 +0000 UTC m=+373.407195199" Aug 05 17:29:46.081419 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:46.081378 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:29:46.210254 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:46.210222 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:29:46.355726 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:46.355638 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:29:46.473126 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:46.473091 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54rfz"] Aug 05 17:29:46.489895 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:46.489865 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54rfz" Aug 05 17:29:46.494630 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:46.494608 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Aug 05 17:29:46.496478 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:46.496244 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Aug 05 17:29:46.496478 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:46.496355 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hhv6f\"" Aug 05 17:29:46.500380 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:46.500353 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54rfz"] Aug 05 17:29:46.506536 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:46.506508 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:29:46.629462 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:46.629387 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d07b3bf4-0ebc-4039-beeb-09365fe4bc54-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54rfz\" (UID: \"d07b3bf4-0ebc-4039-beeb-09365fe4bc54\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54rfz" Aug 05 17:29:46.629462 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:46.629435 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d07b3bf4-0ebc-4039-beeb-09365fe4bc54-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54rfz\" (UID: \"d07b3bf4-0ebc-4039-beeb-09365fe4bc54\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54rfz" Aug 05 17:29:46.629900 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:46.629527 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vfnd\" (UniqueName: \"kubernetes.io/projected/d07b3bf4-0ebc-4039-beeb-09365fe4bc54-kube-api-access-4vfnd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54rfz\" (UID: \"d07b3bf4-0ebc-4039-beeb-09365fe4bc54\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54rfz" Aug 05 17:29:46.730877 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:46.730841 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d07b3bf4-0ebc-4039-beeb-09365fe4bc54-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54rfz\" (UID: \"d07b3bf4-0ebc-4039-beeb-09365fe4bc54\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54rfz" Aug 05 17:29:46.731045 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:46.730905 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vfnd\" (UniqueName: \"kubernetes.io/projected/d07b3bf4-0ebc-4039-beeb-09365fe4bc54-kube-api-access-4vfnd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54rfz\" (UID: \"d07b3bf4-0ebc-4039-beeb-09365fe4bc54\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54rfz" Aug 05 17:29:46.731045 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:46.730954 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d07b3bf4-0ebc-4039-beeb-09365fe4bc54-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54rfz\" (UID: \"d07b3bf4-0ebc-4039-beeb-09365fe4bc54\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54rfz" Aug 05 17:29:46.731238 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:46.731219 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d07b3bf4-0ebc-4039-beeb-09365fe4bc54-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54rfz\" (UID: \"d07b3bf4-0ebc-4039-beeb-09365fe4bc54\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54rfz" Aug 05 17:29:46.731290 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:46.731252 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d07b3bf4-0ebc-4039-beeb-09365fe4bc54-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54rfz\" (UID: \"d07b3bf4-0ebc-4039-beeb-09365fe4bc54\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54rfz" Aug 05 17:29:46.740780 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:46.740751 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vfnd\" (UniqueName: \"kubernetes.io/projected/d07b3bf4-0ebc-4039-beeb-09365fe4bc54-kube-api-access-4vfnd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54rfz\" (UID: \"d07b3bf4-0ebc-4039-beeb-09365fe4bc54\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54rfz" Aug 05 17:29:46.806283 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:46.806249 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54rfz" Aug 05 17:29:46.969530 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:46.969492 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54rfz"] Aug 05 17:29:46.973205 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:29:46.973179 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd07b3bf4_0ebc_4039_beeb_09365fe4bc54.slice/crio-e615121bf74c507f5a6b729f39afae208d5a24645591682be7387cfe7ce4fc70 WatchSource:0}: Error finding container e615121bf74c507f5a6b729f39afae208d5a24645591682be7387cfe7ce4fc70: Status 404 returned error can't find the container with id e615121bf74c507f5a6b729f39afae208d5a24645591682be7387cfe7ce4fc70 Aug 05 17:29:47.628594 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:47.628561 2579 generic.go:356] "Generic (PLEG): container finished" podID="d07b3bf4-0ebc-4039-beeb-09365fe4bc54" containerID="0c8ac91bddb21db7488a2050bedc7b48098724c67507668d3530d2d9a4545734" exitCode=0 Aug 05 17:29:47.628594 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:47.628598 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54rfz" event={"ID":"d07b3bf4-0ebc-4039-beeb-09365fe4bc54","Type":"ContainerDied","Data":"0c8ac91bddb21db7488a2050bedc7b48098724c67507668d3530d2d9a4545734"} Aug 05 17:29:47.628803 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:47.628633 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54rfz" event={"ID":"d07b3bf4-0ebc-4039-beeb-09365fe4bc54","Type":"ContainerStarted","Data":"e615121bf74c507f5a6b729f39afae208d5a24645591682be7387cfe7ce4fc70"} Aug 05 17:29:48.680101 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:48.680063 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:29:48.878710 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:48.878678 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:29:50.646079 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:50.646045 2579 generic.go:356] "Generic (PLEG): container finished" podID="d07b3bf4-0ebc-4039-beeb-09365fe4bc54" containerID="70ae9f10ae07642d2dade21d8567ac99e43ad94b46b65146170e299ccd101053" exitCode=0 Aug 05 17:29:50.646494 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:50.646098 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54rfz" event={"ID":"d07b3bf4-0ebc-4039-beeb-09365fe4bc54","Type":"ContainerDied","Data":"70ae9f10ae07642d2dade21d8567ac99e43ad94b46b65146170e299ccd101053"} Aug 05 17:29:51.069094 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:51.069008 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:29:51.169556 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:51.169521 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:29:51.652552 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:51.652518 2579 generic.go:356] "Generic (PLEG): container finished" podID="d07b3bf4-0ebc-4039-beeb-09365fe4bc54" containerID="538dd058d138e931313eb011ebfc9634e9a0e88d217a64668f8efcb99ce0f62e" exitCode=0 Aug 05 17:29:51.652950 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:51.652607 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54rfz" event={"ID":"d07b3bf4-0ebc-4039-beeb-09365fe4bc54","Type":"ContainerDied","Data":"538dd058d138e931313eb011ebfc9634e9a0e88d217a64668f8efcb99ce0f62e"} Aug 05 17:29:52.761749 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:52.761713 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-p242d"] Aug 05 17:29:52.766248 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:52.766224 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-p242d" Aug 05 17:29:52.769195 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:52.769129 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Aug 05 17:29:52.769195 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:52.769181 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-pt8gf\"" Aug 05 17:29:52.769366 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:52.769257 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Aug 05 17:29:52.773598 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:52.773578 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-p242d"] Aug 05 17:29:52.803814 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:52.803789 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54rfz" Aug 05 17:29:52.880933 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:52.880898 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vfnd\" (UniqueName: \"kubernetes.io/projected/d07b3bf4-0ebc-4039-beeb-09365fe4bc54-kube-api-access-4vfnd\") pod \"d07b3bf4-0ebc-4039-beeb-09365fe4bc54\" (UID: \"d07b3bf4-0ebc-4039-beeb-09365fe4bc54\") " Aug 05 17:29:52.881130 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:52.880961 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d07b3bf4-0ebc-4039-beeb-09365fe4bc54-util\") pod \"d07b3bf4-0ebc-4039-beeb-09365fe4bc54\" (UID: \"d07b3bf4-0ebc-4039-beeb-09365fe4bc54\") " Aug 05 17:29:52.881130 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:52.881037 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d07b3bf4-0ebc-4039-beeb-09365fe4bc54-bundle\") pod \"d07b3bf4-0ebc-4039-beeb-09365fe4bc54\" (UID: \"d07b3bf4-0ebc-4039-beeb-09365fe4bc54\") " Aug 05 17:29:52.881287 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:52.881212 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgdl9\" (UniqueName: \"kubernetes.io/projected/6c1e1213-b9fc-484c-95ae-8112a6fd404d-kube-api-access-tgdl9\") pod \"cert-manager-cainjector-559cdd8c87-p242d\" (UID: \"6c1e1213-b9fc-484c-95ae-8112a6fd404d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p242d" Aug 05 17:29:52.881351 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:52.881317 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c1e1213-b9fc-484c-95ae-8112a6fd404d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-p242d\" (UID: \"6c1e1213-b9fc-484c-95ae-8112a6fd404d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p242d" Aug 05 17:29:52.881531 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:52.881493 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d07b3bf4-0ebc-4039-beeb-09365fe4bc54-bundle" (OuterVolumeSpecName: "bundle") pod "d07b3bf4-0ebc-4039-beeb-09365fe4bc54" (UID: "d07b3bf4-0ebc-4039-beeb-09365fe4bc54"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:29:52.883199 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:52.883175 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d07b3bf4-0ebc-4039-beeb-09365fe4bc54-kube-api-access-4vfnd" (OuterVolumeSpecName: "kube-api-access-4vfnd") pod "d07b3bf4-0ebc-4039-beeb-09365fe4bc54" (UID: "d07b3bf4-0ebc-4039-beeb-09365fe4bc54"). InnerVolumeSpecName "kube-api-access-4vfnd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:29:52.885565 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:52.885545 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d07b3bf4-0ebc-4039-beeb-09365fe4bc54-util" (OuterVolumeSpecName: "util") pod "d07b3bf4-0ebc-4039-beeb-09365fe4bc54" (UID: "d07b3bf4-0ebc-4039-beeb-09365fe4bc54"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:29:52.982552 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:52.982462 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgdl9\" (UniqueName: \"kubernetes.io/projected/6c1e1213-b9fc-484c-95ae-8112a6fd404d-kube-api-access-tgdl9\") pod \"cert-manager-cainjector-559cdd8c87-p242d\" (UID: \"6c1e1213-b9fc-484c-95ae-8112a6fd404d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p242d" Aug 05 17:29:52.982552 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:52.982526 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c1e1213-b9fc-484c-95ae-8112a6fd404d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-p242d\" (UID: \"6c1e1213-b9fc-484c-95ae-8112a6fd404d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p242d" Aug 05 17:29:52.982740 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:52.982591 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d07b3bf4-0ebc-4039-beeb-09365fe4bc54-bundle\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:29:52.982740 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:52.982601 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vfnd\" (UniqueName: \"kubernetes.io/projected/d07b3bf4-0ebc-4039-beeb-09365fe4bc54-kube-api-access-4vfnd\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:29:52.982740 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:52.982611 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d07b3bf4-0ebc-4039-beeb-09365fe4bc54-util\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:29:52.991567 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:52.991543 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c1e1213-b9fc-484c-95ae-8112a6fd404d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-p242d\" (UID: \"6c1e1213-b9fc-484c-95ae-8112a6fd404d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p242d" Aug 05 17:29:52.991690 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:52.991597 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgdl9\" (UniqueName: \"kubernetes.io/projected/6c1e1213-b9fc-484c-95ae-8112a6fd404d-kube-api-access-tgdl9\") pod \"cert-manager-cainjector-559cdd8c87-p242d\" (UID: \"6c1e1213-b9fc-484c-95ae-8112a6fd404d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p242d" Aug 05 17:29:53.100570 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:53.100537 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-p242d" Aug 05 17:29:53.232333 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:53.232290 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-p242d"] Aug 05 17:29:53.234968 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:29:53.234941 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c1e1213_b9fc_484c_95ae_8112a6fd404d.slice/crio-2b096a3c9c9a28b2c261ff5d1cac2bbd4ca31a164292b14955089c4f1b718fd5 WatchSource:0}: Error finding container 2b096a3c9c9a28b2c261ff5d1cac2bbd4ca31a164292b14955089c4f1b718fd5: Status 404 returned error can't find the container with id 2b096a3c9c9a28b2c261ff5d1cac2bbd4ca31a164292b14955089c4f1b718fd5 Aug 05 17:29:53.664043 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:53.664014 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54rfz" Aug 05 17:29:53.664043 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:53.664033 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f54rfz" event={"ID":"d07b3bf4-0ebc-4039-beeb-09365fe4bc54","Type":"ContainerDied","Data":"e615121bf74c507f5a6b729f39afae208d5a24645591682be7387cfe7ce4fc70"} Aug 05 17:29:53.664340 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:53.664076 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e615121bf74c507f5a6b729f39afae208d5a24645591682be7387cfe7ce4fc70" Aug 05 17:29:53.665328 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:53.665305 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-p242d" event={"ID":"6c1e1213-b9fc-484c-95ae-8112a6fd404d","Type":"ContainerStarted","Data":"2b096a3c9c9a28b2c261ff5d1cac2bbd4ca31a164292b14955089c4f1b718fd5"} Aug 05 17:29:56.290677 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:56.290543 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:29:56.681901 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:56.681866 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-p242d" event={"ID":"6c1e1213-b9fc-484c-95ae-8112a6fd404d","Type":"ContainerStarted","Data":"1ce7493eb90c1c9af0e6f5ae20485663c6950eb4e74d96f2b54ead3f66a42ed7"} Aug 05 17:29:56.699016 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:56.698967 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-p242d" podStartSLOduration=1.9909550089999999 podStartE2EDuration="4.69895251s" totalImagesPullingTime="2.707997501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:29:56.697760389 +0000 UTC m=+384.465140624" watchObservedRunningTime="2026-08-05 17:29:56.69895251 +0000 UTC m=+384.466332743" Aug 05 17:29:56.723699 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:56.723664 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:29:56.779997 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:56.779968 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:29:57.486829 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:57.486788 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:29:57.574371 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:57.574333 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:29:58.838918 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:58.838886 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ck5b4"] Aug 05 17:29:58.839295 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:58.839238 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d07b3bf4-0ebc-4039-beeb-09365fe4bc54" containerName="util" Aug 05 17:29:58.839295 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:58.839249 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d07b3bf4-0ebc-4039-beeb-09365fe4bc54" containerName="util" Aug 05 17:29:58.839295 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:58.839256 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d07b3bf4-0ebc-4039-beeb-09365fe4bc54" containerName="pull" Aug 05 17:29:58.839295 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:58.839263 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d07b3bf4-0ebc-4039-beeb-09365fe4bc54" containerName="pull" Aug 05 17:29:58.839295 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:58.839270 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d07b3bf4-0ebc-4039-beeb-09365fe4bc54" containerName="extract" Aug 05 17:29:58.839295 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:58.839275 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d07b3bf4-0ebc-4039-beeb-09365fe4bc54" containerName="extract" Aug 05 17:29:58.839498 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:58.839331 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d07b3bf4-0ebc-4039-beeb-09365fe4bc54" containerName="extract" Aug 05 17:29:58.841174 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:58.841135 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ck5b4" Aug 05 17:29:58.843784 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:58.843764 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-8qwtj\"" Aug 05 17:29:58.850174 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:58.850134 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ck5b4"] Aug 05 17:29:58.936066 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:58.936034 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhftq\" (UniqueName: \"kubernetes.io/projected/cde8f751-2526-4e3e-81ac-6ea6eef2bc22-kube-api-access-dhftq\") pod \"cert-manager-55b4d954d5-ck5b4\" (UID: \"cde8f751-2526-4e3e-81ac-6ea6eef2bc22\") " pod="cert-manager/cert-manager-55b4d954d5-ck5b4" Aug 05 17:29:58.936238 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:58.936108 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cde8f751-2526-4e3e-81ac-6ea6eef2bc22-bound-sa-token\") pod \"cert-manager-55b4d954d5-ck5b4\" (UID: \"cde8f751-2526-4e3e-81ac-6ea6eef2bc22\") " pod="cert-manager/cert-manager-55b4d954d5-ck5b4" Aug 05 17:29:59.037501 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:59.037468 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cde8f751-2526-4e3e-81ac-6ea6eef2bc22-bound-sa-token\") pod \"cert-manager-55b4d954d5-ck5b4\" (UID: \"cde8f751-2526-4e3e-81ac-6ea6eef2bc22\") " pod="cert-manager/cert-manager-55b4d954d5-ck5b4" Aug 05 17:29:59.037696 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:59.037534 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhftq\" (UniqueName: \"kubernetes.io/projected/cde8f751-2526-4e3e-81ac-6ea6eef2bc22-kube-api-access-dhftq\") pod \"cert-manager-55b4d954d5-ck5b4\" (UID: \"cde8f751-2526-4e3e-81ac-6ea6eef2bc22\") " pod="cert-manager/cert-manager-55b4d954d5-ck5b4" Aug 05 17:29:59.046056 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:59.046030 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cde8f751-2526-4e3e-81ac-6ea6eef2bc22-bound-sa-token\") pod \"cert-manager-55b4d954d5-ck5b4\" (UID: \"cde8f751-2526-4e3e-81ac-6ea6eef2bc22\") " pod="cert-manager/cert-manager-55b4d954d5-ck5b4" Aug 05 17:29:59.046316 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:59.046293 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhftq\" (UniqueName: \"kubernetes.io/projected/cde8f751-2526-4e3e-81ac-6ea6eef2bc22-kube-api-access-dhftq\") pod \"cert-manager-55b4d954d5-ck5b4\" (UID: \"cde8f751-2526-4e3e-81ac-6ea6eef2bc22\") " pod="cert-manager/cert-manager-55b4d954d5-ck5b4" Aug 05 17:29:59.150660 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:59.150571 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ck5b4" Aug 05 17:29:59.277416 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:59.277392 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ck5b4"] Aug 05 17:29:59.279658 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:29:59.279626 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcde8f751_2526_4e3e_81ac_6ea6eef2bc22.slice/crio-7662c24f48deb519716ed6c4fdc1e5f7ca8e9cb43a82ca1b9644872df7ef7414 WatchSource:0}: Error finding container 7662c24f48deb519716ed6c4fdc1e5f7ca8e9cb43a82ca1b9644872df7ef7414: Status 404 returned error can't find the container with id 7662c24f48deb519716ed6c4fdc1e5f7ca8e9cb43a82ca1b9644872df7ef7414 Aug 05 17:29:59.696280 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:59.696247 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ck5b4" event={"ID":"cde8f751-2526-4e3e-81ac-6ea6eef2bc22","Type":"ContainerStarted","Data":"ea5cfd509e0f45b4921b9183d84bf775746fde32d6f4ce1efd6d79a98128f15a"} Aug 05 17:29:59.696690 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:59.696290 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ck5b4" event={"ID":"cde8f751-2526-4e3e-81ac-6ea6eef2bc22","Type":"ContainerStarted","Data":"7662c24f48deb519716ed6c4fdc1e5f7ca8e9cb43a82ca1b9644872df7ef7414"} Aug 05 17:29:59.713531 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:29:59.713483 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-ck5b4" podStartSLOduration=1.713464262 podStartE2EDuration="1.713464262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:29:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:29:59.711428783 +0000 UTC m=+387.478809016" watchObservedRunningTime="2026-08-05 17:29:59.713464262 +0000 UTC m=+387.480844494" Aug 05 17:30:10.346248 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:10.346207 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:10.446974 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:10.446933 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:11.968758 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:11.968669 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh2h8z"] Aug 05 17:30:11.971460 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:11.971442 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh2h8z" Aug 05 17:30:11.974476 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:11.974452 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Aug 05 17:30:11.974703 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:11.974686 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Aug 05 17:30:11.975704 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:11.975688 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hhv6f\"" Aug 05 17:30:11.980768 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:11.980740 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh2h8z"] Aug 05 17:30:12.114007 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.113966 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:12.152075 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.152046 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43f4e7b3-d2f0-455d-9b98-b10cdd339d76-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh2h8z\" (UID: \"43f4e7b3-d2f0-455d-9b98-b10cdd339d76\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh2h8z" Aug 05 17:30:12.152266 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.152097 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qhcj\" (UniqueName: \"kubernetes.io/projected/43f4e7b3-d2f0-455d-9b98-b10cdd339d76-kube-api-access-7qhcj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh2h8z\" (UID: \"43f4e7b3-d2f0-455d-9b98-b10cdd339d76\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh2h8z" Aug 05 17:30:12.152266 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.152208 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43f4e7b3-d2f0-455d-9b98-b10cdd339d76-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh2h8z\" (UID: \"43f4e7b3-d2f0-455d-9b98-b10cdd339d76\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh2h8z" Aug 05 17:30:12.178111 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.178078 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6597fffd6-zvwp8"] Aug 05 17:30:12.180926 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.180892 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6597fffd6-zvwp8" Aug 05 17:30:12.195437 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.195408 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6597fffd6-zvwp8"] Aug 05 17:30:12.243192 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.243080 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:12.253331 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.253305 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43f4e7b3-d2f0-455d-9b98-b10cdd339d76-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh2h8z\" (UID: \"43f4e7b3-d2f0-455d-9b98-b10cdd339d76\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh2h8z" Aug 05 17:30:12.253449 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.253341 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43f4e7b3-d2f0-455d-9b98-b10cdd339d76-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh2h8z\" (UID: \"43f4e7b3-d2f0-455d-9b98-b10cdd339d76\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh2h8z" Aug 05 17:30:12.253449 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.253387 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qhcj\" (UniqueName: \"kubernetes.io/projected/43f4e7b3-d2f0-455d-9b98-b10cdd339d76-kube-api-access-7qhcj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh2h8z\" (UID: \"43f4e7b3-d2f0-455d-9b98-b10cdd339d76\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh2h8z" Aug 05 17:30:12.253683 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.253659 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43f4e7b3-d2f0-455d-9b98-b10cdd339d76-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh2h8z\" (UID: \"43f4e7b3-d2f0-455d-9b98-b10cdd339d76\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh2h8z" Aug 05 17:30:12.253759 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.253713 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43f4e7b3-d2f0-455d-9b98-b10cdd339d76-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh2h8z\" (UID: \"43f4e7b3-d2f0-455d-9b98-b10cdd339d76\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh2h8z" Aug 05 17:30:12.263102 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.263075 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qhcj\" (UniqueName: \"kubernetes.io/projected/43f4e7b3-d2f0-455d-9b98-b10cdd339d76-kube-api-access-7qhcj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh2h8z\" (UID: \"43f4e7b3-d2f0-455d-9b98-b10cdd339d76\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh2h8z" Aug 05 17:30:12.282684 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.282658 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh2h8z" Aug 05 17:30:12.345660 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.345587 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:12.354374 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.354346 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f1c7cff-70a3-43f4-b09b-6d34321ddea6-trusted-ca-bundle\") pod \"console-6597fffd6-zvwp8\" (UID: \"9f1c7cff-70a3-43f4-b09b-6d34321ddea6\") " pod="openshift-console/console-6597fffd6-zvwp8" Aug 05 17:30:12.354512 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.354386 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f1c7cff-70a3-43f4-b09b-6d34321ddea6-console-oauth-config\") pod \"console-6597fffd6-zvwp8\" (UID: \"9f1c7cff-70a3-43f4-b09b-6d34321ddea6\") " pod="openshift-console/console-6597fffd6-zvwp8" Aug 05 17:30:12.354512 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.354484 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqp2c\" (UniqueName: \"kubernetes.io/projected/9f1c7cff-70a3-43f4-b09b-6d34321ddea6-kube-api-access-pqp2c\") pod \"console-6597fffd6-zvwp8\" (UID: \"9f1c7cff-70a3-43f4-b09b-6d34321ddea6\") " pod="openshift-console/console-6597fffd6-zvwp8" Aug 05 17:30:12.354634 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.354519 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f1c7cff-70a3-43f4-b09b-6d34321ddea6-console-serving-cert\") pod \"console-6597fffd6-zvwp8\" (UID: \"9f1c7cff-70a3-43f4-b09b-6d34321ddea6\") " pod="openshift-console/console-6597fffd6-zvwp8" Aug 05 17:30:12.354634 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.354543 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f1c7cff-70a3-43f4-b09b-6d34321ddea6-oauth-serving-cert\") pod \"console-6597fffd6-zvwp8\" (UID: \"9f1c7cff-70a3-43f4-b09b-6d34321ddea6\") " pod="openshift-console/console-6597fffd6-zvwp8" Aug 05 17:30:12.354634 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.354578 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f1c7cff-70a3-43f4-b09b-6d34321ddea6-service-ca\") pod \"console-6597fffd6-zvwp8\" (UID: \"9f1c7cff-70a3-43f4-b09b-6d34321ddea6\") " pod="openshift-console/console-6597fffd6-zvwp8" Aug 05 17:30:12.354634 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.354619 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f1c7cff-70a3-43f4-b09b-6d34321ddea6-console-config\") pod \"console-6597fffd6-zvwp8\" (UID: \"9f1c7cff-70a3-43f4-b09b-6d34321ddea6\") " pod="openshift-console/console-6597fffd6-zvwp8" Aug 05 17:30:12.416169 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.416130 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh2h8z"] Aug 05 17:30:12.418162 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:30:12.418114 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43f4e7b3_d2f0_455d_9b98_b10cdd339d76.slice/crio-8ad43650df0f9f48ed1988a9ea1a38a8ddad8675b73c0a90382a843a8e6a19d9 WatchSource:0}: Error finding container 8ad43650df0f9f48ed1988a9ea1a38a8ddad8675b73c0a90382a843a8e6a19d9: Status 404 returned error can't find the container with id 8ad43650df0f9f48ed1988a9ea1a38a8ddad8675b73c0a90382a843a8e6a19d9 Aug 05 17:30:12.445909 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.445878 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:12.455002 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.454979 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f1c7cff-70a3-43f4-b09b-6d34321ddea6-console-serving-cert\") pod \"console-6597fffd6-zvwp8\" (UID: \"9f1c7cff-70a3-43f4-b09b-6d34321ddea6\") " pod="openshift-console/console-6597fffd6-zvwp8" Aug 05 17:30:12.455090 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.455015 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f1c7cff-70a3-43f4-b09b-6d34321ddea6-oauth-serving-cert\") pod \"console-6597fffd6-zvwp8\" (UID: \"9f1c7cff-70a3-43f4-b09b-6d34321ddea6\") " pod="openshift-console/console-6597fffd6-zvwp8" Aug 05 17:30:12.455200 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.455178 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f1c7cff-70a3-43f4-b09b-6d34321ddea6-service-ca\") pod \"console-6597fffd6-zvwp8\" (UID: \"9f1c7cff-70a3-43f4-b09b-6d34321ddea6\") " pod="openshift-console/console-6597fffd6-zvwp8" Aug 05 17:30:12.455333 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.455249 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f1c7cff-70a3-43f4-b09b-6d34321ddea6-console-config\") pod \"console-6597fffd6-zvwp8\" (UID: \"9f1c7cff-70a3-43f4-b09b-6d34321ddea6\") " pod="openshift-console/console-6597fffd6-zvwp8" Aug 05 17:30:12.455333 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.455302 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f1c7cff-70a3-43f4-b09b-6d34321ddea6-trusted-ca-bundle\") pod \"console-6597fffd6-zvwp8\" (UID: \"9f1c7cff-70a3-43f4-b09b-6d34321ddea6\") " pod="openshift-console/console-6597fffd6-zvwp8" Aug 05 17:30:12.455526 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.455335 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f1c7cff-70a3-43f4-b09b-6d34321ddea6-console-oauth-config\") pod \"console-6597fffd6-zvwp8\" (UID: \"9f1c7cff-70a3-43f4-b09b-6d34321ddea6\") " pod="openshift-console/console-6597fffd6-zvwp8" Aug 05 17:30:12.455526 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.455405 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqp2c\" (UniqueName: \"kubernetes.io/projected/9f1c7cff-70a3-43f4-b09b-6d34321ddea6-kube-api-access-pqp2c\") pod \"console-6597fffd6-zvwp8\" (UID: \"9f1c7cff-70a3-43f4-b09b-6d34321ddea6\") " pod="openshift-console/console-6597fffd6-zvwp8" Aug 05 17:30:12.456606 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.456376 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9f1c7cff-70a3-43f4-b09b-6d34321ddea6-oauth-serving-cert\") pod \"console-6597fffd6-zvwp8\" (UID: \"9f1c7cff-70a3-43f4-b09b-6d34321ddea6\") " pod="openshift-console/console-6597fffd6-zvwp8" Aug 05 17:30:12.456715 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.456694 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9f1c7cff-70a3-43f4-b09b-6d34321ddea6-service-ca\") pod \"console-6597fffd6-zvwp8\" (UID: \"9f1c7cff-70a3-43f4-b09b-6d34321ddea6\") " pod="openshift-console/console-6597fffd6-zvwp8" Aug 05 17:30:12.456786 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.456761 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9f1c7cff-70a3-43f4-b09b-6d34321ddea6-console-config\") pod \"console-6597fffd6-zvwp8\" (UID: \"9f1c7cff-70a3-43f4-b09b-6d34321ddea6\") " pod="openshift-console/console-6597fffd6-zvwp8" Aug 05 17:30:12.457005 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.456979 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f1c7cff-70a3-43f4-b09b-6d34321ddea6-trusted-ca-bundle\") pod \"console-6597fffd6-zvwp8\" (UID: \"9f1c7cff-70a3-43f4-b09b-6d34321ddea6\") " pod="openshift-console/console-6597fffd6-zvwp8" Aug 05 17:30:12.457988 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.457969 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9f1c7cff-70a3-43f4-b09b-6d34321ddea6-console-serving-cert\") pod \"console-6597fffd6-zvwp8\" (UID: \"9f1c7cff-70a3-43f4-b09b-6d34321ddea6\") " pod="openshift-console/console-6597fffd6-zvwp8" Aug 05 17:30:12.458625 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.458605 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9f1c7cff-70a3-43f4-b09b-6d34321ddea6-console-oauth-config\") pod \"console-6597fffd6-zvwp8\" (UID: \"9f1c7cff-70a3-43f4-b09b-6d34321ddea6\") " pod="openshift-console/console-6597fffd6-zvwp8" Aug 05 17:30:12.463860 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.463732 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqp2c\" (UniqueName: \"kubernetes.io/projected/9f1c7cff-70a3-43f4-b09b-6d34321ddea6-kube-api-access-pqp2c\") pod \"console-6597fffd6-zvwp8\" (UID: \"9f1c7cff-70a3-43f4-b09b-6d34321ddea6\") " pod="openshift-console/console-6597fffd6-zvwp8" Aug 05 17:30:12.491236 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.491200 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6597fffd6-zvwp8" Aug 05 17:30:12.632738 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.632708 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6597fffd6-zvwp8"] Aug 05 17:30:12.635035 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:30:12.635011 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f1c7cff_70a3_43f4_b09b_6d34321ddea6.slice/crio-901a83572799cf03529bbf0cbe96eaaba4605dd2ba73baf159d95c7a57c035ad WatchSource:0}: Error finding container 901a83572799cf03529bbf0cbe96eaaba4605dd2ba73baf159d95c7a57c035ad: Status 404 returned error can't find the container with id 901a83572799cf03529bbf0cbe96eaaba4605dd2ba73baf159d95c7a57c035ad Aug 05 17:30:12.758278 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.758187 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6597fffd6-zvwp8" event={"ID":"9f1c7cff-70a3-43f4-b09b-6d34321ddea6","Type":"ContainerStarted","Data":"43999789409a71a8b9d57bd6e9ce4d2af971c424a72661070a2479ca662c6880"} Aug 05 17:30:12.758278 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.758241 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6597fffd6-zvwp8" event={"ID":"9f1c7cff-70a3-43f4-b09b-6d34321ddea6","Type":"ContainerStarted","Data":"901a83572799cf03529bbf0cbe96eaaba4605dd2ba73baf159d95c7a57c035ad"} Aug 05 17:30:12.759691 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.759666 2579 generic.go:356] "Generic (PLEG): container finished" podID="43f4e7b3-d2f0-455d-9b98-b10cdd339d76" containerID="cfba3435dcc0a9a358ca57db0784183d75c560da0659b025296570ff05543fb9" exitCode=0 Aug 05 17:30:12.759804 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.759714 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh2h8z" event={"ID":"43f4e7b3-d2f0-455d-9b98-b10cdd339d76","Type":"ContainerDied","Data":"cfba3435dcc0a9a358ca57db0784183d75c560da0659b025296570ff05543fb9"} Aug 05 17:30:12.759804 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.759743 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh2h8z" event={"ID":"43f4e7b3-d2f0-455d-9b98-b10cdd339d76","Type":"ContainerStarted","Data":"8ad43650df0f9f48ed1988a9ea1a38a8ddad8675b73c0a90382a843a8e6a19d9"} Aug 05 17:30:12.778620 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.778579 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6597fffd6-zvwp8" podStartSLOduration=0.7785635 podStartE2EDuration="778.5635ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:30:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:30:12.77670799 +0000 UTC m=+400.544088223" watchObservedRunningTime="2026-08-05 17:30:12.7785635 +0000 UTC m=+400.545943732" Aug 05 17:30:12.974937 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:12.974895 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:13.030005 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:13.029908 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:13.766841 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:13.766810 2579 generic.go:356] "Generic (PLEG): container finished" podID="43f4e7b3-d2f0-455d-9b98-b10cdd339d76" containerID="1cd5a9b432aaf11d4c1227388428daaa0a20155675c1b7135d4c121dbb7cb530" exitCode=0 Aug 05 17:30:13.767048 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:13.766865 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh2h8z" event={"ID":"43f4e7b3-d2f0-455d-9b98-b10cdd339d76","Type":"ContainerDied","Data":"1cd5a9b432aaf11d4c1227388428daaa0a20155675c1b7135d4c121dbb7cb530"} Aug 05 17:30:14.773477 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:14.773444 2579 generic.go:356] "Generic (PLEG): container finished" podID="43f4e7b3-d2f0-455d-9b98-b10cdd339d76" containerID="05b8279fc440f962f6cabef672c8ad891be49bd2adfde87d6a9dc1bab55da8a5" exitCode=0 Aug 05 17:30:14.773993 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:14.773487 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh2h8z" event={"ID":"43f4e7b3-d2f0-455d-9b98-b10cdd339d76","Type":"ContainerDied","Data":"05b8279fc440f962f6cabef672c8ad891be49bd2adfde87d6a9dc1bab55da8a5"} Aug 05 17:30:15.916031 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:15.916006 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh2h8z" Aug 05 17:30:15.981559 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:15.981525 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43f4e7b3-d2f0-455d-9b98-b10cdd339d76-bundle\") pod \"43f4e7b3-d2f0-455d-9b98-b10cdd339d76\" (UID: \"43f4e7b3-d2f0-455d-9b98-b10cdd339d76\") " Aug 05 17:30:15.981768 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:15.981599 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43f4e7b3-d2f0-455d-9b98-b10cdd339d76-util\") pod \"43f4e7b3-d2f0-455d-9b98-b10cdd339d76\" (UID: \"43f4e7b3-d2f0-455d-9b98-b10cdd339d76\") " Aug 05 17:30:15.981768 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:15.981634 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qhcj\" (UniqueName: \"kubernetes.io/projected/43f4e7b3-d2f0-455d-9b98-b10cdd339d76-kube-api-access-7qhcj\") pod \"43f4e7b3-d2f0-455d-9b98-b10cdd339d76\" (UID: \"43f4e7b3-d2f0-455d-9b98-b10cdd339d76\") " Aug 05 17:30:15.982325 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:15.982293 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43f4e7b3-d2f0-455d-9b98-b10cdd339d76-bundle" (OuterVolumeSpecName: "bundle") pod "43f4e7b3-d2f0-455d-9b98-b10cdd339d76" (UID: "43f4e7b3-d2f0-455d-9b98-b10cdd339d76"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:30:15.983772 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:15.983748 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43f4e7b3-d2f0-455d-9b98-b10cdd339d76-kube-api-access-7qhcj" (OuterVolumeSpecName: "kube-api-access-7qhcj") pod "43f4e7b3-d2f0-455d-9b98-b10cdd339d76" (UID: "43f4e7b3-d2f0-455d-9b98-b10cdd339d76"). InnerVolumeSpecName "kube-api-access-7qhcj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:30:15.989675 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:15.989649 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43f4e7b3-d2f0-455d-9b98-b10cdd339d76-util" (OuterVolumeSpecName: "util") pod "43f4e7b3-d2f0-455d-9b98-b10cdd339d76" (UID: "43f4e7b3-d2f0-455d-9b98-b10cdd339d76"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:30:16.082465 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:16.082425 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43f4e7b3-d2f0-455d-9b98-b10cdd339d76-util\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:30:16.082465 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:16.082463 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qhcj\" (UniqueName: \"kubernetes.io/projected/43f4e7b3-d2f0-455d-9b98-b10cdd339d76-kube-api-access-7qhcj\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:30:16.082708 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:16.082476 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43f4e7b3-d2f0-455d-9b98-b10cdd339d76-bundle\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:30:16.784940 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:16.784908 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh2h8z" event={"ID":"43f4e7b3-d2f0-455d-9b98-b10cdd339d76","Type":"ContainerDied","Data":"8ad43650df0f9f48ed1988a9ea1a38a8ddad8675b73c0a90382a843a8e6a19d9"} Aug 05 17:30:16.784940 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:16.784934 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afh2h8z" Aug 05 17:30:16.785135 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:16.784952 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ad43650df0f9f48ed1988a9ea1a38a8ddad8675b73c0a90382a843a8e6a19d9" Aug 05 17:30:22.491522 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:22.491478 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6597fffd6-zvwp8" Aug 05 17:30:22.491972 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:22.491567 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6597fffd6-zvwp8" Aug 05 17:30:22.496508 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:22.496486 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6597fffd6-zvwp8" Aug 05 17:30:22.816630 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:22.816546 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6597fffd6-zvwp8" Aug 05 17:30:22.880250 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:22.880211 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5768d8f559-6pzk8"] Aug 05 17:30:22.997685 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:22.997656 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:23.112440 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:23.112391 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:23.212258 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:23.212217 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:24.332869 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:24.332831 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:24.471491 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:24.471456 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:25.087656 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:25.087618 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:25.223645 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:25.223609 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:25.749710 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:25.749668 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:25.975682 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:25.975643 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:26.075441 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.075396 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:26.102281 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.102243 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-666c5d8f77-7fnj9"] Aug 05 17:30:26.102690 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.102672 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43f4e7b3-d2f0-455d-9b98-b10cdd339d76" containerName="extract" Aug 05 17:30:26.102777 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.102692 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="43f4e7b3-d2f0-455d-9b98-b10cdd339d76" containerName="extract" Aug 05 17:30:26.102777 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.102716 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43f4e7b3-d2f0-455d-9b98-b10cdd339d76" containerName="util" Aug 05 17:30:26.102777 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.102724 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="43f4e7b3-d2f0-455d-9b98-b10cdd339d76" containerName="util" Aug 05 17:30:26.102777 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.102736 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43f4e7b3-d2f0-455d-9b98-b10cdd339d76" containerName="pull" Aug 05 17:30:26.102777 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.102744 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="43f4e7b3-d2f0-455d-9b98-b10cdd339d76" containerName="pull" Aug 05 17:30:26.103032 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.102821 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="43f4e7b3-d2f0-455d-9b98-b10cdd339d76" containerName="extract" Aug 05 17:30:26.106136 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.106116 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-666c5d8f77-7fnj9" Aug 05 17:30:26.109515 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.109493 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pjvn6\"" Aug 05 17:30:26.109643 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.109493 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Aug 05 17:30:26.109643 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.109570 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Aug 05 17:30:26.109643 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.109635 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Aug 05 17:30:26.110057 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.110044 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Aug 05 17:30:26.116186 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.116163 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-666c5d8f77-7fnj9"] Aug 05 17:30:26.167199 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.167166 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh2q9\" (UniqueName: \"kubernetes.io/projected/244dd5ea-2775-42ac-8a83-02c4a9cf942b-kube-api-access-xh2q9\") pod \"opendatahub-operator-controller-manager-666c5d8f77-7fnj9\" (UID: \"244dd5ea-2775-42ac-8a83-02c4a9cf942b\") " pod="opendatahub/opendatahub-operator-controller-manager-666c5d8f77-7fnj9" Aug 05 17:30:26.167386 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.167227 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/244dd5ea-2775-42ac-8a83-02c4a9cf942b-webhook-cert\") pod \"opendatahub-operator-controller-manager-666c5d8f77-7fnj9\" (UID: \"244dd5ea-2775-42ac-8a83-02c4a9cf942b\") " pod="opendatahub/opendatahub-operator-controller-manager-666c5d8f77-7fnj9" Aug 05 17:30:26.167386 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.167264 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/244dd5ea-2775-42ac-8a83-02c4a9cf942b-manifests\") pod \"opendatahub-operator-controller-manager-666c5d8f77-7fnj9\" (UID: \"244dd5ea-2775-42ac-8a83-02c4a9cf942b\") " pod="opendatahub/opendatahub-operator-controller-manager-666c5d8f77-7fnj9" Aug 05 17:30:26.167386 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.167288 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/244dd5ea-2775-42ac-8a83-02c4a9cf942b-tmp\") pod \"opendatahub-operator-controller-manager-666c5d8f77-7fnj9\" (UID: \"244dd5ea-2775-42ac-8a83-02c4a9cf942b\") " pod="opendatahub/opendatahub-operator-controller-manager-666c5d8f77-7fnj9" Aug 05 17:30:26.167386 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.167310 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/244dd5ea-2775-42ac-8a83-02c4a9cf942b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-666c5d8f77-7fnj9\" (UID: \"244dd5ea-2775-42ac-8a83-02c4a9cf942b\") " pod="opendatahub/opendatahub-operator-controller-manager-666c5d8f77-7fnj9" Aug 05 17:30:26.268360 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.268324 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/244dd5ea-2775-42ac-8a83-02c4a9cf942b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-666c5d8f77-7fnj9\" (UID: \"244dd5ea-2775-42ac-8a83-02c4a9cf942b\") " pod="opendatahub/opendatahub-operator-controller-manager-666c5d8f77-7fnj9" Aug 05 17:30:26.268542 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.268398 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh2q9\" (UniqueName: \"kubernetes.io/projected/244dd5ea-2775-42ac-8a83-02c4a9cf942b-kube-api-access-xh2q9\") pod \"opendatahub-operator-controller-manager-666c5d8f77-7fnj9\" (UID: \"244dd5ea-2775-42ac-8a83-02c4a9cf942b\") " pod="opendatahub/opendatahub-operator-controller-manager-666c5d8f77-7fnj9" Aug 05 17:30:26.268542 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.268432 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/244dd5ea-2775-42ac-8a83-02c4a9cf942b-webhook-cert\") pod \"opendatahub-operator-controller-manager-666c5d8f77-7fnj9\" (UID: \"244dd5ea-2775-42ac-8a83-02c4a9cf942b\") " pod="opendatahub/opendatahub-operator-controller-manager-666c5d8f77-7fnj9" Aug 05 17:30:26.268542 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.268454 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/244dd5ea-2775-42ac-8a83-02c4a9cf942b-manifests\") pod \"opendatahub-operator-controller-manager-666c5d8f77-7fnj9\" (UID: \"244dd5ea-2775-42ac-8a83-02c4a9cf942b\") " pod="opendatahub/opendatahub-operator-controller-manager-666c5d8f77-7fnj9" Aug 05 17:30:26.268542 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.268489 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/244dd5ea-2775-42ac-8a83-02c4a9cf942b-tmp\") pod \"opendatahub-operator-controller-manager-666c5d8f77-7fnj9\" (UID: \"244dd5ea-2775-42ac-8a83-02c4a9cf942b\") " pod="opendatahub/opendatahub-operator-controller-manager-666c5d8f77-7fnj9" Aug 05 17:30:26.268914 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.268888 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/244dd5ea-2775-42ac-8a83-02c4a9cf942b-manifests\") pod \"opendatahub-operator-controller-manager-666c5d8f77-7fnj9\" (UID: \"244dd5ea-2775-42ac-8a83-02c4a9cf942b\") " pod="opendatahub/opendatahub-operator-controller-manager-666c5d8f77-7fnj9" Aug 05 17:30:26.270799 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.270776 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/244dd5ea-2775-42ac-8a83-02c4a9cf942b-tmp\") pod \"opendatahub-operator-controller-manager-666c5d8f77-7fnj9\" (UID: \"244dd5ea-2775-42ac-8a83-02c4a9cf942b\") " pod="opendatahub/opendatahub-operator-controller-manager-666c5d8f77-7fnj9" Aug 05 17:30:26.270981 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.270963 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/244dd5ea-2775-42ac-8a83-02c4a9cf942b-webhook-cert\") pod \"opendatahub-operator-controller-manager-666c5d8f77-7fnj9\" (UID: \"244dd5ea-2775-42ac-8a83-02c4a9cf942b\") " pod="opendatahub/opendatahub-operator-controller-manager-666c5d8f77-7fnj9" Aug 05 17:30:26.271025 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.270991 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/244dd5ea-2775-42ac-8a83-02c4a9cf942b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-666c5d8f77-7fnj9\" (UID: \"244dd5ea-2775-42ac-8a83-02c4a9cf942b\") " pod="opendatahub/opendatahub-operator-controller-manager-666c5d8f77-7fnj9" Aug 05 17:30:26.287470 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.287443 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh2q9\" (UniqueName: \"kubernetes.io/projected/244dd5ea-2775-42ac-8a83-02c4a9cf942b-kube-api-access-xh2q9\") pod \"opendatahub-operator-controller-manager-666c5d8f77-7fnj9\" (UID: \"244dd5ea-2775-42ac-8a83-02c4a9cf942b\") " pod="opendatahub/opendatahub-operator-controller-manager-666c5d8f77-7fnj9" Aug 05 17:30:26.306299 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.306262 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:26.403865 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.403775 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:26.417657 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.417630 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-666c5d8f77-7fnj9" Aug 05 17:30:26.507124 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.507081 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:26.559100 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.559069 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-666c5d8f77-7fnj9"] Aug 05 17:30:26.562472 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:30:26.562448 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod244dd5ea_2775_42ac_8a83_02c4a9cf942b.slice/crio-0594431fe6443d832790200fe998f3a2bcd035d0a6853fb482e202d51d2e6377 WatchSource:0}: Error finding container 0594431fe6443d832790200fe998f3a2bcd035d0a6853fb482e202d51d2e6377: Status 404 returned error can't find the container with id 0594431fe6443d832790200fe998f3a2bcd035d0a6853fb482e202d51d2e6377 Aug 05 17:30:26.572214 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.572182 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:26.650122 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.650087 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:26.832370 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:26.832341 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-666c5d8f77-7fnj9" event={"ID":"244dd5ea-2775-42ac-8a83-02c4a9cf942b","Type":"ContainerStarted","Data":"0594431fe6443d832790200fe998f3a2bcd035d0a6853fb482e202d51d2e6377"} Aug 05 17:30:29.850985 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:29.850952 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-666c5d8f77-7fnj9" event={"ID":"244dd5ea-2775-42ac-8a83-02c4a9cf942b","Type":"ContainerStarted","Data":"378ae63e09293aeacd7fa98188895386f86a766a5d0d1d4d463f459a31658390"} Aug 05 17:30:30.857877 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:30.857783 2579 generic.go:356] "Generic (PLEG): container finished" podID="244dd5ea-2775-42ac-8a83-02c4a9cf942b" containerID="378ae63e09293aeacd7fa98188895386f86a766a5d0d1d4d463f459a31658390" exitCode=0 Aug 05 17:30:30.857877 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:30.857864 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-666c5d8f77-7fnj9" event={"ID":"244dd5ea-2775-42ac-8a83-02c4a9cf942b","Type":"ContainerDied","Data":"378ae63e09293aeacd7fa98188895386f86a766a5d0d1d4d463f459a31658390"} Aug 05 17:30:31.871603 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:31.871566 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-666c5d8f77-7fnj9" event={"ID":"244dd5ea-2775-42ac-8a83-02c4a9cf942b","Type":"ContainerStarted","Data":"9d04c88361b4d7aa36d089ac14920af0ff3c342e8a5f8533441bd2288d2dcdc5"} Aug 05 17:30:31.872026 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:31.871725 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-666c5d8f77-7fnj9" Aug 05 17:30:31.908511 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:31.908453 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-666c5d8f77-7fnj9" podStartSLOduration=1.396784109 podStartE2EDuration="5.908436671s" totalImagesPullingTime="3.463862905s" totalInitContainerRuntime="1.047789657s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:30:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:30:31.906113328 +0000 UTC m=+419.673493601" watchObservedRunningTime="2026-08-05 17:30:31.908436671 +0000 UTC m=+419.675816904" Aug 05 17:30:32.012245 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:32.012196 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:42.649762 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:42.649730 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:42.723705 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:42.723674 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:42.878977 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:42.878946 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-666c5d8f77-7fnj9" Aug 05 17:30:45.709552 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:45.709522 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:45.810616 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:45.810581 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:46.094571 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.094540 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:46.222700 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.222664 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-57859c69d8-k7mhq"] Aug 05 17:30:46.228688 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.228667 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57859c69d8-k7mhq" Aug 05 17:30:46.231832 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.231807 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Aug 05 17:30:46.232100 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.232077 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Aug 05 17:30:46.245002 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.244972 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57859c69d8-k7mhq"] Aug 05 17:30:46.250665 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.250638 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:46.350213 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.350110 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eed65b12-a5e5-474e-b542-02d9a1a34d48-tmp\") pod \"kube-auth-proxy-57859c69d8-k7mhq\" (UID: \"eed65b12-a5e5-474e-b542-02d9a1a34d48\") " pod="openshift-ingress/kube-auth-proxy-57859c69d8-k7mhq" Aug 05 17:30:46.350410 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.350268 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eed65b12-a5e5-474e-b542-02d9a1a34d48-tls-certs\") pod \"kube-auth-proxy-57859c69d8-k7mhq\" (UID: \"eed65b12-a5e5-474e-b542-02d9a1a34d48\") " pod="openshift-ingress/kube-auth-proxy-57859c69d8-k7mhq" Aug 05 17:30:46.350410 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.350324 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5whrz\" (UniqueName: \"kubernetes.io/projected/eed65b12-a5e5-474e-b542-02d9a1a34d48-kube-api-access-5whrz\") pod \"kube-auth-proxy-57859c69d8-k7mhq\" (UID: \"eed65b12-a5e5-474e-b542-02d9a1a34d48\") " pod="openshift-ingress/kube-auth-proxy-57859c69d8-k7mhq" Aug 05 17:30:46.451457 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.451416 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5whrz\" (UniqueName: \"kubernetes.io/projected/eed65b12-a5e5-474e-b542-02d9a1a34d48-kube-api-access-5whrz\") pod \"kube-auth-proxy-57859c69d8-k7mhq\" (UID: \"eed65b12-a5e5-474e-b542-02d9a1a34d48\") " pod="openshift-ingress/kube-auth-proxy-57859c69d8-k7mhq" Aug 05 17:30:46.451662 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.451507 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eed65b12-a5e5-474e-b542-02d9a1a34d48-tmp\") pod \"kube-auth-proxy-57859c69d8-k7mhq\" (UID: \"eed65b12-a5e5-474e-b542-02d9a1a34d48\") " pod="openshift-ingress/kube-auth-proxy-57859c69d8-k7mhq" Aug 05 17:30:46.451662 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.451567 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eed65b12-a5e5-474e-b542-02d9a1a34d48-tls-certs\") pod \"kube-auth-proxy-57859c69d8-k7mhq\" (UID: \"eed65b12-a5e5-474e-b542-02d9a1a34d48\") " pod="openshift-ingress/kube-auth-proxy-57859c69d8-k7mhq" Aug 05 17:30:46.454228 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.454190 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eed65b12-a5e5-474e-b542-02d9a1a34d48-tmp\") pod \"kube-auth-proxy-57859c69d8-k7mhq\" (UID: \"eed65b12-a5e5-474e-b542-02d9a1a34d48\") " pod="openshift-ingress/kube-auth-proxy-57859c69d8-k7mhq" Aug 05 17:30:46.454966 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.454940 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eed65b12-a5e5-474e-b542-02d9a1a34d48-tls-certs\") pod \"kube-auth-proxy-57859c69d8-k7mhq\" (UID: \"eed65b12-a5e5-474e-b542-02d9a1a34d48\") " pod="openshift-ingress/kube-auth-proxy-57859c69d8-k7mhq" Aug 05 17:30:46.457428 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.457407 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9b569"] Aug 05 17:30:46.460372 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.460354 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9b569" Aug 05 17:30:46.463493 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.463470 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Aug 05 17:30:46.463600 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.463496 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-mdblf\"" Aug 05 17:30:46.465008 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.464991 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5whrz\" (UniqueName: \"kubernetes.io/projected/eed65b12-a5e5-474e-b542-02d9a1a34d48-kube-api-access-5whrz\") pod \"kube-auth-proxy-57859c69d8-k7mhq\" (UID: \"eed65b12-a5e5-474e-b542-02d9a1a34d48\") " pod="openshift-ingress/kube-auth-proxy-57859c69d8-k7mhq" Aug 05 17:30:46.476798 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.476735 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9b569"] Aug 05 17:30:46.502951 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.502922 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:46.538591 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.538564 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57859c69d8-k7mhq" Aug 05 17:30:46.553133 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.553101 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98d99d9f-8019-466e-acac-1d45f96e5cb4-cert\") pod \"odh-model-controller-7998c67dc4-9b569\" (UID: \"98d99d9f-8019-466e-acac-1d45f96e5cb4\") " pod="opendatahub/odh-model-controller-7998c67dc4-9b569" Aug 05 17:30:46.553308 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.553276 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2kjt\" (UniqueName: \"kubernetes.io/projected/98d99d9f-8019-466e-acac-1d45f96e5cb4-kube-api-access-t2kjt\") pod \"odh-model-controller-7998c67dc4-9b569\" (UID: \"98d99d9f-8019-466e-acac-1d45f96e5cb4\") " pod="opendatahub/odh-model-controller-7998c67dc4-9b569" Aug 05 17:30:46.610928 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.610819 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:46.654207 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.654127 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98d99d9f-8019-466e-acac-1d45f96e5cb4-cert\") pod \"odh-model-controller-7998c67dc4-9b569\" (UID: \"98d99d9f-8019-466e-acac-1d45f96e5cb4\") " pod="opendatahub/odh-model-controller-7998c67dc4-9b569" Aug 05 17:30:46.654207 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.654198 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2kjt\" (UniqueName: \"kubernetes.io/projected/98d99d9f-8019-466e-acac-1d45f96e5cb4-kube-api-access-t2kjt\") pod \"odh-model-controller-7998c67dc4-9b569\" (UID: \"98d99d9f-8019-466e-acac-1d45f96e5cb4\") " pod="opendatahub/odh-model-controller-7998c67dc4-9b569" Aug 05 17:30:46.658903 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.658363 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98d99d9f-8019-466e-acac-1d45f96e5cb4-cert\") pod \"odh-model-controller-7998c67dc4-9b569\" (UID: \"98d99d9f-8019-466e-acac-1d45f96e5cb4\") " pod="opendatahub/odh-model-controller-7998c67dc4-9b569" Aug 05 17:30:46.670034 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.670003 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2kjt\" (UniqueName: \"kubernetes.io/projected/98d99d9f-8019-466e-acac-1d45f96e5cb4-kube-api-access-t2kjt\") pod \"odh-model-controller-7998c67dc4-9b569\" (UID: \"98d99d9f-8019-466e-acac-1d45f96e5cb4\") " pod="opendatahub/odh-model-controller-7998c67dc4-9b569" Aug 05 17:30:46.698842 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.698818 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57859c69d8-k7mhq"] Aug 05 17:30:46.700842 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.700807 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:46.701563 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:30:46.701541 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeed65b12_a5e5_474e_b542_02d9a1a34d48.slice/crio-afc5fb75fef9ecaf57dd9d408cef30365b2a3539200381d53176017711356ef7 WatchSource:0}: Error finding container afc5fb75fef9ecaf57dd9d408cef30365b2a3539200381d53176017711356ef7: Status 404 returned error can't find the container with id afc5fb75fef9ecaf57dd9d408cef30365b2a3539200381d53176017711356ef7 Aug 05 17:30:46.768516 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.768466 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:46.791780 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.791745 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9b569" Aug 05 17:30:46.953668 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.953635 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57859c69d8-k7mhq" event={"ID":"eed65b12-a5e5-474e-b542-02d9a1a34d48","Type":"ContainerStarted","Data":"afc5fb75fef9ecaf57dd9d408cef30365b2a3539200381d53176017711356ef7"} Aug 05 17:30:46.977456 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:30:46.977418 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98d99d9f_8019_466e_acac_1d45f96e5cb4.slice/crio-72a7696ca96e60ee4cda91f323530030a14ee9d72e114c568a23cf5cea56dcc6 WatchSource:0}: Error finding container 72a7696ca96e60ee4cda91f323530030a14ee9d72e114c568a23cf5cea56dcc6: Status 404 returned error can't find the container with id 72a7696ca96e60ee4cda91f323530030a14ee9d72e114c568a23cf5cea56dcc6 Aug 05 17:30:46.993623 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:46.993585 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9b569"] Aug 05 17:30:47.310949 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.310847 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:47.338534 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.338496 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-x7b84"] Aug 05 17:30:47.341314 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.341293 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-x7b84" Aug 05 17:30:47.344588 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.344559 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-p7dbs\"" Aug 05 17:30:47.345165 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.345121 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Aug 05 17:30:47.355797 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.355767 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-x7b84"] Aug 05 17:30:47.461567 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.461531 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/350757b4-2a8f-46bd-8a4d-ca0498e4061e-tls-certs\") pod \"model-serving-api-54d89bd5fc-x7b84\" (UID: \"350757b4-2a8f-46bd-8a4d-ca0498e4061e\") " pod="opendatahub/model-serving-api-54d89bd5fc-x7b84" Aug 05 17:30:47.461740 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.461693 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t96rn\" (UniqueName: \"kubernetes.io/projected/350757b4-2a8f-46bd-8a4d-ca0498e4061e-kube-api-access-t96rn\") pod \"model-serving-api-54d89bd5fc-x7b84\" (UID: \"350757b4-2a8f-46bd-8a4d-ca0498e4061e\") " pod="opendatahub/model-serving-api-54d89bd5fc-x7b84" Aug 05 17:30:47.555590 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.555554 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:47.562951 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.562416 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/350757b4-2a8f-46bd-8a4d-ca0498e4061e-tls-certs\") pod \"model-serving-api-54d89bd5fc-x7b84\" (UID: \"350757b4-2a8f-46bd-8a4d-ca0498e4061e\") " pod="opendatahub/model-serving-api-54d89bd5fc-x7b84" Aug 05 17:30:47.562951 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.562547 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t96rn\" (UniqueName: \"kubernetes.io/projected/350757b4-2a8f-46bd-8a4d-ca0498e4061e-kube-api-access-t96rn\") pod \"model-serving-api-54d89bd5fc-x7b84\" (UID: \"350757b4-2a8f-46bd-8a4d-ca0498e4061e\") " pod="opendatahub/model-serving-api-54d89bd5fc-x7b84" Aug 05 17:30:47.565743 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.565709 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/350757b4-2a8f-46bd-8a4d-ca0498e4061e-tls-certs\") pod \"model-serving-api-54d89bd5fc-x7b84\" (UID: \"350757b4-2a8f-46bd-8a4d-ca0498e4061e\") " pod="opendatahub/model-serving-api-54d89bd5fc-x7b84" Aug 05 17:30:47.594821 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.594736 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t96rn\" (UniqueName: \"kubernetes.io/projected/350757b4-2a8f-46bd-8a4d-ca0498e4061e-kube-api-access-t96rn\") pod \"model-serving-api-54d89bd5fc-x7b84\" (UID: \"350757b4-2a8f-46bd-8a4d-ca0498e4061e\") " pod="opendatahub/model-serving-api-54d89bd5fc-x7b84" Aug 05 17:30:47.655612 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.655581 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-x7b84" Aug 05 17:30:47.695963 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.695771 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:47.703523 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.701696 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn"] Aug 05 17:30:47.705690 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.705669 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" Aug 05 17:30:47.711442 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.708812 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-4p9lh\"" Aug 05 17:30:47.711442 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.708833 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Aug 05 17:30:47.711442 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.709352 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Aug 05 17:30:47.711442 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.709386 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Aug 05 17:30:47.711442 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.709621 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Aug 05 17:30:47.723319 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.722638 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn"] Aug 05 17:30:47.835399 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.835217 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:47.866221 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.865881 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/77cae7e0-58cc-45de-b0e8-893b5bebd004-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-j69tn\" (UID: \"77cae7e0-58cc-45de-b0e8-893b5bebd004\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" Aug 05 17:30:47.866221 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.865938 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/77cae7e0-58cc-45de-b0e8-893b5bebd004-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-j69tn\" (UID: \"77cae7e0-58cc-45de-b0e8-893b5bebd004\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" Aug 05 17:30:47.866221 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.865986 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/77cae7e0-58cc-45de-b0e8-893b5bebd004-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-j69tn\" (UID: \"77cae7e0-58cc-45de-b0e8-893b5bebd004\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" Aug 05 17:30:47.866221 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.866030 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/77cae7e0-58cc-45de-b0e8-893b5bebd004-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-j69tn\" (UID: \"77cae7e0-58cc-45de-b0e8-893b5bebd004\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" Aug 05 17:30:47.866221 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.866099 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/77cae7e0-58cc-45de-b0e8-893b5bebd004-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-j69tn\" (UID: \"77cae7e0-58cc-45de-b0e8-893b5bebd004\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" Aug 05 17:30:47.867087 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.866914 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77cae7e0-58cc-45de-b0e8-893b5bebd004-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-j69tn\" (UID: \"77cae7e0-58cc-45de-b0e8-893b5bebd004\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" Aug 05 17:30:47.867087 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.866954 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpbdm\" (UniqueName: \"kubernetes.io/projected/77cae7e0-58cc-45de-b0e8-893b5bebd004-kube-api-access-dpbdm\") pod \"istiod-openshift-gateway-7b7995d5cd-j69tn\" (UID: \"77cae7e0-58cc-45de-b0e8-893b5bebd004\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" Aug 05 17:30:47.872943 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.872918 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-x7b84"] Aug 05 17:30:47.875412 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:30:47.875382 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod350757b4_2a8f_46bd_8a4d_ca0498e4061e.slice/crio-036d63de8b5e6ee66293fdd429a6328ff3f928747012b461f13ff54ea43e77e2 WatchSource:0}: Error finding container 036d63de8b5e6ee66293fdd429a6328ff3f928747012b461f13ff54ea43e77e2: Status 404 returned error can't find the container with id 036d63de8b5e6ee66293fdd429a6328ff3f928747012b461f13ff54ea43e77e2 Aug 05 17:30:47.902702 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.902519 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5768d8f559-6pzk8" podUID="f5a21ba1-306d-44e7-99e5-363af52cf24f" containerName="console" containerID="cri-o://2a2a0f71c093f71347221d4939cb84f2d6f2c3ee9f8733d7452af18c19a88ed4" gracePeriod=15 Aug 05 17:30:47.966968 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.966926 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9b569" event={"ID":"98d99d9f-8019-466e-acac-1d45f96e5cb4","Type":"ContainerStarted","Data":"72a7696ca96e60ee4cda91f323530030a14ee9d72e114c568a23cf5cea56dcc6"} Aug 05 17:30:47.967818 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.967757 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77cae7e0-58cc-45de-b0e8-893b5bebd004-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-j69tn\" (UID: \"77cae7e0-58cc-45de-b0e8-893b5bebd004\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" Aug 05 17:30:47.967818 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.967798 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpbdm\" (UniqueName: \"kubernetes.io/projected/77cae7e0-58cc-45de-b0e8-893b5bebd004-kube-api-access-dpbdm\") pod \"istiod-openshift-gateway-7b7995d5cd-j69tn\" (UID: \"77cae7e0-58cc-45de-b0e8-893b5bebd004\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" Aug 05 17:30:47.968005 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.967935 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/77cae7e0-58cc-45de-b0e8-893b5bebd004-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-j69tn\" (UID: \"77cae7e0-58cc-45de-b0e8-893b5bebd004\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" Aug 05 17:30:47.968005 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.967980 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/77cae7e0-58cc-45de-b0e8-893b5bebd004-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-j69tn\" (UID: \"77cae7e0-58cc-45de-b0e8-893b5bebd004\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" Aug 05 17:30:47.968850 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.968023 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/77cae7e0-58cc-45de-b0e8-893b5bebd004-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-j69tn\" (UID: \"77cae7e0-58cc-45de-b0e8-893b5bebd004\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" Aug 05 17:30:47.968850 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.968062 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/77cae7e0-58cc-45de-b0e8-893b5bebd004-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-j69tn\" (UID: \"77cae7e0-58cc-45de-b0e8-893b5bebd004\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" Aug 05 17:30:47.968850 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.968130 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/77cae7e0-58cc-45de-b0e8-893b5bebd004-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-j69tn\" (UID: \"77cae7e0-58cc-45de-b0e8-893b5bebd004\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" Aug 05 17:30:47.969071 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.969048 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/77cae7e0-58cc-45de-b0e8-893b5bebd004-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-j69tn\" (UID: \"77cae7e0-58cc-45de-b0e8-893b5bebd004\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" Aug 05 17:30:47.970247 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.970219 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-x7b84" event={"ID":"350757b4-2a8f-46bd-8a4d-ca0498e4061e","Type":"ContainerStarted","Data":"036d63de8b5e6ee66293fdd429a6328ff3f928747012b461f13ff54ea43e77e2"} Aug 05 17:30:47.971224 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.971182 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/77cae7e0-58cc-45de-b0e8-893b5bebd004-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-j69tn\" (UID: \"77cae7e0-58cc-45de-b0e8-893b5bebd004\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" Aug 05 17:30:47.974644 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.974618 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/77cae7e0-58cc-45de-b0e8-893b5bebd004-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-j69tn\" (UID: \"77cae7e0-58cc-45de-b0e8-893b5bebd004\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" Aug 05 17:30:47.977299 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.977266 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/77cae7e0-58cc-45de-b0e8-893b5bebd004-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-j69tn\" (UID: \"77cae7e0-58cc-45de-b0e8-893b5bebd004\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" Aug 05 17:30:47.977426 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.977405 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/77cae7e0-58cc-45de-b0e8-893b5bebd004-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-j69tn\" (UID: \"77cae7e0-58cc-45de-b0e8-893b5bebd004\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" Aug 05 17:30:47.977930 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.977912 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77cae7e0-58cc-45de-b0e8-893b5bebd004-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-j69tn\" (UID: \"77cae7e0-58cc-45de-b0e8-893b5bebd004\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" Aug 05 17:30:47.978831 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:47.978790 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpbdm\" (UniqueName: \"kubernetes.io/projected/77cae7e0-58cc-45de-b0e8-893b5bebd004-kube-api-access-dpbdm\") pod \"istiod-openshift-gateway-7b7995d5cd-j69tn\" (UID: \"77cae7e0-58cc-45de-b0e8-893b5bebd004\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" Aug 05 17:30:48.025846 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:48.025417 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" Aug 05 17:30:48.236713 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:48.236680 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5768d8f559-6pzk8" Aug 05 17:30:48.249327 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:48.249287 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn"] Aug 05 17:30:48.373170 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:48.373060 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f5a21ba1-306d-44e7-99e5-363af52cf24f-console-serving-cert\") pod \"f5a21ba1-306d-44e7-99e5-363af52cf24f\" (UID: \"f5a21ba1-306d-44e7-99e5-363af52cf24f\") " Aug 05 17:30:48.373170 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:48.373117 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f5a21ba1-306d-44e7-99e5-363af52cf24f-console-config\") pod \"f5a21ba1-306d-44e7-99e5-363af52cf24f\" (UID: \"f5a21ba1-306d-44e7-99e5-363af52cf24f\") " Aug 05 17:30:48.373170 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:48.373164 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f5a21ba1-306d-44e7-99e5-363af52cf24f-oauth-serving-cert\") pod \"f5a21ba1-306d-44e7-99e5-363af52cf24f\" (UID: \"f5a21ba1-306d-44e7-99e5-363af52cf24f\") " Aug 05 17:30:48.373448 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:48.373229 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5a21ba1-306d-44e7-99e5-363af52cf24f-trusted-ca-bundle\") pod \"f5a21ba1-306d-44e7-99e5-363af52cf24f\" (UID: \"f5a21ba1-306d-44e7-99e5-363af52cf24f\") " Aug 05 17:30:48.373448 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:48.373271 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2slh2\" (UniqueName: \"kubernetes.io/projected/f5a21ba1-306d-44e7-99e5-363af52cf24f-kube-api-access-2slh2\") pod \"f5a21ba1-306d-44e7-99e5-363af52cf24f\" (UID: \"f5a21ba1-306d-44e7-99e5-363af52cf24f\") " Aug 05 17:30:48.373448 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:48.373315 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f5a21ba1-306d-44e7-99e5-363af52cf24f-service-ca\") pod \"f5a21ba1-306d-44e7-99e5-363af52cf24f\" (UID: \"f5a21ba1-306d-44e7-99e5-363af52cf24f\") " Aug 05 17:30:48.373448 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:48.373361 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f5a21ba1-306d-44e7-99e5-363af52cf24f-console-oauth-config\") pod \"f5a21ba1-306d-44e7-99e5-363af52cf24f\" (UID: \"f5a21ba1-306d-44e7-99e5-363af52cf24f\") " Aug 05 17:30:48.374812 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:48.374539 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5a21ba1-306d-44e7-99e5-363af52cf24f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f5a21ba1-306d-44e7-99e5-363af52cf24f" (UID: "f5a21ba1-306d-44e7-99e5-363af52cf24f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:30:48.374954 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:48.374926 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5a21ba1-306d-44e7-99e5-363af52cf24f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f5a21ba1-306d-44e7-99e5-363af52cf24f" (UID: "f5a21ba1-306d-44e7-99e5-363af52cf24f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:30:48.375677 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:48.375498 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5a21ba1-306d-44e7-99e5-363af52cf24f-service-ca" (OuterVolumeSpecName: "service-ca") pod "f5a21ba1-306d-44e7-99e5-363af52cf24f" (UID: "f5a21ba1-306d-44e7-99e5-363af52cf24f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:30:48.375677 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:48.375648 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5a21ba1-306d-44e7-99e5-363af52cf24f-console-config" (OuterVolumeSpecName: "console-config") pod "f5a21ba1-306d-44e7-99e5-363af52cf24f" (UID: "f5a21ba1-306d-44e7-99e5-363af52cf24f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:30:48.379181 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:48.379155 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5a21ba1-306d-44e7-99e5-363af52cf24f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f5a21ba1-306d-44e7-99e5-363af52cf24f" (UID: "f5a21ba1-306d-44e7-99e5-363af52cf24f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:30:48.379297 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:48.379272 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5a21ba1-306d-44e7-99e5-363af52cf24f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f5a21ba1-306d-44e7-99e5-363af52cf24f" (UID: "f5a21ba1-306d-44e7-99e5-363af52cf24f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:30:48.381058 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:48.381033 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5a21ba1-306d-44e7-99e5-363af52cf24f-kube-api-access-2slh2" (OuterVolumeSpecName: "kube-api-access-2slh2") pod "f5a21ba1-306d-44e7-99e5-363af52cf24f" (UID: "f5a21ba1-306d-44e7-99e5-363af52cf24f"). InnerVolumeSpecName "kube-api-access-2slh2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:30:48.474633 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:48.474604 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5a21ba1-306d-44e7-99e5-363af52cf24f-trusted-ca-bundle\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:30:48.474765 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:48.474641 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2slh2\" (UniqueName: \"kubernetes.io/projected/f5a21ba1-306d-44e7-99e5-363af52cf24f-kube-api-access-2slh2\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:30:48.474765 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:48.474656 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f5a21ba1-306d-44e7-99e5-363af52cf24f-service-ca\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:30:48.474765 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:48.474669 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f5a21ba1-306d-44e7-99e5-363af52cf24f-console-oauth-config\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:30:48.474765 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:48.474680 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f5a21ba1-306d-44e7-99e5-363af52cf24f-console-serving-cert\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:30:48.474765 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:48.474692 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f5a21ba1-306d-44e7-99e5-363af52cf24f-console-config\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:30:48.474765 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:48.474705 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f5a21ba1-306d-44e7-99e5-363af52cf24f-oauth-serving-cert\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:30:48.986218 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:48.985012 2579 generic.go:356] "Generic (PLEG): container finished" podID="f5a21ba1-306d-44e7-99e5-363af52cf24f" containerID="2a2a0f71c093f71347221d4939cb84f2d6f2c3ee9f8733d7452af18c19a88ed4" exitCode=0 Aug 05 17:30:48.986218 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:48.985131 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5768d8f559-6pzk8" event={"ID":"f5a21ba1-306d-44e7-99e5-363af52cf24f","Type":"ContainerDied","Data":"2a2a0f71c093f71347221d4939cb84f2d6f2c3ee9f8733d7452af18c19a88ed4"} Aug 05 17:30:48.986218 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:48.985201 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5768d8f559-6pzk8" event={"ID":"f5a21ba1-306d-44e7-99e5-363af52cf24f","Type":"ContainerDied","Data":"f3b0f31fdf2ad1747eb98a956d6831c4bce295d5be8b90f7a5dcde281b453e58"} Aug 05 17:30:48.986218 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:48.985232 2579 scope.go:117] "RemoveContainer" containerID="2a2a0f71c093f71347221d4939cb84f2d6f2c3ee9f8733d7452af18c19a88ed4" Aug 05 17:30:48.986218 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:48.985419 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5768d8f559-6pzk8" Aug 05 17:30:48.995258 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:48.995226 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" event={"ID":"77cae7e0-58cc-45de-b0e8-893b5bebd004","Type":"ContainerStarted","Data":"3107293de290c9dec0cabc7d73ee4edb43b728fe2bb38702ca225f3f79cb9d84"} Aug 05 17:30:49.001065 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:49.000984 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:49.007016 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:49.006984 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5768d8f559-6pzk8"] Aug 05 17:30:49.012825 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:49.012764 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5768d8f559-6pzk8"] Aug 05 17:30:49.954031 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:49.953997 2579 scope.go:117] "RemoveContainer" containerID="2a2a0f71c093f71347221d4939cb84f2d6f2c3ee9f8733d7452af18c19a88ed4" Aug 05 17:30:49.954420 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:30:49.954398 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a2a0f71c093f71347221d4939cb84f2d6f2c3ee9f8733d7452af18c19a88ed4\": container with ID starting with 2a2a0f71c093f71347221d4939cb84f2d6f2c3ee9f8733d7452af18c19a88ed4 not found: ID does not exist" containerID="2a2a0f71c093f71347221d4939cb84f2d6f2c3ee9f8733d7452af18c19a88ed4" Aug 05 17:30:49.954516 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:49.954431 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a2a0f71c093f71347221d4939cb84f2d6f2c3ee9f8733d7452af18c19a88ed4"} err="failed to get container status \"2a2a0f71c093f71347221d4939cb84f2d6f2c3ee9f8733d7452af18c19a88ed4\": rpc error: code = NotFound desc = could not find container \"2a2a0f71c093f71347221d4939cb84f2d6f2c3ee9f8733d7452af18c19a88ed4\": container with ID starting with 2a2a0f71c093f71347221d4939cb84f2d6f2c3ee9f8733d7452af18c19a88ed4 not found: ID does not exist" Aug 05 17:30:50.771364 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:50.771316 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5a21ba1-306d-44e7-99e5-363af52cf24f" path="/var/lib/kubelet/pods/f5a21ba1-306d-44e7-99e5-363af52cf24f/volumes" Aug 05 17:30:53.026075 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:53.026038 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9b569" event={"ID":"98d99d9f-8019-466e-acac-1d45f96e5cb4","Type":"ContainerStarted","Data":"0ce54b80f1f483b35f333bc30f60a0317e0cd7ecc1e37bf8efa2947a09e964bb"} Aug 05 17:30:53.026567 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:53.026478 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-9b569" Aug 05 17:30:53.028577 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:53.028549 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57859c69d8-k7mhq" event={"ID":"eed65b12-a5e5-474e-b542-02d9a1a34d48","Type":"ContainerStarted","Data":"53bbde5e173a76fb15999343620f6391f6ffcdfe03d599610d44c72465fb41d3"} Aug 05 17:30:53.030584 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:53.030560 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-x7b84" event={"ID":"350757b4-2a8f-46bd-8a4d-ca0498e4061e","Type":"ContainerStarted","Data":"312508010cedac844e2d1af0972d922edc43f8101e7778988ba23afcd7409943"} Aug 05 17:30:53.030717 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:53.030689 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-x7b84" Aug 05 17:30:53.045616 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:53.045562 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-9b569" podStartSLOduration=1.572752515 podStartE2EDuration="7.045542323s" totalImagesPullingTime="5.472789808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:30:53.043616366 +0000 UTC m=+440.810996600" watchObservedRunningTime="2026-08-05 17:30:53.045542323 +0000 UTC m=+440.812922556" Aug 05 17:30:53.084044 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:53.083670 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-57859c69d8-k7mhq" podStartSLOduration=1.381139443 podStartE2EDuration="7.083649942s" totalImagesPullingTime="5.702510499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:30:53.063612186 +0000 UTC m=+440.830992421" watchObservedRunningTime="2026-08-05 17:30:53.083649942 +0000 UTC m=+440.851030175" Aug 05 17:30:53.084360 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:53.084317 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-x7b84" podStartSLOduration=1.572261083 podStartE2EDuration="6.084307854s" totalImagesPullingTime="4.512046771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:30:53.082927976 +0000 UTC m=+440.850308210" watchObservedRunningTime="2026-08-05 17:30:53.084307854 +0000 UTC m=+440.851688089" Aug 05 17:30:53.292822 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:53.292700 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:53.895024 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:53.894982 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Aug 05 17:30:53.895181 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:53.895054 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Aug 05 17:30:54.038655 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:54.038618 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" event={"ID":"77cae7e0-58cc-45de-b0e8-893b5bebd004","Type":"ContainerStarted","Data":"8081e69461c71e6869bb130210def3b48f5d8d8d6d9c36834b023719f09b9b08"} Aug 05 17:30:54.039167 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:54.038941 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" Aug 05 17:30:54.040808 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:54.040779 2579 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-j69tn container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Aug 05 17:30:54.041122 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:54.040837 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" podUID="77cae7e0-58cc-45de-b0e8-893b5bebd004" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:30:54.061914 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:54.061862 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" podStartSLOduration=1.424761425 podStartE2EDuration="7.061847209s" totalImagesPullingTime="5.637085784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:30:54.059448606 +0000 UTC m=+441.826828841" watchObservedRunningTime="2026-08-05 17:30:54.061847209 +0000 UTC m=+441.829227441" Aug 05 17:30:54.601097 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:54.601043 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:54.704371 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:54.704322 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:54.960704 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:54.960574 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:55.014014 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.013981 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz"] Aug 05 17:30:55.014754 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.014734 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5a21ba1-306d-44e7-99e5-363af52cf24f" containerName="console" Aug 05 17:30:55.014754 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.014756 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5a21ba1-306d-44e7-99e5-363af52cf24f" containerName="console" Aug 05 17:30:55.014971 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.014957 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5a21ba1-306d-44e7-99e5-363af52cf24f" containerName="console" Aug 05 17:30:55.018479 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.018457 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" Aug 05 17:30:55.023887 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.023852 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-ldwv7\"" Aug 05 17:30:55.044403 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.044370 2579 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-j69tn container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Aug 05 17:30:55.044749 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.044438 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" podUID="77cae7e0-58cc-45de-b0e8-893b5bebd004" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:30:55.049663 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.049638 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz"] Aug 05 17:30:55.083951 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.083914 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:55.144922 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.144889 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ec49604-1ddb-4059-bed3-18d19cf55508-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqlggz\" (UID: \"0ec49604-1ddb-4059-bed3-18d19cf55508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" Aug 05 17:30:55.145092 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.144934 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ec49604-1ddb-4059-bed3-18d19cf55508-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqlggz\" (UID: \"0ec49604-1ddb-4059-bed3-18d19cf55508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" Aug 05 17:30:55.145092 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.144956 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ec49604-1ddb-4059-bed3-18d19cf55508-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqlggz\" (UID: \"0ec49604-1ddb-4059-bed3-18d19cf55508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" Aug 05 17:30:55.145092 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.145064 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht86k\" (UniqueName: \"kubernetes.io/projected/0ec49604-1ddb-4059-bed3-18d19cf55508-kube-api-access-ht86k\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqlggz\" (UID: \"0ec49604-1ddb-4059-bed3-18d19cf55508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" Aug 05 17:30:55.145317 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.145211 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ec49604-1ddb-4059-bed3-18d19cf55508-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqlggz\" (UID: \"0ec49604-1ddb-4059-bed3-18d19cf55508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" Aug 05 17:30:55.145317 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.145280 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ec49604-1ddb-4059-bed3-18d19cf55508-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqlggz\" (UID: \"0ec49604-1ddb-4059-bed3-18d19cf55508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" Aug 05 17:30:55.145437 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.145327 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ec49604-1ddb-4059-bed3-18d19cf55508-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqlggz\" (UID: \"0ec49604-1ddb-4059-bed3-18d19cf55508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" Aug 05 17:30:55.145437 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.145357 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ec49604-1ddb-4059-bed3-18d19cf55508-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqlggz\" (UID: \"0ec49604-1ddb-4059-bed3-18d19cf55508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" Aug 05 17:30:55.145437 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.145422 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ec49604-1ddb-4059-bed3-18d19cf55508-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqlggz\" (UID: \"0ec49604-1ddb-4059-bed3-18d19cf55508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" Aug 05 17:30:55.184310 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.184275 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:55.246181 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.246066 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ec49604-1ddb-4059-bed3-18d19cf55508-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqlggz\" (UID: \"0ec49604-1ddb-4059-bed3-18d19cf55508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" Aug 05 17:30:55.246181 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.246124 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ec49604-1ddb-4059-bed3-18d19cf55508-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqlggz\" (UID: \"0ec49604-1ddb-4059-bed3-18d19cf55508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" Aug 05 17:30:55.246392 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.246283 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ec49604-1ddb-4059-bed3-18d19cf55508-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqlggz\" (UID: \"0ec49604-1ddb-4059-bed3-18d19cf55508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" Aug 05 17:30:55.246392 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.246329 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ec49604-1ddb-4059-bed3-18d19cf55508-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqlggz\" (UID: \"0ec49604-1ddb-4059-bed3-18d19cf55508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" Aug 05 17:30:55.246392 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.246363 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ec49604-1ddb-4059-bed3-18d19cf55508-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqlggz\" (UID: \"0ec49604-1ddb-4059-bed3-18d19cf55508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" Aug 05 17:30:55.246550 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.246414 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ec49604-1ddb-4059-bed3-18d19cf55508-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqlggz\" (UID: \"0ec49604-1ddb-4059-bed3-18d19cf55508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" Aug 05 17:30:55.246550 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.246440 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ec49604-1ddb-4059-bed3-18d19cf55508-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqlggz\" (UID: \"0ec49604-1ddb-4059-bed3-18d19cf55508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" Aug 05 17:30:55.246550 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.246520 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ec49604-1ddb-4059-bed3-18d19cf55508-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqlggz\" (UID: \"0ec49604-1ddb-4059-bed3-18d19cf55508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" Aug 05 17:30:55.246697 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.246566 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht86k\" (UniqueName: \"kubernetes.io/projected/0ec49604-1ddb-4059-bed3-18d19cf55508-kube-api-access-ht86k\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqlggz\" (UID: \"0ec49604-1ddb-4059-bed3-18d19cf55508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" Aug 05 17:30:55.246697 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.246580 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ec49604-1ddb-4059-bed3-18d19cf55508-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqlggz\" (UID: \"0ec49604-1ddb-4059-bed3-18d19cf55508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" Aug 05 17:30:55.246815 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.246742 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ec49604-1ddb-4059-bed3-18d19cf55508-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqlggz\" (UID: \"0ec49604-1ddb-4059-bed3-18d19cf55508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" Aug 05 17:30:55.246935 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.246914 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ec49604-1ddb-4059-bed3-18d19cf55508-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqlggz\" (UID: \"0ec49604-1ddb-4059-bed3-18d19cf55508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" Aug 05 17:30:55.247004 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.246960 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ec49604-1ddb-4059-bed3-18d19cf55508-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqlggz\" (UID: \"0ec49604-1ddb-4059-bed3-18d19cf55508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" Aug 05 17:30:55.247087 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.247063 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ec49604-1ddb-4059-bed3-18d19cf55508-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqlggz\" (UID: \"0ec49604-1ddb-4059-bed3-18d19cf55508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" Aug 05 17:30:55.248686 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.248658 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ec49604-1ddb-4059-bed3-18d19cf55508-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqlggz\" (UID: \"0ec49604-1ddb-4059-bed3-18d19cf55508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" Aug 05 17:30:55.248912 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.248896 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ec49604-1ddb-4059-bed3-18d19cf55508-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqlggz\" (UID: \"0ec49604-1ddb-4059-bed3-18d19cf55508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" Aug 05 17:30:55.255598 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.255563 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ec49604-1ddb-4059-bed3-18d19cf55508-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqlggz\" (UID: \"0ec49604-1ddb-4059-bed3-18d19cf55508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" Aug 05 17:30:55.255735 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.255659 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht86k\" (UniqueName: \"kubernetes.io/projected/0ec49604-1ddb-4059-bed3-18d19cf55508-kube-api-access-ht86k\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cqlggz\" (UID: \"0ec49604-1ddb-4059-bed3-18d19cf55508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" Aug 05 17:30:55.330811 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.330770 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" Aug 05 17:30:55.525731 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:55.525707 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz"] Aug 05 17:30:55.527384 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:30:55.527360 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ec49604_1ddb_4059_bed3_18d19cf55508.slice/crio-8ef552cca0ea55616386936a315751766441fa448f3a4324846fddec4130860d WatchSource:0}: Error finding container 8ef552cca0ea55616386936a315751766441fa448f3a4324846fddec4130860d: Status 404 returned error can't find the container with id 8ef552cca0ea55616386936a315751766441fa448f3a4324846fddec4130860d Aug 05 17:30:56.049625 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:56.049592 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" event={"ID":"0ec49604-1ddb-4059-bed3-18d19cf55508","Type":"ContainerStarted","Data":"8ef552cca0ea55616386936a315751766441fa448f3a4324846fddec4130860d"} Aug 05 17:30:58.045307 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:58.045277 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" Aug 05 17:30:58.234387 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:58.234346 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Aug 05 17:30:58.234529 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:58.234432 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Aug 05 17:30:58.234529 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:58.234483 2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Aug 05 17:30:58.308347 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:58.308249 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:58.375671 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:58.375637 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-g6lqz"] Aug 05 17:30:58.379343 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:58.379321 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g6lqz" Aug 05 17:30:58.382790 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:58.382739 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-d58rz\"" Aug 05 17:30:58.383125 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:58.383105 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Aug 05 17:30:58.387837 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:58.387667 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-2h5k2"] Aug 05 17:30:58.392612 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:58.392589 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2h5k2" Aug 05 17:30:58.397251 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:58.397233 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Aug 05 17:30:58.397615 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:58.397358 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-54pjs\"" Aug 05 17:30:58.399482 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:58.399459 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-g6lqz"] Aug 05 17:30:58.404959 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:58.404756 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-2h5k2"] Aug 05 17:30:58.466056 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:58.465680 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:58.478852 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:58.478817 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ebd8d0da-d7b5-4375-8e19-3cf7bcc3ec3f-cert\") pod \"kserve-controller-manager-d6f4b65b8-g6lqz\" (UID: \"ebd8d0da-d7b5-4375-8e19-3cf7bcc3ec3f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g6lqz" Aug 05 17:30:58.479041 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:58.478939 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5crq7\" (UniqueName: \"kubernetes.io/projected/7e2ace6e-6626-4a0a-938b-5d15ac6e3ac1-kube-api-access-5crq7\") pod \"llmisvc-controller-manager-777c6bd7d5-2h5k2\" (UID: \"7e2ace6e-6626-4a0a-938b-5d15ac6e3ac1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2h5k2" Aug 05 17:30:58.479118 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:58.479043 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flvpf\" (UniqueName: \"kubernetes.io/projected/ebd8d0da-d7b5-4375-8e19-3cf7bcc3ec3f-kube-api-access-flvpf\") pod \"kserve-controller-manager-d6f4b65b8-g6lqz\" (UID: \"ebd8d0da-d7b5-4375-8e19-3cf7bcc3ec3f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g6lqz" Aug 05 17:30:58.479118 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:58.479075 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e2ace6e-6626-4a0a-938b-5d15ac6e3ac1-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2h5k2\" (UID: \"7e2ace6e-6626-4a0a-938b-5d15ac6e3ac1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2h5k2" Aug 05 17:30:58.580160 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:58.580107 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flvpf\" (UniqueName: \"kubernetes.io/projected/ebd8d0da-d7b5-4375-8e19-3cf7bcc3ec3f-kube-api-access-flvpf\") pod \"kserve-controller-manager-d6f4b65b8-g6lqz\" (UID: \"ebd8d0da-d7b5-4375-8e19-3cf7bcc3ec3f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g6lqz" Aug 05 17:30:58.580434 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:58.580411 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e2ace6e-6626-4a0a-938b-5d15ac6e3ac1-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2h5k2\" (UID: \"7e2ace6e-6626-4a0a-938b-5d15ac6e3ac1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2h5k2" Aug 05 17:30:58.580601 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:30:58.580569 2579 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Aug 05 17:30:58.580727 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:58.580616 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ebd8d0da-d7b5-4375-8e19-3cf7bcc3ec3f-cert\") pod \"kserve-controller-manager-d6f4b65b8-g6lqz\" (UID: \"ebd8d0da-d7b5-4375-8e19-3cf7bcc3ec3f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g6lqz" Aug 05 17:30:58.580727 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:30:58.580644 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e2ace6e-6626-4a0a-938b-5d15ac6e3ac1-cert podName:7e2ace6e-6626-4a0a-938b-5d15ac6e3ac1 nodeName:}" failed. No retries permitted until 2026-08-05 17:30:59.080623076 +0000 UTC m=+446.848003304 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7e2ace6e-6626-4a0a-938b-5d15ac6e3ac1-cert") pod "llmisvc-controller-manager-777c6bd7d5-2h5k2" (UID: "7e2ace6e-6626-4a0a-938b-5d15ac6e3ac1") : secret "llmisvc-webhook-server-cert" not found Aug 05 17:30:58.580727 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:30:58.580699 2579 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Aug 05 17:30:58.580727 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:58.580700 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5crq7\" (UniqueName: \"kubernetes.io/projected/7e2ace6e-6626-4a0a-938b-5d15ac6e3ac1-kube-api-access-5crq7\") pod \"llmisvc-controller-manager-777c6bd7d5-2h5k2\" (UID: \"7e2ace6e-6626-4a0a-938b-5d15ac6e3ac1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2h5k2" Aug 05 17:30:58.580962 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:30:58.580749 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebd8d0da-d7b5-4375-8e19-3cf7bcc3ec3f-cert podName:ebd8d0da-d7b5-4375-8e19-3cf7bcc3ec3f nodeName:}" failed. No retries permitted until 2026-08-05 17:30:59.080732913 +0000 UTC m=+446.848113129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ebd8d0da-d7b5-4375-8e19-3cf7bcc3ec3f-cert") pod "kserve-controller-manager-d6f4b65b8-g6lqz" (UID: "ebd8d0da-d7b5-4375-8e19-3cf7bcc3ec3f") : secret "kserve-webhook-server-cert" not found Aug 05 17:30:58.601504 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:58.601473 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5crq7\" (UniqueName: \"kubernetes.io/projected/7e2ace6e-6626-4a0a-938b-5d15ac6e3ac1-kube-api-access-5crq7\") pod \"llmisvc-controller-manager-777c6bd7d5-2h5k2\" (UID: \"7e2ace6e-6626-4a0a-938b-5d15ac6e3ac1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2h5k2" Aug 05 17:30:58.602008 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:58.601962 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flvpf\" (UniqueName: \"kubernetes.io/projected/ebd8d0da-d7b5-4375-8e19-3cf7bcc3ec3f-kube-api-access-flvpf\") pod \"kserve-controller-manager-d6f4b65b8-g6lqz\" (UID: \"ebd8d0da-d7b5-4375-8e19-3cf7bcc3ec3f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g6lqz" Aug 05 17:30:58.690350 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:58.690312 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:58.820221 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:58.820177 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:58.908629 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:58.908538 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:59.007433 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:59.007400 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:30:59.070334 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:59.070297 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" event={"ID":"0ec49604-1ddb-4059-bed3-18d19cf55508","Type":"ContainerStarted","Data":"38a17e1760ba06a5ca9d66813519d7987b49fe36d70a83ef9f4ff79795ee63c1"} Aug 05 17:30:59.084411 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:59.084382 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ebd8d0da-d7b5-4375-8e19-3cf7bcc3ec3f-cert\") pod \"kserve-controller-manager-d6f4b65b8-g6lqz\" (UID: \"ebd8d0da-d7b5-4375-8e19-3cf7bcc3ec3f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g6lqz" Aug 05 17:30:59.084563 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:59.084450 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e2ace6e-6626-4a0a-938b-5d15ac6e3ac1-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2h5k2\" (UID: \"7e2ace6e-6626-4a0a-938b-5d15ac6e3ac1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2h5k2" Aug 05 17:30:59.086964 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:59.086933 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e2ace6e-6626-4a0a-938b-5d15ac6e3ac1-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2h5k2\" (UID: \"7e2ace6e-6626-4a0a-938b-5d15ac6e3ac1\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2h5k2" Aug 05 17:30:59.087119 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:59.086960 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ebd8d0da-d7b5-4375-8e19-3cf7bcc3ec3f-cert\") pod \"kserve-controller-manager-d6f4b65b8-g6lqz\" (UID: \"ebd8d0da-d7b5-4375-8e19-3cf7bcc3ec3f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g6lqz" Aug 05 17:30:59.126955 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:59.126907 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" podStartSLOduration=2.422798882 podStartE2EDuration="5.126891434s" totalImagesPullingTime="2.704092552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:30:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:30:59.123828414 +0000 UTC m=+446.891208647" watchObservedRunningTime="2026-08-05 17:30:59.126891434 +0000 UTC m=+446.894271667" Aug 05 17:30:59.292738 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:59.292654 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g6lqz" Aug 05 17:30:59.310177 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:59.310128 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2h5k2" Aug 05 17:30:59.332011 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:59.331959 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" Aug 05 17:30:59.337775 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:59.337749 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" Aug 05 17:30:59.444894 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:59.444867 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-g6lqz"] Aug 05 17:30:59.447463 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:30:59.447429 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebd8d0da_d7b5_4375_8e19_3cf7bcc3ec3f.slice/crio-093ff437a411676ea0dbf7888a83beaedd59da07abf6b7af6fa2bebd9146c98a WatchSource:0}: Error finding container 093ff437a411676ea0dbf7888a83beaedd59da07abf6b7af6fa2bebd9146c98a: Status 404 returned error can't find the container with id 093ff437a411676ea0dbf7888a83beaedd59da07abf6b7af6fa2bebd9146c98a Aug 05 17:30:59.473321 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:30:59.473297 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-2h5k2"] Aug 05 17:30:59.475244 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:30:59.475222 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7e2ace6e_6626_4a0a_938b_5d15ac6e3ac1.slice/crio-e74a67ff2b390d75439a6211cb9628d894d08ca797cd4674466ad1437191f124 WatchSource:0}: Error finding container e74a67ff2b390d75439a6211cb9628d894d08ca797cd4674466ad1437191f124: Status 404 returned error can't find the container with id e74a67ff2b390d75439a6211cb9628d894d08ca797cd4674466ad1437191f124 Aug 05 17:31:00.077186 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:00.077133 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g6lqz" event={"ID":"ebd8d0da-d7b5-4375-8e19-3cf7bcc3ec3f","Type":"ContainerStarted","Data":"093ff437a411676ea0dbf7888a83beaedd59da07abf6b7af6fa2bebd9146c98a"} Aug 05 17:31:00.078389 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:00.078362 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2h5k2" event={"ID":"7e2ace6e-6626-4a0a-938b-5d15ac6e3ac1","Type":"ContainerStarted","Data":"e74a67ff2b390d75439a6211cb9628d894d08ca797cd4674466ad1437191f124"} Aug 05 17:31:00.078552 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:00.078540 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" Aug 05 17:31:00.079400 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:00.079383 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cqlggz" Aug 05 17:31:01.903930 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:01.903894 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn"] Aug 05 17:31:01.904413 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:01.904118 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" podUID="77cae7e0-58cc-45de-b0e8-893b5bebd004" containerName="discovery" containerID="cri-o://8081e69461c71e6869bb130210def3b48f5d8d8d6d9c36834b023719f09b9b08" gracePeriod=30 Aug 05 17:31:02.730312 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:02.730289 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" Aug 05 17:31:02.925227 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:02.925195 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/77cae7e0-58cc-45de-b0e8-893b5bebd004-istio-csr-dns-cert\") pod \"77cae7e0-58cc-45de-b0e8-893b5bebd004\" (UID: \"77cae7e0-58cc-45de-b0e8-893b5bebd004\") " Aug 05 17:31:02.925227 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:02.925231 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/77cae7e0-58cc-45de-b0e8-893b5bebd004-istio-kubeconfig\") pod \"77cae7e0-58cc-45de-b0e8-893b5bebd004\" (UID: \"77cae7e0-58cc-45de-b0e8-893b5bebd004\") " Aug 05 17:31:02.925683 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:02.925260 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77cae7e0-58cc-45de-b0e8-893b5bebd004-istio-token\") pod \"77cae7e0-58cc-45de-b0e8-893b5bebd004\" (UID: \"77cae7e0-58cc-45de-b0e8-893b5bebd004\") " Aug 05 17:31:02.925683 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:02.925326 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpbdm\" (UniqueName: \"kubernetes.io/projected/77cae7e0-58cc-45de-b0e8-893b5bebd004-kube-api-access-dpbdm\") pod \"77cae7e0-58cc-45de-b0e8-893b5bebd004\" (UID: \"77cae7e0-58cc-45de-b0e8-893b5bebd004\") " Aug 05 17:31:02.925683 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:02.925452 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/77cae7e0-58cc-45de-b0e8-893b5bebd004-local-certs\") pod \"77cae7e0-58cc-45de-b0e8-893b5bebd004\" (UID: \"77cae7e0-58cc-45de-b0e8-893b5bebd004\") " Aug 05 17:31:02.925683 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:02.925503 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/77cae7e0-58cc-45de-b0e8-893b5bebd004-istio-csr-ca-configmap\") pod \"77cae7e0-58cc-45de-b0e8-893b5bebd004\" (UID: \"77cae7e0-58cc-45de-b0e8-893b5bebd004\") " Aug 05 17:31:02.925683 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:02.925537 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/77cae7e0-58cc-45de-b0e8-893b5bebd004-cacerts\") pod \"77cae7e0-58cc-45de-b0e8-893b5bebd004\" (UID: \"77cae7e0-58cc-45de-b0e8-893b5bebd004\") " Aug 05 17:31:02.925960 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:02.925849 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77cae7e0-58cc-45de-b0e8-893b5bebd004-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "77cae7e0-58cc-45de-b0e8-893b5bebd004" (UID: "77cae7e0-58cc-45de-b0e8-893b5bebd004"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:31:02.926017 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:02.925998 2579 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/77cae7e0-58cc-45de-b0e8-893b5bebd004-istio-csr-ca-configmap\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:31:02.928451 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:02.928380 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77cae7e0-58cc-45de-b0e8-893b5bebd004-istio-token" (OuterVolumeSpecName: "istio-token") pod "77cae7e0-58cc-45de-b0e8-893b5bebd004" (UID: "77cae7e0-58cc-45de-b0e8-893b5bebd004"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:31:02.928451 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:02.928409 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77cae7e0-58cc-45de-b0e8-893b5bebd004-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "77cae7e0-58cc-45de-b0e8-893b5bebd004" (UID: "77cae7e0-58cc-45de-b0e8-893b5bebd004"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:31:02.928451 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:02.928408 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77cae7e0-58cc-45de-b0e8-893b5bebd004-kube-api-access-dpbdm" (OuterVolumeSpecName: "kube-api-access-dpbdm") pod "77cae7e0-58cc-45de-b0e8-893b5bebd004" (UID: "77cae7e0-58cc-45de-b0e8-893b5bebd004"). InnerVolumeSpecName "kube-api-access-dpbdm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:31:02.928678 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:02.928594 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77cae7e0-58cc-45de-b0e8-893b5bebd004-cacerts" (OuterVolumeSpecName: "cacerts") pod "77cae7e0-58cc-45de-b0e8-893b5bebd004" (UID: "77cae7e0-58cc-45de-b0e8-893b5bebd004"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:31:02.928731 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:02.928686 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77cae7e0-58cc-45de-b0e8-893b5bebd004-local-certs" (OuterVolumeSpecName: "local-certs") pod "77cae7e0-58cc-45de-b0e8-893b5bebd004" (UID: "77cae7e0-58cc-45de-b0e8-893b5bebd004"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:31:02.928811 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:02.928793 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77cae7e0-58cc-45de-b0e8-893b5bebd004-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "77cae7e0-58cc-45de-b0e8-893b5bebd004" (UID: "77cae7e0-58cc-45de-b0e8-893b5bebd004"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:31:03.027602 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:03.027510 2579 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/77cae7e0-58cc-45de-b0e8-893b5bebd004-istio-csr-dns-cert\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:31:03.027602 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:03.027543 2579 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/77cae7e0-58cc-45de-b0e8-893b5bebd004-istio-kubeconfig\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:31:03.027602 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:03.027552 2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77cae7e0-58cc-45de-b0e8-893b5bebd004-istio-token\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:31:03.027602 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:03.027563 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpbdm\" (UniqueName: \"kubernetes.io/projected/77cae7e0-58cc-45de-b0e8-893b5bebd004-kube-api-access-dpbdm\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:31:03.027602 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:03.027573 2579 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/77cae7e0-58cc-45de-b0e8-893b5bebd004-local-certs\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:31:03.027602 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:03.027582 2579 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/77cae7e0-58cc-45de-b0e8-893b5bebd004-cacerts\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:31:03.100673 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:03.100640 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g6lqz" event={"ID":"ebd8d0da-d7b5-4375-8e19-3cf7bcc3ec3f","Type":"ContainerStarted","Data":"5bab7051f2216ec611f83a9918444956ffb1ee035d8d1d24e188974fa74c34aa"} Aug 05 17:31:03.100832 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:03.100728 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g6lqz" Aug 05 17:31:03.102275 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:03.102249 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2h5k2" event={"ID":"7e2ace6e-6626-4a0a-938b-5d15ac6e3ac1","Type":"ContainerStarted","Data":"08131c37625e2e902def4fbaca7dd54ec288777810cea953ff9685f9f933c24c"} Aug 05 17:31:03.102402 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:03.102305 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2h5k2" Aug 05 17:31:03.103704 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:03.103680 2579 generic.go:356] "Generic (PLEG): container finished" podID="77cae7e0-58cc-45de-b0e8-893b5bebd004" containerID="8081e69461c71e6869bb130210def3b48f5d8d8d6d9c36834b023719f09b9b08" exitCode=0 Aug 05 17:31:03.103836 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:03.103710 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" Aug 05 17:31:03.103836 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:03.103731 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" event={"ID":"77cae7e0-58cc-45de-b0e8-893b5bebd004","Type":"ContainerDied","Data":"8081e69461c71e6869bb130210def3b48f5d8d8d6d9c36834b023719f09b9b08"} Aug 05 17:31:03.103836 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:03.103766 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn" event={"ID":"77cae7e0-58cc-45de-b0e8-893b5bebd004","Type":"ContainerDied","Data":"3107293de290c9dec0cabc7d73ee4edb43b728fe2bb38702ca225f3f79cb9d84"} Aug 05 17:31:03.103836 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:03.103786 2579 scope.go:117] "RemoveContainer" containerID="8081e69461c71e6869bb130210def3b48f5d8d8d6d9c36834b023719f09b9b08" Aug 05 17:31:03.113539 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:03.113522 2579 scope.go:117] "RemoveContainer" containerID="8081e69461c71e6869bb130210def3b48f5d8d8d6d9c36834b023719f09b9b08" Aug 05 17:31:03.113801 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:31:03.113784 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8081e69461c71e6869bb130210def3b48f5d8d8d6d9c36834b023719f09b9b08\": container with ID starting with 8081e69461c71e6869bb130210def3b48f5d8d8d6d9c36834b023719f09b9b08 not found: ID does not exist" containerID="8081e69461c71e6869bb130210def3b48f5d8d8d6d9c36834b023719f09b9b08" Aug 05 17:31:03.113872 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:03.113812 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8081e69461c71e6869bb130210def3b48f5d8d8d6d9c36834b023719f09b9b08"} err="failed to get container status \"8081e69461c71e6869bb130210def3b48f5d8d8d6d9c36834b023719f09b9b08\": rpc error: code = NotFound desc = could not find container \"8081e69461c71e6869bb130210def3b48f5d8d8d6d9c36834b023719f09b9b08\": container with ID starting with 8081e69461c71e6869bb130210def3b48f5d8d8d6d9c36834b023719f09b9b08 not found: ID does not exist" Aug 05 17:31:03.119123 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:03.119086 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g6lqz" podStartSLOduration=1.838056312 podStartE2EDuration="5.119073508s" totalImagesPullingTime="3.281017196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:30:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:31:03.117438715 +0000 UTC m=+450.884818949" watchObservedRunningTime="2026-08-05 17:31:03.119073508 +0000 UTC m=+450.886453776" Aug 05 17:31:03.135059 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:03.135036 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn"] Aug 05 17:31:03.146172 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:03.144334 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-j69tn"] Aug 05 17:31:03.161573 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:03.161529 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2h5k2" podStartSLOduration=1.905089402 podStartE2EDuration="5.161513831s" totalImagesPullingTime="3.256424429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:30:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:31:03.161114904 +0000 UTC m=+450.928495139" watchObservedRunningTime="2026-08-05 17:31:03.161513831 +0000 UTC m=+450.928894064" Aug 05 17:31:04.041387 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:04.041356 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-9b569" Aug 05 17:31:04.042987 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:04.042962 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-x7b84" Aug 05 17:31:04.769732 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:04.769699 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77cae7e0-58cc-45de-b0e8-893b5bebd004" path="/var/lib/kubelet/pods/77cae7e0-58cc-45de-b0e8-893b5bebd004/volumes" Aug 05 17:31:34.114565 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:34.114531 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2h5k2" Aug 05 17:31:34.117561 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:34.117540 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g6lqz" Aug 05 17:31:47.503060 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:47.503016 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:31:47.571470 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:47.571432 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:31:51.119582 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.119456 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jfvln"] Aug 05 17:31:51.119991 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.119964 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77cae7e0-58cc-45de-b0e8-893b5bebd004" containerName="discovery" Aug 05 17:31:51.119991 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.119981 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="77cae7e0-58cc-45de-b0e8-893b5bebd004" containerName="discovery" Aug 05 17:31:51.120069 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.120056 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="77cae7e0-58cc-45de-b0e8-893b5bebd004" containerName="discovery" Aug 05 17:31:51.129779 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.129752 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jfvln" Aug 05 17:31:51.132002 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.131975 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jfvln"] Aug 05 17:31:51.132911 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.132890 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Aug 05 17:31:51.134258 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.134238 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hhv6f\"" Aug 05 17:31:51.134369 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.134285 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Aug 05 17:31:51.220861 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.220818 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0v7bbx"] Aug 05 17:31:51.223933 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.223915 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0v7bbx" Aug 05 17:31:51.232212 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.232164 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0v7bbx"] Aug 05 17:31:51.259358 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.259326 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54677efc-e07b-4443-9263-2bb955661d0a-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jfvln\" (UID: \"54677efc-e07b-4443-9263-2bb955661d0a\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jfvln" Aug 05 17:31:51.259358 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.259363 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54677efc-e07b-4443-9263-2bb955661d0a-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jfvln\" (UID: \"54677efc-e07b-4443-9263-2bb955661d0a\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jfvln" Aug 05 17:31:51.259579 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.259395 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7w2q\" (UniqueName: \"kubernetes.io/projected/54677efc-e07b-4443-9263-2bb955661d0a-kube-api-access-v7w2q\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jfvln\" (UID: \"54677efc-e07b-4443-9263-2bb955661d0a\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jfvln" Aug 05 17:31:51.319727 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.319693 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183clnzjh"] Aug 05 17:31:51.322484 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.322463 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183clnzjh" Aug 05 17:31:51.331487 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.331459 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183clnzjh"] Aug 05 17:31:51.360592 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.360554 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvgsx\" (UniqueName: \"kubernetes.io/projected/8ca7b462-222c-423a-84ba-0f60160063a6-kube-api-access-xvgsx\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0v7bbx\" (UID: \"8ca7b462-222c-423a-84ba-0f60160063a6\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0v7bbx" Aug 05 17:31:51.360775 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.360602 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ca7b462-222c-423a-84ba-0f60160063a6-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0v7bbx\" (UID: \"8ca7b462-222c-423a-84ba-0f60160063a6\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0v7bbx" Aug 05 17:31:51.360775 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.360702 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54677efc-e07b-4443-9263-2bb955661d0a-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jfvln\" (UID: \"54677efc-e07b-4443-9263-2bb955661d0a\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jfvln" Aug 05 17:31:51.360775 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.360726 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54677efc-e07b-4443-9263-2bb955661d0a-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jfvln\" (UID: \"54677efc-e07b-4443-9263-2bb955661d0a\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jfvln" Aug 05 17:31:51.360775 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.360757 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7w2q\" (UniqueName: \"kubernetes.io/projected/54677efc-e07b-4443-9263-2bb955661d0a-kube-api-access-v7w2q\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jfvln\" (UID: \"54677efc-e07b-4443-9263-2bb955661d0a\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jfvln" Aug 05 17:31:51.360995 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.360784 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ca7b462-222c-423a-84ba-0f60160063a6-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0v7bbx\" (UID: \"8ca7b462-222c-423a-84ba-0f60160063a6\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0v7bbx" Aug 05 17:31:51.361185 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.361131 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54677efc-e07b-4443-9263-2bb955661d0a-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jfvln\" (UID: \"54677efc-e07b-4443-9263-2bb955661d0a\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jfvln" Aug 05 17:31:51.361302 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.361195 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54677efc-e07b-4443-9263-2bb955661d0a-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jfvln\" (UID: \"54677efc-e07b-4443-9263-2bb955661d0a\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jfvln" Aug 05 17:31:51.369479 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.369455 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7w2q\" (UniqueName: \"kubernetes.io/projected/54677efc-e07b-4443-9263-2bb955661d0a-kube-api-access-v7w2q\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jfvln\" (UID: \"54677efc-e07b-4443-9263-2bb955661d0a\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jfvln" Aug 05 17:31:51.419830 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.419747 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwcczl"] Aug 05 17:31:51.422667 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.422651 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwcczl" Aug 05 17:31:51.432544 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.432516 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwcczl"] Aug 05 17:31:51.440897 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.440858 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jfvln" Aug 05 17:31:51.462084 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.462052 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvgsx\" (UniqueName: \"kubernetes.io/projected/8ca7b462-222c-423a-84ba-0f60160063a6-kube-api-access-xvgsx\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0v7bbx\" (UID: \"8ca7b462-222c-423a-84ba-0f60160063a6\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0v7bbx" Aug 05 17:31:51.462243 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.462111 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ca7b462-222c-423a-84ba-0f60160063a6-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0v7bbx\" (UID: \"8ca7b462-222c-423a-84ba-0f60160063a6\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0v7bbx" Aug 05 17:31:51.462243 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.462239 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87292f4f-2f74-4991-bac3-7e2dcbb838e1-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183clnzjh\" (UID: \"87292f4f-2f74-4991-bac3-7e2dcbb838e1\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183clnzjh" Aug 05 17:31:51.462380 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.462284 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ca7b462-222c-423a-84ba-0f60160063a6-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0v7bbx\" (UID: \"8ca7b462-222c-423a-84ba-0f60160063a6\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0v7bbx" Aug 05 17:31:51.462380 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.462319 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87292f4f-2f74-4991-bac3-7e2dcbb838e1-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183clnzjh\" (UID: \"87292f4f-2f74-4991-bac3-7e2dcbb838e1\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183clnzjh" Aug 05 17:31:51.462380 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.462346 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2xcc\" (UniqueName: \"kubernetes.io/projected/87292f4f-2f74-4991-bac3-7e2dcbb838e1-kube-api-access-m2xcc\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183clnzjh\" (UID: \"87292f4f-2f74-4991-bac3-7e2dcbb838e1\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183clnzjh" Aug 05 17:31:51.462577 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.462540 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ca7b462-222c-423a-84ba-0f60160063a6-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0v7bbx\" (UID: \"8ca7b462-222c-423a-84ba-0f60160063a6\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0v7bbx" Aug 05 17:31:51.462577 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.462557 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ca7b462-222c-423a-84ba-0f60160063a6-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0v7bbx\" (UID: \"8ca7b462-222c-423a-84ba-0f60160063a6\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0v7bbx" Aug 05 17:31:51.471987 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.471960 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvgsx\" (UniqueName: \"kubernetes.io/projected/8ca7b462-222c-423a-84ba-0f60160063a6-kube-api-access-xvgsx\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0v7bbx\" (UID: \"8ca7b462-222c-423a-84ba-0f60160063a6\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0v7bbx" Aug 05 17:31:51.534582 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.534552 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0v7bbx" Aug 05 17:31:51.564501 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.563765 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87292f4f-2f74-4991-bac3-7e2dcbb838e1-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183clnzjh\" (UID: \"87292f4f-2f74-4991-bac3-7e2dcbb838e1\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183clnzjh" Aug 05 17:31:51.564501 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.563815 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2xcc\" (UniqueName: \"kubernetes.io/projected/87292f4f-2f74-4991-bac3-7e2dcbb838e1-kube-api-access-m2xcc\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183clnzjh\" (UID: \"87292f4f-2f74-4991-bac3-7e2dcbb838e1\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183clnzjh" Aug 05 17:31:51.564501 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.563961 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24hk2\" (UniqueName: \"kubernetes.io/projected/8ec6ad76-7ff4-480a-a457-b89eb99c783f-kube-api-access-24hk2\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwcczl\" (UID: \"8ec6ad76-7ff4-480a-a457-b89eb99c783f\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwcczl" Aug 05 17:31:51.564501 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.563990 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87292f4f-2f74-4991-bac3-7e2dcbb838e1-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183clnzjh\" (UID: \"87292f4f-2f74-4991-bac3-7e2dcbb838e1\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183clnzjh" Aug 05 17:31:51.564501 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.564023 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ec6ad76-7ff4-480a-a457-b89eb99c783f-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwcczl\" (UID: \"8ec6ad76-7ff4-480a-a457-b89eb99c783f\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwcczl" Aug 05 17:31:51.564501 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.564051 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ec6ad76-7ff4-480a-a457-b89eb99c783f-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwcczl\" (UID: \"8ec6ad76-7ff4-480a-a457-b89eb99c783f\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwcczl" Aug 05 17:31:51.564501 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.564198 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87292f4f-2f74-4991-bac3-7e2dcbb838e1-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183clnzjh\" (UID: \"87292f4f-2f74-4991-bac3-7e2dcbb838e1\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183clnzjh" Aug 05 17:31:51.564501 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.564466 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87292f4f-2f74-4991-bac3-7e2dcbb838e1-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183clnzjh\" (UID: \"87292f4f-2f74-4991-bac3-7e2dcbb838e1\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183clnzjh" Aug 05 17:31:51.574424 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.574398 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2xcc\" (UniqueName: \"kubernetes.io/projected/87292f4f-2f74-4991-bac3-7e2dcbb838e1-kube-api-access-m2xcc\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183clnzjh\" (UID: \"87292f4f-2f74-4991-bac3-7e2dcbb838e1\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183clnzjh" Aug 05 17:31:51.595451 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.595416 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jfvln"] Aug 05 17:31:51.632923 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.632894 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183clnzjh" Aug 05 17:31:51.665254 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.665220 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24hk2\" (UniqueName: \"kubernetes.io/projected/8ec6ad76-7ff4-480a-a457-b89eb99c783f-kube-api-access-24hk2\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwcczl\" (UID: \"8ec6ad76-7ff4-480a-a457-b89eb99c783f\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwcczl" Aug 05 17:31:51.665431 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.665278 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ec6ad76-7ff4-480a-a457-b89eb99c783f-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwcczl\" (UID: \"8ec6ad76-7ff4-480a-a457-b89eb99c783f\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwcczl" Aug 05 17:31:51.665431 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.665309 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ec6ad76-7ff4-480a-a457-b89eb99c783f-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwcczl\" (UID: \"8ec6ad76-7ff4-480a-a457-b89eb99c783f\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwcczl" Aug 05 17:31:51.665768 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.665721 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ec6ad76-7ff4-480a-a457-b89eb99c783f-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwcczl\" (UID: \"8ec6ad76-7ff4-480a-a457-b89eb99c783f\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwcczl" Aug 05 17:31:51.665768 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.665755 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ec6ad76-7ff4-480a-a457-b89eb99c783f-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwcczl\" (UID: \"8ec6ad76-7ff4-480a-a457-b89eb99c783f\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwcczl" Aug 05 17:31:51.675721 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.675617 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24hk2\" (UniqueName: \"kubernetes.io/projected/8ec6ad76-7ff4-480a-a457-b89eb99c783f-kube-api-access-24hk2\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwcczl\" (UID: \"8ec6ad76-7ff4-480a-a457-b89eb99c783f\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwcczl" Aug 05 17:31:51.700193 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.700165 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0v7bbx"] Aug 05 17:31:51.701944 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:31:51.701916 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ca7b462_222c_423a_84ba_0f60160063a6.slice/crio-074fcdf50f47378cf6a40d3265342c8e291afcbe3a5aa7b5e194695393af9061 WatchSource:0}: Error finding container 074fcdf50f47378cf6a40d3265342c8e291afcbe3a5aa7b5e194695393af9061: Status 404 returned error can't find the container with id 074fcdf50f47378cf6a40d3265342c8e291afcbe3a5aa7b5e194695393af9061 Aug 05 17:31:51.732876 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.732840 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwcczl" Aug 05 17:31:51.814982 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.814053 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183clnzjh"] Aug 05 17:31:51.898787 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:51.898762 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwcczl"] Aug 05 17:31:51.926444 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:31:51.926372 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ec6ad76_7ff4_480a_a457_b89eb99c783f.slice/crio-574c0d79f7ae28d8edb5d7a927ead2229e2048256b3ae69e4a96e4a492d6036b WatchSource:0}: Error finding container 574c0d79f7ae28d8edb5d7a927ead2229e2048256b3ae69e4a96e4a492d6036b: Status 404 returned error can't find the container with id 574c0d79f7ae28d8edb5d7a927ead2229e2048256b3ae69e4a96e4a492d6036b Aug 05 17:31:52.363007 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:52.362972 2579 generic.go:356] "Generic (PLEG): container finished" podID="87292f4f-2f74-4991-bac3-7e2dcbb838e1" containerID="aca91687a078ad76a15dce35bade2c57eff8f2c0a99b5f5c1139ce736b528be0" exitCode=0 Aug 05 17:31:52.363508 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:52.363041 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183clnzjh" event={"ID":"87292f4f-2f74-4991-bac3-7e2dcbb838e1","Type":"ContainerDied","Data":"aca91687a078ad76a15dce35bade2c57eff8f2c0a99b5f5c1139ce736b528be0"} Aug 05 17:31:52.363508 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:52.363103 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183clnzjh" event={"ID":"87292f4f-2f74-4991-bac3-7e2dcbb838e1","Type":"ContainerStarted","Data":"124d399a9808dcf361a68d388574707346d58881535cfa1bc0a53ca5d2c1b6be"} Aug 05 17:31:52.364741 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:52.364722 2579 generic.go:356] "Generic (PLEG): container finished" podID="8ca7b462-222c-423a-84ba-0f60160063a6" containerID="a93c94d9d9c8dd69f72259af1c877a41dccf03e66705ff4c4c41e8a94b2c3867" exitCode=0 Aug 05 17:31:52.364845 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:52.364820 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0v7bbx" event={"ID":"8ca7b462-222c-423a-84ba-0f60160063a6","Type":"ContainerDied","Data":"a93c94d9d9c8dd69f72259af1c877a41dccf03e66705ff4c4c41e8a94b2c3867"} Aug 05 17:31:52.364934 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:52.364912 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0v7bbx" event={"ID":"8ca7b462-222c-423a-84ba-0f60160063a6","Type":"ContainerStarted","Data":"074fcdf50f47378cf6a40d3265342c8e291afcbe3a5aa7b5e194695393af9061"} Aug 05 17:31:52.366456 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:52.366439 2579 generic.go:356] "Generic (PLEG): container finished" podID="8ec6ad76-7ff4-480a-a457-b89eb99c783f" containerID="b5d0508e3586e74fc361f761fb400f9179341ca3060b8a5e816f5c4ca0cb8135" exitCode=0 Aug 05 17:31:52.366538 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:52.366496 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwcczl" event={"ID":"8ec6ad76-7ff4-480a-a457-b89eb99c783f","Type":"ContainerDied","Data":"b5d0508e3586e74fc361f761fb400f9179341ca3060b8a5e816f5c4ca0cb8135"} Aug 05 17:31:52.366597 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:52.366537 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwcczl" event={"ID":"8ec6ad76-7ff4-480a-a457-b89eb99c783f","Type":"ContainerStarted","Data":"574c0d79f7ae28d8edb5d7a927ead2229e2048256b3ae69e4a96e4a492d6036b"} Aug 05 17:31:52.368216 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:52.368197 2579 generic.go:356] "Generic (PLEG): container finished" podID="54677efc-e07b-4443-9263-2bb955661d0a" containerID="50a76066210b71f161b57cbed4f9f05366b9f0705b144825b9b73d131fe55606" exitCode=0 Aug 05 17:31:52.368380 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:52.368339 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jfvln" event={"ID":"54677efc-e07b-4443-9263-2bb955661d0a","Type":"ContainerDied","Data":"50a76066210b71f161b57cbed4f9f05366b9f0705b144825b9b73d131fe55606"} Aug 05 17:31:52.368691 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:52.368386 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jfvln" event={"ID":"54677efc-e07b-4443-9263-2bb955661d0a","Type":"ContainerStarted","Data":"5bb5b149ac7e26d5e222c6834c89396eba0fd992c2e650c4549ec80b05ba2c8e"} Aug 05 17:31:53.375989 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:53.375957 2579 generic.go:356] "Generic (PLEG): container finished" podID="87292f4f-2f74-4991-bac3-7e2dcbb838e1" containerID="6e4757a61a6af5d10df26ad98fdd68dcc8b8bcd56fa3eb0776d9b25577e260e1" exitCode=0 Aug 05 17:31:53.376445 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:53.376045 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183clnzjh" event={"ID":"87292f4f-2f74-4991-bac3-7e2dcbb838e1","Type":"ContainerDied","Data":"6e4757a61a6af5d10df26ad98fdd68dcc8b8bcd56fa3eb0776d9b25577e260e1"} Aug 05 17:31:53.378220 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:53.378195 2579 generic.go:356] "Generic (PLEG): container finished" podID="8ec6ad76-7ff4-480a-a457-b89eb99c783f" containerID="cb1849ae8f33fde459ceb400aa65a3cf2eb3800f79af8a273b4860e702fd0a91" exitCode=0 Aug 05 17:31:53.378363 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:53.378336 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwcczl" event={"ID":"8ec6ad76-7ff4-480a-a457-b89eb99c783f","Type":"ContainerDied","Data":"cb1849ae8f33fde459ceb400aa65a3cf2eb3800f79af8a273b4860e702fd0a91"} Aug 05 17:31:54.385479 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:54.385449 2579 generic.go:356] "Generic (PLEG): container finished" podID="87292f4f-2f74-4991-bac3-7e2dcbb838e1" containerID="444729b815a09d55dd45df12ce694b19bfd3ae18ef6b6ca94fd145b32acc5c5e" exitCode=0 Aug 05 17:31:54.385874 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:54.385526 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183clnzjh" event={"ID":"87292f4f-2f74-4991-bac3-7e2dcbb838e1","Type":"ContainerDied","Data":"444729b815a09d55dd45df12ce694b19bfd3ae18ef6b6ca94fd145b32acc5c5e"} Aug 05 17:31:54.387238 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:54.387213 2579 generic.go:356] "Generic (PLEG): container finished" podID="8ca7b462-222c-423a-84ba-0f60160063a6" containerID="c7f966a025a04cc7528ea6ea89548a613de650bfb12a065d145f4d5633c6b144" exitCode=0 Aug 05 17:31:54.387367 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:54.387288 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0v7bbx" event={"ID":"8ca7b462-222c-423a-84ba-0f60160063a6","Type":"ContainerDied","Data":"c7f966a025a04cc7528ea6ea89548a613de650bfb12a065d145f4d5633c6b144"} Aug 05 17:31:54.389439 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:54.389418 2579 generic.go:356] "Generic (PLEG): container finished" podID="8ec6ad76-7ff4-480a-a457-b89eb99c783f" containerID="b574eba022400568af1521568e6ccb7aa26c0f46b84ffc015a5f4b1f76d72c2e" exitCode=0 Aug 05 17:31:54.389537 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:54.389491 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwcczl" event={"ID":"8ec6ad76-7ff4-480a-a457-b89eb99c783f","Type":"ContainerDied","Data":"b574eba022400568af1521568e6ccb7aa26c0f46b84ffc015a5f4b1f76d72c2e"} Aug 05 17:31:54.391466 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:54.391445 2579 generic.go:356] "Generic (PLEG): container finished" podID="54677efc-e07b-4443-9263-2bb955661d0a" containerID="4e307e4499ce35397644398d3ec0852cc51ff3c2ffe07c01edda35f44ed3959d" exitCode=0 Aug 05 17:31:54.391553 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:54.391485 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jfvln" event={"ID":"54677efc-e07b-4443-9263-2bb955661d0a","Type":"ContainerDied","Data":"4e307e4499ce35397644398d3ec0852cc51ff3c2ffe07c01edda35f44ed3959d"} Aug 05 17:31:55.399501 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:55.399466 2579 generic.go:356] "Generic (PLEG): container finished" podID="8ca7b462-222c-423a-84ba-0f60160063a6" containerID="d9a6172d03c11bddf1c03cf4b75bc180f7cf5dd47ad0bb9302b31b1713ec0c0c" exitCode=0 Aug 05 17:31:55.399968 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:55.399558 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0v7bbx" event={"ID":"8ca7b462-222c-423a-84ba-0f60160063a6","Type":"ContainerDied","Data":"d9a6172d03c11bddf1c03cf4b75bc180f7cf5dd47ad0bb9302b31b1713ec0c0c"} Aug 05 17:31:55.401553 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:55.401528 2579 generic.go:356] "Generic (PLEG): container finished" podID="54677efc-e07b-4443-9263-2bb955661d0a" containerID="edc98445a02ae73d47fe4c9f07747005edb56ffce05e9bd5cbf07f74e02de503" exitCode=0 Aug 05 17:31:55.401659 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:55.401597 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jfvln" event={"ID":"54677efc-e07b-4443-9263-2bb955661d0a","Type":"ContainerDied","Data":"edc98445a02ae73d47fe4c9f07747005edb56ffce05e9bd5cbf07f74e02de503"} Aug 05 17:31:55.539044 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:55.539018 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwcczl" Aug 05 17:31:55.567611 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:55.567579 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183clnzjh" Aug 05 17:31:55.703920 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:55.703816 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2xcc\" (UniqueName: \"kubernetes.io/projected/87292f4f-2f74-4991-bac3-7e2dcbb838e1-kube-api-access-m2xcc\") pod \"87292f4f-2f74-4991-bac3-7e2dcbb838e1\" (UID: \"87292f4f-2f74-4991-bac3-7e2dcbb838e1\") " Aug 05 17:31:55.703920 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:55.703877 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24hk2\" (UniqueName: \"kubernetes.io/projected/8ec6ad76-7ff4-480a-a457-b89eb99c783f-kube-api-access-24hk2\") pod \"8ec6ad76-7ff4-480a-a457-b89eb99c783f\" (UID: \"8ec6ad76-7ff4-480a-a457-b89eb99c783f\") " Aug 05 17:31:55.704288 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:55.703941 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ec6ad76-7ff4-480a-a457-b89eb99c783f-util\") pod \"8ec6ad76-7ff4-480a-a457-b89eb99c783f\" (UID: \"8ec6ad76-7ff4-480a-a457-b89eb99c783f\") " Aug 05 17:31:55.704288 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:55.703977 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ec6ad76-7ff4-480a-a457-b89eb99c783f-bundle\") pod \"8ec6ad76-7ff4-480a-a457-b89eb99c783f\" (UID: \"8ec6ad76-7ff4-480a-a457-b89eb99c783f\") " Aug 05 17:31:55.704288 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:55.704018 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87292f4f-2f74-4991-bac3-7e2dcbb838e1-bundle\") pod \"87292f4f-2f74-4991-bac3-7e2dcbb838e1\" (UID: \"87292f4f-2f74-4991-bac3-7e2dcbb838e1\") " Aug 05 17:31:55.704288 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:55.704086 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87292f4f-2f74-4991-bac3-7e2dcbb838e1-util\") pod \"87292f4f-2f74-4991-bac3-7e2dcbb838e1\" (UID: \"87292f4f-2f74-4991-bac3-7e2dcbb838e1\") " Aug 05 17:31:55.704731 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:55.704686 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87292f4f-2f74-4991-bac3-7e2dcbb838e1-bundle" (OuterVolumeSpecName: "bundle") pod "87292f4f-2f74-4991-bac3-7e2dcbb838e1" (UID: "87292f4f-2f74-4991-bac3-7e2dcbb838e1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:31:55.704833 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:55.704775 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ec6ad76-7ff4-480a-a457-b89eb99c783f-bundle" (OuterVolumeSpecName: "bundle") pod "8ec6ad76-7ff4-480a-a457-b89eb99c783f" (UID: "8ec6ad76-7ff4-480a-a457-b89eb99c783f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:31:55.706100 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:55.706073 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87292f4f-2f74-4991-bac3-7e2dcbb838e1-kube-api-access-m2xcc" (OuterVolumeSpecName: "kube-api-access-m2xcc") pod "87292f4f-2f74-4991-bac3-7e2dcbb838e1" (UID: "87292f4f-2f74-4991-bac3-7e2dcbb838e1"). InnerVolumeSpecName "kube-api-access-m2xcc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:31:55.706100 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:55.706094 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ec6ad76-7ff4-480a-a457-b89eb99c783f-kube-api-access-24hk2" (OuterVolumeSpecName: "kube-api-access-24hk2") pod "8ec6ad76-7ff4-480a-a457-b89eb99c783f" (UID: "8ec6ad76-7ff4-480a-a457-b89eb99c783f"). InnerVolumeSpecName "kube-api-access-24hk2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:31:55.710362 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:55.710329 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87292f4f-2f74-4991-bac3-7e2dcbb838e1-util" (OuterVolumeSpecName: "util") pod "87292f4f-2f74-4991-bac3-7e2dcbb838e1" (UID: "87292f4f-2f74-4991-bac3-7e2dcbb838e1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:31:55.712375 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:55.712351 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ec6ad76-7ff4-480a-a457-b89eb99c783f-util" (OuterVolumeSpecName: "util") pod "8ec6ad76-7ff4-480a-a457-b89eb99c783f" (UID: "8ec6ad76-7ff4-480a-a457-b89eb99c783f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:31:55.805522 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:55.805489 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2xcc\" (UniqueName: \"kubernetes.io/projected/87292f4f-2f74-4991-bac3-7e2dcbb838e1-kube-api-access-m2xcc\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:31:55.805522 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:55.805516 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24hk2\" (UniqueName: \"kubernetes.io/projected/8ec6ad76-7ff4-480a-a457-b89eb99c783f-kube-api-access-24hk2\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:31:55.805522 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:55.805525 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ec6ad76-7ff4-480a-a457-b89eb99c783f-util\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:31:55.805746 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:55.805534 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ec6ad76-7ff4-480a-a457-b89eb99c783f-bundle\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:31:55.805746 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:55.805541 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87292f4f-2f74-4991-bac3-7e2dcbb838e1-bundle\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:31:55.805746 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:55.805548 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87292f4f-2f74-4991-bac3-7e2dcbb838e1-util\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:31:56.410049 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:56.410019 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183clnzjh" Aug 05 17:31:56.410049 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:56.410032 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183clnzjh" event={"ID":"87292f4f-2f74-4991-bac3-7e2dcbb838e1","Type":"ContainerDied","Data":"124d399a9808dcf361a68d388574707346d58881535cfa1bc0a53ca5d2c1b6be"} Aug 05 17:31:56.410531 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:56.410113 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="124d399a9808dcf361a68d388574707346d58881535cfa1bc0a53ca5d2c1b6be" Aug 05 17:31:56.412018 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:56.412002 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwcczl" Aug 05 17:31:56.412167 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:56.412040 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwcczl" event={"ID":"8ec6ad76-7ff4-480a-a457-b89eb99c783f","Type":"ContainerDied","Data":"574c0d79f7ae28d8edb5d7a927ead2229e2048256b3ae69e4a96e4a492d6036b"} Aug 05 17:31:56.412167 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:56.412081 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="574c0d79f7ae28d8edb5d7a927ead2229e2048256b3ae69e4a96e4a492d6036b" Aug 05 17:31:56.554819 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:56.554794 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0v7bbx" Aug 05 17:31:56.580112 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:56.580084 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jfvln" Aug 05 17:31:56.715599 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:56.715525 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ca7b462-222c-423a-84ba-0f60160063a6-util\") pod \"8ca7b462-222c-423a-84ba-0f60160063a6\" (UID: \"8ca7b462-222c-423a-84ba-0f60160063a6\") " Aug 05 17:31:56.715599 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:56.715575 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54677efc-e07b-4443-9263-2bb955661d0a-util\") pod \"54677efc-e07b-4443-9263-2bb955661d0a\" (UID: \"54677efc-e07b-4443-9263-2bb955661d0a\") " Aug 05 17:31:56.715599 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:56.715599 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7w2q\" (UniqueName: \"kubernetes.io/projected/54677efc-e07b-4443-9263-2bb955661d0a-kube-api-access-v7w2q\") pod \"54677efc-e07b-4443-9263-2bb955661d0a\" (UID: \"54677efc-e07b-4443-9263-2bb955661d0a\") " Aug 05 17:31:56.715885 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:56.715639 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54677efc-e07b-4443-9263-2bb955661d0a-bundle\") pod \"54677efc-e07b-4443-9263-2bb955661d0a\" (UID: \"54677efc-e07b-4443-9263-2bb955661d0a\") " Aug 05 17:31:56.715885 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:56.715656 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ca7b462-222c-423a-84ba-0f60160063a6-bundle\") pod \"8ca7b462-222c-423a-84ba-0f60160063a6\" (UID: \"8ca7b462-222c-423a-84ba-0f60160063a6\") " Aug 05 17:31:56.715885 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:56.715689 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvgsx\" (UniqueName: \"kubernetes.io/projected/8ca7b462-222c-423a-84ba-0f60160063a6-kube-api-access-xvgsx\") pod \"8ca7b462-222c-423a-84ba-0f60160063a6\" (UID: \"8ca7b462-222c-423a-84ba-0f60160063a6\") " Aug 05 17:31:56.716213 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:56.716179 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ca7b462-222c-423a-84ba-0f60160063a6-bundle" (OuterVolumeSpecName: "bundle") pod "8ca7b462-222c-423a-84ba-0f60160063a6" (UID: "8ca7b462-222c-423a-84ba-0f60160063a6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:31:56.716445 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:56.716422 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54677efc-e07b-4443-9263-2bb955661d0a-bundle" (OuterVolumeSpecName: "bundle") pod "54677efc-e07b-4443-9263-2bb955661d0a" (UID: "54677efc-e07b-4443-9263-2bb955661d0a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:31:56.718421 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:56.718387 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54677efc-e07b-4443-9263-2bb955661d0a-kube-api-access-v7w2q" (OuterVolumeSpecName: "kube-api-access-v7w2q") pod "54677efc-e07b-4443-9263-2bb955661d0a" (UID: "54677efc-e07b-4443-9263-2bb955661d0a"). InnerVolumeSpecName "kube-api-access-v7w2q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:31:56.718421 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:56.718416 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ca7b462-222c-423a-84ba-0f60160063a6-kube-api-access-xvgsx" (OuterVolumeSpecName: "kube-api-access-xvgsx") pod "8ca7b462-222c-423a-84ba-0f60160063a6" (UID: "8ca7b462-222c-423a-84ba-0f60160063a6"). InnerVolumeSpecName "kube-api-access-xvgsx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:31:56.721518 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:56.721495 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ca7b462-222c-423a-84ba-0f60160063a6-util" (OuterVolumeSpecName: "util") pod "8ca7b462-222c-423a-84ba-0f60160063a6" (UID: "8ca7b462-222c-423a-84ba-0f60160063a6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:31:56.722931 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:56.722906 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54677efc-e07b-4443-9263-2bb955661d0a-util" (OuterVolumeSpecName: "util") pod "54677efc-e07b-4443-9263-2bb955661d0a" (UID: "54677efc-e07b-4443-9263-2bb955661d0a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:31:56.816734 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:56.816707 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ca7b462-222c-423a-84ba-0f60160063a6-util\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:31:56.816734 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:56.816730 2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54677efc-e07b-4443-9263-2bb955661d0a-util\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:31:56.816734 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:56.816739 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7w2q\" (UniqueName: \"kubernetes.io/projected/54677efc-e07b-4443-9263-2bb955661d0a-kube-api-access-v7w2q\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:31:56.816919 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:56.816749 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54677efc-e07b-4443-9263-2bb955661d0a-bundle\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:31:56.816919 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:56.816758 2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ca7b462-222c-423a-84ba-0f60160063a6-bundle\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:31:56.816919 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:56.816765 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvgsx\" (UniqueName: \"kubernetes.io/projected/8ca7b462-222c-423a-84ba-0f60160063a6-kube-api-access-xvgsx\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:31:57.420098 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:57.420066 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0v7bbx" Aug 05 17:31:57.420098 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:57.420079 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0v7bbx" event={"ID":"8ca7b462-222c-423a-84ba-0f60160063a6","Type":"ContainerDied","Data":"074fcdf50f47378cf6a40d3265342c8e291afcbe3a5aa7b5e194695393af9061"} Aug 05 17:31:57.420547 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:57.420131 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="074fcdf50f47378cf6a40d3265342c8e291afcbe3a5aa7b5e194695393af9061" Aug 05 17:31:57.422176 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:57.422135 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jfvln" event={"ID":"54677efc-e07b-4443-9263-2bb955661d0a","Type":"ContainerDied","Data":"5bb5b149ac7e26d5e222c6834c89396eba0fd992c2e650c4549ec80b05ba2c8e"} Aug 05 17:31:57.422324 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:57.422194 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5bb5b149ac7e26d5e222c6834c89396eba0fd992c2e650c4549ec80b05ba2c8e" Aug 05 17:31:57.422324 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:57.422200 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053jfvln" Aug 05 17:31:59.916051 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:31:59.916022 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:00.717655 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:00.717625 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:01.519023 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:01.518982 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:04.304640 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.304603 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2w5nz"] Aug 05 17:32:04.305159 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.304978 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ca7b462-222c-423a-84ba-0f60160063a6" containerName="extract" Aug 05 17:32:04.305159 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.304988 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ca7b462-222c-423a-84ba-0f60160063a6" containerName="extract" Aug 05 17:32:04.305159 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.304999 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87292f4f-2f74-4991-bac3-7e2dcbb838e1" containerName="extract" Aug 05 17:32:04.305159 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.305004 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="87292f4f-2f74-4991-bac3-7e2dcbb838e1" containerName="extract" Aug 05 17:32:04.305159 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.305012 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87292f4f-2f74-4991-bac3-7e2dcbb838e1" containerName="pull" Aug 05 17:32:04.305159 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.305017 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="87292f4f-2f74-4991-bac3-7e2dcbb838e1" containerName="pull" Aug 05 17:32:04.305159 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.305029 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ca7b462-222c-423a-84ba-0f60160063a6" containerName="pull" Aug 05 17:32:04.305159 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.305034 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ca7b462-222c-423a-84ba-0f60160063a6" containerName="pull" Aug 05 17:32:04.305159 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.305039 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54677efc-e07b-4443-9263-2bb955661d0a" containerName="pull" Aug 05 17:32:04.305159 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.305044 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="54677efc-e07b-4443-9263-2bb955661d0a" containerName="pull" Aug 05 17:32:04.305159 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.305051 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87292f4f-2f74-4991-bac3-7e2dcbb838e1" containerName="util" Aug 05 17:32:04.305159 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.305056 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="87292f4f-2f74-4991-bac3-7e2dcbb838e1" containerName="util" Aug 05 17:32:04.305159 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.305064 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54677efc-e07b-4443-9263-2bb955661d0a" containerName="extract" Aug 05 17:32:04.305159 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.305069 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="54677efc-e07b-4443-9263-2bb955661d0a" containerName="extract" Aug 05 17:32:04.305159 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.305077 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54677efc-e07b-4443-9263-2bb955661d0a" containerName="util" Aug 05 17:32:04.305159 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.305083 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="54677efc-e07b-4443-9263-2bb955661d0a" containerName="util" Aug 05 17:32:04.305159 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.305091 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ec6ad76-7ff4-480a-a457-b89eb99c783f" containerName="extract" Aug 05 17:32:04.305159 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.305096 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ec6ad76-7ff4-480a-a457-b89eb99c783f" containerName="extract" Aug 05 17:32:04.305159 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.305103 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ca7b462-222c-423a-84ba-0f60160063a6" containerName="util" Aug 05 17:32:04.305159 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.305108 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ca7b462-222c-423a-84ba-0f60160063a6" containerName="util" Aug 05 17:32:04.305159 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.305114 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ec6ad76-7ff4-480a-a457-b89eb99c783f" containerName="util" Aug 05 17:32:04.305159 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.305119 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ec6ad76-7ff4-480a-a457-b89eb99c783f" containerName="util" Aug 05 17:32:04.305159 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.305126 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ec6ad76-7ff4-480a-a457-b89eb99c783f" containerName="pull" Aug 05 17:32:04.305159 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.305130 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ec6ad76-7ff4-480a-a457-b89eb99c783f" containerName="pull" Aug 05 17:32:04.305953 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.305226 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="54677efc-e07b-4443-9263-2bb955661d0a" containerName="extract" Aug 05 17:32:04.305953 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.305237 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ca7b462-222c-423a-84ba-0f60160063a6" containerName="extract" Aug 05 17:32:04.305953 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.305244 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="87292f4f-2f74-4991-bac3-7e2dcbb838e1" containerName="extract" Aug 05 17:32:04.305953 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.305249 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ec6ad76-7ff4-480a-a457-b89eb99c783f" containerName="extract" Aug 05 17:32:04.315180 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.315129 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2w5nz" Aug 05 17:32:04.318104 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.318075 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Aug 05 17:32:04.318272 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.318132 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2w5nz"] Aug 05 17:32:04.318272 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.318172 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gll9d\"" Aug 05 17:32:04.318272 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.318222 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Aug 05 17:32:04.377527 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.377484 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5da62709-fe61-46b8-abea-278986a4cfcb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-2w5nz\" (UID: \"5da62709-fe61-46b8-abea-278986a4cfcb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2w5nz" Aug 05 17:32:04.377527 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.377526 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx5wd\" (UniqueName: \"kubernetes.io/projected/5da62709-fe61-46b8-abea-278986a4cfcb-kube-api-access-kx5wd\") pod \"kuadrant-operator-controller-manager-58fc56757c-2w5nz\" (UID: \"5da62709-fe61-46b8-abea-278986a4cfcb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2w5nz" Aug 05 17:32:04.479233 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.479189 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5da62709-fe61-46b8-abea-278986a4cfcb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-2w5nz\" (UID: \"5da62709-fe61-46b8-abea-278986a4cfcb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2w5nz" Aug 05 17:32:04.479473 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.479262 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx5wd\" (UniqueName: \"kubernetes.io/projected/5da62709-fe61-46b8-abea-278986a4cfcb-kube-api-access-kx5wd\") pod \"kuadrant-operator-controller-manager-58fc56757c-2w5nz\" (UID: \"5da62709-fe61-46b8-abea-278986a4cfcb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2w5nz" Aug 05 17:32:04.479802 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.479780 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5da62709-fe61-46b8-abea-278986a4cfcb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-2w5nz\" (UID: \"5da62709-fe61-46b8-abea-278986a4cfcb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2w5nz" Aug 05 17:32:04.489837 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.489791 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx5wd\" (UniqueName: \"kubernetes.io/projected/5da62709-fe61-46b8-abea-278986a4cfcb-kube-api-access-kx5wd\") pod \"kuadrant-operator-controller-manager-58fc56757c-2w5nz\" (UID: \"5da62709-fe61-46b8-abea-278986a4cfcb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2w5nz" Aug 05 17:32:04.628790 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.628750 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2w5nz" Aug 05 17:32:04.792711 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.792688 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2w5nz"] Aug 05 17:32:04.795607 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:32:04.795577 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5da62709_fe61_46b8_abea_278986a4cfcb.slice/crio-fe90d8f431a897e815512bae889e8004be4c9e44f06f8ace43146ad45889d46c WatchSource:0}: Error finding container fe90d8f431a897e815512bae889e8004be4c9e44f06f8ace43146ad45889d46c: Status 404 returned error can't find the container with id fe90d8f431a897e815512bae889e8004be4c9e44f06f8ace43146ad45889d46c Aug 05 17:32:04.802135 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:04.802107 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:05.000396 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:05.000209 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:05.470070 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:05.470036 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2w5nz" event={"ID":"5da62709-fe61-46b8-abea-278986a4cfcb","Type":"ContainerStarted","Data":"fe90d8f431a897e815512bae889e8004be4c9e44f06f8ace43146ad45889d46c"} Aug 05 17:32:06.376514 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:06.376473 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ctz42"] Aug 05 17:32:06.384506 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:06.384473 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ctz42" Aug 05 17:32:06.387505 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:06.387481 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-r4znm\"" Aug 05 17:32:06.395233 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:06.395163 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ctz42"] Aug 05 17:32:06.398211 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:06.398121 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64m2x\" (UniqueName: \"kubernetes.io/projected/4ac5f20c-d72f-4d8d-b3ab-3cade5bd5847-kube-api-access-64m2x\") pod \"limitador-operator-controller-manager-6c549b6d85-ctz42\" (UID: \"4ac5f20c-d72f-4d8d-b3ab-3cade5bd5847\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ctz42" Aug 05 17:32:06.499596 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:06.499559 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64m2x\" (UniqueName: \"kubernetes.io/projected/4ac5f20c-d72f-4d8d-b3ab-3cade5bd5847-kube-api-access-64m2x\") pod \"limitador-operator-controller-manager-6c549b6d85-ctz42\" (UID: \"4ac5f20c-d72f-4d8d-b3ab-3cade5bd5847\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ctz42" Aug 05 17:32:06.508837 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:06.508810 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64m2x\" (UniqueName: \"kubernetes.io/projected/4ac5f20c-d72f-4d8d-b3ab-3cade5bd5847-kube-api-access-64m2x\") pod \"limitador-operator-controller-manager-6c549b6d85-ctz42\" (UID: \"4ac5f20c-d72f-4d8d-b3ab-3cade5bd5847\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ctz42" Aug 05 17:32:06.700088 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:06.699793 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ctz42" Aug 05 17:32:06.770883 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:06.770846 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:06.875459 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:06.875319 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:06.977540 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:06.977435 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:07.176796 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:07.176743 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:07.281521 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:07.281489 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ctz42"] Aug 05 17:32:07.283615 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:32:07.283578 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ac5f20c_d72f_4d8d_b3ab_3cade5bd5847.slice/crio-f2d00f3e199a080fcad2d964ec78e99ae7848a2eff83c0685a2f24f5a90b8987 WatchSource:0}: Error finding container f2d00f3e199a080fcad2d964ec78e99ae7848a2eff83c0685a2f24f5a90b8987: Status 404 returned error can't find the container with id f2d00f3e199a080fcad2d964ec78e99ae7848a2eff83c0685a2f24f5a90b8987 Aug 05 17:32:07.488425 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:07.488387 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ctz42" event={"ID":"4ac5f20c-d72f-4d8d-b3ab-3cade5bd5847","Type":"ContainerStarted","Data":"f2d00f3e199a080fcad2d964ec78e99ae7848a2eff83c0685a2f24f5a90b8987"} Aug 05 17:32:08.516087 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:08.516048 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-v29lb"] Aug 05 17:32:08.520318 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:08.520295 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-v29lb" Aug 05 17:32:08.524964 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:08.524918 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Aug 05 17:32:08.525124 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:08.525100 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-vw6bd\"" Aug 05 17:32:08.541076 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:08.540990 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-v29lb"] Aug 05 17:32:08.551836 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:08.551808 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:08.620536 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:08.620505 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npzbp\" (UniqueName: \"kubernetes.io/projected/4902e1d0-5be3-4247-8412-658a66035af1-kube-api-access-npzbp\") pod \"dns-operator-controller-manager-5985564776-v29lb\" (UID: \"4902e1d0-5be3-4247-8412-658a66035af1\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-v29lb" Aug 05 17:32:08.640926 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:08.640893 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:08.721983 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:08.721948 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npzbp\" (UniqueName: \"kubernetes.io/projected/4902e1d0-5be3-4247-8412-658a66035af1-kube-api-access-npzbp\") pod \"dns-operator-controller-manager-5985564776-v29lb\" (UID: \"4902e1d0-5be3-4247-8412-658a66035af1\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-v29lb" Aug 05 17:32:08.736540 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:08.736511 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npzbp\" (UniqueName: \"kubernetes.io/projected/4902e1d0-5be3-4247-8412-658a66035af1-kube-api-access-npzbp\") pod \"dns-operator-controller-manager-5985564776-v29lb\" (UID: \"4902e1d0-5be3-4247-8412-658a66035af1\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-v29lb" Aug 05 17:32:08.739890 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:08.739857 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:08.834680 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:08.834639 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-v29lb" Aug 05 17:32:09.074548 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:09.074468 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-v29lb"] Aug 05 17:32:09.077772 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:32:09.077736 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4902e1d0_5be3_4247_8412_658a66035af1.slice/crio-b326ef1a9173ac8987ded81c56b01304fd587f29e7f870daf18ba4bc0a3a2483 WatchSource:0}: Error finding container b326ef1a9173ac8987ded81c56b01304fd587f29e7f870daf18ba4bc0a3a2483: Status 404 returned error can't find the container with id b326ef1a9173ac8987ded81c56b01304fd587f29e7f870daf18ba4bc0a3a2483 Aug 05 17:32:09.322387 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:09.322345 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:09.504606 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:09.504513 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2w5nz" event={"ID":"5da62709-fe61-46b8-abea-278986a4cfcb","Type":"ContainerStarted","Data":"5789931fb43adbee939624374fd9e546f84efd5d9c037b3467a53c99d8e3f306"} Aug 05 17:32:09.504880 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:09.504822 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2w5nz" Aug 05 17:32:09.506334 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:09.506312 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-v29lb" event={"ID":"4902e1d0-5be3-4247-8412-658a66035af1","Type":"ContainerStarted","Data":"b326ef1a9173ac8987ded81c56b01304fd587f29e7f870daf18ba4bc0a3a2483"} Aug 05 17:32:09.534601 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:09.534549 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2w5nz" podStartSLOduration=1.320619333 podStartE2EDuration="5.534533855s" totalImagesPullingTime="4.213914522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:32:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:32:09.532790265 +0000 UTC m=+517.300170500" watchObservedRunningTime="2026-08-05 17:32:09.534533855 +0000 UTC m=+517.301914088" Aug 05 17:32:10.519695 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:10.519659 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ctz42" event={"ID":"4ac5f20c-d72f-4d8d-b3ab-3cade5bd5847","Type":"ContainerStarted","Data":"e1022350cf51499b6cfc3072907c5d048e1826c1a31d92a12835d073560c9849"} Aug 05 17:32:10.520038 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:10.520016 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ctz42" Aug 05 17:32:10.539603 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:10.539546 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ctz42" podStartSLOduration=2.03153435 podStartE2EDuration="4.539527463s" totalImagesPullingTime="2.507993113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:32:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:32:10.537706488 +0000 UTC m=+518.305086747" watchObservedRunningTime="2026-08-05 17:32:10.539527463 +0000 UTC m=+518.306907696" Aug 05 17:32:10.767508 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:10.767467 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:10.905375 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:10.905346 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:11.289560 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:11.289475 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-4jt25"] Aug 05 17:32:11.293184 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:11.293163 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-4jt25" Aug 05 17:32:11.298385 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:11.298358 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-m6mqc\"" Aug 05 17:32:11.305441 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:11.305411 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-4jt25"] Aug 05 17:32:11.349612 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:11.349571 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdjwq\" (UniqueName: \"kubernetes.io/projected/53a28f8b-3f66-457b-9a10-488895c07975-kube-api-access-bdjwq\") pod \"authorino-operator-68d88948d8-4jt25\" (UID: \"53a28f8b-3f66-457b-9a10-488895c07975\") " pod="kuadrant-system/authorino-operator-68d88948d8-4jt25" Aug 05 17:32:11.450953 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:11.450910 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdjwq\" (UniqueName: \"kubernetes.io/projected/53a28f8b-3f66-457b-9a10-488895c07975-kube-api-access-bdjwq\") pod \"authorino-operator-68d88948d8-4jt25\" (UID: \"53a28f8b-3f66-457b-9a10-488895c07975\") " pod="kuadrant-system/authorino-operator-68d88948d8-4jt25" Aug 05 17:32:11.460030 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:11.460006 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdjwq\" (UniqueName: \"kubernetes.io/projected/53a28f8b-3f66-457b-9a10-488895c07975-kube-api-access-bdjwq\") pod \"authorino-operator-68d88948d8-4jt25\" (UID: \"53a28f8b-3f66-457b-9a10-488895c07975\") " pod="kuadrant-system/authorino-operator-68d88948d8-4jt25" Aug 05 17:32:11.526455 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:11.526416 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-v29lb" event={"ID":"4902e1d0-5be3-4247-8412-658a66035af1","Type":"ContainerStarted","Data":"a6251bbad66cdadec9cbd294cc68b387dd51b169c9e1a53a6efa976c5707c417"} Aug 05 17:32:11.526636 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:11.526489 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-v29lb" Aug 05 17:32:11.545807 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:11.545710 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-v29lb" podStartSLOduration=1.755259133 podStartE2EDuration="3.54569302s" totalImagesPullingTime="1.790433887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:32:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:32:11.54435643 +0000 UTC m=+519.311736663" watchObservedRunningTime="2026-08-05 17:32:11.54569302 +0000 UTC m=+519.313073252" Aug 05 17:32:11.603649 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:11.603605 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-4jt25" Aug 05 17:32:11.749321 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:11.749289 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-4jt25"] Aug 05 17:32:11.750877 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:32:11.750841 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53a28f8b_3f66_457b_9a10_488895c07975.slice/crio-bd02ce0c0c81261698d64e70fc1739df166041824aa4f4e0bb523d7fc8669f4c WatchSource:0}: Error finding container bd02ce0c0c81261698d64e70fc1739df166041824aa4f4e0bb523d7fc8669f4c: Status 404 returned error can't find the container with id bd02ce0c0c81261698d64e70fc1739df166041824aa4f4e0bb523d7fc8669f4c Aug 05 17:32:12.142682 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:12.142647 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:12.533553 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:12.533465 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-4jt25" event={"ID":"53a28f8b-3f66-457b-9a10-488895c07975","Type":"ContainerStarted","Data":"bd02ce0c0c81261698d64e70fc1739df166041824aa4f4e0bb523d7fc8669f4c"} Aug 05 17:32:12.909155 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:12.909092 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:14.546809 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:14.546766 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-4jt25" event={"ID":"53a28f8b-3f66-457b-9a10-488895c07975","Type":"ContainerStarted","Data":"d96a6fa0096803ada9c32663f5903cdc0537f0e3e54a737114d4cae1c141f57b"} Aug 05 17:32:14.547227 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:14.546930 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-4jt25" Aug 05 17:32:14.564807 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:14.564763 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-4jt25" podStartSLOduration=1.807366976 podStartE2EDuration="3.564749872s" totalImagesPullingTime="1.757382896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:32:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:32:14.563342862 +0000 UTC m=+522.330723095" watchObservedRunningTime="2026-08-05 17:32:14.564749872 +0000 UTC m=+522.332130105" Aug 05 17:32:15.129978 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:15.129933 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:15.201511 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:15.201473 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:15.524977 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:15.524890 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:15.625599 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:15.625564 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:15.926006 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:15.925975 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:15.986746 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:15.986710 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:20.522091 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:20.522063 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2w5nz" Aug 05 17:32:21.529586 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:21.529557 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ctz42" Aug 05 17:32:22.238880 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.238841 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:22.359160 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.359116 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:22.443320 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.443285 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bxd2g"] Aug 05 17:32:22.447135 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.447110 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bxd2g" Aug 05 17:32:22.456942 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.456918 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2w5nz"] Aug 05 17:32:22.457322 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.457291 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2w5nz" podUID="5da62709-fe61-46b8-abea-278986a4cfcb" containerName="manager" containerID="cri-o://5789931fb43adbee939624374fd9e546f84efd5d9c037b3467a53c99d8e3f306" gracePeriod=2 Aug 05 17:32:22.463486 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.463463 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2w5nz"] Aug 05 17:32:22.469644 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.469610 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bxd2g"] Aug 05 17:32:22.489207 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.489134 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bxd2g"] Aug 05 17:32:22.489778 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:32:22.489750 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-vrlzv], unattached volumes=[], failed to process volumes=[extensions-socket-volume kube-api-access-vrlzv]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bxd2g" podUID="b56a6d58-34a6-48dd-96b4-8db8309083c1" Aug 05 17:32:22.494172 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.493481 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9tgsb"] Aug 05 17:32:22.494172 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.494059 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5da62709-fe61-46b8-abea-278986a4cfcb" containerName="manager" Aug 05 17:32:22.494172 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.494073 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5da62709-fe61-46b8-abea-278986a4cfcb" containerName="manager" Aug 05 17:32:22.494400 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.494201 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5da62709-fe61-46b8-abea-278986a4cfcb" containerName="manager" Aug 05 17:32:22.495945 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:32:22.495889 2579 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"b56a6d58-34a6-48dd-96b4-8db8309083c1\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-08-05T17:32:22Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-08-05T17:32:22Z\\\",\\\"observedGeneration\\\":1,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-08-05T17:32:22Z\\\",\\\"message\\\":\\\"containers with unready status: [manager]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-08-05T17:32:22Z\\\",\\\"message\\\":\\\"containers with unready status: [manager]\\\",\\\"observedGeneration\\\":1,\\\"reason\\\":\\\"ContainersNotReady\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":1,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:8c2d9a84169e86454e4fb3df6f4846c5c5495d19b01137b6e78e113161981e47\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"manager\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/tmp/kuadrant\\\",\\\"name\\\":\\\"extensions-socket-volume\\\"},{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-vrlzv\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.136.250\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.136.250\\\"}],\\\"observedGeneration\\\":1,\\\"startTime\\\":\\\"2026-08-05T17:32:22Z\\\"}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-68cf589589-bxd2g\": pods \"kuadrant-operator-controller-manager-68cf589589-bxd2g\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bxd2g" Aug 05 17:32:22.497726 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.497708 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bxd2g"] Aug 05 17:32:22.497838 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.497788 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9tgsb" Aug 05 17:32:22.502038 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:32:22.502008 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-2w5nz\" is forbidden: User \"system:node:ip-10-0-136-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-250.ec2.internal' and this object" podUID="5da62709-fe61-46b8-abea-278986a4cfcb" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2w5nz" Aug 05 17:32:22.503998 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.503968 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ctz42"] Aug 05 17:32:22.504135 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.504115 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ctz42" podUID="4ac5f20c-d72f-4d8d-b3ab-3cade5bd5847" containerName="manager" containerID="cri-o://e1022350cf51499b6cfc3072907c5d048e1826c1a31d92a12835d073560c9849" gracePeriod=2 Aug 05 17:32:22.505027 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:32:22.504955 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-68cf589589-bxd2g\" is forbidden: User \"system:node:ip-10-0-136-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-250.ec2.internal' and this object" podUID="b56a6d58-34a6-48dd-96b4-8db8309083c1" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bxd2g" Aug 05 17:32:22.507943 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:32:22.507917 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-2w5nz\" is forbidden: User \"system:node:ip-10-0-136-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-250.ec2.internal' and this object" podUID="5da62709-fe61-46b8-abea-278986a4cfcb" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2w5nz" Aug 05 17:32:22.510814 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:32:22.510787 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-68cf589589-bxd2g\" is forbidden: User \"system:node:ip-10-0-136-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-250.ec2.internal' and this object" podUID="b56a6d58-34a6-48dd-96b4-8db8309083c1" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bxd2g" Aug 05 17:32:22.514603 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.514580 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9tgsb"] Aug 05 17:32:22.526510 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.526478 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ctz42"] Aug 05 17:32:22.533492 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.529042 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7w98f"] Aug 05 17:32:22.533492 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.529891 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ac5f20c-d72f-4d8d-b3ab-3cade5bd5847" containerName="manager" Aug 05 17:32:22.533492 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.529910 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ac5f20c-d72f-4d8d-b3ab-3cade5bd5847" containerName="manager" Aug 05 17:32:22.533492 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.530124 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ac5f20c-d72f-4d8d-b3ab-3cade5bd5847" containerName="manager" Aug 05 17:32:22.534841 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.534819 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7w98f" Aug 05 17:32:22.536009 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.535988 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-v29lb" Aug 05 17:32:22.541358 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:32:22.541316 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-ctz42\" is forbidden: User \"system:node:ip-10-0-136-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-250.ec2.internal' and this object" podUID="4ac5f20c-d72f-4d8d-b3ab-3cade5bd5847" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ctz42" Aug 05 17:32:22.543684 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.543654 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jk2jb"] Aug 05 17:32:22.546184 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:32:22.546137 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-ctz42\" is forbidden: User \"system:node:ip-10-0-136-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-250.ec2.internal' and this object" podUID="4ac5f20c-d72f-4d8d-b3ab-3cade5bd5847" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ctz42" Aug 05 17:32:22.547844 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.547800 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jk2jb" Aug 05 17:32:22.548738 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:32:22.548711 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-68cf589589-bxd2g\" is forbidden: User \"system:node:ip-10-0-136-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-250.ec2.internal' and this object" podUID="b56a6d58-34a6-48dd-96b4-8db8309083c1" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bxd2g" Aug 05 17:32:22.549639 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.549618 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7w98f"] Aug 05 17:32:22.550169 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.550118 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9m8w\" (UniqueName: \"kubernetes.io/projected/8841f41a-d30f-462b-a773-01da270053b3-kube-api-access-z9m8w\") pod \"kuadrant-operator-controller-manager-58fc56757c-9tgsb\" (UID: \"8841f41a-d30f-462b-a773-01da270053b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9tgsb" Aug 05 17:32:22.550261 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.550196 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8841f41a-d30f-462b-a773-01da270053b3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-9tgsb\" (UID: \"8841f41a-d30f-462b-a773-01da270053b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9tgsb" Aug 05 17:32:22.565615 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.565583 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jk2jb"] Aug 05 17:32:22.599406 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.599378 2579 generic.go:356] "Generic (PLEG): container finished" podID="5da62709-fe61-46b8-abea-278986a4cfcb" containerID="5789931fb43adbee939624374fd9e546f84efd5d9c037b3467a53c99d8e3f306" exitCode=0 Aug 05 17:32:22.599588 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.599560 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bxd2g" Aug 05 17:32:22.602909 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:32:22.602875 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-2w5nz\" is forbidden: User \"system:node:ip-10-0-136-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-250.ec2.internal' and this object" podUID="5da62709-fe61-46b8-abea-278986a4cfcb" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2w5nz" Aug 05 17:32:22.606966 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:32:22.606936 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-68cf589589-bxd2g\" is forbidden: User \"system:node:ip-10-0-136-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-250.ec2.internal' and this object" podUID="b56a6d58-34a6-48dd-96b4-8db8309083c1" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bxd2g" Aug 05 17:32:22.611683 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.611591 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bxd2g" Aug 05 17:32:22.628735 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:32:22.628691 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-2w5nz\" is forbidden: User \"system:node:ip-10-0-136-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-250.ec2.internal' and this object" podUID="5da62709-fe61-46b8-abea-278986a4cfcb" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2w5nz" Aug 05 17:32:22.630945 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:32:22.630913 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-ctz42\" is forbidden: User \"system:node:ip-10-0-136-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-250.ec2.internal' and this object" podUID="4ac5f20c-d72f-4d8d-b3ab-3cade5bd5847" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ctz42" Aug 05 17:32:22.633277 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:32:22.633245 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-68cf589589-bxd2g\" is forbidden: User \"system:node:ip-10-0-136-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-250.ec2.internal' and this object" podUID="b56a6d58-34a6-48dd-96b4-8db8309083c1" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bxd2g" Aug 05 17:32:22.635528 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:32:22.635500 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-2w5nz\" is forbidden: User \"system:node:ip-10-0-136-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-250.ec2.internal' and this object" podUID="5da62709-fe61-46b8-abea-278986a4cfcb" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2w5nz" Aug 05 17:32:22.637713 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:32:22.637687 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-ctz42\" is forbidden: User \"system:node:ip-10-0-136-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-250.ec2.internal' and this object" podUID="4ac5f20c-d72f-4d8d-b3ab-3cade5bd5847" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ctz42" Aug 05 17:32:22.651207 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.651106 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpn2h\" (UniqueName: \"kubernetes.io/projected/71b2b669-7a65-4006-a795-15f328215073-kube-api-access-qpn2h\") pod \"kuadrant-operator-controller-manager-68cf589589-7w98f\" (UID: \"71b2b669-7a65-4006-a795-15f328215073\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7w98f" Aug 05 17:32:22.651207 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.651205 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/71b2b669-7a65-4006-a795-15f328215073-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-7w98f\" (UID: \"71b2b669-7a65-4006-a795-15f328215073\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7w98f" Aug 05 17:32:22.651421 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.651252 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8841f41a-d30f-462b-a773-01da270053b3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-9tgsb\" (UID: \"8841f41a-d30f-462b-a773-01da270053b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9tgsb" Aug 05 17:32:22.651421 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.651282 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49nkr\" (UniqueName: \"kubernetes.io/projected/bc95fe38-12e7-42ec-81d2-081ef6d3eabb-kube-api-access-49nkr\") pod \"limitador-operator-controller-manager-6c549b6d85-jk2jb\" (UID: \"bc95fe38-12e7-42ec-81d2-081ef6d3eabb\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jk2jb" Aug 05 17:32:22.651537 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.651451 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9m8w\" (UniqueName: \"kubernetes.io/projected/8841f41a-d30f-462b-a773-01da270053b3-kube-api-access-z9m8w\") pod \"kuadrant-operator-controller-manager-58fc56757c-9tgsb\" (UID: \"8841f41a-d30f-462b-a773-01da270053b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9tgsb" Aug 05 17:32:22.652018 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.651978 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8841f41a-d30f-462b-a773-01da270053b3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-9tgsb\" (UID: \"8841f41a-d30f-462b-a773-01da270053b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9tgsb" Aug 05 17:32:22.664550 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.664517 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9m8w\" (UniqueName: \"kubernetes.io/projected/8841f41a-d30f-462b-a773-01da270053b3-kube-api-access-z9m8w\") pod \"kuadrant-operator-controller-manager-58fc56757c-9tgsb\" (UID: \"8841f41a-d30f-462b-a773-01da270053b3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9tgsb" Aug 05 17:32:22.752250 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.752219 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpn2h\" (UniqueName: \"kubernetes.io/projected/71b2b669-7a65-4006-a795-15f328215073-kube-api-access-qpn2h\") pod \"kuadrant-operator-controller-manager-68cf589589-7w98f\" (UID: \"71b2b669-7a65-4006-a795-15f328215073\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7w98f" Aug 05 17:32:22.752378 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.752276 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/71b2b669-7a65-4006-a795-15f328215073-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-7w98f\" (UID: \"71b2b669-7a65-4006-a795-15f328215073\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7w98f" Aug 05 17:32:22.752378 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.752328 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49nkr\" (UniqueName: \"kubernetes.io/projected/bc95fe38-12e7-42ec-81d2-081ef6d3eabb-kube-api-access-49nkr\") pod \"limitador-operator-controller-manager-6c549b6d85-jk2jb\" (UID: \"bc95fe38-12e7-42ec-81d2-081ef6d3eabb\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jk2jb" Aug 05 17:32:22.752649 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.752630 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/71b2b669-7a65-4006-a795-15f328215073-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-7w98f\" (UID: \"71b2b669-7a65-4006-a795-15f328215073\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7w98f" Aug 05 17:32:22.758419 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.758393 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2w5nz" Aug 05 17:32:22.760592 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.760570 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ctz42" Aug 05 17:32:22.760946 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:32:22.760923 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-68cf589589-bxd2g\" is forbidden: User \"system:node:ip-10-0-136-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-250.ec2.internal' and this object" podUID="b56a6d58-34a6-48dd-96b4-8db8309083c1" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bxd2g" Aug 05 17:32:22.762394 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.762369 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpn2h\" (UniqueName: \"kubernetes.io/projected/71b2b669-7a65-4006-a795-15f328215073-kube-api-access-qpn2h\") pod \"kuadrant-operator-controller-manager-68cf589589-7w98f\" (UID: \"71b2b669-7a65-4006-a795-15f328215073\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7w98f" Aug 05 17:32:22.763137 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.763120 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49nkr\" (UniqueName: \"kubernetes.io/projected/bc95fe38-12e7-42ec-81d2-081ef6d3eabb-kube-api-access-49nkr\") pod \"limitador-operator-controller-manager-6c549b6d85-jk2jb\" (UID: \"bc95fe38-12e7-42ec-81d2-081ef6d3eabb\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jk2jb" Aug 05 17:32:22.763472 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:32:22.763450 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-2w5nz\" is forbidden: User \"system:node:ip-10-0-136-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-250.ec2.internal' and this object" podUID="5da62709-fe61-46b8-abea-278986a4cfcb" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2w5nz" Aug 05 17:32:22.765638 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:32:22.765619 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-ctz42\" is forbidden: User \"system:node:ip-10-0-136-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-250.ec2.internal' and this object" podUID="4ac5f20c-d72f-4d8d-b3ab-3cade5bd5847" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ctz42" Aug 05 17:32:22.767847 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:32:22.767824 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-68cf589589-bxd2g\" is forbidden: User \"system:node:ip-10-0-136-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-250.ec2.internal' and this object" podUID="b56a6d58-34a6-48dd-96b4-8db8309083c1" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bxd2g" Aug 05 17:32:22.769806 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:32:22.769776 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-2w5nz\" is forbidden: User \"system:node:ip-10-0-136-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-250.ec2.internal' and this object" podUID="5da62709-fe61-46b8-abea-278986a4cfcb" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2w5nz" Aug 05 17:32:22.770820 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.770802 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b56a6d58-34a6-48dd-96b4-8db8309083c1" path="/var/lib/kubelet/pods/b56a6d58-34a6-48dd-96b4-8db8309083c1/volumes" Aug 05 17:32:22.771884 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:32:22.771867 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-ctz42\" is forbidden: User \"system:node:ip-10-0-136-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-250.ec2.internal' and this object" podUID="4ac5f20c-d72f-4d8d-b3ab-3cade5bd5847" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ctz42" Aug 05 17:32:22.853132 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.853106 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64m2x\" (UniqueName: \"kubernetes.io/projected/4ac5f20c-d72f-4d8d-b3ab-3cade5bd5847-kube-api-access-64m2x\") pod \"4ac5f20c-d72f-4d8d-b3ab-3cade5bd5847\" (UID: \"4ac5f20c-d72f-4d8d-b3ab-3cade5bd5847\") " Aug 05 17:32:22.853327 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.853161 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5da62709-fe61-46b8-abea-278986a4cfcb-extensions-socket-volume\") pod \"5da62709-fe61-46b8-abea-278986a4cfcb\" (UID: \"5da62709-fe61-46b8-abea-278986a4cfcb\") " Aug 05 17:32:22.853327 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.853264 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kx5wd\" (UniqueName: \"kubernetes.io/projected/5da62709-fe61-46b8-abea-278986a4cfcb-kube-api-access-kx5wd\") pod \"5da62709-fe61-46b8-abea-278986a4cfcb\" (UID: \"5da62709-fe61-46b8-abea-278986a4cfcb\") " Aug 05 17:32:22.853630 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.853607 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5da62709-fe61-46b8-abea-278986a4cfcb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5da62709-fe61-46b8-abea-278986a4cfcb" (UID: "5da62709-fe61-46b8-abea-278986a4cfcb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:32:22.855367 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.855338 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5da62709-fe61-46b8-abea-278986a4cfcb-kube-api-access-kx5wd" (OuterVolumeSpecName: "kube-api-access-kx5wd") pod "5da62709-fe61-46b8-abea-278986a4cfcb" (UID: "5da62709-fe61-46b8-abea-278986a4cfcb"). InnerVolumeSpecName "kube-api-access-kx5wd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:32:22.855445 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.855364 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ac5f20c-d72f-4d8d-b3ab-3cade5bd5847-kube-api-access-64m2x" (OuterVolumeSpecName: "kube-api-access-64m2x") pod "4ac5f20c-d72f-4d8d-b3ab-3cade5bd5847" (UID: "4ac5f20c-d72f-4d8d-b3ab-3cade5bd5847"). InnerVolumeSpecName "kube-api-access-64m2x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:32:22.889440 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.889398 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9tgsb" Aug 05 17:32:22.899666 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.899641 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7w98f" Aug 05 17:32:22.908576 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.908555 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jk2jb" Aug 05 17:32:22.957226 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.957127 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kx5wd\" (UniqueName: \"kubernetes.io/projected/5da62709-fe61-46b8-abea-278986a4cfcb-kube-api-access-kx5wd\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:32:22.957226 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.957175 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64m2x\" (UniqueName: \"kubernetes.io/projected/4ac5f20c-d72f-4d8d-b3ab-3cade5bd5847-kube-api-access-64m2x\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:32:22.957226 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:22.957196 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5da62709-fe61-46b8-abea-278986a4cfcb-extensions-socket-volume\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:32:23.072092 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:32:23.072048 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8841f41a_d30f_462b_a773_01da270053b3.slice/crio-7497c665badc992b050878ef5180e3788fee167d7345c795e673927155e8d5ca WatchSource:0}: Error finding container 7497c665badc992b050878ef5180e3788fee167d7345c795e673927155e8d5ca: Status 404 returned error can't find the container with id 7497c665badc992b050878ef5180e3788fee167d7345c795e673927155e8d5ca Aug 05 17:32:23.073470 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:23.073447 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9tgsb"] Aug 05 17:32:23.305669 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:32:23.305617 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc95fe38_12e7_42ec_81d2_081ef6d3eabb.slice/crio-a964d04713dac45d8223d87f76c2782a84f157c14d525c16a01fd42d716bb4a6 WatchSource:0}: Error finding container a964d04713dac45d8223d87f76c2782a84f157c14d525c16a01fd42d716bb4a6: Status 404 returned error can't find the container with id a964d04713dac45d8223d87f76c2782a84f157c14d525c16a01fd42d716bb4a6 Aug 05 17:32:23.306430 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:32:23.306406 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71b2b669_7a65_4006_a795_15f328215073.slice/crio-5a1d00c9948670d013298ea0320816a01e31e00245ae40ec5d50b8f0a9171b43 WatchSource:0}: Error finding container 5a1d00c9948670d013298ea0320816a01e31e00245ae40ec5d50b8f0a9171b43: Status 404 returned error can't find the container with id 5a1d00c9948670d013298ea0320816a01e31e00245ae40ec5d50b8f0a9171b43 Aug 05 17:32:23.308154 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:23.308112 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jk2jb"] Aug 05 17:32:23.310777 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:23.310754 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7w98f"] Aug 05 17:32:23.607128 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:23.607092 2579 generic.go:356] "Generic (PLEG): container finished" podID="4ac5f20c-d72f-4d8d-b3ab-3cade5bd5847" containerID="e1022350cf51499b6cfc3072907c5d048e1826c1a31d92a12835d073560c9849" exitCode=0 Aug 05 17:32:23.607596 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:23.607188 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ctz42" Aug 05 17:32:23.607596 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:23.607237 2579 scope.go:117] "RemoveContainer" containerID="e1022350cf51499b6cfc3072907c5d048e1826c1a31d92a12835d073560c9849" Aug 05 17:32:23.609275 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:23.609244 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jk2jb" event={"ID":"bc95fe38-12e7-42ec-81d2-081ef6d3eabb","Type":"ContainerStarted","Data":"737c200dad279f3e7647d28d1a74c624bbe1afc23d97a4c893c75808726815ac"} Aug 05 17:32:23.609395 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:23.609305 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jk2jb" event={"ID":"bc95fe38-12e7-42ec-81d2-081ef6d3eabb","Type":"ContainerStarted","Data":"a964d04713dac45d8223d87f76c2782a84f157c14d525c16a01fd42d716bb4a6"} Aug 05 17:32:23.609395 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:23.609352 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jk2jb" Aug 05 17:32:23.609795 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:32:23.609641 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-ctz42\" is forbidden: User \"system:node:ip-10-0-136-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-250.ec2.internal' and this object" podUID="4ac5f20c-d72f-4d8d-b3ab-3cade5bd5847" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ctz42" Aug 05 17:32:23.611136 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:23.611094 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2w5nz" Aug 05 17:32:23.613455 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:23.613430 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9tgsb" event={"ID":"8841f41a-d30f-462b-a773-01da270053b3","Type":"ContainerStarted","Data":"d3f9a7e29fc2ba04d580e080589e8ef41d34593a9a09c2b2e2d416b0ed9584e9"} Aug 05 17:32:23.613564 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:23.613479 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9tgsb" event={"ID":"8841f41a-d30f-462b-a773-01da270053b3","Type":"ContainerStarted","Data":"7497c665badc992b050878ef5180e3788fee167d7345c795e673927155e8d5ca"} Aug 05 17:32:23.613626 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:23.613593 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9tgsb" Aug 05 17:32:23.615253 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:23.615233 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bxd2g" Aug 05 17:32:23.615347 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:23.615263 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7w98f" event={"ID":"71b2b669-7a65-4006-a795-15f328215073","Type":"ContainerStarted","Data":"44eb3f576452456e75abbaaebcee3d00cee2356e3c91813d97a1d2dbc50122e4"} Aug 05 17:32:23.615347 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:23.615303 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7w98f" event={"ID":"71b2b669-7a65-4006-a795-15f328215073","Type":"ContainerStarted","Data":"5a1d00c9948670d013298ea0320816a01e31e00245ae40ec5d50b8f0a9171b43"} Aug 05 17:32:23.615347 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:23.615329 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7w98f" Aug 05 17:32:23.618914 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:23.618895 2579 scope.go:117] "RemoveContainer" containerID="e1022350cf51499b6cfc3072907c5d048e1826c1a31d92a12835d073560c9849" Aug 05 17:32:23.619476 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:32:23.619329 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1022350cf51499b6cfc3072907c5d048e1826c1a31d92a12835d073560c9849\": container with ID starting with e1022350cf51499b6cfc3072907c5d048e1826c1a31d92a12835d073560c9849 not found: ID does not exist" containerID="e1022350cf51499b6cfc3072907c5d048e1826c1a31d92a12835d073560c9849" Aug 05 17:32:23.619476 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:23.619369 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1022350cf51499b6cfc3072907c5d048e1826c1a31d92a12835d073560c9849"} err="failed to get container status \"e1022350cf51499b6cfc3072907c5d048e1826c1a31d92a12835d073560c9849\": rpc error: code = NotFound desc = could not find container \"e1022350cf51499b6cfc3072907c5d048e1826c1a31d92a12835d073560c9849\": container with ID starting with e1022350cf51499b6cfc3072907c5d048e1826c1a31d92a12835d073560c9849 not found: ID does not exist" Aug 05 17:32:23.619476 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:23.619391 2579 scope.go:117] "RemoveContainer" containerID="5789931fb43adbee939624374fd9e546f84efd5d9c037b3467a53c99d8e3f306" Aug 05 17:32:23.633595 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:23.633554 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jk2jb" podStartSLOduration=1.6335387510000001 podStartE2EDuration="1.633538751s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:32:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:32:23.632038773 +0000 UTC m=+531.399419031" watchObservedRunningTime="2026-08-05 17:32:23.633538751 +0000 UTC m=+531.400918961" Aug 05 17:32:23.634462 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:32:23.634438 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-ctz42\" is forbidden: User \"system:node:ip-10-0-136-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-250.ec2.internal' and this object" podUID="4ac5f20c-d72f-4d8d-b3ab-3cade5bd5847" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ctz42" Aug 05 17:32:23.636719 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:32:23.636696 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-68cf589589-bxd2g\" is forbidden: User \"system:node:ip-10-0-136-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-250.ec2.internal' and this object" podUID="b56a6d58-34a6-48dd-96b4-8db8309083c1" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-bxd2g" Aug 05 17:32:23.658806 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:23.658762 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7w98f" podStartSLOduration=1.658746294 podStartE2EDuration="1.658746294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:32:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:32:23.658614399 +0000 UTC m=+531.425994631" watchObservedRunningTime="2026-08-05 17:32:23.658746294 +0000 UTC m=+531.426126526" Aug 05 17:32:23.682882 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:23.682832 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9tgsb" podStartSLOduration=1.68281735 podStartE2EDuration="1.68281735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:32:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:32:23.681858224 +0000 UTC m=+531.449238457" watchObservedRunningTime="2026-08-05 17:32:23.68281735 +0000 UTC m=+531.450197583" Aug 05 17:32:23.684490 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:32:23.684348 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-2w5nz\" is forbidden: User \"system:node:ip-10-0-136-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-250.ec2.internal' and this object" podUID="5da62709-fe61-46b8-abea-278986a4cfcb" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-2w5nz" Aug 05 17:32:23.686625 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:32:23.686582 2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-ctz42\" is forbidden: User \"system:node:ip-10-0-136-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-250.ec2.internal' and this object" podUID="4ac5f20c-d72f-4d8d-b3ab-3cade5bd5847" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-ctz42" Aug 05 17:32:24.603884 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:24.603799 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:24.720510 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:24.720448 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:24.771310 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:24.771278 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ac5f20c-d72f-4d8d-b3ab-3cade5bd5847" path="/var/lib/kubelet/pods/4ac5f20c-d72f-4d8d-b3ab-3cade5bd5847/volumes" Aug 05 17:32:24.771654 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:24.771641 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5da62709-fe61-46b8-abea-278986a4cfcb" path="/var/lib/kubelet/pods/5da62709-fe61-46b8-abea-278986a4cfcb/volumes" Aug 05 17:32:25.554555 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:25.554525 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-4jt25" Aug 05 17:32:31.147638 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:31.147574 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:31.245980 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:31.245941 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:34.625456 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:34.625423 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9tgsb" Aug 05 17:32:34.625862 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:34.625496 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-7w98f" Aug 05 17:32:34.625862 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:34.625532 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jk2jb" Aug 05 17:32:34.711537 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:34.711504 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9tgsb"] Aug 05 17:32:34.711811 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:34.711772 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9tgsb" podUID="8841f41a-d30f-462b-a773-01da270053b3" containerName="manager" containerID="cri-o://d3f9a7e29fc2ba04d580e080589e8ef41d34593a9a09c2b2e2d416b0ed9584e9" gracePeriod=10 Aug 05 17:32:34.972676 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:34.972653 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9tgsb" Aug 05 17:32:35.070662 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:35.070633 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9m8w\" (UniqueName: \"kubernetes.io/projected/8841f41a-d30f-462b-a773-01da270053b3-kube-api-access-z9m8w\") pod \"8841f41a-d30f-462b-a773-01da270053b3\" (UID: \"8841f41a-d30f-462b-a773-01da270053b3\") " Aug 05 17:32:35.070815 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:35.070761 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8841f41a-d30f-462b-a773-01da270053b3-extensions-socket-volume\") pod \"8841f41a-d30f-462b-a773-01da270053b3\" (UID: \"8841f41a-d30f-462b-a773-01da270053b3\") " Aug 05 17:32:35.071118 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:35.071091 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8841f41a-d30f-462b-a773-01da270053b3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8841f41a-d30f-462b-a773-01da270053b3" (UID: "8841f41a-d30f-462b-a773-01da270053b3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:32:35.072749 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:35.072717 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8841f41a-d30f-462b-a773-01da270053b3-kube-api-access-z9m8w" (OuterVolumeSpecName: "kube-api-access-z9m8w") pod "8841f41a-d30f-462b-a773-01da270053b3" (UID: "8841f41a-d30f-462b-a773-01da270053b3"). InnerVolumeSpecName "kube-api-access-z9m8w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:32:35.171808 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:35.171726 2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8841f41a-d30f-462b-a773-01da270053b3-extensions-socket-volume\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:32:35.171808 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:35.171756 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9m8w\" (UniqueName: \"kubernetes.io/projected/8841f41a-d30f-462b-a773-01da270053b3-kube-api-access-z9m8w\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:32:35.697520 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:35.697485 2579 generic.go:356] "Generic (PLEG): container finished" podID="8841f41a-d30f-462b-a773-01da270053b3" containerID="d3f9a7e29fc2ba04d580e080589e8ef41d34593a9a09c2b2e2d416b0ed9584e9" exitCode=0 Aug 05 17:32:35.697969 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:35.697533 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9tgsb" Aug 05 17:32:35.697969 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:35.697537 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9tgsb" event={"ID":"8841f41a-d30f-462b-a773-01da270053b3","Type":"ContainerDied","Data":"d3f9a7e29fc2ba04d580e080589e8ef41d34593a9a09c2b2e2d416b0ed9584e9"} Aug 05 17:32:35.697969 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:35.697679 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9tgsb" event={"ID":"8841f41a-d30f-462b-a773-01da270053b3","Type":"ContainerDied","Data":"7497c665badc992b050878ef5180e3788fee167d7345c795e673927155e8d5ca"} Aug 05 17:32:35.697969 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:35.697713 2579 scope.go:117] "RemoveContainer" containerID="d3f9a7e29fc2ba04d580e080589e8ef41d34593a9a09c2b2e2d416b0ed9584e9" Aug 05 17:32:35.707302 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:35.707285 2579 scope.go:117] "RemoveContainer" containerID="d3f9a7e29fc2ba04d580e080589e8ef41d34593a9a09c2b2e2d416b0ed9584e9" Aug 05 17:32:35.707596 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:32:35.707577 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3f9a7e29fc2ba04d580e080589e8ef41d34593a9a09c2b2e2d416b0ed9584e9\": container with ID starting with d3f9a7e29fc2ba04d580e080589e8ef41d34593a9a09c2b2e2d416b0ed9584e9 not found: ID does not exist" containerID="d3f9a7e29fc2ba04d580e080589e8ef41d34593a9a09c2b2e2d416b0ed9584e9" Aug 05 17:32:35.707716 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:35.707610 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3f9a7e29fc2ba04d580e080589e8ef41d34593a9a09c2b2e2d416b0ed9584e9"} err="failed to get container status \"d3f9a7e29fc2ba04d580e080589e8ef41d34593a9a09c2b2e2d416b0ed9584e9\": rpc error: code = NotFound desc = could not find container \"d3f9a7e29fc2ba04d580e080589e8ef41d34593a9a09c2b2e2d416b0ed9584e9\": container with ID starting with d3f9a7e29fc2ba04d580e080589e8ef41d34593a9a09c2b2e2d416b0ed9584e9 not found: ID does not exist" Aug 05 17:32:35.724771 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:35.724748 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9tgsb"] Aug 05 17:32:35.730316 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:35.730295 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-9tgsb"] Aug 05 17:32:36.352348 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:36.352315 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:36.452938 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:36.452907 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:36.747821 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:36.747713 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:36.770256 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:36.770223 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8841f41a-d30f-462b-a773-01da270053b3" path="/var/lib/kubelet/pods/8841f41a-d30f-462b-a773-01da270053b3/volumes" Aug 05 17:32:36.851088 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:36.851051 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:36.942685 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:36.942652 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:37.044750 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:37.044632 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:42.940333 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:42.940292 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:43.948499 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:43.948460 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:44.051351 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:44.051320 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:46.396973 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:46.396932 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:46.498298 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:46.498257 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:51.144195 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:51.144155 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:51.382253 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:51.382218 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:52.949627 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:52.949592 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:53.050653 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:53.050618 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:53.360412 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:53.360377 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:53.375469 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:53.375435 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-frmbn"] Aug 05 17:32:53.375918 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:53.375891 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8841f41a-d30f-462b-a773-01da270053b3" containerName="manager" Aug 05 17:32:53.375918 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:53.375908 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8841f41a-d30f-462b-a773-01da270053b3" containerName="manager" Aug 05 17:32:53.376097 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:53.375995 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8841f41a-d30f-462b-a773-01da270053b3" containerName="manager" Aug 05 17:32:53.381461 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:53.381443 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-frmbn" Aug 05 17:32:53.384346 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:53.384328 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Aug 05 17:32:53.384438 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:53.384418 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-m9js8\"" Aug 05 17:32:53.392246 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:53.392225 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-frmbn"] Aug 05 17:32:53.441433 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:53.441401 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx62f\" (UniqueName: \"kubernetes.io/projected/06ba779d-f081-42f6-8b1d-5e08b252beb4-kube-api-access-dx62f\") pod \"limitador-limitador-859c4d96d6-frmbn\" (UID: \"06ba779d-f081-42f6-8b1d-5e08b252beb4\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-frmbn" Aug 05 17:32:53.441623 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:53.441533 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/06ba779d-f081-42f6-8b1d-5e08b252beb4-config-file\") pod \"limitador-limitador-859c4d96d6-frmbn\" (UID: \"06ba779d-f081-42f6-8b1d-5e08b252beb4\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-frmbn" Aug 05 17:32:53.467658 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:53.467626 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-frmbn"] Aug 05 17:32:53.470351 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:53.470318 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:53.542516 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:53.542481 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/06ba779d-f081-42f6-8b1d-5e08b252beb4-config-file\") pod \"limitador-limitador-859c4d96d6-frmbn\" (UID: \"06ba779d-f081-42f6-8b1d-5e08b252beb4\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-frmbn" Aug 05 17:32:53.542693 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:53.542549 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dx62f\" (UniqueName: \"kubernetes.io/projected/06ba779d-f081-42f6-8b1d-5e08b252beb4-kube-api-access-dx62f\") pod \"limitador-limitador-859c4d96d6-frmbn\" (UID: \"06ba779d-f081-42f6-8b1d-5e08b252beb4\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-frmbn" Aug 05 17:32:53.543081 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:53.543060 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/06ba779d-f081-42f6-8b1d-5e08b252beb4-config-file\") pod \"limitador-limitador-859c4d96d6-frmbn\" (UID: \"06ba779d-f081-42f6-8b1d-5e08b252beb4\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-frmbn" Aug 05 17:32:53.551095 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:53.551070 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx62f\" (UniqueName: \"kubernetes.io/projected/06ba779d-f081-42f6-8b1d-5e08b252beb4-kube-api-access-dx62f\") pod \"limitador-limitador-859c4d96d6-frmbn\" (UID: \"06ba779d-f081-42f6-8b1d-5e08b252beb4\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-frmbn" Aug 05 17:32:53.568205 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:53.568167 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:53.693974 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:53.693894 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-frmbn" Aug 05 17:32:53.855392 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:53.855369 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-frmbn"] Aug 05 17:32:53.857102 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:32:53.857080 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06ba779d_f081_42f6_8b1d_5e08b252beb4.slice/crio-38979c55114ef4df5508a33b239db9361c0ee4eca3d3c45a9ccd0f7c601c143c WatchSource:0}: Error finding container 38979c55114ef4df5508a33b239db9361c0ee4eca3d3c45a9ccd0f7c601c143c: Status 404 returned error can't find the container with id 38979c55114ef4df5508a33b239db9361c0ee4eca3d3c45a9ccd0f7c601c143c Aug 05 17:32:54.166269 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:54.166239 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-d5827"] Aug 05 17:32:54.169385 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:54.169368 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-d5827" Aug 05 17:32:54.172369 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:54.172342 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-p9542\"" Aug 05 17:32:54.179102 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:54.179082 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-d5827"] Aug 05 17:32:54.206713 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:54.206684 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:54.249375 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:54.249346 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxjf8\" (UniqueName: \"kubernetes.io/projected/62226564-1e1f-4ff0-b42f-84f3d8daba0d-kube-api-access-zxjf8\") pod \"authorino-b54df94b4-d5827\" (UID: \"62226564-1e1f-4ff0-b42f-84f3d8daba0d\") " pod="kuadrant-system/authorino-b54df94b4-d5827" Aug 05 17:32:54.302365 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:54.302321 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:54.350650 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:54.350618 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxjf8\" (UniqueName: \"kubernetes.io/projected/62226564-1e1f-4ff0-b42f-84f3d8daba0d-kube-api-access-zxjf8\") pod \"authorino-b54df94b4-d5827\" (UID: \"62226564-1e1f-4ff0-b42f-84f3d8daba0d\") " pod="kuadrant-system/authorino-b54df94b4-d5827" Aug 05 17:32:54.359325 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:54.359293 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxjf8\" (UniqueName: \"kubernetes.io/projected/62226564-1e1f-4ff0-b42f-84f3d8daba0d-kube-api-access-zxjf8\") pod \"authorino-b54df94b4-d5827\" (UID: \"62226564-1e1f-4ff0-b42f-84f3d8daba0d\") " pod="kuadrant-system/authorino-b54df94b4-d5827" Aug 05 17:32:54.480438 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:54.480340 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-d5827" Aug 05 17:32:54.611764 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:54.611689 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-d5827"] Aug 05 17:32:54.614337 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:32:54.614308 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62226564_1e1f_4ff0_b42f_84f3d8daba0d.slice/crio-86435d75c397455e65631841e4b66352803055396fa125a05f5334f2682ffac0 WatchSource:0}: Error finding container 86435d75c397455e65631841e4b66352803055396fa125a05f5334f2682ffac0: Status 404 returned error can't find the container with id 86435d75c397455e65631841e4b66352803055396fa125a05f5334f2682ffac0 Aug 05 17:32:54.812532 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:54.812440 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-frmbn" event={"ID":"06ba779d-f081-42f6-8b1d-5e08b252beb4","Type":"ContainerStarted","Data":"38979c55114ef4df5508a33b239db9361c0ee4eca3d3c45a9ccd0f7c601c143c"} Aug 05 17:32:54.813649 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:54.813623 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-d5827" event={"ID":"62226564-1e1f-4ff0-b42f-84f3d8daba0d","Type":"ContainerStarted","Data":"86435d75c397455e65631841e4b66352803055396fa125a05f5334f2682ffac0"} Aug 05 17:32:56.829251 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:56.829212 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-d5827" event={"ID":"62226564-1e1f-4ff0-b42f-84f3d8daba0d","Type":"ContainerStarted","Data":"815232a36dc88f47cfb8a11977587e34c8f15a62ca2f383257219b75c97ec6a8"} Aug 05 17:32:56.846765 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:56.846709 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-d5827" podStartSLOduration=1.009221932 podStartE2EDuration="2.846694397s" totalImagesPullingTime="1.837472465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:32:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:32:56.844471818 +0000 UTC m=+564.611852052" watchObservedRunningTime="2026-08-05 17:32:56.846694397 +0000 UTC m=+564.614074629" Aug 05 17:32:57.668859 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:57.668826 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-d5827"] Aug 05 17:32:57.837306 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:57.837264 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-frmbn" event={"ID":"06ba779d-f081-42f6-8b1d-5e08b252beb4","Type":"ContainerStarted","Data":"4ee8d17cb317cfb35e0ccb5132b01efd60b54cd02642f59203cfaa019bd7e97f"} Aug 05 17:32:57.837693 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:57.837357 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-frmbn" Aug 05 17:32:57.855283 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:57.855237 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-frmbn" podStartSLOduration=1.038778206 podStartE2EDuration="4.855223269s" totalImagesPullingTime="3.816445063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:32:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:32:57.852288952 +0000 UTC m=+565.619669184" watchObservedRunningTime="2026-08-05 17:32:57.855223269 +0000 UTC m=+565.622603506" Aug 05 17:32:58.310712 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:58.310679 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:58.411483 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:58.411450 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:58.842847 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:58.842808 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-d5827" podUID="62226564-1e1f-4ff0-b42f-84f3d8daba0d" containerName="authorino" containerID="cri-o://815232a36dc88f47cfb8a11977587e34c8f15a62ca2f383257219b75c97ec6a8" gracePeriod=30 Aug 05 17:32:59.087948 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:59.087925 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-d5827" Aug 05 17:32:59.199353 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:59.199257 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxjf8\" (UniqueName: \"kubernetes.io/projected/62226564-1e1f-4ff0-b42f-84f3d8daba0d-kube-api-access-zxjf8\") pod \"62226564-1e1f-4ff0-b42f-84f3d8daba0d\" (UID: \"62226564-1e1f-4ff0-b42f-84f3d8daba0d\") " Aug 05 17:32:59.201295 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:59.201270 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62226564-1e1f-4ff0-b42f-84f3d8daba0d-kube-api-access-zxjf8" (OuterVolumeSpecName: "kube-api-access-zxjf8") pod "62226564-1e1f-4ff0-b42f-84f3d8daba0d" (UID: "62226564-1e1f-4ff0-b42f-84f3d8daba0d"). InnerVolumeSpecName "kube-api-access-zxjf8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:32:59.300571 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:59.300537 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxjf8\" (UniqueName: \"kubernetes.io/projected/62226564-1e1f-4ff0-b42f-84f3d8daba0d-kube-api-access-zxjf8\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:32:59.850479 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:59.850447 2579 generic.go:356] "Generic (PLEG): container finished" podID="62226564-1e1f-4ff0-b42f-84f3d8daba0d" containerID="815232a36dc88f47cfb8a11977587e34c8f15a62ca2f383257219b75c97ec6a8" exitCode=0 Aug 05 17:32:59.850917 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:59.850495 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-d5827" Aug 05 17:32:59.850917 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:59.850536 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-d5827" event={"ID":"62226564-1e1f-4ff0-b42f-84f3d8daba0d","Type":"ContainerDied","Data":"815232a36dc88f47cfb8a11977587e34c8f15a62ca2f383257219b75c97ec6a8"} Aug 05 17:32:59.850917 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:59.850581 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-d5827" event={"ID":"62226564-1e1f-4ff0-b42f-84f3d8daba0d","Type":"ContainerDied","Data":"86435d75c397455e65631841e4b66352803055396fa125a05f5334f2682ffac0"} Aug 05 17:32:59.850917 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:59.850606 2579 scope.go:117] "RemoveContainer" containerID="815232a36dc88f47cfb8a11977587e34c8f15a62ca2f383257219b75c97ec6a8" Aug 05 17:32:59.860472 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:59.860452 2579 scope.go:117] "RemoveContainer" containerID="815232a36dc88f47cfb8a11977587e34c8f15a62ca2f383257219b75c97ec6a8" Aug 05 17:32:59.860788 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:32:59.860769 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"815232a36dc88f47cfb8a11977587e34c8f15a62ca2f383257219b75c97ec6a8\": container with ID starting with 815232a36dc88f47cfb8a11977587e34c8f15a62ca2f383257219b75c97ec6a8 not found: ID does not exist" containerID="815232a36dc88f47cfb8a11977587e34c8f15a62ca2f383257219b75c97ec6a8" Aug 05 17:32:59.860847 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:59.860797 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"815232a36dc88f47cfb8a11977587e34c8f15a62ca2f383257219b75c97ec6a8"} err="failed to get container status \"815232a36dc88f47cfb8a11977587e34c8f15a62ca2f383257219b75c97ec6a8\": rpc error: code = NotFound desc = could not find container \"815232a36dc88f47cfb8a11977587e34c8f15a62ca2f383257219b75c97ec6a8\": container with ID starting with 815232a36dc88f47cfb8a11977587e34c8f15a62ca2f383257219b75c97ec6a8 not found: ID does not exist" Aug 05 17:32:59.872096 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:59.872057 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-d5827"] Aug 05 17:32:59.876683 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:32:59.876659 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-d5827"] Aug 05 17:33:00.770275 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:00.770245 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62226564-1e1f-4ff0-b42f-84f3d8daba0d" path="/var/lib/kubelet/pods/62226564-1e1f-4ff0-b42f-84f3d8daba0d/volumes" Aug 05 17:33:08.674163 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:08.670283 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-frmbn"] Aug 05 17:33:08.674163 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:08.670625 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-frmbn" podUID="06ba779d-f081-42f6-8b1d-5e08b252beb4" containerName="limitador" containerID="cri-o://4ee8d17cb317cfb35e0ccb5132b01efd60b54cd02642f59203cfaa019bd7e97f" gracePeriod=30 Aug 05 17:33:08.675474 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:08.675452 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-frmbn" Aug 05 17:33:09.235916 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:09.235853 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-frmbn" Aug 05 17:33:09.390856 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:09.390820 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/06ba779d-f081-42f6-8b1d-5e08b252beb4-config-file\") pod \"06ba779d-f081-42f6-8b1d-5e08b252beb4\" (UID: \"06ba779d-f081-42f6-8b1d-5e08b252beb4\") " Aug 05 17:33:09.391055 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:09.390874 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dx62f\" (UniqueName: \"kubernetes.io/projected/06ba779d-f081-42f6-8b1d-5e08b252beb4-kube-api-access-dx62f\") pod \"06ba779d-f081-42f6-8b1d-5e08b252beb4\" (UID: \"06ba779d-f081-42f6-8b1d-5e08b252beb4\") " Aug 05 17:33:09.391276 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:09.391249 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06ba779d-f081-42f6-8b1d-5e08b252beb4-config-file" (OuterVolumeSpecName: "config-file") pod "06ba779d-f081-42f6-8b1d-5e08b252beb4" (UID: "06ba779d-f081-42f6-8b1d-5e08b252beb4"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:33:09.392977 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:09.392948 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06ba779d-f081-42f6-8b1d-5e08b252beb4-kube-api-access-dx62f" (OuterVolumeSpecName: "kube-api-access-dx62f") pod "06ba779d-f081-42f6-8b1d-5e08b252beb4" (UID: "06ba779d-f081-42f6-8b1d-5e08b252beb4"). InnerVolumeSpecName "kube-api-access-dx62f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:33:09.491893 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:09.491806 2579 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/06ba779d-f081-42f6-8b1d-5e08b252beb4-config-file\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:33:09.491893 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:09.491832 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dx62f\" (UniqueName: \"kubernetes.io/projected/06ba779d-f081-42f6-8b1d-5e08b252beb4-kube-api-access-dx62f\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:33:09.909034 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:09.908995 2579 generic.go:356] "Generic (PLEG): container finished" podID="06ba779d-f081-42f6-8b1d-5e08b252beb4" containerID="4ee8d17cb317cfb35e0ccb5132b01efd60b54cd02642f59203cfaa019bd7e97f" exitCode=0 Aug 05 17:33:09.909490 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:09.909046 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-frmbn" Aug 05 17:33:09.909490 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:09.909090 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-frmbn" event={"ID":"06ba779d-f081-42f6-8b1d-5e08b252beb4","Type":"ContainerDied","Data":"4ee8d17cb317cfb35e0ccb5132b01efd60b54cd02642f59203cfaa019bd7e97f"} Aug 05 17:33:09.909490 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:09.909156 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-frmbn" event={"ID":"06ba779d-f081-42f6-8b1d-5e08b252beb4","Type":"ContainerDied","Data":"38979c55114ef4df5508a33b239db9361c0ee4eca3d3c45a9ccd0f7c601c143c"} Aug 05 17:33:09.909490 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:09.909185 2579 scope.go:117] "RemoveContainer" containerID="4ee8d17cb317cfb35e0ccb5132b01efd60b54cd02642f59203cfaa019bd7e97f" Aug 05 17:33:09.919083 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:09.919060 2579 scope.go:117] "RemoveContainer" containerID="4ee8d17cb317cfb35e0ccb5132b01efd60b54cd02642f59203cfaa019bd7e97f" Aug 05 17:33:09.919367 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:33:09.919340 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ee8d17cb317cfb35e0ccb5132b01efd60b54cd02642f59203cfaa019bd7e97f\": container with ID starting with 4ee8d17cb317cfb35e0ccb5132b01efd60b54cd02642f59203cfaa019bd7e97f not found: ID does not exist" containerID="4ee8d17cb317cfb35e0ccb5132b01efd60b54cd02642f59203cfaa019bd7e97f" Aug 05 17:33:09.919428 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:09.919376 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ee8d17cb317cfb35e0ccb5132b01efd60b54cd02642f59203cfaa019bd7e97f"} err="failed to get container status \"4ee8d17cb317cfb35e0ccb5132b01efd60b54cd02642f59203cfaa019bd7e97f\": rpc error: code = NotFound desc = could not find container \"4ee8d17cb317cfb35e0ccb5132b01efd60b54cd02642f59203cfaa019bd7e97f\": container with ID starting with 4ee8d17cb317cfb35e0ccb5132b01efd60b54cd02642f59203cfaa019bd7e97f not found: ID does not exist" Aug 05 17:33:09.931697 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:09.931670 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-frmbn"] Aug 05 17:33:09.935164 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:09.935128 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-frmbn"] Aug 05 17:33:10.771050 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:10.771017 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06ba779d-f081-42f6-8b1d-5e08b252beb4" path="/var/lib/kubelet/pods/06ba779d-f081-42f6-8b1d-5e08b252beb4/volumes" Aug 05 17:33:14.632018 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:14.631979 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:33:14.730300 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:14.730251 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:33:15.099931 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:15.099901 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-m96tq"] Aug 05 17:33:15.100352 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:15.100337 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06ba779d-f081-42f6-8b1d-5e08b252beb4" containerName="limitador" Aug 05 17:33:15.100399 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:15.100354 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="06ba779d-f081-42f6-8b1d-5e08b252beb4" containerName="limitador" Aug 05 17:33:15.100399 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:15.100365 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62226564-1e1f-4ff0-b42f-84f3d8daba0d" containerName="authorino" Aug 05 17:33:15.100399 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:15.100370 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="62226564-1e1f-4ff0-b42f-84f3d8daba0d" containerName="authorino" Aug 05 17:33:15.100491 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:15.100445 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="62226564-1e1f-4ff0-b42f-84f3d8daba0d" containerName="authorino" Aug 05 17:33:15.100491 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:15.100458 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="06ba779d-f081-42f6-8b1d-5e08b252beb4" containerName="limitador" Aug 05 17:33:15.103378 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:15.103360 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-m96tq" Aug 05 17:33:15.106287 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:15.106263 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Aug 05 17:33:15.107655 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:15.107635 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Aug 05 17:33:15.107859 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:15.107648 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Aug 05 17:33:15.107975 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:15.107734 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-6sxgc\"" Aug 05 17:33:15.111767 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:15.111747 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-m96tq"] Aug 05 17:33:15.136646 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:15.136619 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:33:15.243336 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:15.243305 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c8a8c8a9-e792-4e7d-be72-4db4d539e360-data\") pod \"postgres-69fb4594cf-m96tq\" (UID: \"c8a8c8a9-e792-4e7d-be72-4db4d539e360\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-m96tq" Aug 05 17:33:15.243523 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:15.243362 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvf7f\" (UniqueName: \"kubernetes.io/projected/c8a8c8a9-e792-4e7d-be72-4db4d539e360-kube-api-access-bvf7f\") pod \"postgres-69fb4594cf-m96tq\" (UID: \"c8a8c8a9-e792-4e7d-be72-4db4d539e360\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-m96tq" Aug 05 17:33:15.344934 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:15.344895 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c8a8c8a9-e792-4e7d-be72-4db4d539e360-data\") pod \"postgres-69fb4594cf-m96tq\" (UID: \"c8a8c8a9-e792-4e7d-be72-4db4d539e360\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-m96tq" Aug 05 17:33:15.345078 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:15.344947 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvf7f\" (UniqueName: \"kubernetes.io/projected/c8a8c8a9-e792-4e7d-be72-4db4d539e360-kube-api-access-bvf7f\") pod \"postgres-69fb4594cf-m96tq\" (UID: \"c8a8c8a9-e792-4e7d-be72-4db4d539e360\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-m96tq" Aug 05 17:33:15.345297 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:15.345278 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c8a8c8a9-e792-4e7d-be72-4db4d539e360-data\") pod \"postgres-69fb4594cf-m96tq\" (UID: \"c8a8c8a9-e792-4e7d-be72-4db4d539e360\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-m96tq" Aug 05 17:33:15.359792 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:15.359726 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvf7f\" (UniqueName: \"kubernetes.io/projected/c8a8c8a9-e792-4e7d-be72-4db4d539e360-kube-api-access-bvf7f\") pod \"postgres-69fb4594cf-m96tq\" (UID: \"c8a8c8a9-e792-4e7d-be72-4db4d539e360\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-m96tq" Aug 05 17:33:15.416729 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:15.416692 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-m96tq" Aug 05 17:33:15.560452 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:15.560428 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-m96tq"] Aug 05 17:33:15.562064 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:33:15.562034 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8a8c8a9_e792_4e7d_be72_4db4d539e360.slice/crio-cfa2f32bb6861fe699c2ba8ae3f6a02af4c2598e7356198d3ae7043645f83900 WatchSource:0}: Error finding container cfa2f32bb6861fe699c2ba8ae3f6a02af4c2598e7356198d3ae7043645f83900: Status 404 returned error can't find the container with id cfa2f32bb6861fe699c2ba8ae3f6a02af4c2598e7356198d3ae7043645f83900 Aug 05 17:33:15.946480 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:15.946445 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-m96tq" event={"ID":"c8a8c8a9-e792-4e7d-be72-4db4d539e360","Type":"ContainerStarted","Data":"cfa2f32bb6861fe699c2ba8ae3f6a02af4c2598e7356198d3ae7043645f83900"} Aug 05 17:33:20.995864 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:20.995817 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-m96tq" event={"ID":"c8a8c8a9-e792-4e7d-be72-4db4d539e360","Type":"ContainerStarted","Data":"d03645c59dfeab2cac91cb821c40df9e28739c4bd221d54aa82b308df5f0e256"} Aug 05 17:33:20.996345 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:20.996052 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-m96tq" Aug 05 17:33:21.015483 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:21.015426 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-m96tq" podStartSLOduration=1.109806152 podStartE2EDuration="6.015405753s" totalImagesPullingTime="4.905599601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:33:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:33:21.012640146 +0000 UTC m=+588.780020378" watchObservedRunningTime="2026-08-05 17:33:21.015405753 +0000 UTC m=+588.782785986" Aug 05 17:33:24.496333 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:24.496299 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:33:27.031034 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:27.031006 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-m96tq" Aug 05 17:33:27.355371 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:27.355336 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:33:27.560941 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:27.560905 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:33:27.620735 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:27.620659 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-2zkgq"] Aug 05 17:33:27.623545 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:27.623523 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-2zkgq" Aug 05 17:33:27.626237 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:27.626221 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-p9542\"" Aug 05 17:33:27.634575 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:27.634553 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-2zkgq"] Aug 05 17:33:27.666532 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:27.666505 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dnbn\" (UniqueName: \"kubernetes.io/projected/a656faff-2793-4b06-bdbf-4e7bf0825dca-kube-api-access-6dnbn\") pod \"authorino-5dc7ccb5f-2zkgq\" (UID: \"a656faff-2793-4b06-bdbf-4e7bf0825dca\") " pod="kuadrant-system/authorino-5dc7ccb5f-2zkgq" Aug 05 17:33:27.672696 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:27.672669 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-2zkgq"] Aug 05 17:33:27.673002 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:33:27.672977 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-6dnbn], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5dc7ccb5f-2zkgq" podUID="a656faff-2793-4b06-bdbf-4e7bf0825dca" Aug 05 17:33:27.703774 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:27.703741 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-687bd45585-ptl8h"] Aug 05 17:33:27.706810 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:27.706789 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-ptl8h" Aug 05 17:33:27.709585 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:27.709562 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Aug 05 17:33:27.717344 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:27.717324 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-687bd45585-ptl8h"] Aug 05 17:33:27.767175 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:27.767128 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/669002b0-c34e-4117-b45a-e9bc3c138c78-tls-cert\") pod \"authorino-687bd45585-ptl8h\" (UID: \"669002b0-c34e-4117-b45a-e9bc3c138c78\") " pod="kuadrant-system/authorino-687bd45585-ptl8h" Aug 05 17:33:27.767363 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:27.767246 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq974\" (UniqueName: \"kubernetes.io/projected/669002b0-c34e-4117-b45a-e9bc3c138c78-kube-api-access-tq974\") pod \"authorino-687bd45585-ptl8h\" (UID: \"669002b0-c34e-4117-b45a-e9bc3c138c78\") " pod="kuadrant-system/authorino-687bd45585-ptl8h" Aug 05 17:33:27.767363 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:27.767277 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dnbn\" (UniqueName: \"kubernetes.io/projected/a656faff-2793-4b06-bdbf-4e7bf0825dca-kube-api-access-6dnbn\") pod \"authorino-5dc7ccb5f-2zkgq\" (UID: \"a656faff-2793-4b06-bdbf-4e7bf0825dca\") " pod="kuadrant-system/authorino-5dc7ccb5f-2zkgq" Aug 05 17:33:27.776283 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:27.776260 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dnbn\" (UniqueName: \"kubernetes.io/projected/a656faff-2793-4b06-bdbf-4e7bf0825dca-kube-api-access-6dnbn\") pod \"authorino-5dc7ccb5f-2zkgq\" (UID: \"a656faff-2793-4b06-bdbf-4e7bf0825dca\") " pod="kuadrant-system/authorino-5dc7ccb5f-2zkgq" Aug 05 17:33:27.867748 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:27.867716 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq974\" (UniqueName: \"kubernetes.io/projected/669002b0-c34e-4117-b45a-e9bc3c138c78-kube-api-access-tq974\") pod \"authorino-687bd45585-ptl8h\" (UID: \"669002b0-c34e-4117-b45a-e9bc3c138c78\") " pod="kuadrant-system/authorino-687bd45585-ptl8h" Aug 05 17:33:27.867947 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:27.867812 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/669002b0-c34e-4117-b45a-e9bc3c138c78-tls-cert\") pod \"authorino-687bd45585-ptl8h\" (UID: \"669002b0-c34e-4117-b45a-e9bc3c138c78\") " pod="kuadrant-system/authorino-687bd45585-ptl8h" Aug 05 17:33:27.870363 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:27.870333 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/669002b0-c34e-4117-b45a-e9bc3c138c78-tls-cert\") pod \"authorino-687bd45585-ptl8h\" (UID: \"669002b0-c34e-4117-b45a-e9bc3c138c78\") " pod="kuadrant-system/authorino-687bd45585-ptl8h" Aug 05 17:33:27.880232 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:27.880172 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq974\" (UniqueName: \"kubernetes.io/projected/669002b0-c34e-4117-b45a-e9bc3c138c78-kube-api-access-tq974\") pod \"authorino-687bd45585-ptl8h\" (UID: \"669002b0-c34e-4117-b45a-e9bc3c138c78\") " pod="kuadrant-system/authorino-687bd45585-ptl8h" Aug 05 17:33:27.898828 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:27.898795 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-ptl8h"] Aug 05 17:33:27.899109 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:27.899095 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-ptl8h" Aug 05 17:33:28.039739 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:28.039643 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-2zkgq" Aug 05 17:33:28.042288 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:28.042266 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-ptl8h"] Aug 05 17:33:28.044028 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:33:28.044006 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod669002b0_c34e_4117_b45a_e9bc3c138c78.slice/crio-8961e2b224fc49e2f7ec56003d20d30c844f795faa57ea0075ce9f5a05ffd5d9 WatchSource:0}: Error finding container 8961e2b224fc49e2f7ec56003d20d30c844f795faa57ea0075ce9f5a05ffd5d9: Status 404 returned error can't find the container with id 8961e2b224fc49e2f7ec56003d20d30c844f795faa57ea0075ce9f5a05ffd5d9 Aug 05 17:33:28.047379 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:28.047360 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-2zkgq" Aug 05 17:33:28.069858 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:28.069827 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dnbn\" (UniqueName: \"kubernetes.io/projected/a656faff-2793-4b06-bdbf-4e7bf0825dca-kube-api-access-6dnbn\") pod \"a656faff-2793-4b06-bdbf-4e7bf0825dca\" (UID: \"a656faff-2793-4b06-bdbf-4e7bf0825dca\") " Aug 05 17:33:28.071975 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:28.071951 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a656faff-2793-4b06-bdbf-4e7bf0825dca-kube-api-access-6dnbn" (OuterVolumeSpecName: "kube-api-access-6dnbn") pod "a656faff-2793-4b06-bdbf-4e7bf0825dca" (UID: "a656faff-2793-4b06-bdbf-4e7bf0825dca"). InnerVolumeSpecName "kube-api-access-6dnbn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:33:28.171006 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:28.170919 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dnbn\" (UniqueName: \"kubernetes.io/projected/a656faff-2793-4b06-bdbf-4e7bf0825dca-kube-api-access-6dnbn\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:33:29.047577 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:29.047487 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-687bd45585-ptl8h" event={"ID":"669002b0-c34e-4117-b45a-e9bc3c138c78","Type":"ContainerStarted","Data":"c9de85ed78c4367e3f11cdefa885f895004619544bc90378b1cab8fb0e18b224"} Aug 05 17:33:29.047577 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:29.047537 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-687bd45585-ptl8h" event={"ID":"669002b0-c34e-4117-b45a-e9bc3c138c78","Type":"ContainerStarted","Data":"8961e2b224fc49e2f7ec56003d20d30c844f795faa57ea0075ce9f5a05ffd5d9"} Aug 05 17:33:29.047577 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:29.047500 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-2zkgq" Aug 05 17:33:29.047577 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:29.047563 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-687bd45585-ptl8h" podUID="669002b0-c34e-4117-b45a-e9bc3c138c78" containerName="authorino" containerID="cri-o://c9de85ed78c4367e3f11cdefa885f895004619544bc90378b1cab8fb0e18b224" gracePeriod=30 Aug 05 17:33:29.068458 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:29.068418 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-687bd45585-ptl8h" podStartSLOduration=1.636421307 podStartE2EDuration="2.068402197s" totalImagesPullingTime="431.98089ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:33:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:33:29.066297506 +0000 UTC m=+596.833677740" watchObservedRunningTime="2026-08-05 17:33:29.068402197 +0000 UTC m=+596.835782429" Aug 05 17:33:29.093417 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:29.093393 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-2zkgq"] Aug 05 17:33:29.099804 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:29.099783 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-2zkgq"] Aug 05 17:33:29.301956 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:29.301896 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-ptl8h" Aug 05 17:33:29.384164 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:29.384115 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/669002b0-c34e-4117-b45a-e9bc3c138c78-tls-cert\") pod \"669002b0-c34e-4117-b45a-e9bc3c138c78\" (UID: \"669002b0-c34e-4117-b45a-e9bc3c138c78\") " Aug 05 17:33:29.384312 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:29.384173 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tq974\" (UniqueName: \"kubernetes.io/projected/669002b0-c34e-4117-b45a-e9bc3c138c78-kube-api-access-tq974\") pod \"669002b0-c34e-4117-b45a-e9bc3c138c78\" (UID: \"669002b0-c34e-4117-b45a-e9bc3c138c78\") " Aug 05 17:33:29.386111 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:29.386077 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/669002b0-c34e-4117-b45a-e9bc3c138c78-kube-api-access-tq974" (OuterVolumeSpecName: "kube-api-access-tq974") pod "669002b0-c34e-4117-b45a-e9bc3c138c78" (UID: "669002b0-c34e-4117-b45a-e9bc3c138c78"). InnerVolumeSpecName "kube-api-access-tq974". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:33:29.394438 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:29.394406 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/669002b0-c34e-4117-b45a-e9bc3c138c78-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "669002b0-c34e-4117-b45a-e9bc3c138c78" (UID: "669002b0-c34e-4117-b45a-e9bc3c138c78"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:33:29.485670 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:29.485636 2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/669002b0-c34e-4117-b45a-e9bc3c138c78-tls-cert\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:33:29.485670 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:29.485664 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tq974\" (UniqueName: \"kubernetes.io/projected/669002b0-c34e-4117-b45a-e9bc3c138c78-kube-api-access-tq974\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:33:30.054525 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:30.054438 2579 generic.go:356] "Generic (PLEG): container finished" podID="669002b0-c34e-4117-b45a-e9bc3c138c78" containerID="c9de85ed78c4367e3f11cdefa885f895004619544bc90378b1cab8fb0e18b224" exitCode=0 Aug 05 17:33:30.054525 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:30.054485 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-ptl8h" Aug 05 17:33:30.054992 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:30.054524 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-687bd45585-ptl8h" event={"ID":"669002b0-c34e-4117-b45a-e9bc3c138c78","Type":"ContainerDied","Data":"c9de85ed78c4367e3f11cdefa885f895004619544bc90378b1cab8fb0e18b224"} Aug 05 17:33:30.054992 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:30.054568 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-687bd45585-ptl8h" event={"ID":"669002b0-c34e-4117-b45a-e9bc3c138c78","Type":"ContainerDied","Data":"8961e2b224fc49e2f7ec56003d20d30c844f795faa57ea0075ce9f5a05ffd5d9"} Aug 05 17:33:30.054992 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:30.054586 2579 scope.go:117] "RemoveContainer" containerID="c9de85ed78c4367e3f11cdefa885f895004619544bc90378b1cab8fb0e18b224" Aug 05 17:33:30.064274 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:30.064258 2579 scope.go:117] "RemoveContainer" containerID="c9de85ed78c4367e3f11cdefa885f895004619544bc90378b1cab8fb0e18b224" Aug 05 17:33:30.064516 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:33:30.064499 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9de85ed78c4367e3f11cdefa885f895004619544bc90378b1cab8fb0e18b224\": container with ID starting with c9de85ed78c4367e3f11cdefa885f895004619544bc90378b1cab8fb0e18b224 not found: ID does not exist" containerID="c9de85ed78c4367e3f11cdefa885f895004619544bc90378b1cab8fb0e18b224" Aug 05 17:33:30.064578 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:30.064523 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9de85ed78c4367e3f11cdefa885f895004619544bc90378b1cab8fb0e18b224"} err="failed to get container status \"c9de85ed78c4367e3f11cdefa885f895004619544bc90378b1cab8fb0e18b224\": rpc error: code = NotFound desc = could not find container \"c9de85ed78c4367e3f11cdefa885f895004619544bc90378b1cab8fb0e18b224\": container with ID starting with c9de85ed78c4367e3f11cdefa885f895004619544bc90378b1cab8fb0e18b224 not found: ID does not exist" Aug 05 17:33:30.075964 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:30.075925 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-ptl8h"] Aug 05 17:33:30.082039 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:30.082011 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-687bd45585-ptl8h"] Aug 05 17:33:30.771051 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:30.771016 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="669002b0-c34e-4117-b45a-e9bc3c138c78" path="/var/lib/kubelet/pods/669002b0-c34e-4117-b45a-e9bc3c138c78/volumes" Aug 05 17:33:30.771456 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:30.771438 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a656faff-2793-4b06-bdbf-4e7bf0825dca" path="/var/lib/kubelet/pods/a656faff-2793-4b06-bdbf-4e7bf0825dca/volumes" Aug 05 17:33:32.681560 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:32.681532 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-lpd2k_fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de/cluster-monitoring-operator/0.log" Aug 05 17:33:32.682021 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:32.682010 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-lpd2k_fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de/cluster-monitoring-operator/0.log" Aug 05 17:33:32.687023 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:32.687000 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-5qdp4_e8e537f1-bb75-456e-973b-5ccffc3077c9/console-operator/2.log" Aug 05 17:33:32.687458 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:32.687436 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-5qdp4_e8e537f1-bb75-456e-973b-5ccffc3077c9/console-operator/2.log" Aug 05 17:33:33.736694 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:33.736657 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:33:33.792689 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:33.792654 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:33:34.790415 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:34.790375 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:33:34.807157 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:34.807105 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-bcf45894d-dsk7q"] Aug 05 17:33:34.807586 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:34.807569 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="669002b0-c34e-4117-b45a-e9bc3c138c78" containerName="authorino" Aug 05 17:33:34.807636 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:34.807588 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="669002b0-c34e-4117-b45a-e9bc3c138c78" containerName="authorino" Aug 05 17:33:34.807675 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:34.807658 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="669002b0-c34e-4117-b45a-e9bc3c138c78" containerName="authorino" Aug 05 17:33:34.809941 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:34.809919 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bcf45894d-dsk7q" Aug 05 17:33:34.812628 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:34.812607 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Aug 05 17:33:34.813266 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:34.813250 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Aug 05 17:33:34.813446 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:34.813251 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-sx62t\"" Aug 05 17:33:34.828978 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:34.828950 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bcf45894d-dsk7q"] Aug 05 17:33:34.831684 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:34.831659 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3214f56-4101-44fc-aa41-dd8fe97791db-webhook-cert\") pod \"maas-controller-bcf45894d-dsk7q\" (UID: \"e3214f56-4101-44fc-aa41-dd8fe97791db\") " pod="opendatahub/maas-controller-bcf45894d-dsk7q" Aug 05 17:33:34.831781 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:34.831738 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk95f\" (UniqueName: \"kubernetes.io/projected/e3214f56-4101-44fc-aa41-dd8fe97791db-kube-api-access-jk95f\") pod \"maas-controller-bcf45894d-dsk7q\" (UID: \"e3214f56-4101-44fc-aa41-dd8fe97791db\") " pod="opendatahub/maas-controller-bcf45894d-dsk7q" Aug 05 17:33:34.898968 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:34.898934 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:33:34.933213 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:34.933178 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3214f56-4101-44fc-aa41-dd8fe97791db-webhook-cert\") pod \"maas-controller-bcf45894d-dsk7q\" (UID: \"e3214f56-4101-44fc-aa41-dd8fe97791db\") " pod="opendatahub/maas-controller-bcf45894d-dsk7q" Aug 05 17:33:34.933357 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:34.933262 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk95f\" (UniqueName: \"kubernetes.io/projected/e3214f56-4101-44fc-aa41-dd8fe97791db-kube-api-access-jk95f\") pod \"maas-controller-bcf45894d-dsk7q\" (UID: \"e3214f56-4101-44fc-aa41-dd8fe97791db\") " pod="opendatahub/maas-controller-bcf45894d-dsk7q" Aug 05 17:33:34.933357 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:33:34.933305 2579 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Aug 05 17:33:34.933428 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:33:34.933365 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3214f56-4101-44fc-aa41-dd8fe97791db-webhook-cert podName:e3214f56-4101-44fc-aa41-dd8fe97791db nodeName:}" failed. No retries permitted until 2026-08-05 17:33:35.433348803 +0000 UTC m=+603.200729013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/e3214f56-4101-44fc-aa41-dd8fe97791db-webhook-cert") pod "maas-controller-bcf45894d-dsk7q" (UID: "e3214f56-4101-44fc-aa41-dd8fe97791db") : secret "maas-controller-webhook-cert" not found Aug 05 17:33:34.942804 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:34.942773 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk95f\" (UniqueName: \"kubernetes.io/projected/e3214f56-4101-44fc-aa41-dd8fe97791db-kube-api-access-jk95f\") pod \"maas-controller-bcf45894d-dsk7q\" (UID: \"e3214f56-4101-44fc-aa41-dd8fe97791db\") " pod="opendatahub/maas-controller-bcf45894d-dsk7q" Aug 05 17:33:34.992643 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:34.992610 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:33:34.999931 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:34.999904 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7fb5b67fd7-r52h9"] Aug 05 17:33:35.003248 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:35.003227 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fb5b67fd7-r52h9" Aug 05 17:33:35.013873 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:35.013844 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fb5b67fd7-r52h9"] Aug 05 17:33:35.034321 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:35.034292 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xdxl\" (UniqueName: \"kubernetes.io/projected/347f2b4f-45ca-444a-8b41-71e9e330d1de-kube-api-access-2xdxl\") pod \"maas-controller-7fb5b67fd7-r52h9\" (UID: \"347f2b4f-45ca-444a-8b41-71e9e330d1de\") " pod="opendatahub/maas-controller-7fb5b67fd7-r52h9" Aug 05 17:33:35.034484 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:35.034353 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/347f2b4f-45ca-444a-8b41-71e9e330d1de-webhook-cert\") pod \"maas-controller-7fb5b67fd7-r52h9\" (UID: \"347f2b4f-45ca-444a-8b41-71e9e330d1de\") " pod="opendatahub/maas-controller-7fb5b67fd7-r52h9" Aug 05 17:33:35.135498 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:35.135449 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xdxl\" (UniqueName: \"kubernetes.io/projected/347f2b4f-45ca-444a-8b41-71e9e330d1de-kube-api-access-2xdxl\") pod \"maas-controller-7fb5b67fd7-r52h9\" (UID: \"347f2b4f-45ca-444a-8b41-71e9e330d1de\") " pod="opendatahub/maas-controller-7fb5b67fd7-r52h9" Aug 05 17:33:35.135689 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:35.135530 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/347f2b4f-45ca-444a-8b41-71e9e330d1de-webhook-cert\") pod \"maas-controller-7fb5b67fd7-r52h9\" (UID: \"347f2b4f-45ca-444a-8b41-71e9e330d1de\") " pod="opendatahub/maas-controller-7fb5b67fd7-r52h9" Aug 05 17:33:35.135689 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:33:35.135625 2579 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Aug 05 17:33:35.135689 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:33:35.135676 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/347f2b4f-45ca-444a-8b41-71e9e330d1de-webhook-cert podName:347f2b4f-45ca-444a-8b41-71e9e330d1de nodeName:}" failed. No retries permitted until 2026-08-05 17:33:35.635662062 +0000 UTC m=+603.403042276 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/347f2b4f-45ca-444a-8b41-71e9e330d1de-webhook-cert") pod "maas-controller-7fb5b67fd7-r52h9" (UID: "347f2b4f-45ca-444a-8b41-71e9e330d1de") : secret "maas-controller-webhook-cert" not found Aug 05 17:33:35.145033 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:35.145005 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xdxl\" (UniqueName: \"kubernetes.io/projected/347f2b4f-45ca-444a-8b41-71e9e330d1de-kube-api-access-2xdxl\") pod \"maas-controller-7fb5b67fd7-r52h9\" (UID: \"347f2b4f-45ca-444a-8b41-71e9e330d1de\") " pod="opendatahub/maas-controller-7fb5b67fd7-r52h9" Aug 05 17:33:35.438086 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:35.438002 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3214f56-4101-44fc-aa41-dd8fe97791db-webhook-cert\") pod \"maas-controller-bcf45894d-dsk7q\" (UID: \"e3214f56-4101-44fc-aa41-dd8fe97791db\") " pod="opendatahub/maas-controller-bcf45894d-dsk7q" Aug 05 17:33:35.438279 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:33:35.438131 2579 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Aug 05 17:33:35.438279 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:33:35.438244 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3214f56-4101-44fc-aa41-dd8fe97791db-webhook-cert podName:e3214f56-4101-44fc-aa41-dd8fe97791db nodeName:}" failed. No retries permitted until 2026-08-05 17:33:36.438227049 +0000 UTC m=+604.205607262 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/e3214f56-4101-44fc-aa41-dd8fe97791db-webhook-cert") pod "maas-controller-bcf45894d-dsk7q" (UID: "e3214f56-4101-44fc-aa41-dd8fe97791db") : secret "maas-controller-webhook-cert" not found Aug 05 17:33:35.602268 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:35.602230 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:33:35.640738 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:35.640702 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/347f2b4f-45ca-444a-8b41-71e9e330d1de-webhook-cert\") pod \"maas-controller-7fb5b67fd7-r52h9\" (UID: \"347f2b4f-45ca-444a-8b41-71e9e330d1de\") " pod="opendatahub/maas-controller-7fb5b67fd7-r52h9" Aug 05 17:33:35.643106 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:35.643073 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/347f2b4f-45ca-444a-8b41-71e9e330d1de-webhook-cert\") pod \"maas-controller-7fb5b67fd7-r52h9\" (UID: \"347f2b4f-45ca-444a-8b41-71e9e330d1de\") " pod="opendatahub/maas-controller-7fb5b67fd7-r52h9" Aug 05 17:33:35.915992 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:35.915953 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7fb5b67fd7-r52h9" Aug 05 17:33:36.056311 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:36.056285 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7fb5b67fd7-r52h9"] Aug 05 17:33:36.057094 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:33:36.057072 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod347f2b4f_45ca_444a_8b41_71e9e330d1de.slice/crio-f2125c6e32a07afc08fb4f1e9b78f74bc3c4add09df53e5b9213b09fda106e7f WatchSource:0}: Error finding container f2125c6e32a07afc08fb4f1e9b78f74bc3c4add09df53e5b9213b09fda106e7f: Status 404 returned error can't find the container with id f2125c6e32a07afc08fb4f1e9b78f74bc3c4add09df53e5b9213b09fda106e7f Aug 05 17:33:36.089340 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:36.089310 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fb5b67fd7-r52h9" event={"ID":"347f2b4f-45ca-444a-8b41-71e9e330d1de","Type":"ContainerStarted","Data":"f2125c6e32a07afc08fb4f1e9b78f74bc3c4add09df53e5b9213b09fda106e7f"} Aug 05 17:33:36.447991 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:36.447957 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3214f56-4101-44fc-aa41-dd8fe97791db-webhook-cert\") pod \"maas-controller-bcf45894d-dsk7q\" (UID: \"e3214f56-4101-44fc-aa41-dd8fe97791db\") " pod="opendatahub/maas-controller-bcf45894d-dsk7q" Aug 05 17:33:36.450495 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:36.450472 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3214f56-4101-44fc-aa41-dd8fe97791db-webhook-cert\") pod \"maas-controller-bcf45894d-dsk7q\" (UID: \"e3214f56-4101-44fc-aa41-dd8fe97791db\") " pod="opendatahub/maas-controller-bcf45894d-dsk7q" Aug 05 17:33:36.622450 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:36.622417 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bcf45894d-dsk7q" Aug 05 17:33:36.760278 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:36.760240 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bcf45894d-dsk7q"] Aug 05 17:33:36.761865 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:33:36.761821 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3214f56_4101_44fc_aa41_dd8fe97791db.slice/crio-611f9232e97a05aa8fe9f0ef45865ae3fa7e5e846df7f1a52117bfde259a94e8 WatchSource:0}: Error finding container 611f9232e97a05aa8fe9f0ef45865ae3fa7e5e846df7f1a52117bfde259a94e8: Status 404 returned error can't find the container with id 611f9232e97a05aa8fe9f0ef45865ae3fa7e5e846df7f1a52117bfde259a94e8 Aug 05 17:33:37.097203 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:37.097164 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bcf45894d-dsk7q" event={"ID":"e3214f56-4101-44fc-aa41-dd8fe97791db","Type":"ContainerStarted","Data":"611f9232e97a05aa8fe9f0ef45865ae3fa7e5e846df7f1a52117bfde259a94e8"} Aug 05 17:33:38.853767 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:38.853713 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:33:38.964382 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:38.964293 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:33:39.113853 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:39.113814 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7fb5b67fd7-r52h9" event={"ID":"347f2b4f-45ca-444a-8b41-71e9e330d1de","Type":"ContainerStarted","Data":"2cba668028a5edb4f156222daed94be04957d80929984115d67f97fbcaa41f01"} Aug 05 17:33:39.114025 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:39.113902 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7fb5b67fd7-r52h9" Aug 05 17:33:39.116344 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:39.116308 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bcf45894d-dsk7q" event={"ID":"e3214f56-4101-44fc-aa41-dd8fe97791db","Type":"ContainerStarted","Data":"e868bde2e53cc3e4cd12c2d61fd54f2d65cbcde43eb4c7ce47e1f98fc25a2e9b"} Aug 05 17:33:39.116504 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:39.116367 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-bcf45894d-dsk7q" Aug 05 17:33:39.134660 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:39.134610 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7fb5b67fd7-r52h9" podStartSLOduration=2.516537001 podStartE2EDuration="5.134594234s" totalImagesPullingTime="2.618057233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:33:39.132433032 +0000 UTC m=+606.899813266" watchObservedRunningTime="2026-08-05 17:33:39.134594234 +0000 UTC m=+606.901974467" Aug 05 17:33:39.153352 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:39.153309 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-bcf45894d-dsk7q" podStartSLOduration=3.230024815 podStartE2EDuration="5.153294663s" totalImagesPullingTime="1.923269848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:33:39.151042146 +0000 UTC m=+606.918422404" watchObservedRunningTime="2026-08-05 17:33:39.153294663 +0000 UTC m=+606.920674931" Aug 05 17:33:50.124310 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:50.124280 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-bcf45894d-dsk7q" Aug 05 17:33:50.124782 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:50.124355 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7fb5b67fd7-r52h9" Aug 05 17:33:50.192577 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:50.192542 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bcf45894d-dsk7q"] Aug 05 17:33:50.192786 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:50.192758 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-bcf45894d-dsk7q" podUID="e3214f56-4101-44fc-aa41-dd8fe97791db" containerName="manager" containerID="cri-o://e868bde2e53cc3e4cd12c2d61fd54f2d65cbcde43eb4c7ce47e1f98fc25a2e9b" gracePeriod=30 Aug 05 17:33:50.444638 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:50.444612 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bcf45894d-dsk7q" Aug 05 17:33:50.588197 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:50.588162 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jk95f\" (UniqueName: \"kubernetes.io/projected/e3214f56-4101-44fc-aa41-dd8fe97791db-kube-api-access-jk95f\") pod \"e3214f56-4101-44fc-aa41-dd8fe97791db\" (UID: \"e3214f56-4101-44fc-aa41-dd8fe97791db\") " Aug 05 17:33:50.588388 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:50.588222 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3214f56-4101-44fc-aa41-dd8fe97791db-webhook-cert\") pod \"e3214f56-4101-44fc-aa41-dd8fe97791db\" (UID: \"e3214f56-4101-44fc-aa41-dd8fe97791db\") " Aug 05 17:33:50.590435 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:50.590399 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3214f56-4101-44fc-aa41-dd8fe97791db-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e3214f56-4101-44fc-aa41-dd8fe97791db" (UID: "e3214f56-4101-44fc-aa41-dd8fe97791db"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:33:50.590546 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:50.590466 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3214f56-4101-44fc-aa41-dd8fe97791db-kube-api-access-jk95f" (OuterVolumeSpecName: "kube-api-access-jk95f") pod "e3214f56-4101-44fc-aa41-dd8fe97791db" (UID: "e3214f56-4101-44fc-aa41-dd8fe97791db"). InnerVolumeSpecName "kube-api-access-jk95f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:33:50.689132 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:50.689052 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jk95f\" (UniqueName: \"kubernetes.io/projected/e3214f56-4101-44fc-aa41-dd8fe97791db-kube-api-access-jk95f\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:33:50.689132 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:50.689079 2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3214f56-4101-44fc-aa41-dd8fe97791db-webhook-cert\") on node \"ip-10-0-136-250.ec2.internal\" DevicePath \"\"" Aug 05 17:33:51.198892 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:51.198856 2579 generic.go:356] "Generic (PLEG): container finished" podID="e3214f56-4101-44fc-aa41-dd8fe97791db" containerID="e868bde2e53cc3e4cd12c2d61fd54f2d65cbcde43eb4c7ce47e1f98fc25a2e9b" exitCode=0 Aug 05 17:33:51.198892 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:51.198897 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bcf45894d-dsk7q" event={"ID":"e3214f56-4101-44fc-aa41-dd8fe97791db","Type":"ContainerDied","Data":"e868bde2e53cc3e4cd12c2d61fd54f2d65cbcde43eb4c7ce47e1f98fc25a2e9b"} Aug 05 17:33:51.199379 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:51.198904 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bcf45894d-dsk7q" Aug 05 17:33:51.199379 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:51.198947 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bcf45894d-dsk7q" event={"ID":"e3214f56-4101-44fc-aa41-dd8fe97791db","Type":"ContainerDied","Data":"611f9232e97a05aa8fe9f0ef45865ae3fa7e5e846df7f1a52117bfde259a94e8"} Aug 05 17:33:51.199379 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:51.198972 2579 scope.go:117] "RemoveContainer" containerID="e868bde2e53cc3e4cd12c2d61fd54f2d65cbcde43eb4c7ce47e1f98fc25a2e9b" Aug 05 17:33:51.208323 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:51.208304 2579 scope.go:117] "RemoveContainer" containerID="e868bde2e53cc3e4cd12c2d61fd54f2d65cbcde43eb4c7ce47e1f98fc25a2e9b" Aug 05 17:33:51.208589 ip-10-0-136-250 kubenswrapper[2579]: E0805 17:33:51.208569 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e868bde2e53cc3e4cd12c2d61fd54f2d65cbcde43eb4c7ce47e1f98fc25a2e9b\": container with ID starting with e868bde2e53cc3e4cd12c2d61fd54f2d65cbcde43eb4c7ce47e1f98fc25a2e9b not found: ID does not exist" containerID="e868bde2e53cc3e4cd12c2d61fd54f2d65cbcde43eb4c7ce47e1f98fc25a2e9b" Aug 05 17:33:51.208667 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:51.208599 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e868bde2e53cc3e4cd12c2d61fd54f2d65cbcde43eb4c7ce47e1f98fc25a2e9b"} err="failed to get container status \"e868bde2e53cc3e4cd12c2d61fd54f2d65cbcde43eb4c7ce47e1f98fc25a2e9b\": rpc error: code = NotFound desc = could not find container \"e868bde2e53cc3e4cd12c2d61fd54f2d65cbcde43eb4c7ce47e1f98fc25a2e9b\": container with ID starting with e868bde2e53cc3e4cd12c2d61fd54f2d65cbcde43eb4c7ce47e1f98fc25a2e9b not found: ID does not exist" Aug 05 17:33:51.217236 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:51.217213 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bcf45894d-dsk7q"] Aug 05 17:33:51.220841 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:51.220819 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-bcf45894d-dsk7q"] Aug 05 17:33:52.775972 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:33:52.775936 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3214f56-4101-44fc-aa41-dd8fe97791db" path="/var/lib/kubelet/pods/e3214f56-4101-44fc-aa41-dd8fe97791db/volumes" Aug 05 17:34:08.797280 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:08.797176 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:34:08.902919 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:08.902882 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:34:10.459935 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:10.459899 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:34:10.533041 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:10.533008 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-d54bc5f67-jtt2b"] Aug 05 17:34:10.533491 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:10.533468 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3214f56-4101-44fc-aa41-dd8fe97791db" containerName="manager" Aug 05 17:34:10.533491 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:10.533485 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3214f56-4101-44fc-aa41-dd8fe97791db" containerName="manager" Aug 05 17:34:10.533633 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:10.533544 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3214f56-4101-44fc-aa41-dd8fe97791db" containerName="manager" Aug 05 17:34:10.540017 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:10.539981 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d54bc5f67-jtt2b" Aug 05 17:34:10.542915 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:10.542891 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Aug 05 17:34:10.543018 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:10.542917 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8rz2d\"" Aug 05 17:34:10.553434 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:10.553411 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-d54bc5f67-jtt2b"] Aug 05 17:34:10.578661 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:10.578628 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4460863c-2bf5-4aeb-834c-2dcc2500ef6f-maas-api-tls\") pod \"maas-api-d54bc5f67-jtt2b\" (UID: \"4460863c-2bf5-4aeb-834c-2dcc2500ef6f\") " pod="odh-ai-gateway-infra/maas-api-d54bc5f67-jtt2b" Aug 05 17:34:10.578827 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:10.578737 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzp66\" (UniqueName: \"kubernetes.io/projected/4460863c-2bf5-4aeb-834c-2dcc2500ef6f-kube-api-access-zzp66\") pod \"maas-api-d54bc5f67-jtt2b\" (UID: \"4460863c-2bf5-4aeb-834c-2dcc2500ef6f\") " pod="odh-ai-gateway-infra/maas-api-d54bc5f67-jtt2b" Aug 05 17:34:10.578827 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:10.578789 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4460863c-2bf5-4aeb-834c-2dcc2500ef6f-openshift-service-ca\") pod \"maas-api-d54bc5f67-jtt2b\" (UID: \"4460863c-2bf5-4aeb-834c-2dcc2500ef6f\") " pod="odh-ai-gateway-infra/maas-api-d54bc5f67-jtt2b" Aug 05 17:34:10.630859 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:10.630801 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:34:10.679546 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:10.679512 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4460863c-2bf5-4aeb-834c-2dcc2500ef6f-maas-api-tls\") pod \"maas-api-d54bc5f67-jtt2b\" (UID: \"4460863c-2bf5-4aeb-834c-2dcc2500ef6f\") " pod="odh-ai-gateway-infra/maas-api-d54bc5f67-jtt2b" Aug 05 17:34:10.679748 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:10.679574 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzp66\" (UniqueName: \"kubernetes.io/projected/4460863c-2bf5-4aeb-834c-2dcc2500ef6f-kube-api-access-zzp66\") pod \"maas-api-d54bc5f67-jtt2b\" (UID: \"4460863c-2bf5-4aeb-834c-2dcc2500ef6f\") " pod="odh-ai-gateway-infra/maas-api-d54bc5f67-jtt2b" Aug 05 17:34:10.679748 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:10.679608 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4460863c-2bf5-4aeb-834c-2dcc2500ef6f-openshift-service-ca\") pod \"maas-api-d54bc5f67-jtt2b\" (UID: \"4460863c-2bf5-4aeb-834c-2dcc2500ef6f\") " pod="odh-ai-gateway-infra/maas-api-d54bc5f67-jtt2b" Aug 05 17:34:10.680285 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:10.680264 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4460863c-2bf5-4aeb-834c-2dcc2500ef6f-openshift-service-ca\") pod \"maas-api-d54bc5f67-jtt2b\" (UID: \"4460863c-2bf5-4aeb-834c-2dcc2500ef6f\") " pod="odh-ai-gateway-infra/maas-api-d54bc5f67-jtt2b" Aug 05 17:34:10.682116 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:10.682095 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4460863c-2bf5-4aeb-834c-2dcc2500ef6f-maas-api-tls\") pod \"maas-api-d54bc5f67-jtt2b\" (UID: \"4460863c-2bf5-4aeb-834c-2dcc2500ef6f\") " pod="odh-ai-gateway-infra/maas-api-d54bc5f67-jtt2b" Aug 05 17:34:10.687742 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:10.687721 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzp66\" (UniqueName: \"kubernetes.io/projected/4460863c-2bf5-4aeb-834c-2dcc2500ef6f-kube-api-access-zzp66\") pod \"maas-api-d54bc5f67-jtt2b\" (UID: \"4460863c-2bf5-4aeb-834c-2dcc2500ef6f\") " pod="odh-ai-gateway-infra/maas-api-d54bc5f67-jtt2b" Aug 05 17:34:10.851368 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:10.851326 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d54bc5f67-jtt2b" Aug 05 17:34:10.908228 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:10.908189 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:34:11.005869 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:11.005833 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:34:11.016513 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:11.016475 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-hp579"] Aug 05 17:34:11.018374 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:34:11.018344 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4460863c_2bf5_4aeb_834c_2dcc2500ef6f.slice/crio-ee303669596c985eee168a49b8464da3c890849444644d7cc89abba8314aec26 WatchSource:0}: Error finding container ee303669596c985eee168a49b8464da3c890849444644d7cc89abba8314aec26: Status 404 returned error can't find the container with id ee303669596c985eee168a49b8464da3c890849444644d7cc89abba8314aec26 Aug 05 17:34:11.020224 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:11.020173 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-d54bc5f67-jtt2b"] Aug 05 17:34:11.020301 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:11.020237 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-hp579" Aug 05 17:34:11.023276 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:11.023255 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Aug 05 17:34:11.023411 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:11.023322 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-4q9zx\"" Aug 05 17:34:11.031249 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:11.031223 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-hp579"] Aug 05 17:34:11.084124 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:11.084070 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28q68\" (UniqueName: \"kubernetes.io/projected/20d100e8-1960-4220-8185-56f363147c71-kube-api-access-28q68\") pod \"payload-pre-processing-687dbb6cf6-hp579\" (UID: \"20d100e8-1960-4220-8185-56f363147c71\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-hp579" Aug 05 17:34:11.084330 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:11.084171 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20d100e8-1960-4220-8185-56f363147c71-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-hp579\" (UID: \"20d100e8-1960-4220-8185-56f363147c71\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-hp579" Aug 05 17:34:11.185637 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:11.185538 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20d100e8-1960-4220-8185-56f363147c71-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-hp579\" (UID: \"20d100e8-1960-4220-8185-56f363147c71\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-hp579" Aug 05 17:34:11.185814 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:11.185691 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28q68\" (UniqueName: \"kubernetes.io/projected/20d100e8-1960-4220-8185-56f363147c71-kube-api-access-28q68\") pod \"payload-pre-processing-687dbb6cf6-hp579\" (UID: \"20d100e8-1960-4220-8185-56f363147c71\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-hp579" Aug 05 17:34:11.186401 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:11.186375 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20d100e8-1960-4220-8185-56f363147c71-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-hp579\" (UID: \"20d100e8-1960-4220-8185-56f363147c71\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-hp579" Aug 05 17:34:11.197017 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:11.196990 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28q68\" (UniqueName: \"kubernetes.io/projected/20d100e8-1960-4220-8185-56f363147c71-kube-api-access-28q68\") pod \"payload-pre-processing-687dbb6cf6-hp579\" (UID: \"20d100e8-1960-4220-8185-56f363147c71\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-hp579" Aug 05 17:34:11.318595 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:11.318558 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d54bc5f67-jtt2b" event={"ID":"4460863c-2bf5-4aeb-834c-2dcc2500ef6f","Type":"ContainerStarted","Data":"ee303669596c985eee168a49b8464da3c890849444644d7cc89abba8314aec26"} Aug 05 17:34:11.340856 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:11.340822 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-hp579" Aug 05 17:34:11.484490 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:11.484463 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-hp579"] Aug 05 17:34:11.486789 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:34:11.486760 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20d100e8_1960_4220_8185_56f363147c71.slice/crio-44ddc76a4469768cf0ea3fdab0275c8b5e6ffb8d741bd9851d693114bbb6e014 WatchSource:0}: Error finding container 44ddc76a4469768cf0ea3fdab0275c8b5e6ffb8d741bd9851d693114bbb6e014: Status 404 returned error can't find the container with id 44ddc76a4469768cf0ea3fdab0275c8b5e6ffb8d741bd9851d693114bbb6e014 Aug 05 17:34:12.334314 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:12.334230 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-hp579" event={"ID":"20d100e8-1960-4220-8185-56f363147c71","Type":"ContainerStarted","Data":"44ddc76a4469768cf0ea3fdab0275c8b5e6ffb8d741bd9851d693114bbb6e014"} Aug 05 17:34:13.342743 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:13.342704 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d54bc5f67-jtt2b" event={"ID":"4460863c-2bf5-4aeb-834c-2dcc2500ef6f","Type":"ContainerStarted","Data":"9c84bd3caef065458047796d1aedf700ec729718e9c6c4602d80ea1017d53576"} Aug 05 17:34:13.343192 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:13.342792 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-d54bc5f67-jtt2b" Aug 05 17:34:13.344250 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:13.344228 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-hp579" event={"ID":"20d100e8-1960-4220-8185-56f363147c71","Type":"ContainerStarted","Data":"40346cface23233dc7b5c8b30a25858ad3a20e7571aab67441078751e5387021"} Aug 05 17:34:13.344353 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:13.344285 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-hp579" Aug 05 17:34:13.360870 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:13.360827 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-d54bc5f67-jtt2b" podStartSLOduration=1.69720231 podStartE2EDuration="3.360813502s" totalImagesPullingTime="1.663611192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:34:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:34:13.360128082 +0000 UTC m=+641.127508316" watchObservedRunningTime="2026-08-05 17:34:13.360813502 +0000 UTC m=+641.128193734" Aug 05 17:34:13.376731 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:13.376690 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-hp579" podStartSLOduration=1.610644167 podStartE2EDuration="3.376676684s" totalImagesPullingTime="1.766032517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:34:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:34:13.374650173 +0000 UTC m=+641.142030407" watchObservedRunningTime="2026-08-05 17:34:13.376676684 +0000 UTC m=+641.144056917" Aug 05 17:34:19.356040 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:19.356009 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-d54bc5f67-jtt2b" Aug 05 17:34:20.385603 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:20.385523 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:34:20.480714 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:20.480660 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:34:24.353331 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:24.353296 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-hp579" Aug 05 17:34:27.968174 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:27.968119 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg"] Aug 05 17:34:27.971095 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:27.971078 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg" Aug 05 17:34:27.974643 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:27.974624 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Aug 05 17:34:27.974887 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:27.974871 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2jv8d\"" Aug 05 17:34:27.975416 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:27.975399 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Aug 05 17:34:27.975499 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:27.975461 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Aug 05 17:34:27.989783 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:27.989759 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg"] Aug 05 17:34:28.008788 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:28.008753 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:34:28.064828 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:28.064791 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd7d7f95-567e-4159-ad6c-062ada389611-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg\" (UID: \"fd7d7f95-567e-4159-ad6c-062ada389611\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg" Aug 05 17:34:28.065003 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:28.064895 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd7d7f95-567e-4159-ad6c-062ada389611-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg\" (UID: \"fd7d7f95-567e-4159-ad6c-062ada389611\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg" Aug 05 17:34:28.065003 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:28.064934 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd7d7f95-567e-4159-ad6c-062ada389611-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg\" (UID: \"fd7d7f95-567e-4159-ad6c-062ada389611\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg" Aug 05 17:34:28.065003 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:28.064961 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd7d7f95-567e-4159-ad6c-062ada389611-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg\" (UID: \"fd7d7f95-567e-4159-ad6c-062ada389611\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg" Aug 05 17:34:28.065003 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:28.064977 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rssn5\" (UniqueName: \"kubernetes.io/projected/fd7d7f95-567e-4159-ad6c-062ada389611-kube-api-access-rssn5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg\" (UID: \"fd7d7f95-567e-4159-ad6c-062ada389611\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg" Aug 05 17:34:28.065185 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:28.065057 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd7d7f95-567e-4159-ad6c-062ada389611-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg\" (UID: \"fd7d7f95-567e-4159-ad6c-062ada389611\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg" Aug 05 17:34:28.166339 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:28.166307 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd7d7f95-567e-4159-ad6c-062ada389611-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg\" (UID: \"fd7d7f95-567e-4159-ad6c-062ada389611\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg" Aug 05 17:34:28.166534 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:28.166357 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd7d7f95-567e-4159-ad6c-062ada389611-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg\" (UID: \"fd7d7f95-567e-4159-ad6c-062ada389611\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg" Aug 05 17:34:28.166534 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:28.166373 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd7d7f95-567e-4159-ad6c-062ada389611-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg\" (UID: \"fd7d7f95-567e-4159-ad6c-062ada389611\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg" Aug 05 17:34:28.166534 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:28.166387 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd7d7f95-567e-4159-ad6c-062ada389611-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg\" (UID: \"fd7d7f95-567e-4159-ad6c-062ada389611\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg" Aug 05 17:34:28.166534 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:28.166403 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rssn5\" (UniqueName: \"kubernetes.io/projected/fd7d7f95-567e-4159-ad6c-062ada389611-kube-api-access-rssn5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg\" (UID: \"fd7d7f95-567e-4159-ad6c-062ada389611\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg" Aug 05 17:34:28.166534 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:28.166431 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd7d7f95-567e-4159-ad6c-062ada389611-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg\" (UID: \"fd7d7f95-567e-4159-ad6c-062ada389611\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg" Aug 05 17:34:28.166865 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:28.166844 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd7d7f95-567e-4159-ad6c-062ada389611-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg\" (UID: \"fd7d7f95-567e-4159-ad6c-062ada389611\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg" Aug 05 17:34:28.166943 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:28.166879 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd7d7f95-567e-4159-ad6c-062ada389611-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg\" (UID: \"fd7d7f95-567e-4159-ad6c-062ada389611\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg" Aug 05 17:34:28.166943 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:28.166900 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd7d7f95-567e-4159-ad6c-062ada389611-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg\" (UID: \"fd7d7f95-567e-4159-ad6c-062ada389611\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg" Aug 05 17:34:28.168748 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:28.168729 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd7d7f95-567e-4159-ad6c-062ada389611-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg\" (UID: \"fd7d7f95-567e-4159-ad6c-062ada389611\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg" Aug 05 17:34:28.168852 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:28.168834 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd7d7f95-567e-4159-ad6c-062ada389611-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg\" (UID: \"fd7d7f95-567e-4159-ad6c-062ada389611\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg" Aug 05 17:34:28.176989 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:28.176959 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rssn5\" (UniqueName: \"kubernetes.io/projected/fd7d7f95-567e-4159-ad6c-062ada389611-kube-api-access-rssn5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg\" (UID: \"fd7d7f95-567e-4159-ad6c-062ada389611\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg" Aug 05 17:34:28.290576 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:28.290498 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg" Aug 05 17:34:28.443858 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:28.443832 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg"] Aug 05 17:34:28.446193 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:34:28.446162 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd7d7f95_567e_4159_ad6c_062ada389611.slice/crio-614e9ae138481a1520ffbb353f185c042d8d01dd5293f0c75741d32d791bd74d WatchSource:0}: Error finding container 614e9ae138481a1520ffbb353f185c042d8d01dd5293f0c75741d32d791bd74d: Status 404 returned error can't find the container with id 614e9ae138481a1520ffbb353f185c042d8d01dd5293f0c75741d32d791bd74d Aug 05 17:34:28.447783 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:28.447765 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 05 17:34:29.444595 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:29.444557 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg" event={"ID":"fd7d7f95-567e-4159-ad6c-062ada389611","Type":"ContainerStarted","Data":"614e9ae138481a1520ffbb353f185c042d8d01dd5293f0c75741d32d791bd74d"} Aug 05 17:34:30.452009 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:30.451964 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg" event={"ID":"fd7d7f95-567e-4159-ad6c-062ada389611","Type":"ContainerStarted","Data":"5380b9617440c06e83acf7a5fe79c5ee3cf59065435951fcae9b739cbe2a867b"} Aug 05 17:34:30.471423 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:30.471378 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg" podStartSLOduration=2.390945964 podStartE2EDuration="3.471355504s" totalImagesPullingTime="1.08040954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:34:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:34:30.469828017 +0000 UTC m=+658.237208246" watchObservedRunningTime="2026-08-05 17:34:30.471355504 +0000 UTC m=+658.238735736" Aug 05 17:34:37.271168 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:37.271100 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:34:38.291635 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:38.291595 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg" Aug 05 17:34:38.292115 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:38.291667 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg" Aug 05 17:34:38.304726 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:38.304703 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg" Aug 05 17:34:38.512637 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:38.512606 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg" Aug 05 17:34:42.572853 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:42.572811 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:34:54.138820 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:54.138787 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc"] Aug 05 17:34:54.142635 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:54.142613 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc" Aug 05 17:34:54.145708 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:54.145686 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Aug 05 17:34:54.152175 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:54.152130 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc"] Aug 05 17:34:54.166040 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:54.166013 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:34:54.221013 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:54.220982 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6fe620ab-7a80-47ea-b29b-67c9e2838906-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc\" (UID: \"6fe620ab-7a80-47ea-b29b-67c9e2838906\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc" Aug 05 17:34:54.221219 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:54.221028 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh2qn\" (UniqueName: \"kubernetes.io/projected/6fe620ab-7a80-47ea-b29b-67c9e2838906-kube-api-access-hh2qn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc\" (UID: \"6fe620ab-7a80-47ea-b29b-67c9e2838906\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc" Aug 05 17:34:54.221219 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:54.221054 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fe620ab-7a80-47ea-b29b-67c9e2838906-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc\" (UID: \"6fe620ab-7a80-47ea-b29b-67c9e2838906\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc" Aug 05 17:34:54.221219 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:54.221178 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6fe620ab-7a80-47ea-b29b-67c9e2838906-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc\" (UID: \"6fe620ab-7a80-47ea-b29b-67c9e2838906\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc" Aug 05 17:34:54.221462 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:54.221290 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6fe620ab-7a80-47ea-b29b-67c9e2838906-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc\" (UID: \"6fe620ab-7a80-47ea-b29b-67c9e2838906\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc" Aug 05 17:34:54.221462 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:54.221361 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6fe620ab-7a80-47ea-b29b-67c9e2838906-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc\" (UID: \"6fe620ab-7a80-47ea-b29b-67c9e2838906\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc" Aug 05 17:34:54.321959 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:54.321928 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6fe620ab-7a80-47ea-b29b-67c9e2838906-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc\" (UID: \"6fe620ab-7a80-47ea-b29b-67c9e2838906\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc" Aug 05 17:34:54.322129 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:54.321976 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh2qn\" (UniqueName: \"kubernetes.io/projected/6fe620ab-7a80-47ea-b29b-67c9e2838906-kube-api-access-hh2qn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc\" (UID: \"6fe620ab-7a80-47ea-b29b-67c9e2838906\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc" Aug 05 17:34:54.322129 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:54.322000 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fe620ab-7a80-47ea-b29b-67c9e2838906-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc\" (UID: \"6fe620ab-7a80-47ea-b29b-67c9e2838906\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc" Aug 05 17:34:54.322129 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:54.322045 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6fe620ab-7a80-47ea-b29b-67c9e2838906-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc\" (UID: \"6fe620ab-7a80-47ea-b29b-67c9e2838906\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc" Aug 05 17:34:54.322129 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:54.322093 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6fe620ab-7a80-47ea-b29b-67c9e2838906-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc\" (UID: \"6fe620ab-7a80-47ea-b29b-67c9e2838906\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc" Aug 05 17:34:54.322374 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:54.322136 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6fe620ab-7a80-47ea-b29b-67c9e2838906-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc\" (UID: \"6fe620ab-7a80-47ea-b29b-67c9e2838906\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc" Aug 05 17:34:54.322571 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:54.322546 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6fe620ab-7a80-47ea-b29b-67c9e2838906-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc\" (UID: \"6fe620ab-7a80-47ea-b29b-67c9e2838906\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc" Aug 05 17:34:54.322651 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:54.322571 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6fe620ab-7a80-47ea-b29b-67c9e2838906-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc\" (UID: \"6fe620ab-7a80-47ea-b29b-67c9e2838906\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc" Aug 05 17:34:54.322651 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:54.322608 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6fe620ab-7a80-47ea-b29b-67c9e2838906-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc\" (UID: \"6fe620ab-7a80-47ea-b29b-67c9e2838906\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc" Aug 05 17:34:54.324250 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:54.324229 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6fe620ab-7a80-47ea-b29b-67c9e2838906-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc\" (UID: \"6fe620ab-7a80-47ea-b29b-67c9e2838906\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc" Aug 05 17:34:54.324493 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:54.324477 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6fe620ab-7a80-47ea-b29b-67c9e2838906-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc\" (UID: \"6fe620ab-7a80-47ea-b29b-67c9e2838906\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc" Aug 05 17:34:54.330736 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:54.330715 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh2qn\" (UniqueName: \"kubernetes.io/projected/6fe620ab-7a80-47ea-b29b-67c9e2838906-kube-api-access-hh2qn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc\" (UID: \"6fe620ab-7a80-47ea-b29b-67c9e2838906\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc" Aug 05 17:34:54.455188 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:54.455066 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc" Aug 05 17:34:54.596393 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:54.596370 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc"] Aug 05 17:34:54.598580 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:34:54.598551 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fe620ab_7a80_47ea_b29b_67c9e2838906.slice/crio-50419c4d0993bf6a40b70d15a6e2a3d2400be0d7bd69ab15b558261e65bfa478 WatchSource:0}: Error finding container 50419c4d0993bf6a40b70d15a6e2a3d2400be0d7bd69ab15b558261e65bfa478: Status 404 returned error can't find the container with id 50419c4d0993bf6a40b70d15a6e2a3d2400be0d7bd69ab15b558261e65bfa478 Aug 05 17:34:55.604838 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:55.604802 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc" event={"ID":"6fe620ab-7a80-47ea-b29b-67c9e2838906","Type":"ContainerStarted","Data":"d0441b340793a04ae03c240e27ce9380476fd9fc0cf34098bded1d4e28026cb2"} Aug 05 17:34:55.605293 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:55.604861 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc" event={"ID":"6fe620ab-7a80-47ea-b29b-67c9e2838906","Type":"ContainerStarted","Data":"50419c4d0993bf6a40b70d15a6e2a3d2400be0d7bd69ab15b558261e65bfa478"} Aug 05 17:34:55.625772 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:55.625702 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc" podStartSLOduration=1.4372420240000001 podStartE2EDuration="1.625687392s" totalImagesPullingTime="188.445368ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:34:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:34:55.622290628 +0000 UTC m=+683.389670872" watchObservedRunningTime="2026-08-05 17:34:55.625687392 +0000 UTC m=+683.393067624" Aug 05 17:34:59.777876 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:34:59.777826 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:35:04.455956 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:04.455920 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc" Aug 05 17:35:04.456445 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:04.456016 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc" Aug 05 17:35:04.468820 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:04.468795 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc" Aug 05 17:35:04.672096 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:04.672070 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc" Aug 05 17:35:11.635423 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:11.635384 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:35:18.948346 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:18.948309 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b"] Aug 05 17:35:18.953888 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:18.953860 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b" Aug 05 17:35:18.957017 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:18.956995 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Aug 05 17:35:18.965645 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:18.965046 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b"] Aug 05 17:35:18.973544 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:18.973521 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a6e8512-d4de-440d-b42f-bd30dc8665ad-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b\" (UID: \"0a6e8512-d4de-440d-b42f-bd30dc8665ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b" Aug 05 17:35:18.973681 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:18.973548 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a6e8512-d4de-440d-b42f-bd30dc8665ad-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b\" (UID: \"0a6e8512-d4de-440d-b42f-bd30dc8665ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b" Aug 05 17:35:18.973681 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:18.973577 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a6e8512-d4de-440d-b42f-bd30dc8665ad-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b\" (UID: \"0a6e8512-d4de-440d-b42f-bd30dc8665ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b" Aug 05 17:35:18.973681 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:18.973606 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a6e8512-d4de-440d-b42f-bd30dc8665ad-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b\" (UID: \"0a6e8512-d4de-440d-b42f-bd30dc8665ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b" Aug 05 17:35:18.973681 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:18.973659 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt47h\" (UniqueName: \"kubernetes.io/projected/0a6e8512-d4de-440d-b42f-bd30dc8665ad-kube-api-access-dt47h\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b\" (UID: \"0a6e8512-d4de-440d-b42f-bd30dc8665ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b" Aug 05 17:35:18.973820 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:18.973701 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a6e8512-d4de-440d-b42f-bd30dc8665ad-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b\" (UID: \"0a6e8512-d4de-440d-b42f-bd30dc8665ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b" Aug 05 17:35:18.989259 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:18.989225 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:35:19.074289 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:19.074253 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt47h\" (UniqueName: \"kubernetes.io/projected/0a6e8512-d4de-440d-b42f-bd30dc8665ad-kube-api-access-dt47h\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b\" (UID: \"0a6e8512-d4de-440d-b42f-bd30dc8665ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b" Aug 05 17:35:19.074487 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:19.074326 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a6e8512-d4de-440d-b42f-bd30dc8665ad-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b\" (UID: \"0a6e8512-d4de-440d-b42f-bd30dc8665ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b" Aug 05 17:35:19.074487 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:19.074380 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a6e8512-d4de-440d-b42f-bd30dc8665ad-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b\" (UID: \"0a6e8512-d4de-440d-b42f-bd30dc8665ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b" Aug 05 17:35:19.074487 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:19.074397 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a6e8512-d4de-440d-b42f-bd30dc8665ad-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b\" (UID: \"0a6e8512-d4de-440d-b42f-bd30dc8665ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b" Aug 05 17:35:19.074487 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:19.074435 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a6e8512-d4de-440d-b42f-bd30dc8665ad-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b\" (UID: \"0a6e8512-d4de-440d-b42f-bd30dc8665ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b" Aug 05 17:35:19.074487 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:19.074466 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a6e8512-d4de-440d-b42f-bd30dc8665ad-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b\" (UID: \"0a6e8512-d4de-440d-b42f-bd30dc8665ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b" Aug 05 17:35:19.074886 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:19.074854 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a6e8512-d4de-440d-b42f-bd30dc8665ad-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b\" (UID: \"0a6e8512-d4de-440d-b42f-bd30dc8665ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b" Aug 05 17:35:19.075007 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:19.074897 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a6e8512-d4de-440d-b42f-bd30dc8665ad-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b\" (UID: \"0a6e8512-d4de-440d-b42f-bd30dc8665ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b" Aug 05 17:35:19.075007 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:19.074910 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a6e8512-d4de-440d-b42f-bd30dc8665ad-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b\" (UID: \"0a6e8512-d4de-440d-b42f-bd30dc8665ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b" Aug 05 17:35:19.076709 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:19.076684 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a6e8512-d4de-440d-b42f-bd30dc8665ad-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b\" (UID: \"0a6e8512-d4de-440d-b42f-bd30dc8665ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b" Aug 05 17:35:19.076941 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:19.076922 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a6e8512-d4de-440d-b42f-bd30dc8665ad-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b\" (UID: \"0a6e8512-d4de-440d-b42f-bd30dc8665ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b" Aug 05 17:35:19.082378 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:19.082353 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt47h\" (UniqueName: \"kubernetes.io/projected/0a6e8512-d4de-440d-b42f-bd30dc8665ad-kube-api-access-dt47h\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b\" (UID: \"0a6e8512-d4de-440d-b42f-bd30dc8665ad\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b" Aug 05 17:35:19.266623 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:19.266532 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b" Aug 05 17:35:19.417757 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:19.417724 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b"] Aug 05 17:35:19.419297 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:35:19.419274 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a6e8512_d4de_440d_b42f_bd30dc8665ad.slice/crio-9b7062418ca97fd9982c583d3dac4fe827ad1747cf9bd0bf417a9f9821be569c WatchSource:0}: Error finding container 9b7062418ca97fd9982c583d3dac4fe827ad1747cf9bd0bf417a9f9821be569c: Status 404 returned error can't find the container with id 9b7062418ca97fd9982c583d3dac4fe827ad1747cf9bd0bf417a9f9821be569c Aug 05 17:35:19.756653 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:19.756615 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b" event={"ID":"0a6e8512-d4de-440d-b42f-bd30dc8665ad","Type":"ContainerStarted","Data":"08ca64c65186dba329161f57b9603626276fc690b5df60aece5bdcf6e29f0176"} Aug 05 17:35:19.756653 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:19.756665 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b" event={"ID":"0a6e8512-d4de-440d-b42f-bd30dc8665ad","Type":"ContainerStarted","Data":"9b7062418ca97fd9982c583d3dac4fe827ad1747cf9bd0bf417a9f9821be569c"} Aug 05 17:35:19.777036 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:19.776985 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b" podStartSLOduration=1.561512876 podStartE2EDuration="1.776971435s" totalImagesPullingTime="215.458559ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:35:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:35:19.775252461 +0000 UTC m=+707.542632698" watchObservedRunningTime="2026-08-05 17:35:19.776971435 +0000 UTC m=+707.544351669" Aug 05 17:35:29.267203 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:29.267118 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b" Aug 05 17:35:29.267203 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:29.267186 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b" Aug 05 17:35:29.279676 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:29.279651 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b" Aug 05 17:35:29.831654 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:35:29.831626 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b" Aug 05 17:36:02.278345 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:36:02.278307 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:36:02.379523 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:36:02.379489 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:36:26.161504 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:36:26.161465 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:36:26.263447 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:36:26.263410 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:36:27.358621 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:36:27.358582 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:36:27.479947 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:36:27.479907 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:37:12.213545 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:12.213512 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-g6lqz_ebd8d0da-d7b5-4375-8e19-3cf7bcc3ec3f/manager/0.log" Aug 05 17:37:12.344053 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:12.344021 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-2h5k2_7e2ace6e-6626-4a0a-938b-5d15ac6e3ac1/manager/0.log" Aug 05 17:37:12.480255 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:12.480171 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7fb5b67fd7-r52h9_347f2b4f-45ca-444a-8b41-71e9e330d1de/manager/0.log" Aug 05 17:37:12.600889 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:12.600864 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-x7b84_350757b4-2a8f-46bd-8a4d-ca0498e4061e/server/0.log" Aug 05 17:37:12.739537 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:12.739455 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9b569_98d99d9f-8019-466e-acac-1d45f96e5cb4/manager/0.log" Aug 05 17:37:12.864629 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:12.864601 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-666c5d8f77-7fnj9_244dd5ea-2775-42ac-8a83-02c4a9cf942b/copy-manifests/0.log" Aug 05 17:37:12.884039 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:12.884006 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-666c5d8f77-7fnj9_244dd5ea-2775-42ac-8a83-02c4a9cf942b/manager/0.log" Aug 05 17:37:13.494056 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:13.494023 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-d54bc5f67-jtt2b_4460863c-2bf5-4aeb-834c-2dcc2500ef6f/maas-api/0.log" Aug 05 17:37:13.616622 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:13.616592 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-m96tq_c8a8c8a9-e792-4e7d-be72-4db4d539e360/postgres/0.log" Aug 05 17:37:14.557849 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:14.557814 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-4jt25_53a28f8b-3f66-457b-9a10-488895c07975/manager/0.log" Aug 05 17:37:14.680219 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:14.680187 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-v29lb_4902e1d0-5be3-4247-8412-658a66035af1/manager/0.log" Aug 05 17:37:14.945598 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:14.945563 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-68cf589589-7w98f_71b2b669-7a65-4006-a795-15f328215073/manager/0.log" Aug 05 17:37:15.244016 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:15.243931 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-jk2jb_bc95fe38-12e7-42ec-81d2-081ef6d3eabb/manager/0.log" Aug 05 17:37:15.621840 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:15.621816 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cqlggz_0ec49604-1ddb-4059-bed3-18d19cf55508/istio-proxy/0.log" Aug 05 17:37:15.861880 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:15.861847 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57859c69d8-k7mhq_eed65b12-a5e5-474e-b542-02d9a1a34d48/kube-auth-proxy/0.log" Aug 05 17:37:16.214043 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:16.214010 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-hp579_20d100e8-1960-4220-8185-56f363147c71/payload-pre-processing/0.log" Aug 05 17:37:16.443521 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:16.443484 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5ddbb5b6b4-262r4_d7bee8cb-675d-4da7-a767-149f0d6e026f/router/0.log" Aug 05 17:37:16.794397 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:16.794370 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-r2jfg_fd7d7f95-567e-4159-ad6c-062ada389611/main/0.log" Aug 05 17:37:17.144345 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:17.144315 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fltbcc_6fe620ab-7a80-47ea-b29b-67c9e2838906/main/0.log" Aug 05 17:37:17.378110 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:17.378076 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-5xc5b_0a6e8512-d4de-440d-b42f-bd30dc8665ad/main/0.log" Aug 05 17:37:22.750930 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:22.750891 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:37:22.850631 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:22.850594 2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" limit=1024 Aug 05 17:37:25.694988 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:25.694961 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dbt75_196cbfc1-efdb-48ef-a5ec-f99c27f2e289/global-pull-secret-syncer/0.log" Aug 05 17:37:25.774902 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:25.774875 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-67llw_26e6b157-bbde-4981-b1a8-e3665e69e83c/konnectivity-agent/0.log" Aug 05 17:37:25.858157 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:25.858116 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-250.ec2.internal_7f5bf7ebb4fbbb3822a332d0b41a4ef4/haproxy/0.log" Aug 05 17:37:30.605709 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:30.605677 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-4jt25_53a28f8b-3f66-457b-9a10-488895c07975/manager/0.log" Aug 05 17:37:30.639212 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:30.639185 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-v29lb_4902e1d0-5be3-4247-8412-658a66035af1/manager/0.log" Aug 05 17:37:30.719982 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:30.719933 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-68cf589589-7w98f_71b2b669-7a65-4006-a795-15f328215073/manager/0.log" Aug 05 17:37:30.784584 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:30.784558 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-jk2jb_bc95fe38-12e7-42ec-81d2-081ef6d3eabb/manager/0.log" Aug 05 17:37:32.333043 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:32.333011 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ce2ac0e-ff60-44b9-9341-6c785227197c/alertmanager/0.log" Aug 05 17:37:32.354882 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:32.354856 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ce2ac0e-ff60-44b9-9341-6c785227197c/config-reloader/0.log" Aug 05 17:37:32.376962 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:32.376940 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ce2ac0e-ff60-44b9-9341-6c785227197c/kube-rbac-proxy-web/0.log" Aug 05 17:37:32.397412 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:32.397384 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ce2ac0e-ff60-44b9-9341-6c785227197c/kube-rbac-proxy/0.log" Aug 05 17:37:32.415274 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:32.415246 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ce2ac0e-ff60-44b9-9341-6c785227197c/kube-rbac-proxy-metric/0.log" Aug 05 17:37:32.434722 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:32.434697 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ce2ac0e-ff60-44b9-9341-6c785227197c/prom-label-proxy/0.log" Aug 05 17:37:32.451413 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:32.451380 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1ce2ac0e-ff60-44b9-9341-6c785227197c/init-config-reloader/0.log" Aug 05 17:37:32.490640 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:32.490610 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-lpd2k_fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de/cluster-monitoring-operator/1.log" Aug 05 17:37:32.668341 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:32.668240 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-lpd2k_fc02435a-c76d-4a87-b5c8-c3f2a1d2e9de/cluster-monitoring-operator/0.log" Aug 05 17:37:32.694661 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:32.694635 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-bdmg5_b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc/kube-state-metrics/0.log" Aug 05 17:37:32.707215 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:32.707190 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-bdmg5_b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc/kube-rbac-proxy-main/0.log" Aug 05 17:37:32.722923 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:32.722899 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-bdmg5_b8d6f8ec-49d7-4c33-9ea8-42787dc60cfc/kube-rbac-proxy-self/0.log" Aug 05 17:37:32.770791 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:32.770732 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-6dffbbd67-8nr5p_0fc16714-38ce-478c-b691-484feb90f184/monitoring-plugin/0.log" Aug 05 17:37:32.982629 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:32.982581 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7vpss_d8a8e5dd-1531-4487-8805-1bd38fffeb29/node-exporter/0.log" Aug 05 17:37:33.000054 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:33.000028 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7vpss_d8a8e5dd-1531-4487-8805-1bd38fffeb29/kube-rbac-proxy/0.log" Aug 05 17:37:33.015851 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:33.015830 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7vpss_d8a8e5dd-1531-4487-8805-1bd38fffeb29/init-textfile/0.log" Aug 05 17:37:33.349086 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:33.349058 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-65d9d4b8bd-xc8b5_d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1/telemeter-client/0.log" Aug 05 17:37:33.367829 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:33.367806 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-65d9d4b8bd-xc8b5_d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1/reload/0.log" Aug 05 17:37:33.388046 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:33.388017 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-65d9d4b8bd-xc8b5_d2e72b6c-2f8a-4ade-a5e6-188af1a9e4a1/kube-rbac-proxy/0.log" Aug 05 17:37:34.864900 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:34.864864 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-f77f48c6d-hjdq2_242a220c-bc69-4451-91eb-58260fb20552/networking-console-plugin/0.log" Aug 05 17:37:35.410827 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:35.410795 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-5qdp4_e8e537f1-bb75-456e-973b-5ccffc3077c9/console-operator/2.log" Aug 05 17:37:35.418167 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:35.418134 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-5qdp4_e8e537f1-bb75-456e-973b-5ccffc3077c9/console-operator/3.log" Aug 05 17:37:35.581516 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:35.581489 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-x82q9/perf-node-gather-daemonset-fgm9j"] Aug 05 17:37:35.585279 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:35.585263 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x82q9/perf-node-gather-daemonset-fgm9j" Aug 05 17:37:35.587894 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:35.587870 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x82q9\"/\"kube-root-ca.crt\"" Aug 05 17:37:35.588012 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:35.587916 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x82q9\"/\"openshift-service-ca.crt\"" Aug 05 17:37:35.589319 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:35.589296 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-x82q9\"/\"default-dockercfg-nlsdl\"" Aug 05 17:37:35.593064 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:35.592894 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x82q9/perf-node-gather-daemonset-fgm9j"] Aug 05 17:37:35.718770 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:35.718675 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/731a9328-a3a0-46df-b31b-c3405f71a3ad-proc\") pod \"perf-node-gather-daemonset-fgm9j\" (UID: \"731a9328-a3a0-46df-b31b-c3405f71a3ad\") " pod="openshift-must-gather-x82q9/perf-node-gather-daemonset-fgm9j" Aug 05 17:37:35.718770 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:35.718728 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrrtc\" (UniqueName: \"kubernetes.io/projected/731a9328-a3a0-46df-b31b-c3405f71a3ad-kube-api-access-nrrtc\") pod \"perf-node-gather-daemonset-fgm9j\" (UID: \"731a9328-a3a0-46df-b31b-c3405f71a3ad\") " pod="openshift-must-gather-x82q9/perf-node-gather-daemonset-fgm9j" Aug 05 17:37:35.718968 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:35.718786 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/731a9328-a3a0-46df-b31b-c3405f71a3ad-podres\") pod \"perf-node-gather-daemonset-fgm9j\" (UID: \"731a9328-a3a0-46df-b31b-c3405f71a3ad\") " pod="openshift-must-gather-x82q9/perf-node-gather-daemonset-fgm9j" Aug 05 17:37:35.718968 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:35.718876 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/731a9328-a3a0-46df-b31b-c3405f71a3ad-sys\") pod \"perf-node-gather-daemonset-fgm9j\" (UID: \"731a9328-a3a0-46df-b31b-c3405f71a3ad\") " pod="openshift-must-gather-x82q9/perf-node-gather-daemonset-fgm9j" Aug 05 17:37:35.718968 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:35.718916 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/731a9328-a3a0-46df-b31b-c3405f71a3ad-lib-modules\") pod \"perf-node-gather-daemonset-fgm9j\" (UID: \"731a9328-a3a0-46df-b31b-c3405f71a3ad\") " pod="openshift-must-gather-x82q9/perf-node-gather-daemonset-fgm9j" Aug 05 17:37:35.820433 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:35.820402 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/731a9328-a3a0-46df-b31b-c3405f71a3ad-lib-modules\") pod \"perf-node-gather-daemonset-fgm9j\" (UID: \"731a9328-a3a0-46df-b31b-c3405f71a3ad\") " pod="openshift-must-gather-x82q9/perf-node-gather-daemonset-fgm9j" Aug 05 17:37:35.820636 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:35.820474 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/731a9328-a3a0-46df-b31b-c3405f71a3ad-proc\") pod \"perf-node-gather-daemonset-fgm9j\" (UID: \"731a9328-a3a0-46df-b31b-c3405f71a3ad\") " pod="openshift-must-gather-x82q9/perf-node-gather-daemonset-fgm9j" Aug 05 17:37:35.820636 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:35.820502 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrrtc\" (UniqueName: \"kubernetes.io/projected/731a9328-a3a0-46df-b31b-c3405f71a3ad-kube-api-access-nrrtc\") pod \"perf-node-gather-daemonset-fgm9j\" (UID: \"731a9328-a3a0-46df-b31b-c3405f71a3ad\") " pod="openshift-must-gather-x82q9/perf-node-gather-daemonset-fgm9j" Aug 05 17:37:35.820636 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:35.820542 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/731a9328-a3a0-46df-b31b-c3405f71a3ad-podres\") pod \"perf-node-gather-daemonset-fgm9j\" (UID: \"731a9328-a3a0-46df-b31b-c3405f71a3ad\") " pod="openshift-must-gather-x82q9/perf-node-gather-daemonset-fgm9j" Aug 05 17:37:35.820636 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:35.820576 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/731a9328-a3a0-46df-b31b-c3405f71a3ad-sys\") pod \"perf-node-gather-daemonset-fgm9j\" (UID: \"731a9328-a3a0-46df-b31b-c3405f71a3ad\") " pod="openshift-must-gather-x82q9/perf-node-gather-daemonset-fgm9j" Aug 05 17:37:35.820636 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:35.820607 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/731a9328-a3a0-46df-b31b-c3405f71a3ad-lib-modules\") pod \"perf-node-gather-daemonset-fgm9j\" (UID: \"731a9328-a3a0-46df-b31b-c3405f71a3ad\") " pod="openshift-must-gather-x82q9/perf-node-gather-daemonset-fgm9j" Aug 05 17:37:35.820636 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:35.820606 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/731a9328-a3a0-46df-b31b-c3405f71a3ad-proc\") pod \"perf-node-gather-daemonset-fgm9j\" (UID: \"731a9328-a3a0-46df-b31b-c3405f71a3ad\") " pod="openshift-must-gather-x82q9/perf-node-gather-daemonset-fgm9j" Aug 05 17:37:35.820861 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:35.820643 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/731a9328-a3a0-46df-b31b-c3405f71a3ad-sys\") pod \"perf-node-gather-daemonset-fgm9j\" (UID: \"731a9328-a3a0-46df-b31b-c3405f71a3ad\") " pod="openshift-must-gather-x82q9/perf-node-gather-daemonset-fgm9j" Aug 05 17:37:35.820861 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:35.820684 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/731a9328-a3a0-46df-b31b-c3405f71a3ad-podres\") pod \"perf-node-gather-daemonset-fgm9j\" (UID: \"731a9328-a3a0-46df-b31b-c3405f71a3ad\") " pod="openshift-must-gather-x82q9/perf-node-gather-daemonset-fgm9j" Aug 05 17:37:35.829308 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:35.829284 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrrtc\" (UniqueName: \"kubernetes.io/projected/731a9328-a3a0-46df-b31b-c3405f71a3ad-kube-api-access-nrrtc\") pod \"perf-node-gather-daemonset-fgm9j\" (UID: \"731a9328-a3a0-46df-b31b-c3405f71a3ad\") " pod="openshift-must-gather-x82q9/perf-node-gather-daemonset-fgm9j" Aug 05 17:37:35.896916 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:35.896885 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x82q9/perf-node-gather-daemonset-fgm9j" Aug 05 17:37:35.962810 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:35.962773 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6597fffd6-zvwp8_9f1c7cff-70a3-43f4-b09b-6d34321ddea6/console/0.log" Aug 05 17:37:36.037976 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:36.037950 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x82q9/perf-node-gather-daemonset-fgm9j"] Aug 05 17:37:36.039488 ip-10-0-136-250 kubenswrapper[2579]: W0805 17:37:36.039458 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod731a9328_a3a0_46df_b31b_c3405f71a3ad.slice/crio-ff352601acfe59a8f4a1eafe2fe73c3b2f3f08170480b04106a1a30c1f3845f7 WatchSource:0}: Error finding container ff352601acfe59a8f4a1eafe2fe73c3b2f3f08170480b04106a1a30c1f3845f7: Status 404 returned error can't find the container with id ff352601acfe59a8f4a1eafe2fe73c3b2f3f08170480b04106a1a30c1f3845f7 Aug 05 17:37:36.582486 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:36.582442 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x82q9/perf-node-gather-daemonset-fgm9j" event={"ID":"731a9328-a3a0-46df-b31b-c3405f71a3ad","Type":"ContainerStarted","Data":"3373d5bdebc56896abdf88c3c3ad992a681511d7c331b20cc7493a0bfbd8efa0"} Aug 05 17:37:36.582672 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:36.582655 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-x82q9/perf-node-gather-daemonset-fgm9j" Aug 05 17:37:36.582718 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:36.582688 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x82q9/perf-node-gather-daemonset-fgm9j" event={"ID":"731a9328-a3a0-46df-b31b-c3405f71a3ad","Type":"ContainerStarted","Data":"ff352601acfe59a8f4a1eafe2fe73c3b2f3f08170480b04106a1a30c1f3845f7"} Aug 05 17:37:36.600590 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:36.600540 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-x82q9/perf-node-gather-daemonset-fgm9j" podStartSLOduration=1.60052573 podStartE2EDuration="1.60052573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:37:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:37:36.598015108 +0000 UTC m=+844.365395341" watchObservedRunningTime="2026-08-05 17:37:36.60052573 +0000 UTC m=+844.367905996" Aug 05 17:37:36.690399 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:36.690364 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5b8776669-vgc4l_63a97bae-532f-40f8-843e-00921bee6ab3/volume-data-source-validator/0.log" Aug 05 17:37:37.786387 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:37.786358 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9z24f_3d48c235-6230-45af-8726-39db507d6fa3/dns/0.log" Aug 05 17:37:37.802359 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:37.802327 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9z24f_3d48c235-6230-45af-8726-39db507d6fa3/kube-rbac-proxy/0.log" Aug 05 17:37:37.819853 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:37.819828 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2dhgr_dfa0d5d1-b355-44cc-abf9-124e11c44d6b/dns-node-resolver/0.log" Aug 05 17:37:38.428823 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:38.428791 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6wt47_453d1073-3d90-4861-81d5-2c88980b98ed/node-ca/0.log" Aug 05 17:37:39.346205 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:39.346175 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cqlggz_0ec49604-1ddb-4059-bed3-18d19cf55508/istio-proxy/0.log" Aug 05 17:37:39.402553 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:39.402523 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57859c69d8-k7mhq_eed65b12-a5e5-474e-b542-02d9a1a34d48/kube-auth-proxy/0.log" Aug 05 17:37:39.468020 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:39.467989 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-hp579_20d100e8-1960-4220-8185-56f363147c71/payload-pre-processing/0.log" Aug 05 17:37:39.507571 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:39.507540 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5ddbb5b6b4-262r4_d7bee8cb-675d-4da7-a767-149f0d6e026f/router/0.log" Aug 05 17:37:40.133859 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:40.133835 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rd22r_67501f22-9897-4528-a8d0-4e55e82e41e0/serve-healthcheck-canary/0.log" Aug 05 17:37:40.593284 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:40.593254 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-7xft8_fcb6cf3e-3244-471a-9780-6c3fcc157551/insights-operator/0.log" Aug 05 17:37:40.593758 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:40.593425 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-7xft8_fcb6cf3e-3244-471a-9780-6c3fcc157551/insights-operator/1.log" Aug 05 17:37:40.613409 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:40.613383 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dnlk4_1244d989-fade-4f1b-82f7-9799752149f6/kube-rbac-proxy/0.log" Aug 05 17:37:40.629730 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:40.629682 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dnlk4_1244d989-fade-4f1b-82f7-9799752149f6/exporter/0.log" Aug 05 17:37:40.650232 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:40.650215 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dnlk4_1244d989-fade-4f1b-82f7-9799752149f6/extractor/0.log" Aug 05 17:37:42.599057 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:42.599023 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-x82q9/perf-node-gather-daemonset-fgm9j" Aug 05 17:37:42.873108 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:42.873017 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-g6lqz_ebd8d0da-d7b5-4375-8e19-3cf7bcc3ec3f/manager/0.log" Aug 05 17:37:42.908503 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:42.908471 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-2h5k2_7e2ace6e-6626-4a0a-938b-5d15ac6e3ac1/manager/0.log" Aug 05 17:37:42.943198 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:42.943170 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7fb5b67fd7-r52h9_347f2b4f-45ca-444a-8b41-71e9e330d1de/manager/0.log" Aug 05 17:37:42.962206 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:42.962181 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-x7b84_350757b4-2a8f-46bd-8a4d-ca0498e4061e/server/0.log" Aug 05 17:37:43.024899 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:43.024868 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9b569_98d99d9f-8019-466e-acac-1d45f96e5cb4/manager/0.log" Aug 05 17:37:43.082248 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:43.082200 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-666c5d8f77-7fnj9_244dd5ea-2775-42ac-8a83-02c4a9cf942b/manager/0.log" Aug 05 17:37:43.096381 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:43.096351 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-666c5d8f77-7fnj9_244dd5ea-2775-42ac-8a83-02c4a9cf942b/copy-manifests/0.log" Aug 05 17:37:46.876717 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:46.876685 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cqlggz_0ec49604-1ddb-4059-bed3-18d19cf55508/istio-proxy/0.log" Aug 05 17:37:46.927959 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:46.927928 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57859c69d8-k7mhq_eed65b12-a5e5-474e-b542-02d9a1a34d48/kube-auth-proxy/0.log" Aug 05 17:37:46.973304 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:46.973278 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-hp579_20d100e8-1960-4220-8185-56f363147c71/payload-pre-processing/0.log" Aug 05 17:37:47.000917 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:47.000890 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5ddbb5b6b4-262r4_d7bee8cb-675d-4da7-a767-149f0d6e026f/router/0.log" Aug 05 17:37:48.231753 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:48.231725 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cqlggz_0ec49604-1ddb-4059-bed3-18d19cf55508/istio-proxy/0.log" Aug 05 17:37:48.281075 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:48.281046 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57859c69d8-k7mhq_eed65b12-a5e5-474e-b542-02d9a1a34d48/kube-auth-proxy/0.log" Aug 05 17:37:48.333264 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:48.333235 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-hp579_20d100e8-1960-4220-8185-56f363147c71/payload-pre-processing/0.log" Aug 05 17:37:48.363704 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:48.363680 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5ddbb5b6b4-262r4_d7bee8cb-675d-4da7-a767-149f0d6e026f/router/0.log" Aug 05 17:37:50.127723 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:50.127680 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-vjkmk_45a097fa-7f29-42cc-b351-931955a10ccf/kube-storage-version-migrator-operator/1.log" Aug 05 17:37:50.129256 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:50.129219 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-vjkmk_45a097fa-7f29-42cc-b351-931955a10ccf/kube-storage-version-migrator-operator/0.log" Aug 05 17:37:51.385686 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:51.385656 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hnz8f_14ecac34-eb47-4daa-85f4-d64dcb1a116b/kube-multus-additional-cni-plugins/0.log" Aug 05 17:37:51.401639 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:51.401606 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hnz8f_14ecac34-eb47-4daa-85f4-d64dcb1a116b/egress-router-binary-copy/0.log" Aug 05 17:37:51.417694 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:51.417671 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hnz8f_14ecac34-eb47-4daa-85f4-d64dcb1a116b/cni-plugins/0.log" Aug 05 17:37:51.433682 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:51.433662 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hnz8f_14ecac34-eb47-4daa-85f4-d64dcb1a116b/bond-cni-plugin/0.log" Aug 05 17:37:51.449583 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:51.449554 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hnz8f_14ecac34-eb47-4daa-85f4-d64dcb1a116b/routeoverride-cni/0.log" Aug 05 17:37:51.465250 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:51.465227 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hnz8f_14ecac34-eb47-4daa-85f4-d64dcb1a116b/whereabouts-cni-bincopy/0.log" Aug 05 17:37:51.480857 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:51.480833 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hnz8f_14ecac34-eb47-4daa-85f4-d64dcb1a116b/whereabouts-cni/0.log" Aug 05 17:37:51.520623 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:51.520589 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-p84kb_2e6224d3-5fb6-4c8f-962b-c5864610b153/kube-multus/0.log" Aug 05 17:37:51.576848 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:51.576820 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dmchc_e79bda8c-75ee-4022-a816-f55a58cec6c0/network-metrics-daemon/0.log" Aug 05 17:37:51.591058 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:51.591036 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dmchc_e79bda8c-75ee-4022-a816-f55a58cec6c0/kube-rbac-proxy/0.log" Aug 05 17:37:52.775181 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:52.775132 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w8nvr_5f5b9f8c-f284-4181-b324-8807188e1f06/ovn-controller/0.log" Aug 05 17:37:52.789788 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:52.789762 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w8nvr_5f5b9f8c-f284-4181-b324-8807188e1f06/ovn-acl-logging/0.log" Aug 05 17:37:52.810696 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:52.810666 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w8nvr_5f5b9f8c-f284-4181-b324-8807188e1f06/kube-rbac-proxy-node/0.log" Aug 05 17:37:52.832204 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:52.832179 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w8nvr_5f5b9f8c-f284-4181-b324-8807188e1f06/kube-rbac-proxy-ovn-metrics/0.log" Aug 05 17:37:52.848462 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:52.848438 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w8nvr_5f5b9f8c-f284-4181-b324-8807188e1f06/northd/0.log" Aug 05 17:37:52.865070 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:52.865018 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w8nvr_5f5b9f8c-f284-4181-b324-8807188e1f06/nbdb/0.log" Aug 05 17:37:52.885544 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:52.885509 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w8nvr_5f5b9f8c-f284-4181-b324-8807188e1f06/sbdb/0.log" Aug 05 17:37:52.952168 ip-10-0-136-250 kubenswrapper[2579]: I0805 17:37:52.952114 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w8nvr_5f5b9f8c-f284-4181-b324-8807188e1f06/ovnkube-controller/0.log"