Jul 06 16:26:26.612445 ip-10-0-140-222 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 06 16:26:26.612453 ip-10-0-140-222 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 06 16:26:26.612460 ip-10-0-140-222 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 06 16:26:26.612733 ip-10-0-140-222 systemd[1]: Failed to start Kubernetes Kubelet. Jul 06 16:26:36.659099 ip-10-0-140-222 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 06 16:26:36.659118 ip-10-0-140-222 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 2a67b54f49634d04a5dc956e4b5e1423 -- Jul 06 16:28:38.600280 ip-10-0-140-222 systemd[1]: Starting Kubernetes Kubelet... Jul 06 16:28:39.010787 ip-10-0-140-222 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 16:28:39.010787 ip-10-0-140-222 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 16:28:39.010787 ip-10-0-140-222 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 16:28:39.010787 ip-10-0-140-222 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 16:28:39.010787 ip-10-0-140-222 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 16:28:39.011486 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.011405 2555 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 16:28:39.017246 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017231 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 16:28:39.017246 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017245 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 16:28:39.017335 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017248 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 16:28:39.017335 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017255 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 16:28:39.017335 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017260 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 16:28:39.017335 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017263 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 16:28:39.017335 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017266 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 16:28:39.017335 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017269 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 16:28:39.017335 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017271 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 16:28:39.017335 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017274 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 16:28:39.017335 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017276 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 16:28:39.017335 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017279 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 16:28:39.017335 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017281 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 16:28:39.017335 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017284 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 16:28:39.017335 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017286 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 16:28:39.017335 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017289 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 16:28:39.017335 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017291 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 16:28:39.017335 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017293 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 16:28:39.017335 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017296 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 16:28:39.017335 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017298 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 16:28:39.017335 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017301 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 16:28:39.017335 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017309 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 16:28:39.017811 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017311 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 16:28:39.017811 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017314 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 16:28:39.017811 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017316 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 16:28:39.017811 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017318 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 16:28:39.017811 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017321 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 16:28:39.017811 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017323 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 16:28:39.017811 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017326 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 16:28:39.017811 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017328 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 16:28:39.017811 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017330 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 16:28:39.017811 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017333 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 16:28:39.017811 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017335 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 16:28:39.017811 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017337 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 16:28:39.017811 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017348 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 16:28:39.017811 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017351 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 16:28:39.017811 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017355 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 16:28:39.017811 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017358 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 16:28:39.017811 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017361 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 16:28:39.017811 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017363 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 16:28:39.017811 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017366 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 16:28:39.017811 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017368 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 16:28:39.018303 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017371 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 16:28:39.018303 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017373 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 16:28:39.018303 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017376 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 16:28:39.018303 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017378 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 16:28:39.018303 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017381 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 16:28:39.018303 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017383 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 16:28:39.018303 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017385 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 16:28:39.018303 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017388 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 16:28:39.018303 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017390 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 16:28:39.018303 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017393 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 16:28:39.018303 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017396 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 16:28:39.018303 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017398 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 16:28:39.018303 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017401 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 16:28:39.018303 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017404 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 16:28:39.018303 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017407 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 16:28:39.018303 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017409 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 16:28:39.018303 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017412 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 16:28:39.018303 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017414 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 16:28:39.018303 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017417 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 16:28:39.018303 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017419 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 16:28:39.018867 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017422 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 16:28:39.018867 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017424 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 16:28:39.018867 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017426 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 16:28:39.018867 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017429 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 16:28:39.018867 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017431 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 16:28:39.018867 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017435 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 16:28:39.018867 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017438 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 16:28:39.018867 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017441 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 16:28:39.018867 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017443 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 16:28:39.018867 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017446 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 16:28:39.018867 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017450 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 16:28:39.018867 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017453 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 16:28:39.018867 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017455 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 16:28:39.018867 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017458 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 16:28:39.018867 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017460 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 16:28:39.018867 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017462 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 16:28:39.018867 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017465 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 16:28:39.018867 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017467 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 16:28:39.018867 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017469 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 06 16:28:39.018867 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017472 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 16:28:39.019365 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017474 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 16:28:39.019365 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017477 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 16:28:39.019365 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017479 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 16:28:39.019365 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017481 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 16:28:39.019365 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017484 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 16:28:39.019365 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017487 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 16:28:39.019365 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017490 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 16:28:39.019365 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017493 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 16:28:39.019365 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017495 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 16:28:39.019365 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017498 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 16:28:39.019365 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017501 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 16:28:39.019365 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017505 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 16:28:39.019365 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017508 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 16:28:39.019365 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017510 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 16:28:39.019365 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017513 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 16:28:39.019365 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017516 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 16:28:39.019365 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.017518 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 16:28:39.020253 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020241 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 16:28:39.020253 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020252 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 16:28:39.020313 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020256 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 16:28:39.020313 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020259 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 16:28:39.020313 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020262 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 16:28:39.020313 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020265 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 16:28:39.020313 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020268 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 16:28:39.020313 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020270 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 16:28:39.020313 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020273 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 16:28:39.020313 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020275 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 16:28:39.020313 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020278 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 16:28:39.020313 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020280 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 16:28:39.020313 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020283 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 16:28:39.020313 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020285 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 16:28:39.020313 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020288 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 16:28:39.020313 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020290 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 16:28:39.020313 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020293 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 16:28:39.020313 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020295 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 16:28:39.020313 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020298 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 16:28:39.020313 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020300 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 16:28:39.020313 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020303 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 16:28:39.020313 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020306 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 16:28:39.020810 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020308 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 16:28:39.020810 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020311 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 16:28:39.020810 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020313 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 16:28:39.020810 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020315 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 16:28:39.020810 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020318 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 16:28:39.020810 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020321 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 16:28:39.020810 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020324 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 16:28:39.020810 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020326 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 16:28:39.020810 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020329 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 16:28:39.020810 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020332 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 16:28:39.020810 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020334 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 16:28:39.020810 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020336 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 16:28:39.020810 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020340 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 16:28:39.020810 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020343 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 16:28:39.020810 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020345 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 16:28:39.020810 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020348 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 16:28:39.020810 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020350 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 16:28:39.020810 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020352 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 16:28:39.020810 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020354 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 16:28:39.020810 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020357 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 06 16:28:39.021321 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020359 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 16:28:39.021321 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020361 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 16:28:39.021321 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020364 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 16:28:39.021321 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020366 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 16:28:39.021321 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020368 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 16:28:39.021321 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020371 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 16:28:39.021321 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020373 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 16:28:39.021321 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020375 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 16:28:39.021321 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020377 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 16:28:39.021321 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020380 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 16:28:39.021321 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020382 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 16:28:39.021321 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020384 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 16:28:39.021321 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020387 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 16:28:39.021321 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020391 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 16:28:39.021321 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020393 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 16:28:39.021321 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020396 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 16:28:39.021321 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020399 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 16:28:39.021321 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020401 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 16:28:39.021321 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020403 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 16:28:39.021321 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020406 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 16:28:39.022083 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020408 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 16:28:39.022083 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020412 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 16:28:39.022083 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020416 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 16:28:39.022083 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020418 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 16:28:39.022083 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020421 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 16:28:39.022083 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020424 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 16:28:39.022083 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020427 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 16:28:39.022083 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020429 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 16:28:39.022083 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020433 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 16:28:39.022083 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020436 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 16:28:39.022083 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020439 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 16:28:39.022083 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020442 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 16:28:39.022083 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020444 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 16:28:39.022083 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020447 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 16:28:39.022083 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020449 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 16:28:39.022083 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020451 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 16:28:39.022083 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020453 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 16:28:39.022083 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020456 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 16:28:39.022083 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020458 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 16:28:39.022714 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020460 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 16:28:39.022714 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020463 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 16:28:39.022714 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020465 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 16:28:39.022714 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020468 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 16:28:39.022714 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020470 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 16:28:39.022714 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020474 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 16:28:39.022714 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020478 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 16:28:39.022714 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020481 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 16:28:39.022714 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020483 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 16:28:39.022714 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020486 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 16:28:39.022714 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020488 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 16:28:39.022714 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020491 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 16:28:39.022714 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020493 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 16:28:39.022714 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020496 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 16:28:39.022714 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020498 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 16:28:39.022714 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020500 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 16:28:39.022714 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020503 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 16:28:39.022714 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.020507 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 16:28:39.024506 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024489 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 16:28:39.024506 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024504 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 16:28:39.024506 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024508 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 16:28:39.024506 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024511 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 16:28:39.024664 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024513 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 16:28:39.024664 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024517 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 16:28:39.024664 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024519 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 16:28:39.024664 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024522 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 16:28:39.024664 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024524 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 16:28:39.024664 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024527 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 16:28:39.024664 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024529 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 16:28:39.024664 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024532 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 06 16:28:39.024664 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024535 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 16:28:39.024664 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024537 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 16:28:39.024664 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024540 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 16:28:39.024664 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024542 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 16:28:39.024664 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024545 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 16:28:39.024664 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024547 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 16:28:39.024664 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024555 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 16:28:39.024664 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024557 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 16:28:39.024664 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024560 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 16:28:39.024664 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024563 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 16:28:39.024664 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024565 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 16:28:39.024664 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024567 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 16:28:39.025223 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024570 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 16:28:39.025223 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024572 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 16:28:39.025223 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024575 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 16:28:39.025223 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024577 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 16:28:39.025223 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024580 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 16:28:39.025223 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024582 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 16:28:39.025223 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024585 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 16:28:39.025223 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024587 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 16:28:39.025223 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024590 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 16:28:39.025223 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024592 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 16:28:39.025223 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024596 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 16:28:39.025223 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024600 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 16:28:39.025223 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024603 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 16:28:39.025223 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024607 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 16:28:39.025223 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024609 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 16:28:39.025223 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024612 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 16:28:39.025223 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024614 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 16:28:39.025223 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024617 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 16:28:39.025223 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024619 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 16:28:39.025683 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024621 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 16:28:39.025683 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024624 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 16:28:39.025683 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024626 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 16:28:39.025683 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024629 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 16:28:39.025683 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024631 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 16:28:39.025683 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024634 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 16:28:39.025683 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024636 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 16:28:39.025683 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024639 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 16:28:39.025683 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024641 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 16:28:39.025683 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024644 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 16:28:39.025683 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024646 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 16:28:39.025683 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024648 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 16:28:39.025683 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024651 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 16:28:39.025683 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024653 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 16:28:39.025683 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024655 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 16:28:39.025683 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024658 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 16:28:39.025683 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024660 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 16:28:39.025683 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024662 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 16:28:39.025683 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024665 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 16:28:39.025683 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024667 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 16:28:39.026233 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024670 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 16:28:39.026233 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024672 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 16:28:39.026233 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024675 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 16:28:39.026233 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024678 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 16:28:39.026233 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024680 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 16:28:39.026233 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024683 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 16:28:39.026233 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024686 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 16:28:39.026233 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024689 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 16:28:39.026233 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024691 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 16:28:39.026233 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024694 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 16:28:39.026233 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024697 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 16:28:39.026233 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024699 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 16:28:39.026233 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024701 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 16:28:39.026233 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024704 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 16:28:39.026233 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024706 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 16:28:39.026233 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024710 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 16:28:39.026233 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024712 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 16:28:39.026233 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024714 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 16:28:39.026233 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024716 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 16:28:39.026233 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024720 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 16:28:39.026718 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024723 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 16:28:39.026718 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024727 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 16:28:39.026718 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024729 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 16:28:39.026718 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024732 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 16:28:39.026718 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024735 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 16:28:39.026718 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024738 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 16:28:39.026718 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024741 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 16:28:39.026718 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024743 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 16:28:39.026718 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024746 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 16:28:39.026718 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024749 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 16:28:39.026718 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024753 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 16:28:39.026718 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024757 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 16:28:39.026718 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024760 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 16:28:39.026718 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024763 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 16:28:39.026718 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024766 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 16:28:39.026718 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.024768 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 16:28:39.026718 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024831 2555 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 16:28:39.026718 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024838 2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 16:28:39.026718 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024844 2555 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 16:28:39.026718 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024848 2555 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 16:28:39.027208 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024852 2555 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 16:28:39.027208 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024855 2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 16:28:39.027208 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024860 2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 16:28:39.027208 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024864 2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 16:28:39.027208 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024867 2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 16:28:39.027208 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024870 2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 16:28:39.027208 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024873 2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 16:28:39.027208 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024877 2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 16:28:39.027208 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024880 2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 16:28:39.027208 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024883 2555 flags.go:64] FLAG: --cgroup-root="" Jul 06 16:28:39.027208 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024885 2555 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 16:28:39.027208 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024888 2555 flags.go:64] FLAG: --client-ca-file="" Jul 06 16:28:39.027208 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024891 2555 flags.go:64] FLAG: --cloud-provider="external" Jul 06 16:28:39.027208 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024894 2555 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 16:28:39.027208 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024898 2555 flags.go:64] FLAG: --cluster-domain="" Jul 06 16:28:39.027208 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024900 2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 16:28:39.027208 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024903 2555 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 16:28:39.027208 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024906 2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 16:28:39.027208 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024909 2555 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 16:28:39.027208 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024916 2555 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 16:28:39.027208 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024919 2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 16:28:39.027208 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024922 2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 16:28:39.027208 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024926 2555 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 16:28:39.027787 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024929 2555 flags.go:64] FLAG: --contention-profiling="false" Jul 06 16:28:39.027787 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024932 2555 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 16:28:39.027787 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024934 2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 16:28:39.027787 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024952 2555 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 16:28:39.027787 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024955 2555 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 16:28:39.027787 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024959 2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 16:28:39.027787 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024962 2555 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 16:28:39.027787 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024965 2555 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 16:28:39.027787 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024968 2555 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 16:28:39.027787 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024970 2555 flags.go:64] FLAG: --enable-server="true" Jul 06 16:28:39.027787 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024973 2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 16:28:39.027787 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024978 2555 flags.go:64] FLAG: --event-burst="100" Jul 06 16:28:39.027787 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024981 2555 flags.go:64] FLAG: --event-qps="50" Jul 06 16:28:39.027787 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024984 2555 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 16:28:39.027787 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024986 2555 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 16:28:39.027787 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024989 2555 flags.go:64] FLAG: --eviction-hard="" Jul 06 16:28:39.027787 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024992 2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 16:28:39.027787 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024995 2555 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 16:28:39.027787 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.024998 2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 16:28:39.027787 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025001 2555 flags.go:64] FLAG: --eviction-soft="" Jul 06 16:28:39.027787 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025004 2555 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 16:28:39.027787 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025006 2555 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 16:28:39.027787 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025009 2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 16:28:39.027787 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025012 2555 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 16:28:39.027787 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025015 2555 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 16:28:39.028429 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025018 2555 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 16:28:39.028429 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025020 2555 flags.go:64] FLAG: --feature-gates="" Jul 06 16:28:39.028429 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025023 2555 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 16:28:39.028429 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025026 2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 16:28:39.028429 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025029 2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 16:28:39.028429 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025032 2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 16:28:39.028429 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025036 2555 flags.go:64] FLAG: --healthz-port="10248" Jul 06 16:28:39.028429 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025038 2555 flags.go:64] FLAG: --help="false" Jul 06 16:28:39.028429 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025041 2555 flags.go:64] FLAG: --hostname-override="ip-10-0-140-222.ec2.internal" Jul 06 16:28:39.028429 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025044 2555 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 16:28:39.028429 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025047 2555 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 16:28:39.028429 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025050 2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 16:28:39.028429 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025053 2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 16:28:39.028429 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025056 2555 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 16:28:39.028429 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025059 2555 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 16:28:39.028429 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025062 2555 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 16:28:39.028429 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025064 2555 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 16:28:39.028429 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025067 2555 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 16:28:39.028429 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025070 2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 16:28:39.028429 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025073 2555 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 16:28:39.028429 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025075 2555 flags.go:64] FLAG: --kube-reserved="" Jul 06 16:28:39.028429 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025078 2555 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 16:28:39.028429 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025081 2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 16:28:39.028429 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025083 2555 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 16:28:39.029035 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025086 2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 16:28:39.029035 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025089 2555 flags.go:64] FLAG: --lock-file="" Jul 06 16:28:39.029035 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025091 2555 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 16:28:39.029035 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025094 2555 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 16:28:39.029035 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025097 2555 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 16:28:39.029035 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025102 2555 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 16:28:39.029035 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025105 2555 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 16:28:39.029035 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025108 2555 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 16:28:39.029035 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025110 2555 flags.go:64] FLAG: --logging-format="text" Jul 06 16:28:39.029035 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025113 2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 16:28:39.029035 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025116 2555 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 16:28:39.029035 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025119 2555 flags.go:64] FLAG: --manifest-url="" Jul 06 16:28:39.029035 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025122 2555 flags.go:64] FLAG: --manifest-url-header="" Jul 06 16:28:39.029035 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025127 2555 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 16:28:39.029035 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025130 2555 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 16:28:39.029035 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025134 2555 flags.go:64] FLAG: --max-pods="110" Jul 06 16:28:39.029035 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025136 2555 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 16:28:39.029035 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025139 2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 16:28:39.029035 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025142 2555 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 16:28:39.029035 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025145 2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 16:28:39.029035 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025147 2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 16:28:39.029035 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025150 2555 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 16:28:39.029035 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025154 2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 16:28:39.029035 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025160 2555 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 16:28:39.029035 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025163 2555 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 16:28:39.029689 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025166 2555 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 16:28:39.029689 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025169 2555 flags.go:64] FLAG: --pod-cidr="" Jul 06 16:28:39.029689 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025172 2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 16:28:39.029689 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025176 2555 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 16:28:39.029689 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025179 2555 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 16:28:39.029689 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025182 2555 flags.go:64] FLAG: --pods-per-core="0" Jul 06 16:28:39.029689 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025185 2555 flags.go:64] FLAG: --port="10250" Jul 06 16:28:39.029689 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025188 2555 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 16:28:39.029689 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025191 2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f88d4f234ac4d42b" Jul 06 16:28:39.029689 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025194 2555 flags.go:64] FLAG: --qos-reserved="" Jul 06 16:28:39.029689 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025197 2555 flags.go:64] FLAG: --read-only-port="10255" Jul 06 16:28:39.029689 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025200 2555 flags.go:64] FLAG: --register-node="true" Jul 06 16:28:39.029689 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025203 2555 flags.go:64] FLAG: --register-with-taints="" Jul 06 16:28:39.029689 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025206 2555 flags.go:64] FLAG: --registry-burst="10" Jul 06 16:28:39.029689 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025209 2555 flags.go:64] FLAG: --registry-qps="5" Jul 06 16:28:39.029689 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025212 2555 flags.go:64] FLAG: --reserved-cpus="" Jul 06 16:28:39.029689 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025214 2555 flags.go:64] FLAG: --reserved-memory="" Jul 06 16:28:39.029689 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025218 2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 16:28:39.029689 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025221 2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 16:28:39.029689 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025224 2555 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 16:28:39.029689 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025227 2555 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 16:28:39.029689 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025229 2555 flags.go:64] FLAG: --runonce="false" Jul 06 16:28:39.029689 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025232 2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 16:28:39.029689 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025235 2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 16:28:39.029689 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025238 2555 flags.go:64] FLAG: --seccomp-default="false" Jul 06 16:28:39.030303 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025241 2555 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 16:28:39.030303 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025244 2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 16:28:39.030303 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025246 2555 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 16:28:39.030303 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025249 2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 16:28:39.030303 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025252 2555 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 16:28:39.030303 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025256 2555 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 16:28:39.030303 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025259 2555 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 16:28:39.030303 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025262 2555 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 16:28:39.030303 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025265 2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 16:28:39.030303 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025268 2555 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 16:28:39.030303 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025270 2555 flags.go:64] FLAG: --system-cgroups="" Jul 06 16:28:39.030303 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025273 2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 16:28:39.030303 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025278 2555 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 16:28:39.030303 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025281 2555 flags.go:64] FLAG: --tls-cert-file="" Jul 06 16:28:39.030303 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025284 2555 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 16:28:39.030303 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025287 2555 flags.go:64] FLAG: --tls-min-version="" Jul 06 16:28:39.030303 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025290 2555 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 16:28:39.030303 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025293 2555 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 16:28:39.030303 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025295 2555 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 16:28:39.030303 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025299 2555 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 16:28:39.030303 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025301 2555 flags.go:64] FLAG: --v="2" Jul 06 16:28:39.030303 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025305 2555 flags.go:64] FLAG: --version="false" Jul 06 16:28:39.030303 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025310 2555 flags.go:64] FLAG: --vmodule="" Jul 06 16:28:39.030303 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025314 2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 16:28:39.030303 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.025317 2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 16:28:39.030906 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025430 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 16:28:39.030906 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025435 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 16:28:39.030906 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025438 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 16:28:39.030906 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025440 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 16:28:39.030906 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025443 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 16:28:39.030906 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025445 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 16:28:39.030906 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025448 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 16:28:39.030906 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025450 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 16:28:39.030906 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025453 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 16:28:39.030906 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025455 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 16:28:39.030906 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025458 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 16:28:39.030906 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025460 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 16:28:39.030906 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025464 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 16:28:39.030906 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025467 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 16:28:39.030906 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025469 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 16:28:39.030906 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025472 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 16:28:39.030906 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025474 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 16:28:39.030906 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025477 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 16:28:39.030906 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025480 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 16:28:39.030906 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025483 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 16:28:39.031461 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025485 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 16:28:39.031461 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025488 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 16:28:39.031461 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025490 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 16:28:39.031461 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025493 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 16:28:39.031461 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025495 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 16:28:39.031461 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025497 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 16:28:39.031461 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025500 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 16:28:39.031461 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025503 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 16:28:39.031461 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025505 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 16:28:39.031461 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025508 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 16:28:39.031461 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025510 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 16:28:39.031461 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025513 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 16:28:39.031461 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025515 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 16:28:39.031461 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025517 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 16:28:39.031461 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025520 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 16:28:39.031461 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025522 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 16:28:39.031461 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025524 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 16:28:39.031461 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025528 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 16:28:39.031461 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025531 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 16:28:39.031461 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025533 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 16:28:39.031966 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025535 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 16:28:39.031966 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025538 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 16:28:39.031966 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025540 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 16:28:39.031966 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025542 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 16:28:39.031966 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025546 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 16:28:39.031966 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025548 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 16:28:39.031966 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025550 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 16:28:39.031966 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025553 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 16:28:39.031966 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025555 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 16:28:39.031966 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025558 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 16:28:39.031966 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025560 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 06 16:28:39.031966 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025563 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 16:28:39.031966 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025565 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 16:28:39.031966 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025569 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 16:28:39.031966 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025572 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 16:28:39.031966 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025575 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 16:28:39.031966 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025577 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 16:28:39.031966 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025580 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 16:28:39.031966 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025582 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 16:28:39.032417 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025585 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 16:28:39.032417 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025588 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 16:28:39.032417 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025591 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 16:28:39.032417 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025594 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 16:28:39.032417 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025597 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 16:28:39.032417 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025600 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 16:28:39.032417 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025602 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 16:28:39.032417 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025604 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 16:28:39.032417 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025607 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 16:28:39.032417 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025609 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 16:28:39.032417 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025613 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 16:28:39.032417 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025616 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 16:28:39.032417 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025618 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 16:28:39.032417 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025621 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 16:28:39.032417 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025623 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 16:28:39.032417 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025625 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 16:28:39.032417 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025630 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 16:28:39.032417 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025634 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 16:28:39.032417 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025636 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 16:28:39.032884 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025639 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 16:28:39.032884 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025641 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 16:28:39.032884 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025644 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 16:28:39.032884 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025647 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 16:28:39.032884 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025650 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 16:28:39.032884 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025652 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 16:28:39.032884 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025655 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 16:28:39.032884 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025658 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 16:28:39.032884 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025660 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 16:28:39.032884 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025663 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 16:28:39.032884 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025665 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 16:28:39.032884 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025668 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 16:28:39.032884 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025670 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 16:28:39.032884 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025673 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 16:28:39.032884 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025675 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 16:28:39.032884 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025678 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 16:28:39.032884 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025680 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 16:28:39.032884 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025683 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 16:28:39.032884 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025686 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 16:28:39.032884 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025688 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 16:28:39.033377 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.025691 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 16:28:39.033377 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.026483 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 16:28:39.033377 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.032853 2555 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 16:28:39.033377 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.032868 2555 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 16:28:39.033377 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.032887 2555 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 16:28:39.033377 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.032892 2555 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 16:28:39.033377 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.032971 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 16:28:39.033377 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.032976 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 16:28:39.033377 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.032979 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 16:28:39.033377 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.032982 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 16:28:39.033377 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.032984 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 16:28:39.033377 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.032987 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 16:28:39.033377 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.032991 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 16:28:39.033377 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.032993 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 16:28:39.033731 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.032995 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 16:28:39.033731 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.032998 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 16:28:39.033731 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033001 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 16:28:39.033731 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033003 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 16:28:39.033731 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033006 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 16:28:39.033731 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033008 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 16:28:39.033731 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033011 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 16:28:39.033731 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033013 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 16:28:39.033731 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033016 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 16:28:39.033731 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033018 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 16:28:39.033731 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033021 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 16:28:39.033731 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033023 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 16:28:39.033731 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033026 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 16:28:39.033731 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033029 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 16:28:39.033731 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033031 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 16:28:39.033731 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033034 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 16:28:39.033731 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033038 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 16:28:39.033731 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033040 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 16:28:39.033731 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033043 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 16:28:39.033731 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033045 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 16:28:39.034302 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033048 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 06 16:28:39.034302 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033051 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 16:28:39.034302 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033054 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 16:28:39.034302 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033056 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 16:28:39.034302 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033059 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 16:28:39.034302 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033061 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 16:28:39.034302 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033064 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 16:28:39.034302 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033067 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 16:28:39.034302 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033069 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 16:28:39.034302 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033072 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 16:28:39.034302 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033074 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 16:28:39.034302 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033077 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 16:28:39.034302 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033079 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 16:28:39.034302 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033083 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 16:28:39.034302 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033086 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 16:28:39.034302 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033089 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 16:28:39.034302 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033092 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 16:28:39.034302 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033094 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 16:28:39.034302 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033097 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 16:28:39.034753 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033099 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 16:28:39.034753 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033101 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 16:28:39.034753 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033104 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 16:28:39.034753 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033106 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 16:28:39.034753 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033108 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 16:28:39.034753 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033111 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 16:28:39.034753 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033113 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 16:28:39.034753 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033116 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 16:28:39.034753 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033118 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 16:28:39.034753 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033121 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 16:28:39.034753 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033124 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 16:28:39.034753 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033126 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 16:28:39.034753 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033129 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 16:28:39.034753 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033133 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 16:28:39.034753 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033137 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 16:28:39.034753 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033140 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 16:28:39.034753 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033143 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 16:28:39.034753 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033145 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 16:28:39.034753 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033148 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 16:28:39.035217 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033151 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 16:28:39.035217 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033153 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 16:28:39.035217 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033156 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 16:28:39.035217 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033158 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 16:28:39.035217 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033161 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 16:28:39.035217 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033163 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 16:28:39.035217 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033166 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 16:28:39.035217 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033168 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 16:28:39.035217 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033170 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 16:28:39.035217 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033173 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 16:28:39.035217 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033176 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 16:28:39.035217 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033178 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 16:28:39.035217 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033180 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 16:28:39.035217 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033184 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 16:28:39.035217 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033187 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 16:28:39.035217 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033190 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 16:28:39.035217 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033192 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 16:28:39.035217 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033195 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 16:28:39.035217 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033197 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 16:28:39.035217 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033200 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 16:28:39.035695 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033203 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 16:28:39.035695 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033205 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 16:28:39.035695 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033208 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 16:28:39.035695 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033210 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 16:28:39.035695 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033214 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 16:28:39.035695 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033216 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 16:28:39.035695 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033219 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 16:28:39.035695 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033223 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 16:28:39.035695 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033225 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 16:28:39.035695 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033228 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 16:28:39.035695 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033230 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 16:28:39.035695 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033233 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 16:28:39.035695 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033235 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 16:28:39.035695 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.033240 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 16:28:39.035695 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033359 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 16:28:39.036072 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033363 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 16:28:39.036072 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033366 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 16:28:39.036072 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033369 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 16:28:39.036072 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033372 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 16:28:39.036072 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033375 2555 feature_gate.go:328] unrecognized feature gate: Example Jul 06 16:28:39.036072 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033378 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 16:28:39.036072 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033381 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 16:28:39.036072 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033383 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 16:28:39.036072 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033386 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 16:28:39.036072 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033388 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 16:28:39.036072 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033391 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 16:28:39.036072 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033394 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 16:28:39.036072 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033396 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 16:28:39.036072 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033398 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 16:28:39.036072 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033401 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 16:28:39.036072 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033403 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 16:28:39.036072 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033406 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 16:28:39.036072 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033408 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 16:28:39.036072 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033410 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 16:28:39.036072 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033413 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 16:28:39.036553 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033415 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 16:28:39.036553 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033418 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 16:28:39.036553 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033421 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 16:28:39.036553 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033423 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 16:28:39.036553 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033426 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 16:28:39.036553 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033430 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 16:28:39.036553 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033433 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 16:28:39.036553 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033436 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 16:28:39.036553 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033439 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 16:28:39.036553 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033442 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 16:28:39.036553 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033445 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 16:28:39.036553 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033447 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 16:28:39.036553 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033450 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 16:28:39.036553 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033452 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 16:28:39.036553 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033455 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 16:28:39.036553 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033457 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 16:28:39.036553 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033460 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 16:28:39.036553 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033463 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 16:28:39.036553 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033467 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 16:28:39.037022 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033469 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 16:28:39.037022 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033472 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 16:28:39.037022 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033475 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 16:28:39.037022 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033477 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 16:28:39.037022 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033479 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 16:28:39.037022 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033482 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 16:28:39.037022 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033485 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 16:28:39.037022 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033487 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 16:28:39.037022 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033489 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 16:28:39.037022 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033493 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 16:28:39.037022 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033495 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 16:28:39.037022 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033498 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 16:28:39.037022 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033500 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 16:28:39.037022 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033503 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 16:28:39.037022 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033505 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 16:28:39.037022 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033509 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 16:28:39.037022 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033513 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 16:28:39.037022 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033515 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 16:28:39.037022 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033518 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 16:28:39.037490 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033521 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 16:28:39.037490 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033524 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 16:28:39.037490 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033526 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 16:28:39.037490 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033529 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 16:28:39.037490 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033532 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 16:28:39.037490 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033534 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 16:28:39.037490 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033536 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 16:28:39.037490 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033539 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 16:28:39.037490 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033542 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 16:28:39.037490 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033544 2555 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 16:28:39.037490 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033547 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 16:28:39.037490 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033549 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 16:28:39.037490 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033551 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 16:28:39.037490 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033554 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 16:28:39.037490 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033556 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 16:28:39.037490 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033559 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 16:28:39.037490 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033561 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 16:28:39.037490 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033563 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 16:28:39.037490 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033566 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 16:28:39.037490 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033568 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 16:28:39.037980 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033570 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 16:28:39.037980 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033572 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 16:28:39.037980 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033575 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 16:28:39.037980 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033577 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 16:28:39.037980 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033579 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 16:28:39.037980 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033582 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 16:28:39.037980 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033584 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 16:28:39.037980 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033586 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 16:28:39.037980 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033589 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 16:28:39.037980 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033591 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 16:28:39.037980 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033594 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 16:28:39.037980 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033596 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 16:28:39.037980 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033599 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 16:28:39.037980 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033601 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 16:28:39.037980 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033604 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 16:28:39.037980 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033606 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 16:28:39.037980 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033608 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 16:28:39.037980 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033610 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 16:28:39.037980 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033613 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 16:28:39.037980 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:39.033615 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 16:28:39.038455 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.033620 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 16:28:39.038455 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.033717 2555 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 16:28:39.038455 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.035670 2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 16:28:39.038455 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.036925 2555 server.go:1019] "Starting client certificate rotation" Jul 06 16:28:39.038455 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.037036 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 16:28:39.038455 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.037067 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 16:28:39.039440 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.039427 2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 16:28:39.041711 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.041698 2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 16:28:39.052041 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.052013 2555 log.go:25] "Validated CRI v1 runtime API" Jul 06 16:28:39.054400 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.054384 2555 log.go:25] "Validated CRI v1 image API" Jul 06 16:28:39.056496 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.055309 2555 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 16:28:39.059591 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.059569 2555 fs.go:135] Filesystem UUIDs: map[34066ccc-6102-4c62-b3a5-b2ce8e8dbb96:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 83f77055-4e78-44a4-a914-91eb56ec3824:/dev/nvme0n1p4] Jul 06 16:28:39.059672 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.059590 2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 16:28:39.065064 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.065045 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 16:28:39.066221 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.066117 2555 manager.go:216] Machine: {Timestamp:2026-07-06 16:28:39.063356574 +0000 UTC m=+0.332427602 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103776 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20fd2571baf2d67f27df14a54e7304 SystemUUID:ec20fd25-71ba-f2d6-7f27-df14a54e7304 BootID:2a67b54f-4963-4d04-a5dc-956e4b5e1423 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3c:e5:db:c0:95 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3c:e5:db:c0:95 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:95:98:87:30:89 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 16:28:39.066221 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.066217 2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 16:28:39.066338 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.066299 2555 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 16:28:39.067333 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.067311 2555 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 16:28:39.067496 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.067335 2555 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-222.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 16:28:39.067977 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.067967 2555 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 16:28:39.068008 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.067980 2555 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 16:28:39.068008 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.067987 2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 16:28:39.068725 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.068714 2555 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 16:28:39.069781 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.069771 2555 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 16:28:39.072349 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.072337 2555 state_mem.go:36] "Initialized new in-memory state store" Jul 06 16:28:39.072461 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.072451 2555 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 16:28:39.072491 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.072481 2555 kubelet.go:486] "Attempting to sync node with API server" Jul 06 16:28:39.072491 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.072490 2555 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 16:28:39.072544 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.072500 2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 16:28:39.072544 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.072510 2555 kubelet.go:398] "Adding apiserver pod source" Jul 06 16:28:39.072544 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.072520 2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 16:28:39.073607 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.073124 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 16:28:39.073607 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.073151 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 16:28:39.075267 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.075251 2555 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 16:28:39.077166 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.077152 2555 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 16:28:39.077223 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.077182 2555 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 16:28:39.078075 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.078065 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 16:28:39.078113 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.078080 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 16:28:39.078113 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.078086 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 16:28:39.078113 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.078091 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 16:28:39.078113 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.078099 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 16:28:39.078113 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.078105 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 16:28:39.078113 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.078112 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 16:28:39.078265 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.078118 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 16:28:39.078265 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.078125 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 16:28:39.078265 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.078130 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 16:28:39.078265 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.078142 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 16:28:39.078265 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.078147 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 16:28:39.079351 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.079340 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 16:28:39.079392 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.079355 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 16:28:39.081724 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.081708 2555 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-222.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 16:28:39.082393 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:39.082373 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 16:28:39.082433 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:39.082373 2555 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-222.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 16:28:39.082624 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.082612 2555 server.go:1268] "Started kubelet" Jul 06 16:28:39.082721 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.082688 2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 16:28:39.082769 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.082719 2555 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 16:28:39.082815 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.082773 2555 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 16:28:39.083503 ip-10-0-140-222 systemd[1]: Started Kubernetes Kubelet. Jul 06 16:28:39.084981 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.084966 2555 server.go:310] "Adding debug handlers to kubelet server" Jul 06 16:28:39.088653 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.088516 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qnbxw" Jul 06 16:28:39.089403 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:39.089382 2555 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 16:28:39.089770 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.089753 2555 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 16:28:39.091351 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:39.090438 2555 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-222.ec2.internal.18bfc036ce38a95c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-222.ec2.internal,UID:ip-10-0-140-222.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-222.ec2.internal,},FirstTimestamp:2026-07-06 16:28:39.082592604 +0000 UTC m=+0.351663632,LastTimestamp:2026-07-06 16:28:39.082592604 +0000 UTC m=+0.351663632,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-222.ec2.internal,}" Jul 06 16:28:39.094152 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.094137 2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 16:28:39.094152 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.094144 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 16:28:39.094270 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.094247 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qnbxw" Jul 06 16:28:39.094270 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:39.094256 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-222.ec2.internal\" not found" Jul 06 16:28:39.094898 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.094795 2555 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 16:28:39.094898 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.094814 2555 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 16:28:39.094898 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.094833 2555 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 16:28:39.095115 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.095000 2555 reconstruct.go:97] "Volume reconstruction finished" Jul 06 16:28:39.095115 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.095011 2555 reconciler.go:29] "Reconciler: start to sync state" Jul 06 16:28:39.095115 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.095094 2555 factory.go:55] Registering systemd factory Jul 06 16:28:39.095115 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.095108 2555 factory.go:223] Registration of the systemd container factory successfully Jul 06 16:28:39.095382 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.095366 2555 factory.go:153] Registering CRI-O factory Jul 06 16:28:39.095382 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.095384 2555 factory.go:223] Registration of the crio container factory successfully Jul 06 16:28:39.095513 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.095487 2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 16:28:39.095513 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.095512 2555 factory.go:103] Registering Raw factory Jul 06 16:28:39.095617 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.095540 2555 manager.go:1196] Started watching for new ooms in manager Jul 06 16:28:39.095914 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.095891 2555 manager.go:349] Starting recovery of all containers Jul 06 16:28:39.105652 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.105486 2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 16:28:39.107006 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.106985 2555 manager.go:354] Recovery completed Jul 06 16:28:39.109130 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:39.108930 2555 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 06 16:28:39.109130 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:39.109071 2555 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-222.ec2.internal\" not found" node="ip-10-0-140-222.ec2.internal" Jul 06 16:28:39.112103 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.112091 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 16:28:39.114007 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.113993 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasSufficientMemory" Jul 06 16:28:39.114092 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.114023 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 16:28:39.114092 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.114037 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasSufficientPID" Jul 06 16:28:39.114627 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.114612 2555 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 16:28:39.114627 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.114625 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 16:28:39.114627 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.114626 2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 16:28:39.114778 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.114647 2555 state_mem.go:36] "Initialized new in-memory state store" Jul 06 16:28:39.115503 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.115490 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasSufficientMemory" Jul 06 16:28:39.115565 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.115521 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 16:28:39.115565 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.115534 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasSufficientPID" Jul 06 16:28:39.115842 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.115830 2555 policy_none.go:49] "None policy: Start" Jul 06 16:28:39.115890 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.115849 2555 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 16:28:39.115890 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.115864 2555 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 16:28:39.116879 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.116868 2555 policy_none.go:47] "Start" Jul 06 16:28:39.151553 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.151536 2555 manager.go:337] "Starting Device Plugin manager" Jul 06 16:28:39.151648 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:39.151580 2555 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 16:28:39.151648 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.151594 2555 server.go:87] "Starting device plugin registration server" Jul 06 16:28:39.151866 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.151851 2555 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 16:28:39.151933 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.151869 2555 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 16:28:39.152025 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.151966 2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 16:28:39.152080 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.152044 2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 16:28:39.152080 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.152054 2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 16:28:39.152593 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:39.152569 2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 16:28:39.152664 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:39.152628 2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-222.ec2.internal\" not found" Jul 06 16:28:39.252269 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.252236 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 16:28:39.253352 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.253329 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasSufficientMemory" Jul 06 16:28:39.253419 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.253371 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 16:28:39.253419 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.253383 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasSufficientPID" Jul 06 16:28:39.253419 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.253409 2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-222.ec2.internal" Jul 06 16:28:39.262143 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.262102 2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-222.ec2.internal" Jul 06 16:28:39.262143 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:39.262126 2555 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-222.ec2.internal\": node \"ip-10-0-140-222.ec2.internal\" not found" Jul 06 16:28:39.278602 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:39.278581 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-222.ec2.internal\" not found" Jul 06 16:28:39.293891 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.293865 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 16:28:39.295250 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.295232 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 16:28:39.295326 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.295267 2555 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 16:28:39.295326 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.295284 2555 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 16:28:39.295326 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:39.295321 2555 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 16:28:39.298531 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.298515 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 16:28:39.378977 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:39.378921 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-222.ec2.internal\" not found" Jul 06 16:28:39.396161 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.396141 2555 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-222.ec2.internal"] Jul 06 16:28:39.396232 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.396207 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 16:28:39.397171 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.397151 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasSufficientMemory" Jul 06 16:28:39.397253 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.397193 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 16:28:39.397253 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.397208 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasSufficientPID" Jul 06 16:28:39.398439 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.398426 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 16:28:39.398565 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.398551 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal" Jul 06 16:28:39.398599 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.398583 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 16:28:39.399172 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.399156 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasSufficientMemory" Jul 06 16:28:39.399228 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.399189 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasSufficientMemory" Jul 06 16:28:39.399228 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.399212 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 16:28:39.399228 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.399225 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasSufficientPID" Jul 06 16:28:39.399310 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.399191 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 16:28:39.399310 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.399276 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasSufficientPID" Jul 06 16:28:39.400354 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.400337 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-222.ec2.internal" Jul 06 16:28:39.400411 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.400368 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 16:28:39.401070 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.401054 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasSufficientMemory" Jul 06 16:28:39.401156 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.401078 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 16:28:39.401156 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.401090 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeHasSufficientPID" Jul 06 16:28:39.415495 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:39.415476 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-222.ec2.internal\" not found" node="ip-10-0-140-222.ec2.internal" Jul 06 16:28:39.419297 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:39.419281 2555 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-222.ec2.internal\" not found" node="ip-10-0-140-222.ec2.internal" Jul 06 16:28:39.479909 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:39.479884 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-222.ec2.internal\" not found" Jul 06 16:28:39.496724 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.496703 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac7241bfad6ac12b2f1f9ed8ec9e3d5d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal\" (UID: \"ac7241bfad6ac12b2f1f9ed8ec9e3d5d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal" Jul 06 16:28:39.496787 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.496728 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac7241bfad6ac12b2f1f9ed8ec9e3d5d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal\" (UID: \"ac7241bfad6ac12b2f1f9ed8ec9e3d5d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal" Jul 06 16:28:39.496787 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.496745 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ff5280726b858514ce49d9d3bdaeb9d2-config\") pod \"kube-apiserver-proxy-ip-10-0-140-222.ec2.internal\" (UID: \"ff5280726b858514ce49d9d3bdaeb9d2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-222.ec2.internal" Jul 06 16:28:39.580346 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:39.580291 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-222.ec2.internal\" not found" Jul 06 16:28:39.597662 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.597637 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac7241bfad6ac12b2f1f9ed8ec9e3d5d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal\" (UID: \"ac7241bfad6ac12b2f1f9ed8ec9e3d5d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal" Jul 06 16:28:39.597720 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.597676 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac7241bfad6ac12b2f1f9ed8ec9e3d5d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal\" (UID: \"ac7241bfad6ac12b2f1f9ed8ec9e3d5d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal" Jul 06 16:28:39.597720 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.597699 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ff5280726b858514ce49d9d3bdaeb9d2-config\") pod \"kube-apiserver-proxy-ip-10-0-140-222.ec2.internal\" (UID: \"ff5280726b858514ce49d9d3bdaeb9d2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-222.ec2.internal" Jul 06 16:28:39.597780 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.597756 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac7241bfad6ac12b2f1f9ed8ec9e3d5d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal\" (UID: \"ac7241bfad6ac12b2f1f9ed8ec9e3d5d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal" Jul 06 16:28:39.597867 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.597851 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac7241bfad6ac12b2f1f9ed8ec9e3d5d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal\" (UID: \"ac7241bfad6ac12b2f1f9ed8ec9e3d5d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal" Jul 06 16:28:39.597916 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.597899 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ff5280726b858514ce49d9d3bdaeb9d2-config\") pod \"kube-apiserver-proxy-ip-10-0-140-222.ec2.internal\" (UID: \"ff5280726b858514ce49d9d3bdaeb9d2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-222.ec2.internal" Jul 06 16:28:39.680804 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:39.680767 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-222.ec2.internal\" not found" Jul 06 16:28:39.718254 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.718225 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal" Jul 06 16:28:39.722394 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:39.722010 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-222.ec2.internal" Jul 06 16:28:39.781577 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:39.781539 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-222.ec2.internal\" not found" Jul 06 16:28:39.882137 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:39.882075 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-222.ec2.internal\" not found" Jul 06 16:28:39.982546 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:39.982525 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-222.ec2.internal\" not found" Jul 06 16:28:40.028257 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.028239 2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 16:28:40.036711 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.036690 2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 16:28:40.036824 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.036807 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 16:28:40.036888 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.036866 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 16:28:40.036924 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.036866 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 16:28:40.074912 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.074885 2555 apiserver.go:52] "Watching apiserver" Jul 06 16:28:40.095033 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.094996 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-222.ec2.internal" Jul 06 16:28:40.095136 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.095048 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 16:28:40.096112 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.096082 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 16:23:39 +0000 UTC" deadline="2028-03-09 23:07:59.21858617 +0000 UTC" Jul 06 16:28:40.096176 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.096113 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14694h39m19.122475719s" Jul 06 16:28:40.096176 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.096097 2555 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 16:28:40.097676 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.097655 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-76qf5","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lp5h","openshift-cluster-node-tuning-operator/tuned-t8slq","openshift-dns/node-resolver-qq68r","openshift-multus/multus-additional-cni-plugins-4h5nh","openshift-network-diagnostics/network-check-target-4d6qk","openshift-network-operator/iptables-alerter-zh92b","openshift-ovn-kubernetes/ovnkube-node-tb5t4","kube-system/global-pull-secret-syncer-k69gf","openshift-image-registry/node-ca-4r7fj","openshift-multus/multus-szz2c","openshift-multus/network-metrics-daemon-rj9l8"] Jul 06 16:28:40.099203 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.099188 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-76qf5" Jul 06 16:28:40.100303 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.100270 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lp5h" Jul 06 16:28:40.101350 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.101331 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.101573 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.101536 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tgwjf\"" Jul 06 16:28:40.101573 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.101561 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 16:28:40.101744 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.101699 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 16:28:40.102215 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.102199 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 16:28:40.102290 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.102216 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9997n\"" Jul 06 16:28:40.102340 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.102295 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 16:28:40.102477 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.102465 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 16:28:40.102583 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.102567 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qq68r" Jul 06 16:28:40.104012 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.103998 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4h5nh" Jul 06 16:28:40.106188 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.106159 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4d6qk" Jul 06 16:28:40.106296 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:40.106244 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4d6qk" podUID="50ecbf14-6a55-4051-87de-7cd8cc5ab2ea" Jul 06 16:28:40.107178 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.107155 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zh92b" Jul 06 16:28:40.107510 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.107486 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9k8c8\"" Jul 06 16:28:40.107596 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.107557 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 16:28:40.107647 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.107558 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 16:28:40.107686 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.107667 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 16:28:40.107759 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.107742 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal" Jul 06 16:28:40.107839 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.107791 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 16:28:40.107898 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.107871 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 16:28:40.108121 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.108092 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 16:28:40.108178 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.108143 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 16:28:40.108222 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.108176 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 16:28:40.108261 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.108221 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6n8bf\"" Jul 06 16:28:40.108308 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.108282 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 16:28:40.108396 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.108363 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 16:28:40.108546 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.108522 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.108656 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.108639 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-p8nsr\"" Jul 06 16:28:40.109220 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.109192 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 16:28:40.110015 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.109963 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 16:28:40.110179 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.110162 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:28:40.110254 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.110215 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 16:28:40.110310 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:40.110275 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k69gf" podUID="bc02cd8b-c9cd-4cd1-ae92-184380a1bec2" Jul 06 16:28:40.110367 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.110339 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vpqtm\"" Jul 06 16:28:40.110419 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.110393 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 16:28:40.110504 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.110488 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 16:28:40.110672 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.110655 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 16:28:40.110976 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.110942 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 16:28:40.111155 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.111125 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 16:28:40.111155 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.111128 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4r7fj" Jul 06 16:28:40.111299 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.111229 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 16:28:40.111299 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.111247 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xsz8p\"" Jul 06 16:28:40.111403 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.111232 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 16:28:40.112647 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.112627 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.113634 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.113616 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-l5vc4\"" Jul 06 16:28:40.113831 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.113813 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-222.ec2.internal"] Jul 06 16:28:40.113873 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.113847 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 16:28:40.113967 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.113933 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 16:28:40.114073 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.113990 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:28:40.114073 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.113999 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 16:28:40.114073 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:40.114051 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rj9l8" podUID="0948aaf4-b68e-4587-9a7c-a71b5fb43dda" Jul 06 16:28:40.114650 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.114634 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 16:28:40.114733 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.114710 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-h6q85\"" Jul 06 16:28:40.118700 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.118685 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 16:28:40.118771 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.118763 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal"] Jul 06 16:28:40.139442 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.139424 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v88rm" Jul 06 16:28:40.148332 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.148315 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v88rm" Jul 06 16:28:40.196786 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.196758 2555 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 16:28:40.200133 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.200108 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-run-ovn\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.200252 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.200141 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/629c3598-7a2a-42ee-9905-6cc9560b6c6d-konnectivity-ca\") pod \"konnectivity-agent-76qf5\" (UID: \"629c3598-7a2a-42ee-9905-6cc9560b6c6d\") " pod="kube-system/konnectivity-agent-76qf5" Jul 06 16:28:40.200252 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.200158 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8215f862-bc22-4edb-a7ef-806a3e056187-etc-tuned\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.200252 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.200173 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkxv8\" (UniqueName: \"kubernetes.io/projected/3ceed420-7d00-4dc3-85fd-0fe2db980e33-kube-api-access-kkxv8\") pod \"node-resolver-qq68r\" (UID: \"3ceed420-7d00-4dc3-85fd-0fe2db980e33\") " pod="openshift-dns/node-resolver-qq68r" Jul 06 16:28:40.200252 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.200195 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r49xg\" (UniqueName: \"kubernetes.io/projected/195c23ea-51e7-41ab-ad83-265bb8bdd209-kube-api-access-r49xg\") pod \"multus-additional-cni-plugins-4h5nh\" (UID: \"195c23ea-51e7-41ab-ad83-265bb8bdd209\") " pod="openshift-multus/multus-additional-cni-plugins-4h5nh" Jul 06 16:28:40.200427 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.200257 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0948aaf4-b68e-4587-9a7c-a71b5fb43dda-metrics-certs\") pod \"network-metrics-daemon-rj9l8\" (UID: \"0948aaf4-b68e-4587-9a7c-a71b5fb43dda\") " pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:28:40.200427 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.200290 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e2070c7e-34d0-42d4-a85a-aea1b7d4e08c-host\") pod \"node-ca-4r7fj\" (UID: \"e2070c7e-34d0-42d4-a85a-aea1b7d4e08c\") " pod="openshift-image-registry/node-ca-4r7fj" Jul 06 16:28:40.200427 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.200308 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-etc-kubernetes\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.200427 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.200356 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/195c23ea-51e7-41ab-ad83-265bb8bdd209-cni-binary-copy\") pod \"multus-additional-cni-plugins-4h5nh\" (UID: \"195c23ea-51e7-41ab-ad83-265bb8bdd209\") " pod="openshift-multus/multus-additional-cni-plugins-4h5nh" Jul 06 16:28:40.200427 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.200375 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/195c23ea-51e7-41ab-ad83-265bb8bdd209-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4h5nh\" (UID: \"195c23ea-51e7-41ab-ad83-265bb8bdd209\") " pod="openshift-multus/multus-additional-cni-plugins-4h5nh" Jul 06 16:28:40.200427 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.200392 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-host-kubelet\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.200640 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.200431 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-run-systemd\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.200640 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.200448 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-var-lib-openvswitch\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.200640 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.200462 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-run-openvswitch\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.200640 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.200479 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-host-run-netns\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.200640 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.200502 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0739ad82-cf16-49a1-acf8-3dd957b76036-multus-daemon-config\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.200640 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.200523 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ceed420-7d00-4dc3-85fd-0fe2db980e33-tmp-dir\") pod \"node-resolver-qq68r\" (UID: \"3ceed420-7d00-4dc3-85fd-0fe2db980e33\") " pod="openshift-dns/node-resolver-qq68r" Jul 06 16:28:40.200640 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.200538 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-node-log\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.200640 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.200568 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc02cd8b-c9cd-4cd1-ae92-184380a1bec2-original-pull-secret\") pod \"global-pull-secret-syncer-k69gf\" (UID: \"bc02cd8b-c9cd-4cd1-ae92-184380a1bec2\") " pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:28:40.200640 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.200616 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8215f862-bc22-4edb-a7ef-806a3e056187-var-lib-kubelet\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.200640 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.200636 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3bfcc78f-a4c5-4f6c-b7fb-5cd6d5c692ad-host-slash\") pod \"iptables-alerter-zh92b\" (UID: \"3bfcc78f-a4c5-4f6c-b7fb-5cd6d5c692ad\") " pod="openshift-network-operator/iptables-alerter-zh92b" Jul 06 16:28:40.201085 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.200676 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1614ec45-555f-46c5-ac8e-89e4f12e1e71-socket-dir\") pod \"aws-ebs-csi-driver-node-5lp5h\" (UID: \"1614ec45-555f-46c5-ac8e-89e4f12e1e71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lp5h" Jul 06 16:28:40.201085 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.200701 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1614ec45-555f-46c5-ac8e-89e4f12e1e71-sys-fs\") pod \"aws-ebs-csi-driver-node-5lp5h\" (UID: \"1614ec45-555f-46c5-ac8e-89e4f12e1e71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lp5h" Jul 06 16:28:40.201085 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.200716 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-systemd-units\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.201085 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.200730 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bc02cd8b-c9cd-4cd1-ae92-184380a1bec2-kubelet-config\") pod \"global-pull-secret-syncer-k69gf\" (UID: \"bc02cd8b-c9cd-4cd1-ae92-184380a1bec2\") " pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:28:40.201085 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.200745 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-host-var-lib-kubelet\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.201085 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.200762 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99mvr\" (UniqueName: \"kubernetes.io/projected/0739ad82-cf16-49a1-acf8-3dd957b76036-kube-api-access-99mvr\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.201085 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.200801 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/195c23ea-51e7-41ab-ad83-265bb8bdd209-system-cni-dir\") pod \"multus-additional-cni-plugins-4h5nh\" (UID: \"195c23ea-51e7-41ab-ad83-265bb8bdd209\") " pod="openshift-multus/multus-additional-cni-plugins-4h5nh" Jul 06 16:28:40.201085 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.200838 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e2070c7e-34d0-42d4-a85a-aea1b7d4e08c-serviceca\") pod \"node-ca-4r7fj\" (UID: \"e2070c7e-34d0-42d4-a85a-aea1b7d4e08c\") " pod="openshift-image-registry/node-ca-4r7fj" Jul 06 16:28:40.201085 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.200883 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8215f862-bc22-4edb-a7ef-806a3e056187-etc-sysconfig\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.201085 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.200908 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8215f862-bc22-4edb-a7ef-806a3e056187-etc-systemd\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.201085 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.200930 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8215f862-bc22-4edb-a7ef-806a3e056187-lib-modules\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.201085 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.200993 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/195c23ea-51e7-41ab-ad83-265bb8bdd209-cnibin\") pod \"multus-additional-cni-plugins-4h5nh\" (UID: \"195c23ea-51e7-41ab-ad83-265bb8bdd209\") " pod="openshift-multus/multus-additional-cni-plugins-4h5nh" Jul 06 16:28:40.201085 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.201014 2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 16:28:40.201085 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.201019 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f22be4f0-05eb-424d-a399-c80d76566eab-ovn-node-metrics-cert\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.201597 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.201137 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8215f862-bc22-4edb-a7ef-806a3e056187-etc-modprobe-d\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.201597 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.201169 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8215f862-bc22-4edb-a7ef-806a3e056187-etc-sysctl-d\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.201597 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.201194 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-log-socket\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.201597 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.201218 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-host-cni-bin\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.201597 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.201244 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f22be4f0-05eb-424d-a399-c80d76566eab-ovnkube-config\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.201597 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.201287 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-multus-cni-dir\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.201597 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.201325 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-cnibin\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.201597 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.201351 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-hostroot\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.201597 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.201377 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-host-run-multus-certs\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.201597 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.201401 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82f9q\" (UniqueName: \"kubernetes.io/projected/8215f862-bc22-4edb-a7ef-806a3e056187-kube-api-access-82f9q\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.201597 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.201426 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3ceed420-7d00-4dc3-85fd-0fe2db980e33-hosts-file\") pod \"node-resolver-qq68r\" (UID: \"3ceed420-7d00-4dc3-85fd-0fe2db980e33\") " pod="openshift-dns/node-resolver-qq68r" Jul 06 16:28:40.201597 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.201452 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxvfl\" (UniqueName: \"kubernetes.io/projected/1614ec45-555f-46c5-ac8e-89e4f12e1e71-kube-api-access-xxvfl\") pod \"aws-ebs-csi-driver-node-5lp5h\" (UID: \"1614ec45-555f-46c5-ac8e-89e4f12e1e71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lp5h" Jul 06 16:28:40.201597 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.201477 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0739ad82-cf16-49a1-acf8-3dd957b76036-cni-binary-copy\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.201597 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.201502 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8215f862-bc22-4edb-a7ef-806a3e056187-etc-sysctl-conf\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.201597 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.201550 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/195c23ea-51e7-41ab-ad83-265bb8bdd209-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4h5nh\" (UID: \"195c23ea-51e7-41ab-ad83-265bb8bdd209\") " pod="openshift-multus/multus-additional-cni-plugins-4h5nh" Jul 06 16:28:40.201597 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.201579 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pkqs\" (UniqueName: \"kubernetes.io/projected/50ecbf14-6a55-4051-87de-7cd8cc5ab2ea-kube-api-access-7pkqs\") pod \"network-check-target-4d6qk\" (UID: \"50ecbf14-6a55-4051-87de-7cd8cc5ab2ea\") " pod="openshift-network-diagnostics/network-check-target-4d6qk" Jul 06 16:28:40.202230 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.201604 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-etc-openvswitch\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.202230 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.201628 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-os-release\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.202230 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.201651 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8215f862-bc22-4edb-a7ef-806a3e056187-etc-kubernetes\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.202230 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.201684 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8215f862-bc22-4edb-a7ef-806a3e056187-run\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.202230 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.201716 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8215f862-bc22-4edb-a7ef-806a3e056187-sys\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.202230 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.201749 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1614ec45-555f-46c5-ac8e-89e4f12e1e71-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5lp5h\" (UID: \"1614ec45-555f-46c5-ac8e-89e4f12e1e71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lp5h" Jul 06 16:28:40.202230 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.201769 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-host-run-ovn-kubernetes\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.202230 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.201809 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-multus-conf-dir\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.202230 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.201851 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/629c3598-7a2a-42ee-9905-6cc9560b6c6d-agent-certs\") pod \"konnectivity-agent-76qf5\" (UID: \"629c3598-7a2a-42ee-9905-6cc9560b6c6d\") " pod="kube-system/konnectivity-agent-76qf5" Jul 06 16:28:40.202230 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.201894 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f22be4f0-05eb-424d-a399-c80d76566eab-ovnkube-script-lib\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.202230 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.201928 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lgj4\" (UniqueName: \"kubernetes.io/projected/e2070c7e-34d0-42d4-a85a-aea1b7d4e08c-kube-api-access-6lgj4\") pod \"node-ca-4r7fj\" (UID: \"e2070c7e-34d0-42d4-a85a-aea1b7d4e08c\") " pod="openshift-image-registry/node-ca-4r7fj" Jul 06 16:28:40.202230 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.201969 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-multus-socket-dir-parent\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.202230 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.201989 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-host-var-lib-cni-multus\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.202230 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.202008 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1614ec45-555f-46c5-ac8e-89e4f12e1e71-etc-selinux\") pod \"aws-ebs-csi-driver-node-5lp5h\" (UID: \"1614ec45-555f-46c5-ac8e-89e4f12e1e71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lp5h" Jul 06 16:28:40.202230 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.202023 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-host-slash\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.202230 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.202037 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-system-cni-dir\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.202230 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.202065 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-host-run-k8s-cni-cncf-io\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.203104 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.202091 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gfr6\" (UniqueName: \"kubernetes.io/projected/0948aaf4-b68e-4587-9a7c-a71b5fb43dda-kube-api-access-5gfr6\") pod \"network-metrics-daemon-rj9l8\" (UID: \"0948aaf4-b68e-4587-9a7c-a71b5fb43dda\") " pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:28:40.203104 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.202121 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1614ec45-555f-46c5-ac8e-89e4f12e1e71-device-dir\") pod \"aws-ebs-csi-driver-node-5lp5h\" (UID: \"1614ec45-555f-46c5-ac8e-89e4f12e1e71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lp5h" Jul 06 16:28:40.203104 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.202141 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-host-run-netns\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.203104 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.202164 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-host-cni-netd\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.203104 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.202198 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.203104 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.202215 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f22be4f0-05eb-424d-a399-c80d76566eab-env-overrides\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.203104 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.202230 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-host-var-lib-cni-bin\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.203104 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.202250 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/195c23ea-51e7-41ab-ad83-265bb8bdd209-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4h5nh\" (UID: \"195c23ea-51e7-41ab-ad83-265bb8bdd209\") " pod="openshift-multus/multus-additional-cni-plugins-4h5nh" Jul 06 16:28:40.203104 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.202288 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdkqk\" (UniqueName: \"kubernetes.io/projected/3bfcc78f-a4c5-4f6c-b7fb-5cd6d5c692ad-kube-api-access-pdkqk\") pod \"iptables-alerter-zh92b\" (UID: \"3bfcc78f-a4c5-4f6c-b7fb-5cd6d5c692ad\") " pod="openshift-network-operator/iptables-alerter-zh92b" Jul 06 16:28:40.203104 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.202320 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpzn9\" (UniqueName: \"kubernetes.io/projected/f22be4f0-05eb-424d-a399-c80d76566eab-kube-api-access-rpzn9\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.203104 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.202347 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bc02cd8b-c9cd-4cd1-ae92-184380a1bec2-dbus\") pod \"global-pull-secret-syncer-k69gf\" (UID: \"bc02cd8b-c9cd-4cd1-ae92-184380a1bec2\") " pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:28:40.203104 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.202371 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8215f862-bc22-4edb-a7ef-806a3e056187-host\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.203104 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.202396 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8215f862-bc22-4edb-a7ef-806a3e056187-tmp\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.203104 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.202420 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/195c23ea-51e7-41ab-ad83-265bb8bdd209-os-release\") pod \"multus-additional-cni-plugins-4h5nh\" (UID: \"195c23ea-51e7-41ab-ad83-265bb8bdd209\") " pod="openshift-multus/multus-additional-cni-plugins-4h5nh" Jul 06 16:28:40.203104 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.202447 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3bfcc78f-a4c5-4f6c-b7fb-5cd6d5c692ad-iptables-alerter-script\") pod \"iptables-alerter-zh92b\" (UID: \"3bfcc78f-a4c5-4f6c-b7fb-5cd6d5c692ad\") " pod="openshift-network-operator/iptables-alerter-zh92b" Jul 06 16:28:40.203104 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.202472 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1614ec45-555f-46c5-ac8e-89e4f12e1e71-registration-dir\") pod \"aws-ebs-csi-driver-node-5lp5h\" (UID: \"1614ec45-555f-46c5-ac8e-89e4f12e1e71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lp5h" Jul 06 16:28:40.303593 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.303567 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/629c3598-7a2a-42ee-9905-6cc9560b6c6d-agent-certs\") pod \"konnectivity-agent-76qf5\" (UID: \"629c3598-7a2a-42ee-9905-6cc9560b6c6d\") " pod="kube-system/konnectivity-agent-76qf5" Jul 06 16:28:40.303775 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.303597 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f22be4f0-05eb-424d-a399-c80d76566eab-ovnkube-script-lib\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.303775 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.303615 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lgj4\" (UniqueName: \"kubernetes.io/projected/e2070c7e-34d0-42d4-a85a-aea1b7d4e08c-kube-api-access-6lgj4\") pod \"node-ca-4r7fj\" (UID: \"e2070c7e-34d0-42d4-a85a-aea1b7d4e08c\") " pod="openshift-image-registry/node-ca-4r7fj" Jul 06 16:28:40.303775 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.303658 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-multus-socket-dir-parent\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.303775 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.303681 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-host-var-lib-cni-multus\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.303775 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.303697 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1614ec45-555f-46c5-ac8e-89e4f12e1e71-etc-selinux\") pod \"aws-ebs-csi-driver-node-5lp5h\" (UID: \"1614ec45-555f-46c5-ac8e-89e4f12e1e71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lp5h" Jul 06 16:28:40.303775 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.303720 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-host-slash\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.303775 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.303744 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-system-cni-dir\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.303775 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.303771 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-host-var-lib-cni-multus\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.304269 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.303793 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-multus-socket-dir-parent\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.304269 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.303818 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-host-run-k8s-cni-cncf-io\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.304269 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.303778 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-host-run-k8s-cni-cncf-io\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.304269 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.303839 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-host-slash\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.304269 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.303831 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1614ec45-555f-46c5-ac8e-89e4f12e1e71-etc-selinux\") pod \"aws-ebs-csi-driver-node-5lp5h\" (UID: \"1614ec45-555f-46c5-ac8e-89e4f12e1e71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lp5h" Jul 06 16:28:40.304269 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.303859 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gfr6\" (UniqueName: \"kubernetes.io/projected/0948aaf4-b68e-4587-9a7c-a71b5fb43dda-kube-api-access-5gfr6\") pod \"network-metrics-daemon-rj9l8\" (UID: \"0948aaf4-b68e-4587-9a7c-a71b5fb43dda\") " pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:28:40.304269 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.303884 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1614ec45-555f-46c5-ac8e-89e4f12e1e71-device-dir\") pod \"aws-ebs-csi-driver-node-5lp5h\" (UID: \"1614ec45-555f-46c5-ac8e-89e4f12e1e71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lp5h" Jul 06 16:28:40.304269 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.303890 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-system-cni-dir\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.304269 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.303909 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-host-run-netns\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.304269 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.303981 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-host-cni-netd\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.304269 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304004 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-host-run-netns\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.304269 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.303985 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1614ec45-555f-46c5-ac8e-89e4f12e1e71-device-dir\") pod \"aws-ebs-csi-driver-node-5lp5h\" (UID: \"1614ec45-555f-46c5-ac8e-89e4f12e1e71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lp5h" Jul 06 16:28:40.304269 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304020 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.304269 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304075 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-host-cni-netd\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.304269 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304079 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f22be4f0-05eb-424d-a399-c80d76566eab-env-overrides\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.304269 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304104 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-host-var-lib-cni-bin\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.304269 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304103 2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 16:28:40.305298 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304132 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.305298 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304134 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/195c23ea-51e7-41ab-ad83-265bb8bdd209-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4h5nh\" (UID: \"195c23ea-51e7-41ab-ad83-265bb8bdd209\") " pod="openshift-multus/multus-additional-cni-plugins-4h5nh" Jul 06 16:28:40.305298 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304175 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-host-var-lib-cni-bin\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.305298 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304208 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdkqk\" (UniqueName: \"kubernetes.io/projected/3bfcc78f-a4c5-4f6c-b7fb-5cd6d5c692ad-kube-api-access-pdkqk\") pod \"iptables-alerter-zh92b\" (UID: \"3bfcc78f-a4c5-4f6c-b7fb-5cd6d5c692ad\") " pod="openshift-network-operator/iptables-alerter-zh92b" Jul 06 16:28:40.305298 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304229 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpzn9\" (UniqueName: \"kubernetes.io/projected/f22be4f0-05eb-424d-a399-c80d76566eab-kube-api-access-rpzn9\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.305298 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304249 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bc02cd8b-c9cd-4cd1-ae92-184380a1bec2-dbus\") pod \"global-pull-secret-syncer-k69gf\" (UID: \"bc02cd8b-c9cd-4cd1-ae92-184380a1bec2\") " pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:28:40.305298 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304269 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8215f862-bc22-4edb-a7ef-806a3e056187-host\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.305298 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304281 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/195c23ea-51e7-41ab-ad83-265bb8bdd209-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4h5nh\" (UID: \"195c23ea-51e7-41ab-ad83-265bb8bdd209\") " pod="openshift-multus/multus-additional-cni-plugins-4h5nh" Jul 06 16:28:40.305298 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304292 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8215f862-bc22-4edb-a7ef-806a3e056187-tmp\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.305298 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304316 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/195c23ea-51e7-41ab-ad83-265bb8bdd209-os-release\") pod \"multus-additional-cni-plugins-4h5nh\" (UID: \"195c23ea-51e7-41ab-ad83-265bb8bdd209\") " pod="openshift-multus/multus-additional-cni-plugins-4h5nh" Jul 06 16:28:40.305298 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304366 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3bfcc78f-a4c5-4f6c-b7fb-5cd6d5c692ad-iptables-alerter-script\") pod \"iptables-alerter-zh92b\" (UID: \"3bfcc78f-a4c5-4f6c-b7fb-5cd6d5c692ad\") " pod="openshift-network-operator/iptables-alerter-zh92b" Jul 06 16:28:40.305298 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304392 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1614ec45-555f-46c5-ac8e-89e4f12e1e71-registration-dir\") pod \"aws-ebs-csi-driver-node-5lp5h\" (UID: \"1614ec45-555f-46c5-ac8e-89e4f12e1e71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lp5h" Jul 06 16:28:40.305298 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304393 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bc02cd8b-c9cd-4cd1-ae92-184380a1bec2-dbus\") pod \"global-pull-secret-syncer-k69gf\" (UID: \"bc02cd8b-c9cd-4cd1-ae92-184380a1bec2\") " pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:28:40.305298 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304429 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-run-ovn\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.305298 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304455 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8215f862-bc22-4edb-a7ef-806a3e056187-host\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.305298 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304458 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/629c3598-7a2a-42ee-9905-6cc9560b6c6d-konnectivity-ca\") pod \"konnectivity-agent-76qf5\" (UID: \"629c3598-7a2a-42ee-9905-6cc9560b6c6d\") " pod="kube-system/konnectivity-agent-76qf5" Jul 06 16:28:40.305298 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304490 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8215f862-bc22-4edb-a7ef-806a3e056187-etc-tuned\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.306158 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304366 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f22be4f0-05eb-424d-a399-c80d76566eab-ovnkube-script-lib\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.306158 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304536 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f22be4f0-05eb-424d-a399-c80d76566eab-env-overrides\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.306158 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304517 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkxv8\" (UniqueName: \"kubernetes.io/projected/3ceed420-7d00-4dc3-85fd-0fe2db980e33-kube-api-access-kkxv8\") pod \"node-resolver-qq68r\" (UID: \"3ceed420-7d00-4dc3-85fd-0fe2db980e33\") " pod="openshift-dns/node-resolver-qq68r" Jul 06 16:28:40.306158 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304453 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1614ec45-555f-46c5-ac8e-89e4f12e1e71-registration-dir\") pod \"aws-ebs-csi-driver-node-5lp5h\" (UID: \"1614ec45-555f-46c5-ac8e-89e4f12e1e71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lp5h" Jul 06 16:28:40.306158 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304584 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-run-ovn\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.306158 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304594 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r49xg\" (UniqueName: \"kubernetes.io/projected/195c23ea-51e7-41ab-ad83-265bb8bdd209-kube-api-access-r49xg\") pod \"multus-additional-cni-plugins-4h5nh\" (UID: \"195c23ea-51e7-41ab-ad83-265bb8bdd209\") " pod="openshift-multus/multus-additional-cni-plugins-4h5nh" Jul 06 16:28:40.306158 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304630 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0948aaf4-b68e-4587-9a7c-a71b5fb43dda-metrics-certs\") pod \"network-metrics-daemon-rj9l8\" (UID: \"0948aaf4-b68e-4587-9a7c-a71b5fb43dda\") " pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:28:40.306158 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304671 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e2070c7e-34d0-42d4-a85a-aea1b7d4e08c-host\") pod \"node-ca-4r7fj\" (UID: \"e2070c7e-34d0-42d4-a85a-aea1b7d4e08c\") " pod="openshift-image-registry/node-ca-4r7fj" Jul 06 16:28:40.306158 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304694 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-etc-kubernetes\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.306158 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304720 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/195c23ea-51e7-41ab-ad83-265bb8bdd209-cni-binary-copy\") pod \"multus-additional-cni-plugins-4h5nh\" (UID: \"195c23ea-51e7-41ab-ad83-265bb8bdd209\") " pod="openshift-multus/multus-additional-cni-plugins-4h5nh" Jul 06 16:28:40.306158 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304744 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/195c23ea-51e7-41ab-ad83-265bb8bdd209-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4h5nh\" (UID: \"195c23ea-51e7-41ab-ad83-265bb8bdd209\") " pod="openshift-multus/multus-additional-cni-plugins-4h5nh" Jul 06 16:28:40.306158 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304771 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-host-kubelet\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.306158 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304788 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e2070c7e-34d0-42d4-a85a-aea1b7d4e08c-host\") pod \"node-ca-4r7fj\" (UID: \"e2070c7e-34d0-42d4-a85a-aea1b7d4e08c\") " pod="openshift-image-registry/node-ca-4r7fj" Jul 06 16:28:40.306158 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304798 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-run-systemd\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.306158 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304825 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-etc-kubernetes\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.306158 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304831 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-var-lib-openvswitch\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.306158 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304840 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-run-systemd\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.307079 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304870 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-run-openvswitch\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.307079 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304918 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-run-openvswitch\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.307079 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:40.304938 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 16:28:40.307079 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.304967 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-host-kubelet\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.307079 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:40.305029 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0948aaf4-b68e-4587-9a7c-a71b5fb43dda-metrics-certs podName:0948aaf4-b68e-4587-9a7c-a71b5fb43dda nodeName:}" failed. No retries permitted until 2026-07-06 16:28:40.804990377 +0000 UTC m=+2.074061394 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0948aaf4-b68e-4587-9a7c-a71b5fb43dda-metrics-certs") pod "network-metrics-daemon-rj9l8" (UID: "0948aaf4-b68e-4587-9a7c-a71b5fb43dda") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 16:28:40.307079 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305054 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-host-run-netns\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.307079 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305071 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/629c3598-7a2a-42ee-9905-6cc9560b6c6d-konnectivity-ca\") pod \"konnectivity-agent-76qf5\" (UID: \"629c3598-7a2a-42ee-9905-6cc9560b6c6d\") " pod="kube-system/konnectivity-agent-76qf5" Jul 06 16:28:40.307079 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305085 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0739ad82-cf16-49a1-acf8-3dd957b76036-multus-daemon-config\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.307079 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305116 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ceed420-7d00-4dc3-85fd-0fe2db980e33-tmp-dir\") pod \"node-resolver-qq68r\" (UID: \"3ceed420-7d00-4dc3-85fd-0fe2db980e33\") " pod="openshift-dns/node-resolver-qq68r" Jul 06 16:28:40.307079 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305143 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-node-log\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.307079 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305185 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc02cd8b-c9cd-4cd1-ae92-184380a1bec2-original-pull-secret\") pod \"global-pull-secret-syncer-k69gf\" (UID: \"bc02cd8b-c9cd-4cd1-ae92-184380a1bec2\") " pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:28:40.307079 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305222 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8215f862-bc22-4edb-a7ef-806a3e056187-var-lib-kubelet\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.307079 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305250 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3bfcc78f-a4c5-4f6c-b7fb-5cd6d5c692ad-host-slash\") pod \"iptables-alerter-zh92b\" (UID: \"3bfcc78f-a4c5-4f6c-b7fb-5cd6d5c692ad\") " pod="openshift-network-operator/iptables-alerter-zh92b" Jul 06 16:28:40.307079 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305278 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1614ec45-555f-46c5-ac8e-89e4f12e1e71-socket-dir\") pod \"aws-ebs-csi-driver-node-5lp5h\" (UID: \"1614ec45-555f-46c5-ac8e-89e4f12e1e71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lp5h" Jul 06 16:28:40.307079 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305313 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1614ec45-555f-46c5-ac8e-89e4f12e1e71-sys-fs\") pod \"aws-ebs-csi-driver-node-5lp5h\" (UID: \"1614ec45-555f-46c5-ac8e-89e4f12e1e71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lp5h" Jul 06 16:28:40.307079 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305337 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-systemd-units\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.307079 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305401 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bc02cd8b-c9cd-4cd1-ae92-184380a1bec2-kubelet-config\") pod \"global-pull-secret-syncer-k69gf\" (UID: \"bc02cd8b-c9cd-4cd1-ae92-184380a1bec2\") " pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:28:40.307755 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305429 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-host-var-lib-kubelet\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.307755 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305455 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99mvr\" (UniqueName: \"kubernetes.io/projected/0739ad82-cf16-49a1-acf8-3dd957b76036-kube-api-access-99mvr\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.307755 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305485 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/195c23ea-51e7-41ab-ad83-265bb8bdd209-system-cni-dir\") pod \"multus-additional-cni-plugins-4h5nh\" (UID: \"195c23ea-51e7-41ab-ad83-265bb8bdd209\") " pod="openshift-multus/multus-additional-cni-plugins-4h5nh" Jul 06 16:28:40.307755 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305499 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/195c23ea-51e7-41ab-ad83-265bb8bdd209-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4h5nh\" (UID: \"195c23ea-51e7-41ab-ad83-265bb8bdd209\") " pod="openshift-multus/multus-additional-cni-plugins-4h5nh" Jul 06 16:28:40.307755 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305510 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e2070c7e-34d0-42d4-a85a-aea1b7d4e08c-serviceca\") pod \"node-ca-4r7fj\" (UID: \"e2070c7e-34d0-42d4-a85a-aea1b7d4e08c\") " pod="openshift-image-registry/node-ca-4r7fj" Jul 06 16:28:40.307755 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305546 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8215f862-bc22-4edb-a7ef-806a3e056187-etc-sysconfig\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.307755 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305590 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8215f862-bc22-4edb-a7ef-806a3e056187-etc-systemd\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.307755 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305616 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8215f862-bc22-4edb-a7ef-806a3e056187-lib-modules\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.307755 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305641 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/195c23ea-51e7-41ab-ad83-265bb8bdd209-cnibin\") pod \"multus-additional-cni-plugins-4h5nh\" (UID: \"195c23ea-51e7-41ab-ad83-265bb8bdd209\") " pod="openshift-multus/multus-additional-cni-plugins-4h5nh" Jul 06 16:28:40.307755 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305662 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/195c23ea-51e7-41ab-ad83-265bb8bdd209-cni-binary-copy\") pod \"multus-additional-cni-plugins-4h5nh\" (UID: \"195c23ea-51e7-41ab-ad83-265bb8bdd209\") " pod="openshift-multus/multus-additional-cni-plugins-4h5nh" Jul 06 16:28:40.307755 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305667 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f22be4f0-05eb-424d-a399-c80d76566eab-ovn-node-metrics-cert\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.307755 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305721 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8215f862-bc22-4edb-a7ef-806a3e056187-etc-modprobe-d\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.307755 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305753 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8215f862-bc22-4edb-a7ef-806a3e056187-etc-sysctl-d\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.307755 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305764 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0739ad82-cf16-49a1-acf8-3dd957b76036-multus-daemon-config\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.307755 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305781 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-log-socket\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.307755 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305825 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-host-run-netns\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.307755 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305878 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8215f862-bc22-4edb-a7ef-806a3e056187-etc-sysctl-d\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.308397 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305895 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8215f862-bc22-4edb-a7ef-806a3e056187-etc-modprobe-d\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.308397 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305916 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e2070c7e-34d0-42d4-a85a-aea1b7d4e08c-serviceca\") pod \"node-ca-4r7fj\" (UID: \"e2070c7e-34d0-42d4-a85a-aea1b7d4e08c\") " pod="openshift-image-registry/node-ca-4r7fj" Jul 06 16:28:40.308397 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305933 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-log-socket\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.308397 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305937 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-host-cni-bin\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.308397 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305966 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f22be4f0-05eb-424d-a399-c80d76566eab-ovnkube-config\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.308397 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.305990 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-multus-cni-dir\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.308397 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306074 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-multus-cni-dir\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.308397 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306104 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8215f862-bc22-4edb-a7ef-806a3e056187-etc-systemd\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.308397 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306116 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-var-lib-openvswitch\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.308397 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306138 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8215f862-bc22-4edb-a7ef-806a3e056187-lib-modules\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.308397 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306162 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-host-cni-bin\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.308397 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306166 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8215f862-bc22-4edb-a7ef-806a3e056187-etc-sysconfig\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.308397 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306203 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/195c23ea-51e7-41ab-ad83-265bb8bdd209-cnibin\") pod \"multus-additional-cni-plugins-4h5nh\" (UID: \"195c23ea-51e7-41ab-ad83-265bb8bdd209\") " pod="openshift-multus/multus-additional-cni-plugins-4h5nh" Jul 06 16:28:40.308397 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306214 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1614ec45-555f-46c5-ac8e-89e4f12e1e71-sys-fs\") pod \"aws-ebs-csi-driver-node-5lp5h\" (UID: \"1614ec45-555f-46c5-ac8e-89e4f12e1e71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lp5h" Jul 06 16:28:40.308397 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306227 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-host-var-lib-kubelet\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.308397 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306253 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ceed420-7d00-4dc3-85fd-0fe2db980e33-tmp-dir\") pod \"node-resolver-qq68r\" (UID: \"3ceed420-7d00-4dc3-85fd-0fe2db980e33\") " pod="openshift-dns/node-resolver-qq68r" Jul 06 16:28:40.308397 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306262 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-node-log\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.308397 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306284 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bc02cd8b-c9cd-4cd1-ae92-184380a1bec2-kubelet-config\") pod \"global-pull-secret-syncer-k69gf\" (UID: \"bc02cd8b-c9cd-4cd1-ae92-184380a1bec2\") " pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:28:40.309216 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306257 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-systemd-units\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.309216 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306310 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3bfcc78f-a4c5-4f6c-b7fb-5cd6d5c692ad-host-slash\") pod \"iptables-alerter-zh92b\" (UID: \"3bfcc78f-a4c5-4f6c-b7fb-5cd6d5c692ad\") " pod="openshift-network-operator/iptables-alerter-zh92b" Jul 06 16:28:40.309216 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306307 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8215f862-bc22-4edb-a7ef-806a3e056187-var-lib-kubelet\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.309216 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:40.306376 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 16:28:40.309216 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:40.306442 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc02cd8b-c9cd-4cd1-ae92-184380a1bec2-original-pull-secret podName:bc02cd8b-c9cd-4cd1-ae92-184380a1bec2 nodeName:}" failed. No retries permitted until 2026-07-06 16:28:40.806424133 +0000 UTC m=+2.075495168 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bc02cd8b-c9cd-4cd1-ae92-184380a1bec2-original-pull-secret") pod "global-pull-secret-syncer-k69gf" (UID: "bc02cd8b-c9cd-4cd1-ae92-184380a1bec2") : object "kube-system"/"original-pull-secret" not registered Jul 06 16:28:40.309216 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306433 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-cnibin\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.309216 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306466 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/195c23ea-51e7-41ab-ad83-265bb8bdd209-os-release\") pod \"multus-additional-cni-plugins-4h5nh\" (UID: \"195c23ea-51e7-41ab-ad83-265bb8bdd209\") " pod="openshift-multus/multus-additional-cni-plugins-4h5nh" Jul 06 16:28:40.309216 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306481 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/195c23ea-51e7-41ab-ad83-265bb8bdd209-system-cni-dir\") pod \"multus-additional-cni-plugins-4h5nh\" (UID: \"195c23ea-51e7-41ab-ad83-265bb8bdd209\") " pod="openshift-multus/multus-additional-cni-plugins-4h5nh" Jul 06 16:28:40.309216 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306488 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-hostroot\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.309216 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306441 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1614ec45-555f-46c5-ac8e-89e4f12e1e71-socket-dir\") pod \"aws-ebs-csi-driver-node-5lp5h\" (UID: \"1614ec45-555f-46c5-ac8e-89e4f12e1e71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lp5h" Jul 06 16:28:40.309216 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306494 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-cnibin\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.309216 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306524 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-host-run-multus-certs\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.309216 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306553 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82f9q\" (UniqueName: \"kubernetes.io/projected/8215f862-bc22-4edb-a7ef-806a3e056187-kube-api-access-82f9q\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.309216 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306577 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-host-run-multus-certs\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.309216 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306526 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-hostroot\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.309216 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306608 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3ceed420-7d00-4dc3-85fd-0fe2db980e33-hosts-file\") pod \"node-resolver-qq68r\" (UID: \"3ceed420-7d00-4dc3-85fd-0fe2db980e33\") " pod="openshift-dns/node-resolver-qq68r" Jul 06 16:28:40.309216 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306634 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxvfl\" (UniqueName: \"kubernetes.io/projected/1614ec45-555f-46c5-ac8e-89e4f12e1e71-kube-api-access-xxvfl\") pod \"aws-ebs-csi-driver-node-5lp5h\" (UID: \"1614ec45-555f-46c5-ac8e-89e4f12e1e71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lp5h" Jul 06 16:28:40.309725 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306663 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0739ad82-cf16-49a1-acf8-3dd957b76036-cni-binary-copy\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.309725 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306689 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8215f862-bc22-4edb-a7ef-806a3e056187-etc-sysctl-conf\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.309725 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306716 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/195c23ea-51e7-41ab-ad83-265bb8bdd209-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4h5nh\" (UID: \"195c23ea-51e7-41ab-ad83-265bb8bdd209\") " pod="openshift-multus/multus-additional-cni-plugins-4h5nh" Jul 06 16:28:40.309725 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306747 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pkqs\" (UniqueName: \"kubernetes.io/projected/50ecbf14-6a55-4051-87de-7cd8cc5ab2ea-kube-api-access-7pkqs\") pod \"network-check-target-4d6qk\" (UID: \"50ecbf14-6a55-4051-87de-7cd8cc5ab2ea\") " pod="openshift-network-diagnostics/network-check-target-4d6qk" Jul 06 16:28:40.309725 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306777 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-etc-openvswitch\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.309725 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306798 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-os-release\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.309725 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306821 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8215f862-bc22-4edb-a7ef-806a3e056187-etc-kubernetes\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.309725 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306847 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8215f862-bc22-4edb-a7ef-806a3e056187-run\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.309725 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306872 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8215f862-bc22-4edb-a7ef-806a3e056187-sys\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.309725 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306858 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8215f862-bc22-4edb-a7ef-806a3e056187-etc-sysctl-conf\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.309725 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306895 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1614ec45-555f-46c5-ac8e-89e4f12e1e71-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5lp5h\" (UID: \"1614ec45-555f-46c5-ac8e-89e4f12e1e71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lp5h" Jul 06 16:28:40.309725 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306921 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-host-run-ovn-kubernetes\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.309725 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306949 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-multus-conf-dir\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.309725 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306919 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3bfcc78f-a4c5-4f6c-b7fb-5cd6d5c692ad-iptables-alerter-script\") pod \"iptables-alerter-zh92b\" (UID: \"3bfcc78f-a4c5-4f6c-b7fb-5cd6d5c692ad\") " pod="openshift-network-operator/iptables-alerter-zh92b" Jul 06 16:28:40.309725 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306966 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8215f862-bc22-4edb-a7ef-806a3e056187-run\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.309725 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306947 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8215f862-bc22-4edb-a7ef-806a3e056187-etc-kubernetes\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.309725 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.306726 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f22be4f0-05eb-424d-a399-c80d76566eab-ovnkube-config\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.310319 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.307062 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8215f862-bc22-4edb-a7ef-806a3e056187-sys\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.310319 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.307081 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-os-release\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.310319 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.307087 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3ceed420-7d00-4dc3-85fd-0fe2db980e33-hosts-file\") pod \"node-resolver-qq68r\" (UID: \"3ceed420-7d00-4dc3-85fd-0fe2db980e33\") " pod="openshift-dns/node-resolver-qq68r" Jul 06 16:28:40.310319 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.307105 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1614ec45-555f-46c5-ac8e-89e4f12e1e71-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5lp5h\" (UID: \"1614ec45-555f-46c5-ac8e-89e4f12e1e71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lp5h" Jul 06 16:28:40.310319 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.307119 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-etc-openvswitch\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.310319 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.307191 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f22be4f0-05eb-424d-a399-c80d76566eab-host-run-ovn-kubernetes\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.310319 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.307231 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0739ad82-cf16-49a1-acf8-3dd957b76036-multus-conf-dir\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.310319 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.307256 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0739ad82-cf16-49a1-acf8-3dd957b76036-cni-binary-copy\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.310319 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.307582 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/195c23ea-51e7-41ab-ad83-265bb8bdd209-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4h5nh\" (UID: \"195c23ea-51e7-41ab-ad83-265bb8bdd209\") " pod="openshift-multus/multus-additional-cni-plugins-4h5nh" Jul 06 16:28:40.310319 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.307941 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8215f862-bc22-4edb-a7ef-806a3e056187-etc-tuned\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.310319 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.308828 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8215f862-bc22-4edb-a7ef-806a3e056187-tmp\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.310319 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.308901 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/629c3598-7a2a-42ee-9905-6cc9560b6c6d-agent-certs\") pod \"konnectivity-agent-76qf5\" (UID: \"629c3598-7a2a-42ee-9905-6cc9560b6c6d\") " pod="kube-system/konnectivity-agent-76qf5" Jul 06 16:28:40.310319 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.309176 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f22be4f0-05eb-424d-a399-c80d76566eab-ovn-node-metrics-cert\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.313258 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.313239 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkxv8\" (UniqueName: \"kubernetes.io/projected/3ceed420-7d00-4dc3-85fd-0fe2db980e33-kube-api-access-kkxv8\") pod \"node-resolver-qq68r\" (UID: \"3ceed420-7d00-4dc3-85fd-0fe2db980e33\") " pod="openshift-dns/node-resolver-qq68r" Jul 06 16:28:40.313351 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.313314 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r49xg\" (UniqueName: \"kubernetes.io/projected/195c23ea-51e7-41ab-ad83-265bb8bdd209-kube-api-access-r49xg\") pod \"multus-additional-cni-plugins-4h5nh\" (UID: \"195c23ea-51e7-41ab-ad83-265bb8bdd209\") " pod="openshift-multus/multus-additional-cni-plugins-4h5nh" Jul 06 16:28:40.314528 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:40.314416 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 16:28:40.314528 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:40.314445 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 16:28:40.314528 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:40.314475 2555 projected.go:196] Error preparing data for projected volume kube-api-access-7pkqs for pod openshift-network-diagnostics/network-check-target-4d6qk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 16:28:40.314528 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:40.314533 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50ecbf14-6a55-4051-87de-7cd8cc5ab2ea-kube-api-access-7pkqs podName:50ecbf14-6a55-4051-87de-7cd8cc5ab2ea nodeName:}" failed. No retries permitted until 2026-07-06 16:28:40.814513609 +0000 UTC m=+2.083584631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7pkqs" (UniqueName: "kubernetes.io/projected/50ecbf14-6a55-4051-87de-7cd8cc5ab2ea-kube-api-access-7pkqs") pod "network-check-target-4d6qk" (UID: "50ecbf14-6a55-4051-87de-7cd8cc5ab2ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 16:28:40.321167 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.317427 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gfr6\" (UniqueName: \"kubernetes.io/projected/0948aaf4-b68e-4587-9a7c-a71b5fb43dda-kube-api-access-5gfr6\") pod \"network-metrics-daemon-rj9l8\" (UID: \"0948aaf4-b68e-4587-9a7c-a71b5fb43dda\") " pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:28:40.321167 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.317488 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lgj4\" (UniqueName: \"kubernetes.io/projected/e2070c7e-34d0-42d4-a85a-aea1b7d4e08c-kube-api-access-6lgj4\") pod \"node-ca-4r7fj\" (UID: \"e2070c7e-34d0-42d4-a85a-aea1b7d4e08c\") " pod="openshift-image-registry/node-ca-4r7fj" Jul 06 16:28:40.321167 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.317742 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82f9q\" (UniqueName: \"kubernetes.io/projected/8215f862-bc22-4edb-a7ef-806a3e056187-kube-api-access-82f9q\") pod \"tuned-t8slq\" (UID: \"8215f862-bc22-4edb-a7ef-806a3e056187\") " pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.321167 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.317765 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdkqk\" (UniqueName: \"kubernetes.io/projected/3bfcc78f-a4c5-4f6c-b7fb-5cd6d5c692ad-kube-api-access-pdkqk\") pod \"iptables-alerter-zh92b\" (UID: \"3bfcc78f-a4c5-4f6c-b7fb-5cd6d5c692ad\") " pod="openshift-network-operator/iptables-alerter-zh92b" Jul 06 16:28:40.321167 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.319538 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxvfl\" (UniqueName: \"kubernetes.io/projected/1614ec45-555f-46c5-ac8e-89e4f12e1e71-kube-api-access-xxvfl\") pod \"aws-ebs-csi-driver-node-5lp5h\" (UID: \"1614ec45-555f-46c5-ac8e-89e4f12e1e71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lp5h" Jul 06 16:28:40.322035 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.322016 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99mvr\" (UniqueName: \"kubernetes.io/projected/0739ad82-cf16-49a1-acf8-3dd957b76036-kube-api-access-99mvr\") pod \"multus-szz2c\" (UID: \"0739ad82-cf16-49a1-acf8-3dd957b76036\") " pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.322844 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.322825 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpzn9\" (UniqueName: \"kubernetes.io/projected/f22be4f0-05eb-424d-a399-c80d76566eab-kube-api-access-rpzn9\") pod \"ovnkube-node-tb5t4\" (UID: \"f22be4f0-05eb-424d-a399-c80d76566eab\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.355535 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:40.355498 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac7241bfad6ac12b2f1f9ed8ec9e3d5d.slice/crio-34cfdaac064bee75273cabe8cdb7097c9be1bb7ce31f880769f76e9511d93be4 WatchSource:0}: Error finding container 34cfdaac064bee75273cabe8cdb7097c9be1bb7ce31f880769f76e9511d93be4: Status 404 returned error can't find the container with id 34cfdaac064bee75273cabe8cdb7097c9be1bb7ce31f880769f76e9511d93be4 Jul 06 16:28:40.355733 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:40.355714 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff5280726b858514ce49d9d3bdaeb9d2.slice/crio-89dbcab398f09babe82d6f771555ee004a68b76905cc3e200985f67e0aa937b0 WatchSource:0}: Error finding container 89dbcab398f09babe82d6f771555ee004a68b76905cc3e200985f67e0aa937b0: Status 404 returned error can't find the container with id 89dbcab398f09babe82d6f771555ee004a68b76905cc3e200985f67e0aa937b0 Jul 06 16:28:40.361329 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.361311 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 16:28:40.432165 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.432081 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-76qf5" Jul 06 16:28:40.440906 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:40.440882 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod629c3598_7a2a_42ee_9905_6cc9560b6c6d.slice/crio-0143de134c875fd20da375b250edc11d950adfb0e47002a0006d33368b1313cc WatchSource:0}: Error finding container 0143de134c875fd20da375b250edc11d950adfb0e47002a0006d33368b1313cc: Status 404 returned error can't find the container with id 0143de134c875fd20da375b250edc11d950adfb0e47002a0006d33368b1313cc Jul 06 16:28:40.451438 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.451420 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lp5h" Jul 06 16:28:40.458837 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:40.458813 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1614ec45_555f_46c5_ac8e_89e4f12e1e71.slice/crio-ee6aeb541c1d0b769a8485888dfc759e8b9549436b42316f5ef28069e150431b WatchSource:0}: Error finding container ee6aeb541c1d0b769a8485888dfc759e8b9549436b42316f5ef28069e150431b: Status 404 returned error can't find the container with id ee6aeb541c1d0b769a8485888dfc759e8b9549436b42316f5ef28069e150431b Jul 06 16:28:40.466133 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.466116 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t8slq" Jul 06 16:28:40.474058 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:40.474025 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8215f862_bc22_4edb_a7ef_806a3e056187.slice/crio-29d2e47eb5d3149815ab97c076bfb40489f6889d87d1e72ed7715147e5d60106 WatchSource:0}: Error finding container 29d2e47eb5d3149815ab97c076bfb40489f6889d87d1e72ed7715147e5d60106: Status 404 returned error can't find the container with id 29d2e47eb5d3149815ab97c076bfb40489f6889d87d1e72ed7715147e5d60106 Jul 06 16:28:40.485110 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.485083 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qq68r" Jul 06 16:28:40.491974 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:40.491943 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ceed420_7d00_4dc3_85fd_0fe2db980e33.slice/crio-efa3e657f3b91f211ebbdcdc9db8f82b15a129726385c3a86a7daacc2a22b43e WatchSource:0}: Error finding container efa3e657f3b91f211ebbdcdc9db8f82b15a129726385c3a86a7daacc2a22b43e: Status 404 returned error can't find the container with id efa3e657f3b91f211ebbdcdc9db8f82b15a129726385c3a86a7daacc2a22b43e Jul 06 16:28:40.506537 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.506516 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4h5nh" Jul 06 16:28:40.513450 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:40.513428 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod195c23ea_51e7_41ab_ad83_265bb8bdd209.slice/crio-17b9acd2738b14e0d0400e9f06c14d42303a87e6e7a45948acc7c1f47e76987a WatchSource:0}: Error finding container 17b9acd2738b14e0d0400e9f06c14d42303a87e6e7a45948acc7c1f47e76987a: Status 404 returned error can't find the container with id 17b9acd2738b14e0d0400e9f06c14d42303a87e6e7a45948acc7c1f47e76987a Jul 06 16:28:40.523082 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.523065 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zh92b" Jul 06 16:28:40.529683 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:40.529660 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bfcc78f_a4c5_4f6c_b7fb_5cd6d5c692ad.slice/crio-64a4b85ce32c2ae68d82f030f5cfe6ae365780084d7c2063e0fc3ffa3c115d17 WatchSource:0}: Error finding container 64a4b85ce32c2ae68d82f030f5cfe6ae365780084d7c2063e0fc3ffa3c115d17: Status 404 returned error can't find the container with id 64a4b85ce32c2ae68d82f030f5cfe6ae365780084d7c2063e0fc3ffa3c115d17 Jul 06 16:28:40.535319 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.535303 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:28:40.542342 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:40.542323 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf22be4f0_05eb_424d_a399_c80d76566eab.slice/crio-111fa0b7bdf21511422230774a6f5ade6edd3dc8b82137ab674cd3a5b8bad86d WatchSource:0}: Error finding container 111fa0b7bdf21511422230774a6f5ade6edd3dc8b82137ab674cd3a5b8bad86d: Status 404 returned error can't find the container with id 111fa0b7bdf21511422230774a6f5ade6edd3dc8b82137ab674cd3a5b8bad86d Jul 06 16:28:40.554654 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.554632 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4r7fj" Jul 06 16:28:40.560161 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.560144 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-szz2c" Jul 06 16:28:40.562681 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:40.562659 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2070c7e_34d0_42d4_a85a_aea1b7d4e08c.slice/crio-23ccaba17d7faf12bf5446be9240b85b5b01612b763de24ce144e60848b8ef0f WatchSource:0}: Error finding container 23ccaba17d7faf12bf5446be9240b85b5b01612b763de24ce144e60848b8ef0f: Status 404 returned error can't find the container with id 23ccaba17d7faf12bf5446be9240b85b5b01612b763de24ce144e60848b8ef0f Jul 06 16:28:40.568105 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:28:40.568087 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0739ad82_cf16_49a1_acf8_3dd957b76036.slice/crio-7278c32e436121a4baf7b154d4ac473c276559627f65f3bf1933c2f18ac5311e WatchSource:0}: Error finding container 7278c32e436121a4baf7b154d4ac473c276559627f65f3bf1933c2f18ac5311e: Status 404 returned error can't find the container with id 7278c32e436121a4baf7b154d4ac473c276559627f65f3bf1933c2f18ac5311e Jul 06 16:28:40.809929 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.809845 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0948aaf4-b68e-4587-9a7c-a71b5fb43dda-metrics-certs\") pod \"network-metrics-daemon-rj9l8\" (UID: \"0948aaf4-b68e-4587-9a7c-a71b5fb43dda\") " pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:28:40.809929 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.809886 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc02cd8b-c9cd-4cd1-ae92-184380a1bec2-original-pull-secret\") pod \"global-pull-secret-syncer-k69gf\" (UID: \"bc02cd8b-c9cd-4cd1-ae92-184380a1bec2\") " pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:28:40.810123 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:40.809997 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 16:28:40.810123 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:40.810002 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 16:28:40.810123 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:40.810054 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc02cd8b-c9cd-4cd1-ae92-184380a1bec2-original-pull-secret podName:bc02cd8b-c9cd-4cd1-ae92-184380a1bec2 nodeName:}" failed. No retries permitted until 2026-07-06 16:28:41.810041307 +0000 UTC m=+3.079112325 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bc02cd8b-c9cd-4cd1-ae92-184380a1bec2-original-pull-secret") pod "global-pull-secret-syncer-k69gf" (UID: "bc02cd8b-c9cd-4cd1-ae92-184380a1bec2") : object "kube-system"/"original-pull-secret" not registered Jul 06 16:28:40.810123 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:40.810078 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0948aaf4-b68e-4587-9a7c-a71b5fb43dda-metrics-certs podName:0948aaf4-b68e-4587-9a7c-a71b5fb43dda nodeName:}" failed. No retries permitted until 2026-07-06 16:28:41.810062908 +0000 UTC m=+3.079133924 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0948aaf4-b68e-4587-9a7c-a71b5fb43dda-metrics-certs") pod "network-metrics-daemon-rj9l8" (UID: "0948aaf4-b68e-4587-9a7c-a71b5fb43dda") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 16:28:40.896045 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.896007 2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 16:28:40.911002 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:40.910951 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pkqs\" (UniqueName: \"kubernetes.io/projected/50ecbf14-6a55-4051-87de-7cd8cc5ab2ea-kube-api-access-7pkqs\") pod \"network-check-target-4d6qk\" (UID: \"50ecbf14-6a55-4051-87de-7cd8cc5ab2ea\") " pod="openshift-network-diagnostics/network-check-target-4d6qk" Jul 06 16:28:40.911211 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:40.911191 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 16:28:40.911281 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:40.911220 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 16:28:40.911281 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:40.911235 2555 projected.go:196] Error preparing data for projected volume kube-api-access-7pkqs for pod openshift-network-diagnostics/network-check-target-4d6qk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 16:28:40.911390 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:40.911301 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50ecbf14-6a55-4051-87de-7cd8cc5ab2ea-kube-api-access-7pkqs podName:50ecbf14-6a55-4051-87de-7cd8cc5ab2ea nodeName:}" failed. No retries permitted until 2026-07-06 16:28:41.911281514 +0000 UTC m=+3.180352533 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7pkqs" (UniqueName: "kubernetes.io/projected/50ecbf14-6a55-4051-87de-7cd8cc5ab2ea-kube-api-access-7pkqs") pod "network-check-target-4d6qk" (UID: "50ecbf14-6a55-4051-87de-7cd8cc5ab2ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 16:28:41.150605 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:41.150496 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 16:23:40 +0000 UTC" deadline="2028-04-13 10:28:21.904764634 +0000 UTC" Jul 06 16:28:41.150605 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:41.150557 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15521h59m40.754210747s" Jul 06 16:28:41.292915 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:41.292882 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 16:28:41.298609 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:41.298579 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4d6qk" Jul 06 16:28:41.298769 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:41.298747 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4d6qk" podUID="50ecbf14-6a55-4051-87de-7cd8cc5ab2ea" Jul 06 16:28:41.299498 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:41.299207 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:28:41.299498 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:41.299307 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k69gf" podUID="bc02cd8b-c9cd-4cd1-ae92-184380a1bec2" Jul 06 16:28:41.312558 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:41.312507 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" event={"ID":"f22be4f0-05eb-424d-a399-c80d76566eab","Type":"ContainerStarted","Data":"111fa0b7bdf21511422230774a6f5ade6edd3dc8b82137ab674cd3a5b8bad86d"} Jul 06 16:28:41.322710 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:41.322624 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t8slq" event={"ID":"8215f862-bc22-4edb-a7ef-806a3e056187","Type":"ContainerStarted","Data":"29d2e47eb5d3149815ab97c076bfb40489f6889d87d1e72ed7715147e5d60106"} Jul 06 16:28:41.340942 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:41.340868 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lp5h" event={"ID":"1614ec45-555f-46c5-ac8e-89e4f12e1e71","Type":"ContainerStarted","Data":"ee6aeb541c1d0b769a8485888dfc759e8b9549436b42316f5ef28069e150431b"} Jul 06 16:28:41.348178 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:41.348144 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-222.ec2.internal" event={"ID":"ff5280726b858514ce49d9d3bdaeb9d2","Type":"ContainerStarted","Data":"89dbcab398f09babe82d6f771555ee004a68b76905cc3e200985f67e0aa937b0"} Jul 06 16:28:41.350401 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:41.350370 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-szz2c" event={"ID":"0739ad82-cf16-49a1-acf8-3dd957b76036","Type":"ContainerStarted","Data":"7278c32e436121a4baf7b154d4ac473c276559627f65f3bf1933c2f18ac5311e"} Jul 06 16:28:41.354404 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:41.354376 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zh92b" event={"ID":"3bfcc78f-a4c5-4f6c-b7fb-5cd6d5c692ad","Type":"ContainerStarted","Data":"64a4b85ce32c2ae68d82f030f5cfe6ae365780084d7c2063e0fc3ffa3c115d17"} Jul 06 16:28:41.374911 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:41.374818 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4h5nh" event={"ID":"195c23ea-51e7-41ab-ad83-265bb8bdd209","Type":"ContainerStarted","Data":"17b9acd2738b14e0d0400e9f06c14d42303a87e6e7a45948acc7c1f47e76987a"} Jul 06 16:28:41.384713 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:41.384687 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qq68r" event={"ID":"3ceed420-7d00-4dc3-85fd-0fe2db980e33","Type":"ContainerStarted","Data":"efa3e657f3b91f211ebbdcdc9db8f82b15a129726385c3a86a7daacc2a22b43e"} Jul 06 16:28:41.389316 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:41.389286 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-76qf5" event={"ID":"629c3598-7a2a-42ee-9905-6cc9560b6c6d","Type":"ContainerStarted","Data":"0143de134c875fd20da375b250edc11d950adfb0e47002a0006d33368b1313cc"} Jul 06 16:28:41.402705 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:41.402640 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal" event={"ID":"ac7241bfad6ac12b2f1f9ed8ec9e3d5d","Type":"ContainerStarted","Data":"34cfdaac064bee75273cabe8cdb7097c9be1bb7ce31f880769f76e9511d93be4"} Jul 06 16:28:41.412682 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:41.412648 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4r7fj" event={"ID":"e2070c7e-34d0-42d4-a85a-aea1b7d4e08c","Type":"ContainerStarted","Data":"23ccaba17d7faf12bf5446be9240b85b5b01612b763de24ce144e60848b8ef0f"} Jul 06 16:28:41.820395 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:41.820309 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0948aaf4-b68e-4587-9a7c-a71b5fb43dda-metrics-certs\") pod \"network-metrics-daemon-rj9l8\" (UID: \"0948aaf4-b68e-4587-9a7c-a71b5fb43dda\") " pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:28:41.820395 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:41.820374 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc02cd8b-c9cd-4cd1-ae92-184380a1bec2-original-pull-secret\") pod \"global-pull-secret-syncer-k69gf\" (UID: \"bc02cd8b-c9cd-4cd1-ae92-184380a1bec2\") " pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:28:41.820619 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:41.820556 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 16:28:41.820681 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:41.820623 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc02cd8b-c9cd-4cd1-ae92-184380a1bec2-original-pull-secret podName:bc02cd8b-c9cd-4cd1-ae92-184380a1bec2 nodeName:}" failed. No retries permitted until 2026-07-06 16:28:43.820605396 +0000 UTC m=+5.089676416 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bc02cd8b-c9cd-4cd1-ae92-184380a1bec2-original-pull-secret") pod "global-pull-secret-syncer-k69gf" (UID: "bc02cd8b-c9cd-4cd1-ae92-184380a1bec2") : object "kube-system"/"original-pull-secret" not registered Jul 06 16:28:41.821092 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:41.821070 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 16:28:41.821181 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:41.821129 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0948aaf4-b68e-4587-9a7c-a71b5fb43dda-metrics-certs podName:0948aaf4-b68e-4587-9a7c-a71b5fb43dda nodeName:}" failed. No retries permitted until 2026-07-06 16:28:43.821112726 +0000 UTC m=+5.090183747 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0948aaf4-b68e-4587-9a7c-a71b5fb43dda-metrics-certs") pod "network-metrics-daemon-rj9l8" (UID: "0948aaf4-b68e-4587-9a7c-a71b5fb43dda") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 16:28:41.921433 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:41.921392 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pkqs\" (UniqueName: \"kubernetes.io/projected/50ecbf14-6a55-4051-87de-7cd8cc5ab2ea-kube-api-access-7pkqs\") pod \"network-check-target-4d6qk\" (UID: \"50ecbf14-6a55-4051-87de-7cd8cc5ab2ea\") " pod="openshift-network-diagnostics/network-check-target-4d6qk" Jul 06 16:28:41.921630 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:41.921583 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 16:28:41.921630 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:41.921603 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 16:28:41.921630 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:41.921616 2555 projected.go:196] Error preparing data for projected volume kube-api-access-7pkqs for pod openshift-network-diagnostics/network-check-target-4d6qk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 16:28:41.921842 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:41.921681 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50ecbf14-6a55-4051-87de-7cd8cc5ab2ea-kube-api-access-7pkqs podName:50ecbf14-6a55-4051-87de-7cd8cc5ab2ea nodeName:}" failed. No retries permitted until 2026-07-06 16:28:43.921662021 +0000 UTC m=+5.190733040 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7pkqs" (UniqueName: "kubernetes.io/projected/50ecbf14-6a55-4051-87de-7cd8cc5ab2ea-kube-api-access-7pkqs") pod "network-check-target-4d6qk" (UID: "50ecbf14-6a55-4051-87de-7cd8cc5ab2ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 16:28:42.151740 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:42.151169 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 16:23:40 +0000 UTC" deadline="2028-01-01 14:37:27.730570286 +0000 UTC" Jul 06 16:28:42.151740 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:42.151210 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13054h8m45.579365364s" Jul 06 16:28:42.295951 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:42.295899 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:28:42.296161 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:42.296135 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rj9l8" podUID="0948aaf4-b68e-4587-9a7c-a71b5fb43dda" Jul 06 16:28:43.155319 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:43.155288 2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 16:28:43.300593 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:43.300562 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:28:43.301315 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:43.301278 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k69gf" podUID="bc02cd8b-c9cd-4cd1-ae92-184380a1bec2" Jul 06 16:28:43.304095 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:43.304068 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4d6qk" Jul 06 16:28:43.304259 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:43.304236 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4d6qk" podUID="50ecbf14-6a55-4051-87de-7cd8cc5ab2ea" Jul 06 16:28:43.844584 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:43.844550 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0948aaf4-b68e-4587-9a7c-a71b5fb43dda-metrics-certs\") pod \"network-metrics-daemon-rj9l8\" (UID: \"0948aaf4-b68e-4587-9a7c-a71b5fb43dda\") " pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:28:43.844746 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:43.844605 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc02cd8b-c9cd-4cd1-ae92-184380a1bec2-original-pull-secret\") pod \"global-pull-secret-syncer-k69gf\" (UID: \"bc02cd8b-c9cd-4cd1-ae92-184380a1bec2\") " pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:28:43.844796 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:43.844777 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 16:28:43.844886 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:43.844837 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc02cd8b-c9cd-4cd1-ae92-184380a1bec2-original-pull-secret podName:bc02cd8b-c9cd-4cd1-ae92-184380a1bec2 nodeName:}" failed. No retries permitted until 2026-07-06 16:28:47.844818891 +0000 UTC m=+9.113889921 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bc02cd8b-c9cd-4cd1-ae92-184380a1bec2-original-pull-secret") pod "global-pull-secret-syncer-k69gf" (UID: "bc02cd8b-c9cd-4cd1-ae92-184380a1bec2") : object "kube-system"/"original-pull-secret" not registered Jul 06 16:28:43.845355 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:43.845337 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 16:28:43.845444 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:43.845433 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0948aaf4-b68e-4587-9a7c-a71b5fb43dda-metrics-certs podName:0948aaf4-b68e-4587-9a7c-a71b5fb43dda nodeName:}" failed. No retries permitted until 2026-07-06 16:28:47.845415556 +0000 UTC m=+9.114486572 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0948aaf4-b68e-4587-9a7c-a71b5fb43dda-metrics-certs") pod "network-metrics-daemon-rj9l8" (UID: "0948aaf4-b68e-4587-9a7c-a71b5fb43dda") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 16:28:43.945321 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:43.945284 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pkqs\" (UniqueName: \"kubernetes.io/projected/50ecbf14-6a55-4051-87de-7cd8cc5ab2ea-kube-api-access-7pkqs\") pod \"network-check-target-4d6qk\" (UID: \"50ecbf14-6a55-4051-87de-7cd8cc5ab2ea\") " pod="openshift-network-diagnostics/network-check-target-4d6qk" Jul 06 16:28:43.945533 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:43.945511 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 16:28:43.945612 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:43.945542 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 16:28:43.945612 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:43.945557 2555 projected.go:196] Error preparing data for projected volume kube-api-access-7pkqs for pod openshift-network-diagnostics/network-check-target-4d6qk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 16:28:43.945725 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:43.945615 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50ecbf14-6a55-4051-87de-7cd8cc5ab2ea-kube-api-access-7pkqs podName:50ecbf14-6a55-4051-87de-7cd8cc5ab2ea nodeName:}" failed. No retries permitted until 2026-07-06 16:28:47.945597857 +0000 UTC m=+9.214668875 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7pkqs" (UniqueName: "kubernetes.io/projected/50ecbf14-6a55-4051-87de-7cd8cc5ab2ea-kube-api-access-7pkqs") pod "network-check-target-4d6qk" (UID: "50ecbf14-6a55-4051-87de-7cd8cc5ab2ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 16:28:44.296602 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:44.296570 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:28:44.297067 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:44.296709 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rj9l8" podUID="0948aaf4-b68e-4587-9a7c-a71b5fb43dda" Jul 06 16:28:45.296478 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:45.295856 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4d6qk" Jul 06 16:28:45.296478 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:45.296015 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4d6qk" podUID="50ecbf14-6a55-4051-87de-7cd8cc5ab2ea" Jul 06 16:28:45.296478 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:45.295866 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:28:45.296478 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:45.296438 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k69gf" podUID="bc02cd8b-c9cd-4cd1-ae92-184380a1bec2" Jul 06 16:28:46.296497 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:46.296468 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:28:46.296678 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:46.296578 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rj9l8" podUID="0948aaf4-b68e-4587-9a7c-a71b5fb43dda" Jul 06 16:28:47.298888 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:47.298170 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4d6qk" Jul 06 16:28:47.298888 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:47.298457 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4d6qk" podUID="50ecbf14-6a55-4051-87de-7cd8cc5ab2ea" Jul 06 16:28:47.298888 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:47.298199 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:28:47.298888 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:47.298852 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k69gf" podUID="bc02cd8b-c9cd-4cd1-ae92-184380a1bec2" Jul 06 16:28:47.876103 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:47.876058 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc02cd8b-c9cd-4cd1-ae92-184380a1bec2-original-pull-secret\") pod \"global-pull-secret-syncer-k69gf\" (UID: \"bc02cd8b-c9cd-4cd1-ae92-184380a1bec2\") " pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:28:47.876294 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:47.876175 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0948aaf4-b68e-4587-9a7c-a71b5fb43dda-metrics-certs\") pod \"network-metrics-daemon-rj9l8\" (UID: \"0948aaf4-b68e-4587-9a7c-a71b5fb43dda\") " pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:28:47.876294 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:47.876279 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 16:28:47.876413 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:47.876337 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0948aaf4-b68e-4587-9a7c-a71b5fb43dda-metrics-certs podName:0948aaf4-b68e-4587-9a7c-a71b5fb43dda nodeName:}" failed. No retries permitted until 2026-07-06 16:28:55.876323186 +0000 UTC m=+17.145394201 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0948aaf4-b68e-4587-9a7c-a71b5fb43dda-metrics-certs") pod "network-metrics-daemon-rj9l8" (UID: "0948aaf4-b68e-4587-9a7c-a71b5fb43dda") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 16:28:47.876712 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:47.876694 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 16:28:47.876766 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:47.876752 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc02cd8b-c9cd-4cd1-ae92-184380a1bec2-original-pull-secret podName:bc02cd8b-c9cd-4cd1-ae92-184380a1bec2 nodeName:}" failed. No retries permitted until 2026-07-06 16:28:55.876736216 +0000 UTC m=+17.145807238 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bc02cd8b-c9cd-4cd1-ae92-184380a1bec2-original-pull-secret") pod "global-pull-secret-syncer-k69gf" (UID: "bc02cd8b-c9cd-4cd1-ae92-184380a1bec2") : object "kube-system"/"original-pull-secret" not registered Jul 06 16:28:47.977170 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:47.977138 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pkqs\" (UniqueName: \"kubernetes.io/projected/50ecbf14-6a55-4051-87de-7cd8cc5ab2ea-kube-api-access-7pkqs\") pod \"network-check-target-4d6qk\" (UID: \"50ecbf14-6a55-4051-87de-7cd8cc5ab2ea\") " pod="openshift-network-diagnostics/network-check-target-4d6qk" Jul 06 16:28:47.977318 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:47.977302 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 16:28:47.977365 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:47.977328 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 16:28:47.977365 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:47.977340 2555 projected.go:196] Error preparing data for projected volume kube-api-access-7pkqs for pod openshift-network-diagnostics/network-check-target-4d6qk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 16:28:47.977423 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:47.977410 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50ecbf14-6a55-4051-87de-7cd8cc5ab2ea-kube-api-access-7pkqs podName:50ecbf14-6a55-4051-87de-7cd8cc5ab2ea nodeName:}" failed. No retries permitted until 2026-07-06 16:28:55.977390966 +0000 UTC m=+17.246461981 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7pkqs" (UniqueName: "kubernetes.io/projected/50ecbf14-6a55-4051-87de-7cd8cc5ab2ea-kube-api-access-7pkqs") pod "network-check-target-4d6qk" (UID: "50ecbf14-6a55-4051-87de-7cd8cc5ab2ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 16:28:48.296309 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:48.296261 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:28:48.296482 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:48.296410 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rj9l8" podUID="0948aaf4-b68e-4587-9a7c-a71b5fb43dda" Jul 06 16:28:49.296625 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:49.296586 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4d6qk" Jul 06 16:28:49.297072 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:49.296701 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4d6qk" podUID="50ecbf14-6a55-4051-87de-7cd8cc5ab2ea" Jul 06 16:28:49.297072 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:49.297010 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:28:49.297140 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:49.297081 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k69gf" podUID="bc02cd8b-c9cd-4cd1-ae92-184380a1bec2" Jul 06 16:28:50.296068 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:50.296037 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:28:50.296252 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:50.296169 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rj9l8" podUID="0948aaf4-b68e-4587-9a7c-a71b5fb43dda" Jul 06 16:28:51.296341 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:51.296308 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4d6qk" Jul 06 16:28:51.296797 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:51.296445 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4d6qk" podUID="50ecbf14-6a55-4051-87de-7cd8cc5ab2ea" Jul 06 16:28:51.296797 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:51.296497 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:28:51.296797 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:51.296620 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k69gf" podUID="bc02cd8b-c9cd-4cd1-ae92-184380a1bec2" Jul 06 16:28:52.295737 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:52.295717 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:28:52.295836 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:52.295820 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rj9l8" podUID="0948aaf4-b68e-4587-9a7c-a71b5fb43dda" Jul 06 16:28:53.295743 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:53.295707 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4d6qk" Jul 06 16:28:53.296187 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:53.295856 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4d6qk" podUID="50ecbf14-6a55-4051-87de-7cd8cc5ab2ea" Jul 06 16:28:53.296187 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:53.295908 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:28:53.296187 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:53.296050 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k69gf" podUID="bc02cd8b-c9cd-4cd1-ae92-184380a1bec2" Jul 06 16:28:54.295888 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:54.295848 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:28:54.296316 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:54.296016 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rj9l8" podUID="0948aaf4-b68e-4587-9a7c-a71b5fb43dda" Jul 06 16:28:55.295610 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:55.295557 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4d6qk" Jul 06 16:28:55.295780 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:55.295693 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4d6qk" podUID="50ecbf14-6a55-4051-87de-7cd8cc5ab2ea" Jul 06 16:28:55.295780 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:55.295750 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:28:55.295905 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:55.295828 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k69gf" podUID="bc02cd8b-c9cd-4cd1-ae92-184380a1bec2" Jul 06 16:28:55.934376 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:55.934344 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0948aaf4-b68e-4587-9a7c-a71b5fb43dda-metrics-certs\") pod \"network-metrics-daemon-rj9l8\" (UID: \"0948aaf4-b68e-4587-9a7c-a71b5fb43dda\") " pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:28:55.934376 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:55.934384 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc02cd8b-c9cd-4cd1-ae92-184380a1bec2-original-pull-secret\") pod \"global-pull-secret-syncer-k69gf\" (UID: \"bc02cd8b-c9cd-4cd1-ae92-184380a1bec2\") " pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:28:55.934601 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:55.934494 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 16:28:55.934601 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:55.934494 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 16:28:55.934601 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:55.934554 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0948aaf4-b68e-4587-9a7c-a71b5fb43dda-metrics-certs podName:0948aaf4-b68e-4587-9a7c-a71b5fb43dda nodeName:}" failed. No retries permitted until 2026-07-06 16:29:11.934535437 +0000 UTC m=+33.203606452 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0948aaf4-b68e-4587-9a7c-a71b5fb43dda-metrics-certs") pod "network-metrics-daemon-rj9l8" (UID: "0948aaf4-b68e-4587-9a7c-a71b5fb43dda") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 16:28:55.934601 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:55.934571 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc02cd8b-c9cd-4cd1-ae92-184380a1bec2-original-pull-secret podName:bc02cd8b-c9cd-4cd1-ae92-184380a1bec2 nodeName:}" failed. No retries permitted until 2026-07-06 16:29:11.934563073 +0000 UTC m=+33.203634088 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bc02cd8b-c9cd-4cd1-ae92-184380a1bec2-original-pull-secret") pod "global-pull-secret-syncer-k69gf" (UID: "bc02cd8b-c9cd-4cd1-ae92-184380a1bec2") : object "kube-system"/"original-pull-secret" not registered Jul 06 16:28:56.034897 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:56.034857 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pkqs\" (UniqueName: \"kubernetes.io/projected/50ecbf14-6a55-4051-87de-7cd8cc5ab2ea-kube-api-access-7pkqs\") pod \"network-check-target-4d6qk\" (UID: \"50ecbf14-6a55-4051-87de-7cd8cc5ab2ea\") " pod="openshift-network-diagnostics/network-check-target-4d6qk" Jul 06 16:28:56.035072 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:56.035030 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 16:28:56.035072 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:56.035053 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 16:28:56.035072 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:56.035062 2555 projected.go:196] Error preparing data for projected volume kube-api-access-7pkqs for pod openshift-network-diagnostics/network-check-target-4d6qk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 16:28:56.035221 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:56.035113 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50ecbf14-6a55-4051-87de-7cd8cc5ab2ea-kube-api-access-7pkqs podName:50ecbf14-6a55-4051-87de-7cd8cc5ab2ea nodeName:}" failed. No retries permitted until 2026-07-06 16:29:12.035100522 +0000 UTC m=+33.304171540 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7pkqs" (UniqueName: "kubernetes.io/projected/50ecbf14-6a55-4051-87de-7cd8cc5ab2ea-kube-api-access-7pkqs") pod "network-check-target-4d6qk" (UID: "50ecbf14-6a55-4051-87de-7cd8cc5ab2ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 16:28:56.295568 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:56.295545 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:28:56.295707 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:56.295643 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rj9l8" podUID="0948aaf4-b68e-4587-9a7c-a71b5fb43dda" Jul 06 16:28:57.296359 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:57.296320 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4d6qk" Jul 06 16:28:57.296788 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:57.296437 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4d6qk" podUID="50ecbf14-6a55-4051-87de-7cd8cc5ab2ea" Jul 06 16:28:57.296788 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:57.296499 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:28:57.296788 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:57.296615 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k69gf" podUID="bc02cd8b-c9cd-4cd1-ae92-184380a1bec2" Jul 06 16:28:58.295602 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:58.295569 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:28:58.295775 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:58.295711 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rj9l8" podUID="0948aaf4-b68e-4587-9a7c-a71b5fb43dda" Jul 06 16:28:59.296926 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:59.296890 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4d6qk" Jul 06 16:28:59.297371 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:59.297019 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4d6qk" podUID="50ecbf14-6a55-4051-87de-7cd8cc5ab2ea" Jul 06 16:28:59.297371 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:28:59.297070 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:28:59.297371 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:28:59.297169 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k69gf" podUID="bc02cd8b-c9cd-4cd1-ae92-184380a1bec2" Jul 06 16:29:00.295480 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:00.295446 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:29:00.295659 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:00.295566 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rj9l8" podUID="0948aaf4-b68e-4587-9a7c-a71b5fb43dda" Jul 06 16:29:01.296731 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:01.296550 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4d6qk" Jul 06 16:29:01.297553 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:01.296630 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:29:01.297553 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:01.296835 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4d6qk" podUID="50ecbf14-6a55-4051-87de-7cd8cc5ab2ea" Jul 06 16:29:01.297553 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:01.296912 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k69gf" podUID="bc02cd8b-c9cd-4cd1-ae92-184380a1bec2" Jul 06 16:29:01.461770 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:01.461737 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t8slq" event={"ID":"8215f862-bc22-4edb-a7ef-806a3e056187","Type":"ContainerStarted","Data":"bed7d42ff1b8ace36c1ebbc77d723613f83c84f90d21d9f8acbc7e17c5080aea"} Jul 06 16:29:01.463367 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:01.463344 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-222.ec2.internal" event={"ID":"ff5280726b858514ce49d9d3bdaeb9d2","Type":"ContainerStarted","Data":"717ec6a972f08e0f67646cef276e7914b290e833cf6a2197cb6ec8a5bade82d6"} Jul 06 16:29:01.465494 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:01.465464 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-szz2c" event={"ID":"0739ad82-cf16-49a1-acf8-3dd957b76036","Type":"ContainerStarted","Data":"80cced305ac66e081786dc69a283946382e54ca4d1fc296db0dcac59ddc0d448"} Jul 06 16:29:01.469461 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:01.469427 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" event={"ID":"f22be4f0-05eb-424d-a399-c80d76566eab","Type":"ContainerStarted","Data":"c11037f86df6219e5eb8719831dd1e8ea4bfc684b8f3741cf0bcbde7dd5cc1af"} Jul 06 16:29:01.469544 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:01.469497 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" event={"ID":"f22be4f0-05eb-424d-a399-c80d76566eab","Type":"ContainerStarted","Data":"946d812b538f2012d1e312d6be3c12ed6ed7fdcfd00bd9d87eea0cc99a643d9c"} Jul 06 16:29:01.469544 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:01.469534 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" event={"ID":"f22be4f0-05eb-424d-a399-c80d76566eab","Type":"ContainerStarted","Data":"8db0891b4dd919c04ebc3092423c01a16e3790cccbfeed81caf3f768afe7acde"} Jul 06 16:29:01.469620 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:01.469564 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" event={"ID":"f22be4f0-05eb-424d-a399-c80d76566eab","Type":"ContainerStarted","Data":"a8ec46dfbccea2e06a8f0ede3af1c054f48d8ef36df8481cd23975ddc4d2a98a"} Jul 06 16:29:01.477892 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:01.477851 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-t8slq" podStartSLOduration=2.016216798 podStartE2EDuration="22.477838627s" totalImagesPullingTime="20.461621829s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:28:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:29:01.477241209 +0000 UTC m=+22.746312247" watchObservedRunningTime="2026-07-06 16:29:01.477838627 +0000 UTC m=+22.746909664" Jul 06 16:29:01.494532 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:01.494494 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-szz2c" podStartSLOduration=2.024629561 podStartE2EDuration="22.49448245s" totalImagesPullingTime="20.469852889s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:28:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:29:01.49413405 +0000 UTC m=+22.763205090" watchObservedRunningTime="2026-07-06 16:29:01.49448245 +0000 UTC m=+22.763553520" Jul 06 16:29:01.506405 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:01.506371 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-222.ec2.internal" podStartSLOduration=21.506355477 podStartE2EDuration="21.506355477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:28:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:29:01.50635191 +0000 UTC m=+22.775422948" watchObservedRunningTime="2026-07-06 16:29:01.506355477 +0000 UTC m=+22.775426504" Jul 06 16:29:02.295649 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:02.295463 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:29:02.298288 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:02.296105 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rj9l8" podUID="0948aaf4-b68e-4587-9a7c-a71b5fb43dda" Jul 06 16:29:02.472699 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:02.472659 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lp5h" event={"ID":"1614ec45-555f-46c5-ac8e-89e4f12e1e71","Type":"ContainerStarted","Data":"321b3adf1a1210d69b0f17d666248d5472b9d8e019291bed27ccae844e2529ae"} Jul 06 16:29:02.473862 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:02.473832 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zh92b" event={"ID":"3bfcc78f-a4c5-4f6c-b7fb-5cd6d5c692ad","Type":"ContainerStarted","Data":"58cbca71de3ab0adbdf73db8c001c3e1870c7cf1526cc2844cd537717fd88978"} Jul 06 16:29:02.475264 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:02.475238 2555 generic.go:356] "Generic (PLEG): container finished" podID="195c23ea-51e7-41ab-ad83-265bb8bdd209" containerID="5cbb607c4af8d529f1934e7e1840c14e92e0e4f016e8c6c73b82cdf33fe96253" exitCode=0 Jul 06 16:29:02.475370 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:02.475305 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4h5nh" event={"ID":"195c23ea-51e7-41ab-ad83-265bb8bdd209","Type":"ContainerDied","Data":"5cbb607c4af8d529f1934e7e1840c14e92e0e4f016e8c6c73b82cdf33fe96253"} Jul 06 16:29:02.476592 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:02.476556 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qq68r" event={"ID":"3ceed420-7d00-4dc3-85fd-0fe2db980e33","Type":"ContainerStarted","Data":"e452266d134ce5449f5a44f5740b34df7646f8a204444e280a259ed3e4c49a0b"} Jul 06 16:29:02.477908 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:02.477881 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-76qf5" event={"ID":"629c3598-7a2a-42ee-9905-6cc9560b6c6d","Type":"ContainerStarted","Data":"877d71671ae1e31aa49272356b5711c79db14baf185c9012ab4f3233e286a984"} Jul 06 16:29:02.479349 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:02.479322 2555 generic.go:356] "Generic (PLEG): container finished" podID="ac7241bfad6ac12b2f1f9ed8ec9e3d5d" containerID="0eecd1347d14923f3626b2347e1ef17c9770b67763266e34d2172ef5fa183f62" exitCode=0 Jul 06 16:29:02.479423 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:02.479369 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal" event={"ID":"ac7241bfad6ac12b2f1f9ed8ec9e3d5d","Type":"ContainerDied","Data":"0eecd1347d14923f3626b2347e1ef17c9770b67763266e34d2172ef5fa183f62"} Jul 06 16:29:02.480820 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:02.480801 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4r7fj" event={"ID":"e2070c7e-34d0-42d4-a85a-aea1b7d4e08c","Type":"ContainerStarted","Data":"a65f9c11e40a5130db07d2bc936d6e56d3f652f49c5b27d53c7e7b520398a064"} Jul 06 16:29:02.483560 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:02.483540 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" event={"ID":"f22be4f0-05eb-424d-a399-c80d76566eab","Type":"ContainerStarted","Data":"4195e4031d40072f2b42f30a0c02c86d226c97597342f858ccffc53acd07743a"} Jul 06 16:29:02.483653 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:02.483593 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" event={"ID":"f22be4f0-05eb-424d-a399-c80d76566eab","Type":"ContainerStarted","Data":"12aee5cd4d38c70915c6a60e097c2ae32cf77b1b32cb37eec973d80f384a2abb"} Jul 06 16:29:02.521247 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:02.521197 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qq68r" podStartSLOduration=3.375027788 podStartE2EDuration="23.521164229s" totalImagesPullingTime="20.146136441s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:28:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:29:02.520649372 +0000 UTC m=+23.789720410" watchObservedRunningTime="2026-07-06 16:29:02.521164229 +0000 UTC m=+23.790235266" Jul 06 16:29:02.533277 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:02.533232 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4r7fj" podStartSLOduration=3.458321636 podStartE2EDuration="23.53321413s" totalImagesPullingTime="20.074892494s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:28:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:29:02.533030763 +0000 UTC m=+23.802101801" watchObservedRunningTime="2026-07-06 16:29:02.53321413 +0000 UTC m=+23.802285168" Jul 06 16:29:02.546330 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:02.546255 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-76qf5" podStartSLOduration=3.181930634 podStartE2EDuration="23.546242745s" totalImagesPullingTime="20.364312111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:28:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:29:02.546109729 +0000 UTC m=+23.815180768" watchObservedRunningTime="2026-07-06 16:29:02.546242745 +0000 UTC m=+23.815313782" Jul 06 16:29:02.624219 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:02.624159 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:29:02.700415 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:02.700380 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:29:03.120058 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:03.120026 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-76qf5" Jul 06 16:29:03.120763 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:03.120746 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-76qf5" Jul 06 16:29:03.296578 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:03.296534 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4d6qk" Jul 06 16:29:03.296766 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:03.296662 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4d6qk" podUID="50ecbf14-6a55-4051-87de-7cd8cc5ab2ea" Jul 06 16:29:03.296766 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:03.296717 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:29:03.296881 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:03.296826 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k69gf" podUID="bc02cd8b-c9cd-4cd1-ae92-184380a1bec2" Jul 06 16:29:03.465720 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:03.465695 2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 16:29:03.487605 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:03.487576 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lp5h" event={"ID":"1614ec45-555f-46c5-ac8e-89e4f12e1e71","Type":"ContainerStarted","Data":"0a621374a094bfe36dae4cc2098c45517acf1203f89cf21656de8d8af572c8e2"} Jul 06 16:29:03.489456 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:03.489411 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal" event={"ID":"ac7241bfad6ac12b2f1f9ed8ec9e3d5d","Type":"ContainerStarted","Data":"eda80e81dd9e993772eda3e682deaf64944717a860c044d77eb30c879273f6e7"} Jul 06 16:29:03.490005 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:03.489982 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-76qf5" Jul 06 16:29:03.490574 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:03.490558 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-76qf5" Jul 06 16:29:03.508824 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:03.507441 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-222.ec2.internal" podStartSLOduration=23.507423664 podStartE2EDuration="23.507423664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:28:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:29:03.506664452 +0000 UTC m=+24.775735490" watchObservedRunningTime="2026-07-06 16:29:03.507423664 +0000 UTC m=+24.776494705" Jul 06 16:29:03.565151 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:03.565118 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:29:03.652759 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:03.652723 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:29:03.710068 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:03.709991 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:29:04.167554 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:04.167450 2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T16:29:03.465715553Z","UUID":"e409256e-e2bf-4308-b142-d8093b98e493","Handler":null,"Name":"","Endpoint":""} Jul 06 16:29:04.169262 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:04.169239 2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 16:29:04.169406 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:04.169284 2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 16:29:04.295906 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:04.295878 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:29:04.296094 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:04.296027 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rj9l8" podUID="0948aaf4-b68e-4587-9a7c-a71b5fb43dda" Jul 06 16:29:04.495236 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:04.495144 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" event={"ID":"f22be4f0-05eb-424d-a399-c80d76566eab","Type":"ContainerStarted","Data":"3f719a840578a86deb44cb8ad1c37891aa1d34ae14f6db0a0551accc5cca89a4"} Jul 06 16:29:05.295544 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:05.295513 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4d6qk" Jul 06 16:29:05.295544 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:05.295548 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:29:05.295755 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:05.295615 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4d6qk" podUID="50ecbf14-6a55-4051-87de-7cd8cc5ab2ea" Jul 06 16:29:05.295755 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:05.295663 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k69gf" podUID="bc02cd8b-c9cd-4cd1-ae92-184380a1bec2" Jul 06 16:29:05.500127 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:05.500087 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lp5h" event={"ID":"1614ec45-555f-46c5-ac8e-89e4f12e1e71","Type":"ContainerStarted","Data":"62912f0b542fe492e25d4e8041db917b7b9a1bc63eceb61e89fcf2a480c6cf63"} Jul 06 16:29:05.517656 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:05.517603 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lp5h" podStartSLOduration=3.370422424 podStartE2EDuration="26.517585863s" totalImagesPullingTime="23.147163439s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:28:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:29:05.517205142 +0000 UTC m=+26.786276190" watchObservedRunningTime="2026-07-06 16:29:05.517585863 +0000 UTC m=+26.786656900" Jul 06 16:29:05.517903 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:05.517881 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zh92b" podStartSLOduration=6.242028593 podStartE2EDuration="26.517876389s" totalImagesPullingTime="20.275847796s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:28:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:29:03.531511984 +0000 UTC m=+24.800583021" watchObservedRunningTime="2026-07-06 16:29:05.517876389 +0000 UTC m=+26.786947426" Jul 06 16:29:06.296335 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:06.296152 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:29:06.296493 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:06.296437 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rj9l8" podUID="0948aaf4-b68e-4587-9a7c-a71b5fb43dda" Jul 06 16:29:06.377995 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:06.377967 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:29:06.448408 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:06.448376 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:29:06.509061 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:06.509026 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" event={"ID":"f22be4f0-05eb-424d-a399-c80d76566eab","Type":"ContainerStarted","Data":"6ed22ea9510bab49b49a128da85e34cc5c8915a1701363e7a4f747ace64cc9d7"} Jul 06 16:29:06.535773 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:06.535732 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" podStartSLOduration=7.1034645770000004 podStartE2EDuration="27.535718597s" totalImagesPullingTime="20.43225402s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:28:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:29:06.53539505 +0000 UTC m=+27.804466088" watchObservedRunningTime="2026-07-06 16:29:06.535718597 +0000 UTC m=+27.804789633" Jul 06 16:29:07.296325 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:07.296291 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4d6qk" Jul 06 16:29:07.296325 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:07.296319 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:29:07.296552 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:07.296436 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4d6qk" podUID="50ecbf14-6a55-4051-87de-7cd8cc5ab2ea" Jul 06 16:29:07.296606 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:07.296562 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k69gf" podUID="bc02cd8b-c9cd-4cd1-ae92-184380a1bec2" Jul 06 16:29:07.511915 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:07.511870 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:29:07.512652 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:07.511991 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:29:07.512652 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:07.512045 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:29:07.529385 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:07.529357 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:29:07.530449 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:07.530431 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:29:07.901930 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:07.901742 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4d6qk"] Jul 06 16:29:07.902218 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:07.902053 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4d6qk" Jul 06 16:29:07.902218 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:07.902165 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4d6qk" podUID="50ecbf14-6a55-4051-87de-7cd8cc5ab2ea" Jul 06 16:29:07.905694 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:07.905664 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k69gf"] Jul 06 16:29:07.905838 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:07.905782 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:29:07.905908 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:07.905881 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k69gf" podUID="bc02cd8b-c9cd-4cd1-ae92-184380a1bec2" Jul 06 16:29:07.906264 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:07.906247 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rj9l8"] Jul 06 16:29:07.906453 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:07.906335 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:29:07.906453 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:07.906414 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rj9l8" podUID="0948aaf4-b68e-4587-9a7c-a71b5fb43dda" Jul 06 16:29:08.940511 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:08.940469 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:29:09.000560 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:09.000528 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:29:09.297270 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:09.297239 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4d6qk" Jul 06 16:29:09.297474 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:09.297346 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4d6qk" podUID="50ecbf14-6a55-4051-87de-7cd8cc5ab2ea" Jul 06 16:29:09.297474 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:09.297398 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:29:09.297588 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:09.297495 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rj9l8" podUID="0948aaf4-b68e-4587-9a7c-a71b5fb43dda" Jul 06 16:29:10.296454 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:10.296426 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:29:10.296845 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:10.296563 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k69gf" podUID="bc02cd8b-c9cd-4cd1-ae92-184380a1bec2" Jul 06 16:29:10.520604 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:10.520560 2555 generic.go:356] "Generic (PLEG): container finished" podID="195c23ea-51e7-41ab-ad83-265bb8bdd209" containerID="739aa50889e6ba83196d10ea71366686f0a0bad472e6727833a4bfb58ee00e46" exitCode=0 Jul 06 16:29:10.520749 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:10.520608 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4h5nh" event={"ID":"195c23ea-51e7-41ab-ad83-265bb8bdd209","Type":"ContainerDied","Data":"739aa50889e6ba83196d10ea71366686f0a0bad472e6727833a4bfb58ee00e46"} Jul 06 16:29:11.295687 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:11.295656 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4d6qk" Jul 06 16:29:11.295848 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:11.295656 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:29:11.295848 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:11.295767 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4d6qk" podUID="50ecbf14-6a55-4051-87de-7cd8cc5ab2ea" Jul 06 16:29:11.295991 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:11.295846 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rj9l8" podUID="0948aaf4-b68e-4587-9a7c-a71b5fb43dda" Jul 06 16:29:11.524295 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:11.524264 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4h5nh" event={"ID":"195c23ea-51e7-41ab-ad83-265bb8bdd209","Type":"ContainerStarted","Data":"83db710bb38292279cb9279c1fba22f875acd4c1b2f5092a412714767beab043"} Jul 06 16:29:11.958317 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:11.958288 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0948aaf4-b68e-4587-9a7c-a71b5fb43dda-metrics-certs\") pod \"network-metrics-daemon-rj9l8\" (UID: \"0948aaf4-b68e-4587-9a7c-a71b5fb43dda\") " pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:29:11.958492 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:11.958323 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc02cd8b-c9cd-4cd1-ae92-184380a1bec2-original-pull-secret\") pod \"global-pull-secret-syncer-k69gf\" (UID: \"bc02cd8b-c9cd-4cd1-ae92-184380a1bec2\") " pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:29:11.958492 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:11.958423 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 16:29:11.958492 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:11.958437 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 16:29:11.958492 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:11.958474 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc02cd8b-c9cd-4cd1-ae92-184380a1bec2-original-pull-secret podName:bc02cd8b-c9cd-4cd1-ae92-184380a1bec2 nodeName:}" failed. No retries permitted until 2026-07-06 16:29:43.9584615 +0000 UTC m=+65.227532515 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bc02cd8b-c9cd-4cd1-ae92-184380a1bec2-original-pull-secret") pod "global-pull-secret-syncer-k69gf" (UID: "bc02cd8b-c9cd-4cd1-ae92-184380a1bec2") : object "kube-system"/"original-pull-secret" not registered Jul 06 16:29:11.958492 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:11.958496 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0948aaf4-b68e-4587-9a7c-a71b5fb43dda-metrics-certs podName:0948aaf4-b68e-4587-9a7c-a71b5fb43dda nodeName:}" failed. No retries permitted until 2026-07-06 16:29:43.958480268 +0000 UTC m=+65.227551283 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0948aaf4-b68e-4587-9a7c-a71b5fb43dda-metrics-certs") pod "network-metrics-daemon-rj9l8" (UID: "0948aaf4-b68e-4587-9a7c-a71b5fb43dda") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 16:29:12.058950 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:12.058759 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pkqs\" (UniqueName: \"kubernetes.io/projected/50ecbf14-6a55-4051-87de-7cd8cc5ab2ea-kube-api-access-7pkqs\") pod \"network-check-target-4d6qk\" (UID: \"50ecbf14-6a55-4051-87de-7cd8cc5ab2ea\") " pod="openshift-network-diagnostics/network-check-target-4d6qk" Jul 06 16:29:12.059062 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:12.058909 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 16:29:12.059062 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:12.058991 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 16:29:12.059062 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:12.059002 2555 projected.go:196] Error preparing data for projected volume kube-api-access-7pkqs for pod openshift-network-diagnostics/network-check-target-4d6qk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 16:29:12.059062 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:12.059053 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50ecbf14-6a55-4051-87de-7cd8cc5ab2ea-kube-api-access-7pkqs podName:50ecbf14-6a55-4051-87de-7cd8cc5ab2ea nodeName:}" failed. No retries permitted until 2026-07-06 16:29:44.059039322 +0000 UTC m=+65.328110337 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7pkqs" (UniqueName: "kubernetes.io/projected/50ecbf14-6a55-4051-87de-7cd8cc5ab2ea-kube-api-access-7pkqs") pod "network-check-target-4d6qk" (UID: "50ecbf14-6a55-4051-87de-7cd8cc5ab2ea") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 16:29:12.296111 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:12.296083 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:29:12.296247 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:12.296223 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k69gf" podUID="bc02cd8b-c9cd-4cd1-ae92-184380a1bec2" Jul 06 16:29:12.528627 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:12.528540 2555 generic.go:356] "Generic (PLEG): container finished" podID="195c23ea-51e7-41ab-ad83-265bb8bdd209" containerID="83db710bb38292279cb9279c1fba22f875acd4c1b2f5092a412714767beab043" exitCode=0 Jul 06 16:29:12.528627 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:12.528563 2555 generic.go:356] "Generic (PLEG): container finished" podID="195c23ea-51e7-41ab-ad83-265bb8bdd209" containerID="f475080c8142f4a6eecf314365a056e95933ebbffa43eaae560a182dc0f30aa3" exitCode=0 Jul 06 16:29:12.528627 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:12.528605 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4h5nh" event={"ID":"195c23ea-51e7-41ab-ad83-265bb8bdd209","Type":"ContainerDied","Data":"83db710bb38292279cb9279c1fba22f875acd4c1b2f5092a412714767beab043"} Jul 06 16:29:12.529073 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:12.528637 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4h5nh" event={"ID":"195c23ea-51e7-41ab-ad83-265bb8bdd209","Type":"ContainerDied","Data":"f475080c8142f4a6eecf314365a056e95933ebbffa43eaae560a182dc0f30aa3"} Jul 06 16:29:13.295731 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:13.295695 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:29:13.295871 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:13.295739 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4d6qk" Jul 06 16:29:13.295871 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:13.295812 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rj9l8" podUID="0948aaf4-b68e-4587-9a7c-a71b5fb43dda" Jul 06 16:29:13.295932 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:13.295886 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4d6qk" podUID="50ecbf14-6a55-4051-87de-7cd8cc5ab2ea" Jul 06 16:29:14.027996 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.027892 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-222.ec2.internal" event="NodeReady" Jul 06 16:29:14.028452 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.028053 2555 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 16:29:14.078851 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.078818 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hbxj8"] Jul 06 16:29:14.080551 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.080526 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hbxj8" Jul 06 16:29:14.082126 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.082102 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6zmcw"] Jul 06 16:29:14.084080 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.084063 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6zmcw" Jul 06 16:29:14.085797 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.085649 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6rxcp\"" Jul 06 16:29:14.086261 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.086243 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 16:29:14.086471 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.086454 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 16:29:14.086471 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.086463 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 16:29:14.086789 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.086708 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 16:29:14.086789 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.086711 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 16:29:14.087055 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.087036 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tbv5p\"" Jul 06 16:29:14.100081 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.100058 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hbxj8"] Jul 06 16:29:14.100626 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.100587 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6zmcw"] Jul 06 16:29:14.172764 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.172733 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f53e144-c856-4edf-92a9-bacbe1b5d03e-metrics-tls\") pod \"dns-default-hbxj8\" (UID: \"9f53e144-c856-4edf-92a9-bacbe1b5d03e\") " pod="openshift-dns/dns-default-hbxj8" Jul 06 16:29:14.173105 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.172793 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f53e144-c856-4edf-92a9-bacbe1b5d03e-tmp-dir\") pod \"dns-default-hbxj8\" (UID: \"9f53e144-c856-4edf-92a9-bacbe1b5d03e\") " pod="openshift-dns/dns-default-hbxj8" Jul 06 16:29:14.173105 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.172838 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9f53e144-c856-4edf-92a9-bacbe1b5d03e-config-volume\") pod \"dns-default-hbxj8\" (UID: \"9f53e144-c856-4edf-92a9-bacbe1b5d03e\") " pod="openshift-dns/dns-default-hbxj8" Jul 06 16:29:14.173105 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.172900 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljvxw\" (UniqueName: \"kubernetes.io/projected/9f53e144-c856-4edf-92a9-bacbe1b5d03e-kube-api-access-ljvxw\") pod \"dns-default-hbxj8\" (UID: \"9f53e144-c856-4edf-92a9-bacbe1b5d03e\") " pod="openshift-dns/dns-default-hbxj8" Jul 06 16:29:14.173105 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.172961 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd998\" (UniqueName: \"kubernetes.io/projected/7d109c3a-bd70-4cce-bb25-73238bd1f2af-kube-api-access-cd998\") pod \"ingress-canary-6zmcw\" (UID: \"7d109c3a-bd70-4cce-bb25-73238bd1f2af\") " pod="openshift-ingress-canary/ingress-canary-6zmcw" Jul 06 16:29:14.173105 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.173008 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d109c3a-bd70-4cce-bb25-73238bd1f2af-cert\") pod \"ingress-canary-6zmcw\" (UID: \"7d109c3a-bd70-4cce-bb25-73238bd1f2af\") " pod="openshift-ingress-canary/ingress-canary-6zmcw" Jul 06 16:29:14.195060 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.194969 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:29:14.273991 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.273961 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d109c3a-bd70-4cce-bb25-73238bd1f2af-cert\") pod \"ingress-canary-6zmcw\" (UID: \"7d109c3a-bd70-4cce-bb25-73238bd1f2af\") " pod="openshift-ingress-canary/ingress-canary-6zmcw" Jul 06 16:29:14.274153 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.274007 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f53e144-c856-4edf-92a9-bacbe1b5d03e-metrics-tls\") pod \"dns-default-hbxj8\" (UID: \"9f53e144-c856-4edf-92a9-bacbe1b5d03e\") " pod="openshift-dns/dns-default-hbxj8" Jul 06 16:29:14.274153 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:14.274113 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 16:29:14.274153 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.274131 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f53e144-c856-4edf-92a9-bacbe1b5d03e-tmp-dir\") pod \"dns-default-hbxj8\" (UID: \"9f53e144-c856-4edf-92a9-bacbe1b5d03e\") " pod="openshift-dns/dns-default-hbxj8" Jul 06 16:29:14.274282 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:14.274162 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f53e144-c856-4edf-92a9-bacbe1b5d03e-metrics-tls podName:9f53e144-c856-4edf-92a9-bacbe1b5d03e nodeName:}" failed. No retries permitted until 2026-07-06 16:29:14.774146963 +0000 UTC m=+36.043217978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9f53e144-c856-4edf-92a9-bacbe1b5d03e-metrics-tls") pod "dns-default-hbxj8" (UID: "9f53e144-c856-4edf-92a9-bacbe1b5d03e") : secret "dns-default-metrics-tls" not found Jul 06 16:29:14.274282 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.274196 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9f53e144-c856-4edf-92a9-bacbe1b5d03e-config-volume\") pod \"dns-default-hbxj8\" (UID: \"9f53e144-c856-4edf-92a9-bacbe1b5d03e\") " pod="openshift-dns/dns-default-hbxj8" Jul 06 16:29:14.274282 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.274217 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljvxw\" (UniqueName: \"kubernetes.io/projected/9f53e144-c856-4edf-92a9-bacbe1b5d03e-kube-api-access-ljvxw\") pod \"dns-default-hbxj8\" (UID: \"9f53e144-c856-4edf-92a9-bacbe1b5d03e\") " pod="openshift-dns/dns-default-hbxj8" Jul 06 16:29:14.274282 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.274240 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd998\" (UniqueName: \"kubernetes.io/projected/7d109c3a-bd70-4cce-bb25-73238bd1f2af-kube-api-access-cd998\") pod \"ingress-canary-6zmcw\" (UID: \"7d109c3a-bd70-4cce-bb25-73238bd1f2af\") " pod="openshift-ingress-canary/ingress-canary-6zmcw" Jul 06 16:29:14.274496 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.274474 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9f53e144-c856-4edf-92a9-bacbe1b5d03e-tmp-dir\") pod \"dns-default-hbxj8\" (UID: \"9f53e144-c856-4edf-92a9-bacbe1b5d03e\") " pod="openshift-dns/dns-default-hbxj8" Jul 06 16:29:14.274809 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.274791 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9f53e144-c856-4edf-92a9-bacbe1b5d03e-config-volume\") pod \"dns-default-hbxj8\" (UID: \"9f53e144-c856-4edf-92a9-bacbe1b5d03e\") " pod="openshift-dns/dns-default-hbxj8" Jul 06 16:29:14.278559 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.278503 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d109c3a-bd70-4cce-bb25-73238bd1f2af-cert\") pod \"ingress-canary-6zmcw\" (UID: \"7d109c3a-bd70-4cce-bb25-73238bd1f2af\") " pod="openshift-ingress-canary/ingress-canary-6zmcw" Jul 06 16:29:14.287081 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.287056 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljvxw\" (UniqueName: \"kubernetes.io/projected/9f53e144-c856-4edf-92a9-bacbe1b5d03e-kube-api-access-ljvxw\") pod \"dns-default-hbxj8\" (UID: \"9f53e144-c856-4edf-92a9-bacbe1b5d03e\") " pod="openshift-dns/dns-default-hbxj8" Jul 06 16:29:14.287441 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.287422 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd998\" (UniqueName: \"kubernetes.io/projected/7d109c3a-bd70-4cce-bb25-73238bd1f2af-kube-api-access-cd998\") pod \"ingress-canary-6zmcw\" (UID: \"7d109c3a-bd70-4cce-bb25-73238bd1f2af\") " pod="openshift-ingress-canary/ingress-canary-6zmcw" Jul 06 16:29:14.295618 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.295600 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:29:14.296626 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.296569 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:29:14.297696 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.297682 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 16:29:14.397774 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.397745 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6zmcw" Jul 06 16:29:14.544226 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.544200 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6zmcw"] Jul 06 16:29:14.549158 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:29:14.549136 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d109c3a_bd70_4cce_bb25_73238bd1f2af.slice/crio-e4b2daa390d3dbc28a89fbfae6bd100ef49cbc3d57507549387ae16df44f459b WatchSource:0}: Error finding container e4b2daa390d3dbc28a89fbfae6bd100ef49cbc3d57507549387ae16df44f459b: Status 404 returned error can't find the container with id e4b2daa390d3dbc28a89fbfae6bd100ef49cbc3d57507549387ae16df44f459b Jul 06 16:29:14.778216 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:14.778183 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f53e144-c856-4edf-92a9-bacbe1b5d03e-metrics-tls\") pod \"dns-default-hbxj8\" (UID: \"9f53e144-c856-4edf-92a9-bacbe1b5d03e\") " pod="openshift-dns/dns-default-hbxj8" Jul 06 16:29:14.778369 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:14.778282 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 16:29:14.778369 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:14.778344 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f53e144-c856-4edf-92a9-bacbe1b5d03e-metrics-tls podName:9f53e144-c856-4edf-92a9-bacbe1b5d03e nodeName:}" failed. No retries permitted until 2026-07-06 16:29:15.778330433 +0000 UTC m=+37.047401447 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9f53e144-c856-4edf-92a9-bacbe1b5d03e-metrics-tls") pod "dns-default-hbxj8" (UID: "9f53e144-c856-4edf-92a9-bacbe1b5d03e") : secret "dns-default-metrics-tls" not found Jul 06 16:29:15.296444 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:15.296410 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:29:15.297170 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:15.296626 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4d6qk" Jul 06 16:29:15.299347 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:15.299325 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 16:29:15.299473 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:15.299348 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jhwls\"" Jul 06 16:29:15.299473 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:15.299380 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jqc2r\"" Jul 06 16:29:15.299473 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:15.299348 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 16:29:15.299630 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:15.299498 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 16:29:15.537448 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:15.537411 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6zmcw" event={"ID":"7d109c3a-bd70-4cce-bb25-73238bd1f2af","Type":"ContainerStarted","Data":"e4b2daa390d3dbc28a89fbfae6bd100ef49cbc3d57507549387ae16df44f459b"} Jul 06 16:29:15.784481 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:15.784397 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f53e144-c856-4edf-92a9-bacbe1b5d03e-metrics-tls\") pod \"dns-default-hbxj8\" (UID: \"9f53e144-c856-4edf-92a9-bacbe1b5d03e\") " pod="openshift-dns/dns-default-hbxj8" Jul 06 16:29:15.784641 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:15.784536 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 16:29:15.784641 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:15.784597 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f53e144-c856-4edf-92a9-bacbe1b5d03e-metrics-tls podName:9f53e144-c856-4edf-92a9-bacbe1b5d03e nodeName:}" failed. No retries permitted until 2026-07-06 16:29:17.78458366 +0000 UTC m=+39.053654674 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9f53e144-c856-4edf-92a9-bacbe1b5d03e-metrics-tls") pod "dns-default-hbxj8" (UID: "9f53e144-c856-4edf-92a9-bacbe1b5d03e") : secret "dns-default-metrics-tls" not found Jul 06 16:29:17.797324 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:17.797089 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f53e144-c856-4edf-92a9-bacbe1b5d03e-metrics-tls\") pod \"dns-default-hbxj8\" (UID: \"9f53e144-c856-4edf-92a9-bacbe1b5d03e\") " pod="openshift-dns/dns-default-hbxj8" Jul 06 16:29:17.797726 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:17.797253 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 16:29:17.797726 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:17.797461 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f53e144-c856-4edf-92a9-bacbe1b5d03e-metrics-tls podName:9f53e144-c856-4edf-92a9-bacbe1b5d03e nodeName:}" failed. No retries permitted until 2026-07-06 16:29:21.797439302 +0000 UTC m=+43.066510319 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9f53e144-c856-4edf-92a9-bacbe1b5d03e-metrics-tls") pod "dns-default-hbxj8" (UID: "9f53e144-c856-4edf-92a9-bacbe1b5d03e") : secret "dns-default-metrics-tls" not found Jul 06 16:29:18.022102 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:18.022056 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:29:18.085925 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:18.085845 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:29:19.262279 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:19.262246 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:29:19.321298 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:19.321264 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:29:20.551789 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:20.551760 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6zmcw" event={"ID":"7d109c3a-bd70-4cce-bb25-73238bd1f2af","Type":"ContainerStarted","Data":"2880afd3e20352d6137e21d38b8d6ff7939d67daecadd7ce37c399d9fc8f52b5"} Jul 06 16:29:20.554314 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:20.554291 2555 generic.go:356] "Generic (PLEG): container finished" podID="195c23ea-51e7-41ab-ad83-265bb8bdd209" containerID="6ae1605238e885144efe542a0e27baca066526c2fc3e80f36d8b754141ac38a9" exitCode=0 Jul 06 16:29:20.554433 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:20.554343 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4h5nh" event={"ID":"195c23ea-51e7-41ab-ad83-265bb8bdd209","Type":"ContainerDied","Data":"6ae1605238e885144efe542a0e27baca066526c2fc3e80f36d8b754141ac38a9"} Jul 06 16:29:20.566508 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:20.566470 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6zmcw" podStartSLOduration=1.417473953 podStartE2EDuration="6.566457881s" totalImagesPullingTime="5.148983928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:29:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:29:20.565505073 +0000 UTC m=+41.834576110" watchObservedRunningTime="2026-07-06 16:29:20.566457881 +0000 UTC m=+41.835528896" Jul 06 16:29:21.559793 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:21.559758 2555 generic.go:356] "Generic (PLEG): container finished" podID="195c23ea-51e7-41ab-ad83-265bb8bdd209" containerID="8d33341ce7f890554d76712dce50ad130cf3665777217ec80b44d9983bc8c480" exitCode=0 Jul 06 16:29:21.560171 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:21.559840 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4h5nh" event={"ID":"195c23ea-51e7-41ab-ad83-265bb8bdd209","Type":"ContainerDied","Data":"8d33341ce7f890554d76712dce50ad130cf3665777217ec80b44d9983bc8c480"} Jul 06 16:29:21.823649 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:21.823558 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f53e144-c856-4edf-92a9-bacbe1b5d03e-metrics-tls\") pod \"dns-default-hbxj8\" (UID: \"9f53e144-c856-4edf-92a9-bacbe1b5d03e\") " pod="openshift-dns/dns-default-hbxj8" Jul 06 16:29:21.823787 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:21.823698 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 16:29:21.823787 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:21.823759 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f53e144-c856-4edf-92a9-bacbe1b5d03e-metrics-tls podName:9f53e144-c856-4edf-92a9-bacbe1b5d03e nodeName:}" failed. No retries permitted until 2026-07-06 16:29:29.823744524 +0000 UTC m=+51.092815539 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9f53e144-c856-4edf-92a9-bacbe1b5d03e-metrics-tls") pod "dns-default-hbxj8" (UID: "9f53e144-c856-4edf-92a9-bacbe1b5d03e") : secret "dns-default-metrics-tls" not found Jul 06 16:29:22.455579 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:22.455543 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:29:22.519193 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:22.519163 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:29:22.565049 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:22.565014 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4h5nh" event={"ID":"195c23ea-51e7-41ab-ad83-265bb8bdd209","Type":"ContainerStarted","Data":"8da4b49fbf37bc341d006e2cdb49a79da06e0fbd0f4d7f6612a2f4e3147e2a69"} Jul 06 16:29:22.585617 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:22.585565 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4h5nh" podStartSLOduration=15.557564797 podStartE2EDuration="43.585550865s" totalImagesPullingTime="28.027986068s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:28:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:29:22.584725818 +0000 UTC m=+43.853796855" watchObservedRunningTime="2026-07-06 16:29:22.585550865 +0000 UTC m=+43.854621903" Jul 06 16:29:22.708634 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:22.708541 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:29:22.808763 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:22.808723 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:29:29.878905 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:29.878870 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f53e144-c856-4edf-92a9-bacbe1b5d03e-metrics-tls\") pod \"dns-default-hbxj8\" (UID: \"9f53e144-c856-4edf-92a9-bacbe1b5d03e\") " pod="openshift-dns/dns-default-hbxj8" Jul 06 16:29:29.879340 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:29.879044 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 16:29:29.879340 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:29.879114 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f53e144-c856-4edf-92a9-bacbe1b5d03e-metrics-tls podName:9f53e144-c856-4edf-92a9-bacbe1b5d03e nodeName:}" failed. No retries permitted until 2026-07-06 16:29:45.879097527 +0000 UTC m=+67.148168542 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9f53e144-c856-4edf-92a9-bacbe1b5d03e-metrics-tls") pod "dns-default-hbxj8" (UID: "9f53e144-c856-4edf-92a9-bacbe1b5d03e") : secret "dns-default-metrics-tls" not found Jul 06 16:29:31.290447 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:31.290409 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:29:31.348362 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:31.348317 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:29:39.532412 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:39.532386 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tb5t4" Jul 06 16:29:39.686513 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:39.686479 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:29:39.751575 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:39.751540 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:29:43.976629 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:43.976580 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0948aaf4-b68e-4587-9a7c-a71b5fb43dda-metrics-certs\") pod \"network-metrics-daemon-rj9l8\" (UID: \"0948aaf4-b68e-4587-9a7c-a71b5fb43dda\") " pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:29:43.976629 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:43.976635 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc02cd8b-c9cd-4cd1-ae92-184380a1bec2-original-pull-secret\") pod \"global-pull-secret-syncer-k69gf\" (UID: \"bc02cd8b-c9cd-4cd1-ae92-184380a1bec2\") " pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:29:43.979019 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:43.978992 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 16:29:43.979019 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:43.979011 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 16:29:43.986805 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:43.986788 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 16:29:43.986889 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:43.986842 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0948aaf4-b68e-4587-9a7c-a71b5fb43dda-metrics-certs podName:0948aaf4-b68e-4587-9a7c-a71b5fb43dda nodeName:}" failed. No retries permitted until 2026-07-06 16:30:47.986827124 +0000 UTC m=+129.255898139 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0948aaf4-b68e-4587-9a7c-a71b5fb43dda-metrics-certs") pod "network-metrics-daemon-rj9l8" (UID: "0948aaf4-b68e-4587-9a7c-a71b5fb43dda") : secret "metrics-daemon-secret" not found Jul 06 16:29:43.989820 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:43.989802 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bc02cd8b-c9cd-4cd1-ae92-184380a1bec2-original-pull-secret\") pod \"global-pull-secret-syncer-k69gf\" (UID: \"bc02cd8b-c9cd-4cd1-ae92-184380a1bec2\") " pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:29:44.004385 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:44.004361 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k69gf" Jul 06 16:29:44.077585 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:44.077557 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pkqs\" (UniqueName: \"kubernetes.io/projected/50ecbf14-6a55-4051-87de-7cd8cc5ab2ea-kube-api-access-7pkqs\") pod \"network-check-target-4d6qk\" (UID: \"50ecbf14-6a55-4051-87de-7cd8cc5ab2ea\") " pod="openshift-network-diagnostics/network-check-target-4d6qk" Jul 06 16:29:44.080242 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:44.080112 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 16:29:44.090655 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:44.090635 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 16:29:44.101025 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:44.101004 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pkqs\" (UniqueName: \"kubernetes.io/projected/50ecbf14-6a55-4051-87de-7cd8cc5ab2ea-kube-api-access-7pkqs\") pod \"network-check-target-4d6qk\" (UID: \"50ecbf14-6a55-4051-87de-7cd8cc5ab2ea\") " pod="openshift-network-diagnostics/network-check-target-4d6qk" Jul 06 16:29:44.118039 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:44.118016 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jqc2r\"" Jul 06 16:29:44.125821 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:44.125756 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k69gf"] Jul 06 16:29:44.127076 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:44.127056 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4d6qk" Jul 06 16:29:44.129907 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:29:44.129881 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc02cd8b_c9cd_4cd1_ae92_184380a1bec2.slice/crio-6ab97b11e7159d5e74c8544a8bb3868dc9ee86fb49976e71fd33dacf4ad6274b WatchSource:0}: Error finding container 6ab97b11e7159d5e74c8544a8bb3868dc9ee86fb49976e71fd33dacf4ad6274b: Status 404 returned error can't find the container with id 6ab97b11e7159d5e74c8544a8bb3868dc9ee86fb49976e71fd33dacf4ad6274b Jul 06 16:29:44.248580 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:44.248485 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4d6qk"] Jul 06 16:29:44.251727 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:29:44.251704 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50ecbf14_6a55_4051_87de_7cd8cc5ab2ea.slice/crio-ac42e8f1d5c0249a0aa20f2af86c7de6661f0aad063bddbd83c8c17be15d200a WatchSource:0}: Error finding container ac42e8f1d5c0249a0aa20f2af86c7de6661f0aad063bddbd83c8c17be15d200a: Status 404 returned error can't find the container with id ac42e8f1d5c0249a0aa20f2af86c7de6661f0aad063bddbd83c8c17be15d200a Jul 06 16:29:44.616076 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:44.616040 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4d6qk" event={"ID":"50ecbf14-6a55-4051-87de-7cd8cc5ab2ea","Type":"ContainerStarted","Data":"ac42e8f1d5c0249a0aa20f2af86c7de6661f0aad063bddbd83c8c17be15d200a"} Jul 06 16:29:44.616979 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:44.616957 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k69gf" event={"ID":"bc02cd8b-c9cd-4cd1-ae92-184380a1bec2","Type":"ContainerStarted","Data":"6ab97b11e7159d5e74c8544a8bb3868dc9ee86fb49976e71fd33dacf4ad6274b"} Jul 06 16:29:45.408210 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:45.408171 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:29:45.467382 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:45.467345 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:29:45.893168 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:45.893129 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f53e144-c856-4edf-92a9-bacbe1b5d03e-metrics-tls\") pod \"dns-default-hbxj8\" (UID: \"9f53e144-c856-4edf-92a9-bacbe1b5d03e\") " pod="openshift-dns/dns-default-hbxj8" Jul 06 16:29:45.893365 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:45.893261 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 16:29:45.893365 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:29:45.893334 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f53e144-c856-4edf-92a9-bacbe1b5d03e-metrics-tls podName:9f53e144-c856-4edf-92a9-bacbe1b5d03e nodeName:}" failed. No retries permitted until 2026-07-06 16:30:17.893312288 +0000 UTC m=+99.162383305 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9f53e144-c856-4edf-92a9-bacbe1b5d03e-metrics-tls") pod "dns-default-hbxj8" (UID: "9f53e144-c856-4edf-92a9-bacbe1b5d03e") : secret "dns-default-metrics-tls" not found Jul 06 16:29:49.634120 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:49.634062 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4d6qk" event={"ID":"50ecbf14-6a55-4051-87de-7cd8cc5ab2ea","Type":"ContainerStarted","Data":"6b13912271470b23b1da9e4bbb5b89527fb6d2fe666ad6f7242a7461e65fa505"} Jul 06 16:29:49.634568 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:49.634224 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4d6qk" Jul 06 16:29:49.635450 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:49.635415 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k69gf" event={"ID":"bc02cd8b-c9cd-4cd1-ae92-184380a1bec2","Type":"ContainerStarted","Data":"4015dcda83757207fee9b27a84877f2bb4aac3c84bbb75cf6a13839c4db5ff8c"} Jul 06 16:29:49.649771 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:49.649672 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4d6qk" podStartSLOduration=65.639351655 podStartE2EDuration="1m10.649655538s" totalImagesPullingTime="5.010303883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:28:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:29:49.64906185 +0000 UTC m=+70.918132886" watchObservedRunningTime="2026-07-06 16:29:49.649655538 +0000 UTC m=+70.918726577" Jul 06 16:29:49.663302 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:49.663263 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-k69gf" podStartSLOduration=65.533129932 podStartE2EDuration="1m10.663250439s" totalImagesPullingTime="5.130120507s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:28:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:29:49.662535502 +0000 UTC m=+70.931606539" watchObservedRunningTime="2026-07-06 16:29:49.663250439 +0000 UTC m=+70.932321473" Jul 06 16:29:55.746028 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:55.745990 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9449cfc9-p54cd"] Jul 06 16:29:55.748449 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:55.748428 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9449cfc9-p54cd" Jul 06 16:29:55.751841 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:55.751817 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 06 16:29:55.752097 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:55.751857 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 06 16:29:55.752097 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:55.751909 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 06 16:29:55.752575 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:55.752561 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 06 16:29:55.759995 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:55.759975 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71d71176-75ec-4f14-8912-5e8429c13626-tmp\") pod \"klusterlet-addon-workmgr-6b9449cfc9-p54cd\" (UID: \"71d71176-75ec-4f14-8912-5e8429c13626\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9449cfc9-p54cd" Jul 06 16:29:55.760093 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:55.760010 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/71d71176-75ec-4f14-8912-5e8429c13626-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b9449cfc9-p54cd\" (UID: \"71d71176-75ec-4f14-8912-5e8429c13626\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9449cfc9-p54cd" Jul 06 16:29:55.760093 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:55.760039 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnxms\" (UniqueName: \"kubernetes.io/projected/71d71176-75ec-4f14-8912-5e8429c13626-kube-api-access-pnxms\") pod \"klusterlet-addon-workmgr-6b9449cfc9-p54cd\" (UID: \"71d71176-75ec-4f14-8912-5e8429c13626\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9449cfc9-p54cd" Jul 06 16:29:55.762079 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:55.762058 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9449cfc9-p54cd"] Jul 06 16:29:55.861096 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:55.861056 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/71d71176-75ec-4f14-8912-5e8429c13626-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b9449cfc9-p54cd\" (UID: \"71d71176-75ec-4f14-8912-5e8429c13626\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9449cfc9-p54cd" Jul 06 16:29:55.861294 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:55.861119 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnxms\" (UniqueName: \"kubernetes.io/projected/71d71176-75ec-4f14-8912-5e8429c13626-kube-api-access-pnxms\") pod \"klusterlet-addon-workmgr-6b9449cfc9-p54cd\" (UID: \"71d71176-75ec-4f14-8912-5e8429c13626\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9449cfc9-p54cd" Jul 06 16:29:55.861294 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:55.861177 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71d71176-75ec-4f14-8912-5e8429c13626-tmp\") pod \"klusterlet-addon-workmgr-6b9449cfc9-p54cd\" (UID: \"71d71176-75ec-4f14-8912-5e8429c13626\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9449cfc9-p54cd" Jul 06 16:29:55.861586 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:55.861564 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71d71176-75ec-4f14-8912-5e8429c13626-tmp\") pod \"klusterlet-addon-workmgr-6b9449cfc9-p54cd\" (UID: \"71d71176-75ec-4f14-8912-5e8429c13626\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9449cfc9-p54cd" Jul 06 16:29:55.863640 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:55.863619 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/71d71176-75ec-4f14-8912-5e8429c13626-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b9449cfc9-p54cd\" (UID: \"71d71176-75ec-4f14-8912-5e8429c13626\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9449cfc9-p54cd" Jul 06 16:29:55.869766 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:55.869745 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnxms\" (UniqueName: \"kubernetes.io/projected/71d71176-75ec-4f14-8912-5e8429c13626-kube-api-access-pnxms\") pod \"klusterlet-addon-workmgr-6b9449cfc9-p54cd\" (UID: \"71d71176-75ec-4f14-8912-5e8429c13626\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9449cfc9-p54cd" Jul 06 16:29:56.057260 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:56.057229 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9449cfc9-p54cd" Jul 06 16:29:56.184143 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:56.184116 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9449cfc9-p54cd"] Jul 06 16:29:56.187689 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:29:56.187662 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71d71176_75ec_4f14_8912_5e8429c13626.slice/crio-a0c0c146aa639884c5b8075ae5af5c1332de3f3cb407dcfcfde53ebb18d8076e WatchSource:0}: Error finding container a0c0c146aa639884c5b8075ae5af5c1332de3f3cb407dcfcfde53ebb18d8076e: Status 404 returned error can't find the container with id a0c0c146aa639884c5b8075ae5af5c1332de3f3cb407dcfcfde53ebb18d8076e Jul 06 16:29:56.652694 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:29:56.652649 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9449cfc9-p54cd" event={"ID":"71d71176-75ec-4f14-8912-5e8429c13626","Type":"ContainerStarted","Data":"a0c0c146aa639884c5b8075ae5af5c1332de3f3cb407dcfcfde53ebb18d8076e"} Jul 06 16:30:00.665166 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:30:00.665127 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9449cfc9-p54cd" event={"ID":"71d71176-75ec-4f14-8912-5e8429c13626","Type":"ContainerStarted","Data":"7d0b87713c066ea3c27e6015062967f03684d7fab99c4b885a1d432e23b14bfa"} Jul 06 16:30:00.665557 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:30:00.665332 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9449cfc9-p54cd" Jul 06 16:30:00.666864 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:30:00.666840 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9449cfc9-p54cd" Jul 06 16:30:00.681061 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:30:00.681016 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9449cfc9-p54cd" podStartSLOduration=2.129794493 podStartE2EDuration="5.681002878s" totalImagesPullingTime="3.551208385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:29:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:30:00.680290644 +0000 UTC m=+81.949361681" watchObservedRunningTime="2026-07-06 16:30:00.681002878 +0000 UTC m=+81.950073915" Jul 06 16:30:17.914010 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:30:17.913975 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f53e144-c856-4edf-92a9-bacbe1b5d03e-metrics-tls\") pod \"dns-default-hbxj8\" (UID: \"9f53e144-c856-4edf-92a9-bacbe1b5d03e\") " pod="openshift-dns/dns-default-hbxj8" Jul 06 16:30:17.914435 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:30:17.914108 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 16:30:17.914435 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:30:17.914191 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f53e144-c856-4edf-92a9-bacbe1b5d03e-metrics-tls podName:9f53e144-c856-4edf-92a9-bacbe1b5d03e nodeName:}" failed. No retries permitted until 2026-07-06 16:31:21.914175456 +0000 UTC m=+163.183246471 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9f53e144-c856-4edf-92a9-bacbe1b5d03e-metrics-tls") pod "dns-default-hbxj8" (UID: "9f53e144-c856-4edf-92a9-bacbe1b5d03e") : secret "dns-default-metrics-tls" not found Jul 06 16:30:20.640505 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:30:20.640479 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4d6qk" Jul 06 16:30:48.004804 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:30:48.004753 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0948aaf4-b68e-4587-9a7c-a71b5fb43dda-metrics-certs\") pod \"network-metrics-daemon-rj9l8\" (UID: \"0948aaf4-b68e-4587-9a7c-a71b5fb43dda\") " pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:30:48.005322 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:30:48.004912 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 16:30:48.005322 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:30:48.005003 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0948aaf4-b68e-4587-9a7c-a71b5fb43dda-metrics-certs podName:0948aaf4-b68e-4587-9a7c-a71b5fb43dda nodeName:}" failed. No retries permitted until 2026-07-06 16:32:50.00498722 +0000 UTC m=+251.274058234 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0948aaf4-b68e-4587-9a7c-a71b5fb43dda-metrics-certs") pod "network-metrics-daemon-rj9l8" (UID: "0948aaf4-b68e-4587-9a7c-a71b5fb43dda") : secret "metrics-daemon-secret" not found Jul 06 16:31:07.460461 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:31:07.460430 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:31:17.092051 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:31:17.092008 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hbxj8" podUID="9f53e144-c856-4edf-92a9-bacbe1b5d03e" Jul 06 16:31:17.854975 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:31:17.854130 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hbxj8" Jul 06 16:31:18.310201 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:31:18.310171 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-rj9l8" podUID="0948aaf4-b68e-4587-9a7c-a71b5fb43dda" Jul 06 16:31:21.934513 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:31:21.934474 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f53e144-c856-4edf-92a9-bacbe1b5d03e-metrics-tls\") pod \"dns-default-hbxj8\" (UID: \"9f53e144-c856-4edf-92a9-bacbe1b5d03e\") " pod="openshift-dns/dns-default-hbxj8" Jul 06 16:31:21.934990 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:31:21.934620 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 16:31:21.934990 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:31:21.934683 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f53e144-c856-4edf-92a9-bacbe1b5d03e-metrics-tls podName:9f53e144-c856-4edf-92a9-bacbe1b5d03e nodeName:}" failed. No retries permitted until 2026-07-06 16:33:23.934666745 +0000 UTC m=+285.203737761 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9f53e144-c856-4edf-92a9-bacbe1b5d03e-metrics-tls") pod "dns-default-hbxj8" (UID: "9f53e144-c856-4edf-92a9-bacbe1b5d03e") : secret "dns-default-metrics-tls" not found Jul 06 16:31:31.296446 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:31:31.296358 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:31:57.204515 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:31:57.204478 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:31:59.953900 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:31:59.953862 2555 generic.go:356] "Generic (PLEG): container finished" podID="71d71176-75ec-4f14-8912-5e8429c13626" containerID="7d0b87713c066ea3c27e6015062967f03684d7fab99c4b885a1d432e23b14bfa" exitCode=1 Jul 06 16:31:59.954273 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:31:59.953911 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9449cfc9-p54cd" event={"ID":"71d71176-75ec-4f14-8912-5e8429c13626","Type":"ContainerDied","Data":"7d0b87713c066ea3c27e6015062967f03684d7fab99c4b885a1d432e23b14bfa"} Jul 06 16:31:59.954273 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:31:59.954252 2555 scope.go:117] "RemoveContainer" containerID="7d0b87713c066ea3c27e6015062967f03684d7fab99c4b885a1d432e23b14bfa" Jul 06 16:32:00.665759 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:00.665725 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9449cfc9-p54cd" Jul 06 16:32:00.957727 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:00.957638 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9449cfc9-p54cd" event={"ID":"71d71176-75ec-4f14-8912-5e8429c13626","Type":"ContainerStarted","Data":"1ebd9c2d08557e34ffa4f1f3f2956a93429e83782eaa745e2c1812c097cf9c61"} Jul 06 16:32:00.958231 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:00.957900 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9449cfc9-p54cd" Jul 06 16:32:00.958544 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:00.958529 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9449cfc9-p54cd" Jul 06 16:32:25.598811 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.598774 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z9bg9"] Jul 06 16:32:25.600480 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.600463 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z9bg9" Jul 06 16:32:25.602596 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.602567 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 06 16:32:25.602730 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.602637 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 06 16:32:25.602730 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.602671 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 06 16:32:25.602930 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.602913 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 06 16:32:25.603193 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.603179 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-8n9h9\"" Jul 06 16:32:25.606183 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.606154 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-z2jj5"] Jul 06 16:32:25.607975 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.607960 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-z2jj5" Jul 06 16:32:25.609808 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.609792 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 06 16:32:25.610353 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.610332 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 16:32:25.610467 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.610450 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 16:32:25.610565 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.610549 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qkdgm\"" Jul 06 16:32:25.612046 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.612029 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 06 16:32:25.619893 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.619872 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z9bg9"] Jul 06 16:32:25.623462 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.623441 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-z2jj5"] Jul 06 16:32:25.653597 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.653566 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg5bn\" (UniqueName: \"kubernetes.io/projected/a96ad9ee-55e2-46e8-96a1-381dd5af2a2e-kube-api-access-rg5bn\") pod \"kube-storage-version-migrator-operator-846bf668f7-z9bg9\" (UID: \"a96ad9ee-55e2-46e8-96a1-381dd5af2a2e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z9bg9" Jul 06 16:32:25.653597 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.653597 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c3bcfe9c-2960-4edd-99bb-078b967271f9-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-z2jj5\" (UID: \"c3bcfe9c-2960-4edd-99bb-078b967271f9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-z2jj5" Jul 06 16:32:25.653597 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.653615 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3bcfe9c-2960-4edd-99bb-078b967271f9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-z2jj5\" (UID: \"c3bcfe9c-2960-4edd-99bb-078b967271f9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-z2jj5" Jul 06 16:32:25.653861 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.653638 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fq2q\" (UniqueName: \"kubernetes.io/projected/c3bcfe9c-2960-4edd-99bb-078b967271f9-kube-api-access-5fq2q\") pod \"cluster-monitoring-operator-64786d9cbb-z2jj5\" (UID: \"c3bcfe9c-2960-4edd-99bb-078b967271f9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-z2jj5" Jul 06 16:32:25.653861 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.653703 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a96ad9ee-55e2-46e8-96a1-381dd5af2a2e-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-z9bg9\" (UID: \"a96ad9ee-55e2-46e8-96a1-381dd5af2a2e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z9bg9" Jul 06 16:32:25.653861 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.653735 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a96ad9ee-55e2-46e8-96a1-381dd5af2a2e-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-z9bg9\" (UID: \"a96ad9ee-55e2-46e8-96a1-381dd5af2a2e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z9bg9" Jul 06 16:32:25.693532 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.693502 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-847cq"] Jul 06 16:32:25.695584 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.695569 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-847cq" Jul 06 16:32:25.698480 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.698460 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 06 16:32:25.698594 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.698479 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 06 16:32:25.699042 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.699023 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-4hlrh\"" Jul 06 16:32:25.713583 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.713552 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6584475879-hxhhv"] Jul 06 16:32:25.715618 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.715593 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7d69cf4657-pdgx6"] Jul 06 16:32:25.715756 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.715710 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6584475879-hxhhv" Jul 06 16:32:25.717496 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.717473 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-847cq"] Jul 06 16:32:25.717601 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.717571 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7d69cf4657-pdgx6" Jul 06 16:32:25.721906 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.721888 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 16:32:25.722495 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.722478 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 06 16:32:25.722618 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.722527 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 16:32:25.722672 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.722646 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-5bxmf\"" Jul 06 16:32:25.722916 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.722895 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 16:32:25.723059 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.722929 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 06 16:32:25.723059 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.722969 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 16:32:25.723059 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.722972 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 16:32:25.723059 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.722926 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hmcqv\"" Jul 06 16:32:25.723412 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.723396 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 06 16:32:25.724159 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.724146 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 06 16:32:25.729517 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.729496 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 16:32:25.737808 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.737782 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7d69cf4657-pdgx6"] Jul 06 16:32:25.742122 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.742095 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6584475879-hxhhv"] Jul 06 16:32:25.754078 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.754046 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fb33df91-0da5-4f00-bd3a-e47e92c42186-ca-trust-extracted\") pod \"image-registry-6584475879-hxhhv\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " pod="openshift-image-registry/image-registry-6584475879-hxhhv" Jul 06 16:32:25.754078 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.754081 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b3e38ae9-126b-4c58-ac65-3f00859768f4-default-certificate\") pod \"router-default-7d69cf4657-pdgx6\" (UID: \"b3e38ae9-126b-4c58-ac65-3f00859768f4\") " pod="openshift-ingress/router-default-7d69cf4657-pdgx6" Jul 06 16:32:25.754242 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.754101 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fb33df91-0da5-4f00-bd3a-e47e92c42186-registry-tls\") pod \"image-registry-6584475879-hxhhv\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " pod="openshift-image-registry/image-registry-6584475879-hxhhv" Jul 06 16:32:25.754242 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.754197 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg5bn\" (UniqueName: \"kubernetes.io/projected/a96ad9ee-55e2-46e8-96a1-381dd5af2a2e-kube-api-access-rg5bn\") pod \"kube-storage-version-migrator-operator-846bf668f7-z9bg9\" (UID: \"a96ad9ee-55e2-46e8-96a1-381dd5af2a2e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z9bg9" Jul 06 16:32:25.754242 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.754215 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fb33df91-0da5-4f00-bd3a-e47e92c42186-trusted-ca\") pod \"image-registry-6584475879-hxhhv\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " pod="openshift-image-registry/image-registry-6584475879-hxhhv" Jul 06 16:32:25.754242 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.754240 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b3e38ae9-126b-4c58-ac65-3f00859768f4-stats-auth\") pod \"router-default-7d69cf4657-pdgx6\" (UID: \"b3e38ae9-126b-4c58-ac65-3f00859768f4\") " pod="openshift-ingress/router-default-7d69cf4657-pdgx6" Jul 06 16:32:25.754400 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.754258 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6sqw\" (UniqueName: \"kubernetes.io/projected/24f30770-a9ab-418a-bca1-e867f0f905b0-kube-api-access-w6sqw\") pod \"volume-data-source-validator-5d456fdbcd-847cq\" (UID: \"24f30770-a9ab-418a-bca1-e867f0f905b0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-847cq" Jul 06 16:32:25.754400 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.754287 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fq2q\" (UniqueName: \"kubernetes.io/projected/c3bcfe9c-2960-4edd-99bb-078b967271f9-kube-api-access-5fq2q\") pod \"cluster-monitoring-operator-64786d9cbb-z2jj5\" (UID: \"c3bcfe9c-2960-4edd-99bb-078b967271f9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-z2jj5" Jul 06 16:32:25.754400 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.754328 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fb33df91-0da5-4f00-bd3a-e47e92c42186-image-registry-private-configuration\") pod \"image-registry-6584475879-hxhhv\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " pod="openshift-image-registry/image-registry-6584475879-hxhhv" Jul 06 16:32:25.754400 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.754357 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fb33df91-0da5-4f00-bd3a-e47e92c42186-registry-certificates\") pod \"image-registry-6584475879-hxhhv\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " pod="openshift-image-registry/image-registry-6584475879-hxhhv" Jul 06 16:32:25.754400 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.754376 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fb33df91-0da5-4f00-bd3a-e47e92c42186-installation-pull-secrets\") pod \"image-registry-6584475879-hxhhv\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " pod="openshift-image-registry/image-registry-6584475879-hxhhv" Jul 06 16:32:25.754400 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.754394 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnvvt\" (UniqueName: \"kubernetes.io/projected/fb33df91-0da5-4f00-bd3a-e47e92c42186-kube-api-access-gnvvt\") pod \"image-registry-6584475879-hxhhv\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " pod="openshift-image-registry/image-registry-6584475879-hxhhv" Jul 06 16:32:25.754617 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.754472 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3bcfe9c-2960-4edd-99bb-078b967271f9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-z2jj5\" (UID: \"c3bcfe9c-2960-4edd-99bb-078b967271f9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-z2jj5" Jul 06 16:32:25.754617 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.754499 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c3bcfe9c-2960-4edd-99bb-078b967271f9-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-z2jj5\" (UID: \"c3bcfe9c-2960-4edd-99bb-078b967271f9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-z2jj5" Jul 06 16:32:25.754617 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.754524 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3e38ae9-126b-4c58-ac65-3f00859768f4-service-ca-bundle\") pod \"router-default-7d69cf4657-pdgx6\" (UID: \"b3e38ae9-126b-4c58-ac65-3f00859768f4\") " pod="openshift-ingress/router-default-7d69cf4657-pdgx6" Jul 06 16:32:25.754617 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.754563 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a96ad9ee-55e2-46e8-96a1-381dd5af2a2e-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-z9bg9\" (UID: \"a96ad9ee-55e2-46e8-96a1-381dd5af2a2e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z9bg9" Jul 06 16:32:25.754617 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:25.754566 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 16:32:25.754617 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.754580 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a96ad9ee-55e2-46e8-96a1-381dd5af2a2e-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-z9bg9\" (UID: \"a96ad9ee-55e2-46e8-96a1-381dd5af2a2e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z9bg9" Jul 06 16:32:25.754617 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.754596 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3e38ae9-126b-4c58-ac65-3f00859768f4-metrics-certs\") pod \"router-default-7d69cf4657-pdgx6\" (UID: \"b3e38ae9-126b-4c58-ac65-3f00859768f4\") " pod="openshift-ingress/router-default-7d69cf4657-pdgx6" Jul 06 16:32:25.754617 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.754615 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb33df91-0da5-4f00-bd3a-e47e92c42186-bound-sa-token\") pod \"image-registry-6584475879-hxhhv\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " pod="openshift-image-registry/image-registry-6584475879-hxhhv" Jul 06 16:32:25.754906 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:25.754636 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3bcfe9c-2960-4edd-99bb-078b967271f9-cluster-monitoring-operator-tls podName:c3bcfe9c-2960-4edd-99bb-078b967271f9 nodeName:}" failed. No retries permitted until 2026-07-06 16:32:26.254617954 +0000 UTC m=+227.523688984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c3bcfe9c-2960-4edd-99bb-078b967271f9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-z2jj5" (UID: "c3bcfe9c-2960-4edd-99bb-078b967271f9") : secret "cluster-monitoring-operator-tls" not found Jul 06 16:32:25.754906 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.754686 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mclts\" (UniqueName: \"kubernetes.io/projected/b3e38ae9-126b-4c58-ac65-3f00859768f4-kube-api-access-mclts\") pod \"router-default-7d69cf4657-pdgx6\" (UID: \"b3e38ae9-126b-4c58-ac65-3f00859768f4\") " pod="openshift-ingress/router-default-7d69cf4657-pdgx6" Jul 06 16:32:25.755215 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.755198 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c3bcfe9c-2960-4edd-99bb-078b967271f9-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-z2jj5\" (UID: \"c3bcfe9c-2960-4edd-99bb-078b967271f9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-z2jj5" Jul 06 16:32:25.755263 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.755230 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a96ad9ee-55e2-46e8-96a1-381dd5af2a2e-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-z9bg9\" (UID: \"a96ad9ee-55e2-46e8-96a1-381dd5af2a2e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z9bg9" Jul 06 16:32:25.756993 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.756970 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a96ad9ee-55e2-46e8-96a1-381dd5af2a2e-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-z9bg9\" (UID: \"a96ad9ee-55e2-46e8-96a1-381dd5af2a2e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z9bg9" Jul 06 16:32:25.766734 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.766715 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fq2q\" (UniqueName: \"kubernetes.io/projected/c3bcfe9c-2960-4edd-99bb-078b967271f9-kube-api-access-5fq2q\") pod \"cluster-monitoring-operator-64786d9cbb-z2jj5\" (UID: \"c3bcfe9c-2960-4edd-99bb-078b967271f9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-z2jj5" Jul 06 16:32:25.767005 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.766986 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg5bn\" (UniqueName: \"kubernetes.io/projected/a96ad9ee-55e2-46e8-96a1-381dd5af2a2e-kube-api-access-rg5bn\") pod \"kube-storage-version-migrator-operator-846bf668f7-z9bg9\" (UID: \"a96ad9ee-55e2-46e8-96a1-381dd5af2a2e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z9bg9" Jul 06 16:32:25.800195 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.800155 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9h6c5"] Jul 06 16:32:25.803220 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.803196 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9h6c5" Jul 06 16:32:25.805274 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.805253 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 06 16:32:25.805986 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.805970 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 06 16:32:25.805986 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.805978 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 06 16:32:25.806251 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.806060 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-mzcqt\"" Jul 06 16:32:25.806251 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.806246 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 06 16:32:25.814916 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.814891 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9h6c5"] Jul 06 16:32:25.855348 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.855256 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9q9k\" (UniqueName: \"kubernetes.io/projected/971b799f-3189-4871-bb3d-31faf0287f09-kube-api-access-n9q9k\") pod \"service-ca-operator-5d46d9ffd4-9h6c5\" (UID: \"971b799f-3189-4871-bb3d-31faf0287f09\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9h6c5" Jul 06 16:32:25.855348 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.855292 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3e38ae9-126b-4c58-ac65-3f00859768f4-service-ca-bundle\") pod \"router-default-7d69cf4657-pdgx6\" (UID: \"b3e38ae9-126b-4c58-ac65-3f00859768f4\") " pod="openshift-ingress/router-default-7d69cf4657-pdgx6" Jul 06 16:32:25.855348 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.855316 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3e38ae9-126b-4c58-ac65-3f00859768f4-metrics-certs\") pod \"router-default-7d69cf4657-pdgx6\" (UID: \"b3e38ae9-126b-4c58-ac65-3f00859768f4\") " pod="openshift-ingress/router-default-7d69cf4657-pdgx6" Jul 06 16:32:25.855348 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.855333 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb33df91-0da5-4f00-bd3a-e47e92c42186-bound-sa-token\") pod \"image-registry-6584475879-hxhhv\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " pod="openshift-image-registry/image-registry-6584475879-hxhhv" Jul 06 16:32:25.855675 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.855358 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mclts\" (UniqueName: \"kubernetes.io/projected/b3e38ae9-126b-4c58-ac65-3f00859768f4-kube-api-access-mclts\") pod \"router-default-7d69cf4657-pdgx6\" (UID: \"b3e38ae9-126b-4c58-ac65-3f00859768f4\") " pod="openshift-ingress/router-default-7d69cf4657-pdgx6" Jul 06 16:32:25.855675 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.855379 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fb33df91-0da5-4f00-bd3a-e47e92c42186-ca-trust-extracted\") pod \"image-registry-6584475879-hxhhv\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " pod="openshift-image-registry/image-registry-6584475879-hxhhv" Jul 06 16:32:25.855675 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.855398 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b3e38ae9-126b-4c58-ac65-3f00859768f4-default-certificate\") pod \"router-default-7d69cf4657-pdgx6\" (UID: \"b3e38ae9-126b-4c58-ac65-3f00859768f4\") " pod="openshift-ingress/router-default-7d69cf4657-pdgx6" Jul 06 16:32:25.855675 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:25.855403 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 16:32:25.855675 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.855420 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fb33df91-0da5-4f00-bd3a-e47e92c42186-registry-tls\") pod \"image-registry-6584475879-hxhhv\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " pod="openshift-image-registry/image-registry-6584475879-hxhhv" Jul 06 16:32:25.855675 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:25.855463 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3e38ae9-126b-4c58-ac65-3f00859768f4-service-ca-bundle podName:b3e38ae9-126b-4c58-ac65-3f00859768f4 nodeName:}" failed. No retries permitted until 2026-07-06 16:32:26.35543822 +0000 UTC m=+227.624509235 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b3e38ae9-126b-4c58-ac65-3f00859768f4-service-ca-bundle") pod "router-default-7d69cf4657-pdgx6" (UID: "b3e38ae9-126b-4c58-ac65-3f00859768f4") : configmap references non-existent config key: service-ca.crt Jul 06 16:32:25.855675 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:25.855501 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 16:32:25.855675 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:25.855511 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3e38ae9-126b-4c58-ac65-3f00859768f4-metrics-certs podName:b3e38ae9-126b-4c58-ac65-3f00859768f4 nodeName:}" failed. No retries permitted until 2026-07-06 16:32:26.355500097 +0000 UTC m=+227.624571112 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3e38ae9-126b-4c58-ac65-3f00859768f4-metrics-certs") pod "router-default-7d69cf4657-pdgx6" (UID: "b3e38ae9-126b-4c58-ac65-3f00859768f4") : secret "router-metrics-certs-default" not found Jul 06 16:32:25.855675 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:25.855513 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6584475879-hxhhv: secret "image-registry-tls" not found Jul 06 16:32:25.855675 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:25.855565 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb33df91-0da5-4f00-bd3a-e47e92c42186-registry-tls podName:fb33df91-0da5-4f00-bd3a-e47e92c42186 nodeName:}" failed. No retries permitted until 2026-07-06 16:32:26.35554919 +0000 UTC m=+227.624620205 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fb33df91-0da5-4f00-bd3a-e47e92c42186-registry-tls") pod "image-registry-6584475879-hxhhv" (UID: "fb33df91-0da5-4f00-bd3a-e47e92c42186") : secret "image-registry-tls" not found Jul 06 16:32:25.855675 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.855591 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fb33df91-0da5-4f00-bd3a-e47e92c42186-trusted-ca\") pod \"image-registry-6584475879-hxhhv\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " pod="openshift-image-registry/image-registry-6584475879-hxhhv" Jul 06 16:32:25.855675 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.855616 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b3e38ae9-126b-4c58-ac65-3f00859768f4-stats-auth\") pod \"router-default-7d69cf4657-pdgx6\" (UID: \"b3e38ae9-126b-4c58-ac65-3f00859768f4\") " pod="openshift-ingress/router-default-7d69cf4657-pdgx6" Jul 06 16:32:25.855675 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.855641 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/971b799f-3189-4871-bb3d-31faf0287f09-config\") pod \"service-ca-operator-5d46d9ffd4-9h6c5\" (UID: \"971b799f-3189-4871-bb3d-31faf0287f09\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9h6c5" Jul 06 16:32:25.855675 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.855672 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6sqw\" (UniqueName: \"kubernetes.io/projected/24f30770-a9ab-418a-bca1-e867f0f905b0-kube-api-access-w6sqw\") pod \"volume-data-source-validator-5d456fdbcd-847cq\" (UID: \"24f30770-a9ab-418a-bca1-e867f0f905b0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-847cq" Jul 06 16:32:25.856389 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.855703 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fb33df91-0da5-4f00-bd3a-e47e92c42186-image-registry-private-configuration\") pod \"image-registry-6584475879-hxhhv\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " pod="openshift-image-registry/image-registry-6584475879-hxhhv" Jul 06 16:32:25.856389 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.855852 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fb33df91-0da5-4f00-bd3a-e47e92c42186-ca-trust-extracted\") pod \"image-registry-6584475879-hxhhv\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " pod="openshift-image-registry/image-registry-6584475879-hxhhv" Jul 06 16:32:25.856389 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.855899 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fb33df91-0da5-4f00-bd3a-e47e92c42186-registry-certificates\") pod \"image-registry-6584475879-hxhhv\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " pod="openshift-image-registry/image-registry-6584475879-hxhhv" Jul 06 16:32:25.856389 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.855933 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/971b799f-3189-4871-bb3d-31faf0287f09-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-9h6c5\" (UID: \"971b799f-3189-4871-bb3d-31faf0287f09\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9h6c5" Jul 06 16:32:25.856389 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.855981 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fb33df91-0da5-4f00-bd3a-e47e92c42186-installation-pull-secrets\") pod \"image-registry-6584475879-hxhhv\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " pod="openshift-image-registry/image-registry-6584475879-hxhhv" Jul 06 16:32:25.856389 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.855999 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnvvt\" (UniqueName: \"kubernetes.io/projected/fb33df91-0da5-4f00-bd3a-e47e92c42186-kube-api-access-gnvvt\") pod \"image-registry-6584475879-hxhhv\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " pod="openshift-image-registry/image-registry-6584475879-hxhhv" Jul 06 16:32:25.856658 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.856606 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fb33df91-0da5-4f00-bd3a-e47e92c42186-registry-certificates\") pod \"image-registry-6584475879-hxhhv\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " pod="openshift-image-registry/image-registry-6584475879-hxhhv" Jul 06 16:32:25.856960 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.856913 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fb33df91-0da5-4f00-bd3a-e47e92c42186-trusted-ca\") pod \"image-registry-6584475879-hxhhv\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " pod="openshift-image-registry/image-registry-6584475879-hxhhv" Jul 06 16:32:25.858299 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.858273 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b3e38ae9-126b-4c58-ac65-3f00859768f4-default-certificate\") pod \"router-default-7d69cf4657-pdgx6\" (UID: \"b3e38ae9-126b-4c58-ac65-3f00859768f4\") " pod="openshift-ingress/router-default-7d69cf4657-pdgx6" Jul 06 16:32:25.858299 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.858289 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fb33df91-0da5-4f00-bd3a-e47e92c42186-image-registry-private-configuration\") pod \"image-registry-6584475879-hxhhv\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " pod="openshift-image-registry/image-registry-6584475879-hxhhv" Jul 06 16:32:25.858465 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.858390 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fb33df91-0da5-4f00-bd3a-e47e92c42186-installation-pull-secrets\") pod \"image-registry-6584475879-hxhhv\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " pod="openshift-image-registry/image-registry-6584475879-hxhhv" Jul 06 16:32:25.858692 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.858671 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b3e38ae9-126b-4c58-ac65-3f00859768f4-stats-auth\") pod \"router-default-7d69cf4657-pdgx6\" (UID: \"b3e38ae9-126b-4c58-ac65-3f00859768f4\") " pod="openshift-ingress/router-default-7d69cf4657-pdgx6" Jul 06 16:32:25.872290 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.872262 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb33df91-0da5-4f00-bd3a-e47e92c42186-bound-sa-token\") pod \"image-registry-6584475879-hxhhv\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " pod="openshift-image-registry/image-registry-6584475879-hxhhv" Jul 06 16:32:25.872420 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.872355 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mclts\" (UniqueName: \"kubernetes.io/projected/b3e38ae9-126b-4c58-ac65-3f00859768f4-kube-api-access-mclts\") pod \"router-default-7d69cf4657-pdgx6\" (UID: \"b3e38ae9-126b-4c58-ac65-3f00859768f4\") " pod="openshift-ingress/router-default-7d69cf4657-pdgx6" Jul 06 16:32:25.872420 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.872404 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnvvt\" (UniqueName: \"kubernetes.io/projected/fb33df91-0da5-4f00-bd3a-e47e92c42186-kube-api-access-gnvvt\") pod \"image-registry-6584475879-hxhhv\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " pod="openshift-image-registry/image-registry-6584475879-hxhhv" Jul 06 16:32:25.872700 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.872680 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6sqw\" (UniqueName: \"kubernetes.io/projected/24f30770-a9ab-418a-bca1-e867f0f905b0-kube-api-access-w6sqw\") pod \"volume-data-source-validator-5d456fdbcd-847cq\" (UID: \"24f30770-a9ab-418a-bca1-e867f0f905b0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-847cq" Jul 06 16:32:25.894752 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.894721 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:25.909685 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.909660 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z9bg9" Jul 06 16:32:25.957266 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.956997 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/971b799f-3189-4871-bb3d-31faf0287f09-config\") pod \"service-ca-operator-5d46d9ffd4-9h6c5\" (UID: \"971b799f-3189-4871-bb3d-31faf0287f09\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9h6c5" Jul 06 16:32:25.957266 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.957054 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/971b799f-3189-4871-bb3d-31faf0287f09-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-9h6c5\" (UID: \"971b799f-3189-4871-bb3d-31faf0287f09\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9h6c5" Jul 06 16:32:25.957266 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.957130 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9q9k\" (UniqueName: \"kubernetes.io/projected/971b799f-3189-4871-bb3d-31faf0287f09-kube-api-access-n9q9k\") pod \"service-ca-operator-5d46d9ffd4-9h6c5\" (UID: \"971b799f-3189-4871-bb3d-31faf0287f09\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9h6c5" Jul 06 16:32:25.958118 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.957625 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/971b799f-3189-4871-bb3d-31faf0287f09-config\") pod \"service-ca-operator-5d46d9ffd4-9h6c5\" (UID: \"971b799f-3189-4871-bb3d-31faf0287f09\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9h6c5" Jul 06 16:32:25.960131 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.960102 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/971b799f-3189-4871-bb3d-31faf0287f09-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-9h6c5\" (UID: \"971b799f-3189-4871-bb3d-31faf0287f09\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9h6c5" Jul 06 16:32:25.965435 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.965406 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9q9k\" (UniqueName: \"kubernetes.io/projected/971b799f-3189-4871-bb3d-31faf0287f09-kube-api-access-n9q9k\") pod \"service-ca-operator-5d46d9ffd4-9h6c5\" (UID: \"971b799f-3189-4871-bb3d-31faf0287f09\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9h6c5" Jul 06 16:32:25.995304 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:25.995271 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:26.004204 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:26.004056 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-847cq" Jul 06 16:32:26.037685 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:26.037646 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z9bg9"] Jul 06 16:32:26.041852 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:32:26.041824 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda96ad9ee_55e2_46e8_96a1_381dd5af2a2e.slice/crio-bab1bd9277f8a573d7522aa7f083335fc3245fbcaa9cdea76912694deccf7ce7 WatchSource:0}: Error finding container bab1bd9277f8a573d7522aa7f083335fc3245fbcaa9cdea76912694deccf7ce7: Status 404 returned error can't find the container with id bab1bd9277f8a573d7522aa7f083335fc3245fbcaa9cdea76912694deccf7ce7 Jul 06 16:32:26.112377 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:26.112293 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9h6c5" Jul 06 16:32:26.136841 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:26.136799 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-847cq"] Jul 06 16:32:26.140512 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:32:26.140486 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24f30770_a9ab_418a_bca1_e867f0f905b0.slice/crio-dc8c74b35f79d4c40bc980e7a1cca55994c5ca87589e0957d24c8732f6e1a413 WatchSource:0}: Error finding container dc8c74b35f79d4c40bc980e7a1cca55994c5ca87589e0957d24c8732f6e1a413: Status 404 returned error can't find the container with id dc8c74b35f79d4c40bc980e7a1cca55994c5ca87589e0957d24c8732f6e1a413 Jul 06 16:32:26.239223 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:26.239190 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9h6c5"] Jul 06 16:32:26.242074 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:32:26.242048 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod971b799f_3189_4871_bb3d_31faf0287f09.slice/crio-1c1bd61f30fbbbf33e7fdf38a205896d567c136712509fb58d366139563000a1 WatchSource:0}: Error finding container 1c1bd61f30fbbbf33e7fdf38a205896d567c136712509fb58d366139563000a1: Status 404 returned error can't find the container with id 1c1bd61f30fbbbf33e7fdf38a205896d567c136712509fb58d366139563000a1 Jul 06 16:32:26.260913 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:26.260889 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3bcfe9c-2960-4edd-99bb-078b967271f9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-z2jj5\" (UID: \"c3bcfe9c-2960-4edd-99bb-078b967271f9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-z2jj5" Jul 06 16:32:26.261048 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:26.261036 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 16:32:26.261097 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:26.261089 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3bcfe9c-2960-4edd-99bb-078b967271f9-cluster-monitoring-operator-tls podName:c3bcfe9c-2960-4edd-99bb-078b967271f9 nodeName:}" failed. No retries permitted until 2026-07-06 16:32:27.261075275 +0000 UTC m=+228.530146290 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c3bcfe9c-2960-4edd-99bb-078b967271f9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-z2jj5" (UID: "c3bcfe9c-2960-4edd-99bb-078b967271f9") : secret "cluster-monitoring-operator-tls" not found Jul 06 16:32:26.361966 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:26.361905 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3e38ae9-126b-4c58-ac65-3f00859768f4-service-ca-bundle\") pod \"router-default-7d69cf4657-pdgx6\" (UID: \"b3e38ae9-126b-4c58-ac65-3f00859768f4\") " pod="openshift-ingress/router-default-7d69cf4657-pdgx6" Jul 06 16:32:26.361966 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:26.361974 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3e38ae9-126b-4c58-ac65-3f00859768f4-metrics-certs\") pod \"router-default-7d69cf4657-pdgx6\" (UID: \"b3e38ae9-126b-4c58-ac65-3f00859768f4\") " pod="openshift-ingress/router-default-7d69cf4657-pdgx6" Jul 06 16:32:26.362231 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:26.362012 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fb33df91-0da5-4f00-bd3a-e47e92c42186-registry-tls\") pod \"image-registry-6584475879-hxhhv\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " pod="openshift-image-registry/image-registry-6584475879-hxhhv" Jul 06 16:32:26.362231 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:26.362083 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3e38ae9-126b-4c58-ac65-3f00859768f4-service-ca-bundle podName:b3e38ae9-126b-4c58-ac65-3f00859768f4 nodeName:}" failed. No retries permitted until 2026-07-06 16:32:27.362064886 +0000 UTC m=+228.631135923 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b3e38ae9-126b-4c58-ac65-3f00859768f4-service-ca-bundle") pod "router-default-7d69cf4657-pdgx6" (UID: "b3e38ae9-126b-4c58-ac65-3f00859768f4") : configmap references non-existent config key: service-ca.crt Jul 06 16:32:26.362231 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:26.362152 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 16:32:26.362231 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:26.362149 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 16:32:26.362231 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:26.362233 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3e38ae9-126b-4c58-ac65-3f00859768f4-metrics-certs podName:b3e38ae9-126b-4c58-ac65-3f00859768f4 nodeName:}" failed. No retries permitted until 2026-07-06 16:32:27.362212272 +0000 UTC m=+228.631283304 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3e38ae9-126b-4c58-ac65-3f00859768f4-metrics-certs") pod "router-default-7d69cf4657-pdgx6" (UID: "b3e38ae9-126b-4c58-ac65-3f00859768f4") : secret "router-metrics-certs-default" not found Jul 06 16:32:26.362471 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:26.362174 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6584475879-hxhhv: secret "image-registry-tls" not found Jul 06 16:32:26.362471 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:26.362287 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb33df91-0da5-4f00-bd3a-e47e92c42186-registry-tls podName:fb33df91-0da5-4f00-bd3a-e47e92c42186 nodeName:}" failed. No retries permitted until 2026-07-06 16:32:27.362276397 +0000 UTC m=+228.631347432 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fb33df91-0da5-4f00-bd3a-e47e92c42186-registry-tls") pod "image-registry-6584475879-hxhhv" (UID: "fb33df91-0da5-4f00-bd3a-e47e92c42186") : secret "image-registry-tls" not found Jul 06 16:32:26.505203 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:26.505162 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:27.019029 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:27.018993 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9h6c5" event={"ID":"971b799f-3189-4871-bb3d-31faf0287f09","Type":"ContainerStarted","Data":"1c1bd61f30fbbbf33e7fdf38a205896d567c136712509fb58d366139563000a1"} Jul 06 16:32:27.020070 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:27.020047 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z9bg9" event={"ID":"a96ad9ee-55e2-46e8-96a1-381dd5af2a2e","Type":"ContainerStarted","Data":"bab1bd9277f8a573d7522aa7f083335fc3245fbcaa9cdea76912694deccf7ce7"} Jul 06 16:32:27.021051 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:27.021030 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-847cq" event={"ID":"24f30770-a9ab-418a-bca1-e867f0f905b0","Type":"ContainerStarted","Data":"dc8c74b35f79d4c40bc980e7a1cca55994c5ca87589e0957d24c8732f6e1a413"} Jul 06 16:32:27.268504 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:27.268463 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3bcfe9c-2960-4edd-99bb-078b967271f9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-z2jj5\" (UID: \"c3bcfe9c-2960-4edd-99bb-078b967271f9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-z2jj5" Jul 06 16:32:27.268703 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:27.268594 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 16:32:27.268703 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:27.268666 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3bcfe9c-2960-4edd-99bb-078b967271f9-cluster-monitoring-operator-tls podName:c3bcfe9c-2960-4edd-99bb-078b967271f9 nodeName:}" failed. No retries permitted until 2026-07-06 16:32:29.268646686 +0000 UTC m=+230.537717721 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c3bcfe9c-2960-4edd-99bb-078b967271f9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-z2jj5" (UID: "c3bcfe9c-2960-4edd-99bb-078b967271f9") : secret "cluster-monitoring-operator-tls" not found Jul 06 16:32:27.369982 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:27.369923 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fb33df91-0da5-4f00-bd3a-e47e92c42186-registry-tls\") pod \"image-registry-6584475879-hxhhv\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " pod="openshift-image-registry/image-registry-6584475879-hxhhv" Jul 06 16:32:27.370192 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:27.370070 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 16:32:27.370192 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:27.370075 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3e38ae9-126b-4c58-ac65-3f00859768f4-service-ca-bundle\") pod \"router-default-7d69cf4657-pdgx6\" (UID: \"b3e38ae9-126b-4c58-ac65-3f00859768f4\") " pod="openshift-ingress/router-default-7d69cf4657-pdgx6" Jul 06 16:32:27.370192 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:27.370088 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6584475879-hxhhv: secret "image-registry-tls" not found Jul 06 16:32:27.370192 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:27.370110 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3e38ae9-126b-4c58-ac65-3f00859768f4-metrics-certs\") pod \"router-default-7d69cf4657-pdgx6\" (UID: \"b3e38ae9-126b-4c58-ac65-3f00859768f4\") " pod="openshift-ingress/router-default-7d69cf4657-pdgx6" Jul 06 16:32:27.370192 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:27.370148 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb33df91-0da5-4f00-bd3a-e47e92c42186-registry-tls podName:fb33df91-0da5-4f00-bd3a-e47e92c42186 nodeName:}" failed. No retries permitted until 2026-07-06 16:32:29.370130148 +0000 UTC m=+230.639201182 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fb33df91-0da5-4f00-bd3a-e47e92c42186-registry-tls") pod "image-registry-6584475879-hxhhv" (UID: "fb33df91-0da5-4f00-bd3a-e47e92c42186") : secret "image-registry-tls" not found Jul 06 16:32:27.370457 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:27.370216 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 16:32:27.370457 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:27.370274 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3e38ae9-126b-4c58-ac65-3f00859768f4-metrics-certs podName:b3e38ae9-126b-4c58-ac65-3f00859768f4 nodeName:}" failed. No retries permitted until 2026-07-06 16:32:29.370262307 +0000 UTC m=+230.639333325 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3e38ae9-126b-4c58-ac65-3f00859768f4-metrics-certs") pod "router-default-7d69cf4657-pdgx6" (UID: "b3e38ae9-126b-4c58-ac65-3f00859768f4") : secret "router-metrics-certs-default" not found Jul 06 16:32:27.370457 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:27.370333 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3e38ae9-126b-4c58-ac65-3f00859768f4-service-ca-bundle podName:b3e38ae9-126b-4c58-ac65-3f00859768f4 nodeName:}" failed. No retries permitted until 2026-07-06 16:32:29.370323755 +0000 UTC m=+230.639394784 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b3e38ae9-126b-4c58-ac65-3f00859768f4-service-ca-bundle") pod "router-default-7d69cf4657-pdgx6" (UID: "b3e38ae9-126b-4c58-ac65-3f00859768f4") : configmap references non-existent config key: service-ca.crt Jul 06 16:32:28.026551 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:28.026511 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-847cq" event={"ID":"24f30770-a9ab-418a-bca1-e867f0f905b0","Type":"ContainerStarted","Data":"0e2f54e96bf12dad699e64a4d64abdeb3ad6480473956a42d2375a4c6df3e3b9"} Jul 06 16:32:28.040912 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:28.040864 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-847cq" podStartSLOduration=1.676629956 podStartE2EDuration="3.040848077s" totalImagesPullingTime="1.364218121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:32:28.039732304 +0000 UTC m=+229.308803341" watchObservedRunningTime="2026-07-06 16:32:28.040848077 +0000 UTC m=+229.309919113" Jul 06 16:32:28.118323 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:28.118278 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:28.710540 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:28.710502 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:29.031502 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:29.031409 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z9bg9" event={"ID":"a96ad9ee-55e2-46e8-96a1-381dd5af2a2e","Type":"ContainerStarted","Data":"6f244a327a2eafbd45b1cfc1eb5f23062536a4bf4ede46f66d07ae634f817278"} Jul 06 16:32:29.048344 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:29.048290 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z9bg9" podStartSLOduration=1.325745406 podStartE2EDuration="4.048272555s" totalImagesPullingTime="2.722527149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:32:29.047350178 +0000 UTC m=+230.316421215" watchObservedRunningTime="2026-07-06 16:32:29.048272555 +0000 UTC m=+230.317343593" Jul 06 16:32:29.285702 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:29.285609 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3bcfe9c-2960-4edd-99bb-078b967271f9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-z2jj5\" (UID: \"c3bcfe9c-2960-4edd-99bb-078b967271f9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-z2jj5" Jul 06 16:32:29.285844 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:29.285748 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 16:32:29.285844 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:29.285823 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3bcfe9c-2960-4edd-99bb-078b967271f9-cluster-monitoring-operator-tls podName:c3bcfe9c-2960-4edd-99bb-078b967271f9 nodeName:}" failed. No retries permitted until 2026-07-06 16:32:33.285808288 +0000 UTC m=+234.554879302 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c3bcfe9c-2960-4edd-99bb-078b967271f9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-z2jj5" (UID: "c3bcfe9c-2960-4edd-99bb-078b967271f9") : secret "cluster-monitoring-operator-tls" not found Jul 06 16:32:29.386863 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:29.386822 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fb33df91-0da5-4f00-bd3a-e47e92c42186-registry-tls\") pod \"image-registry-6584475879-hxhhv\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " pod="openshift-image-registry/image-registry-6584475879-hxhhv" Jul 06 16:32:29.387057 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:29.386990 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3e38ae9-126b-4c58-ac65-3f00859768f4-service-ca-bundle\") pod \"router-default-7d69cf4657-pdgx6\" (UID: \"b3e38ae9-126b-4c58-ac65-3f00859768f4\") " pod="openshift-ingress/router-default-7d69cf4657-pdgx6" Jul 06 16:32:29.387057 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:29.387021 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3e38ae9-126b-4c58-ac65-3f00859768f4-metrics-certs\") pod \"router-default-7d69cf4657-pdgx6\" (UID: \"b3e38ae9-126b-4c58-ac65-3f00859768f4\") " pod="openshift-ingress/router-default-7d69cf4657-pdgx6" Jul 06 16:32:29.387057 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:29.387034 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 16:32:29.387057 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:29.387059 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6584475879-hxhhv: secret "image-registry-tls" not found Jul 06 16:32:29.387215 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:29.387120 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 16:32:29.387215 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:29.387124 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb33df91-0da5-4f00-bd3a-e47e92c42186-registry-tls podName:fb33df91-0da5-4f00-bd3a-e47e92c42186 nodeName:}" failed. No retries permitted until 2026-07-06 16:32:33.387103479 +0000 UTC m=+234.656174509 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fb33df91-0da5-4f00-bd3a-e47e92c42186-registry-tls") pod "image-registry-6584475879-hxhhv" (UID: "fb33df91-0da5-4f00-bd3a-e47e92c42186") : secret "image-registry-tls" not found Jul 06 16:32:29.387215 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:29.387189 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3e38ae9-126b-4c58-ac65-3f00859768f4-service-ca-bundle podName:b3e38ae9-126b-4c58-ac65-3f00859768f4 nodeName:}" failed. No retries permitted until 2026-07-06 16:32:33.387169058 +0000 UTC m=+234.656240080 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b3e38ae9-126b-4c58-ac65-3f00859768f4-service-ca-bundle") pod "router-default-7d69cf4657-pdgx6" (UID: "b3e38ae9-126b-4c58-ac65-3f00859768f4") : configmap references non-existent config key: service-ca.crt Jul 06 16:32:29.387341 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:29.387219 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3e38ae9-126b-4c58-ac65-3f00859768f4-metrics-certs podName:b3e38ae9-126b-4c58-ac65-3f00859768f4 nodeName:}" failed. No retries permitted until 2026-07-06 16:32:33.387198027 +0000 UTC m=+234.656269048 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3e38ae9-126b-4c58-ac65-3f00859768f4-metrics-certs") pod "router-default-7d69cf4657-pdgx6" (UID: "b3e38ae9-126b-4c58-ac65-3f00859768f4") : secret "router-metrics-certs-default" not found Jul 06 16:32:29.754840 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:29.754735 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:29.853627 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:29.853604 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:29.953481 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:29.953447 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:30.035525 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:30.035443 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9h6c5" event={"ID":"971b799f-3189-4871-bb3d-31faf0287f09","Type":"ContainerStarted","Data":"f2ae24dea300a06044e35cfcb5b81c505eaecda2b43b09a3e41b9742a650cbf7"} Jul 06 16:32:30.050991 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:30.050927 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9h6c5" podStartSLOduration=1.444521017 podStartE2EDuration="5.050907721s" totalImagesPullingTime="3.606386704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:32:30.049915456 +0000 UTC m=+231.318986494" watchObservedRunningTime="2026-07-06 16:32:30.050907721 +0000 UTC m=+231.319978761" Jul 06 16:32:30.894609 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:30.894569 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-t6vgq"] Jul 06 16:32:30.896646 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:30.896631 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t6vgq" Jul 06 16:32:30.901890 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:30.901659 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 16:32:30.901890 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:30.901738 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 16:32:30.901890 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:30.901782 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 16:32:30.902168 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:30.902062 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-285th\"" Jul 06 16:32:30.903456 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:30.903435 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 16:32:30.912369 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:30.912343 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t6vgq"] Jul 06 16:32:30.919984 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:30.919959 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:30.977003 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:30.976973 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:31.002295 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:31.002268 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-crio-socket\") pod \"insights-runtime-extractor-t6vgq\" (UID: \"ee4780a2-31fd-47ce-a3d5-e44d3016ef5d\") " pod="openshift-insights/insights-runtime-extractor-t6vgq" Jul 06 16:32:31.002417 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:31.002332 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t6vgq\" (UID: \"ee4780a2-31fd-47ce-a3d5-e44d3016ef5d\") " pod="openshift-insights/insights-runtime-extractor-t6vgq" Jul 06 16:32:31.002417 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:31.002387 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfjbs\" (UniqueName: \"kubernetes.io/projected/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-kube-api-access-vfjbs\") pod \"insights-runtime-extractor-t6vgq\" (UID: \"ee4780a2-31fd-47ce-a3d5-e44d3016ef5d\") " pod="openshift-insights/insights-runtime-extractor-t6vgq" Jul 06 16:32:31.002521 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:31.002462 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t6vgq\" (UID: \"ee4780a2-31fd-47ce-a3d5-e44d3016ef5d\") " pod="openshift-insights/insights-runtime-extractor-t6vgq" Jul 06 16:32:31.002566 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:31.002517 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-data-volume\") pod \"insights-runtime-extractor-t6vgq\" (UID: \"ee4780a2-31fd-47ce-a3d5-e44d3016ef5d\") " pod="openshift-insights/insights-runtime-extractor-t6vgq" Jul 06 16:32:31.103604 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:31.103572 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-crio-socket\") pod \"insights-runtime-extractor-t6vgq\" (UID: \"ee4780a2-31fd-47ce-a3d5-e44d3016ef5d\") " pod="openshift-insights/insights-runtime-extractor-t6vgq" Jul 06 16:32:31.103999 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:31.103673 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t6vgq\" (UID: \"ee4780a2-31fd-47ce-a3d5-e44d3016ef5d\") " pod="openshift-insights/insights-runtime-extractor-t6vgq" Jul 06 16:32:31.103999 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:31.103696 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-crio-socket\") pod \"insights-runtime-extractor-t6vgq\" (UID: \"ee4780a2-31fd-47ce-a3d5-e44d3016ef5d\") " pod="openshift-insights/insights-runtime-extractor-t6vgq" Jul 06 16:32:31.103999 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:31.103700 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfjbs\" (UniqueName: \"kubernetes.io/projected/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-kube-api-access-vfjbs\") pod \"insights-runtime-extractor-t6vgq\" (UID: \"ee4780a2-31fd-47ce-a3d5-e44d3016ef5d\") " pod="openshift-insights/insights-runtime-extractor-t6vgq" Jul 06 16:32:31.103999 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:31.103790 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 16:32:31.103999 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:31.103817 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t6vgq\" (UID: \"ee4780a2-31fd-47ce-a3d5-e44d3016ef5d\") " pod="openshift-insights/insights-runtime-extractor-t6vgq" Jul 06 16:32:31.103999 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:31.103847 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-insights-runtime-extractor-tls podName:ee4780a2-31fd-47ce-a3d5-e44d3016ef5d nodeName:}" failed. No retries permitted until 2026-07-06 16:32:31.603831016 +0000 UTC m=+232.872902030 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t6vgq" (UID: "ee4780a2-31fd-47ce-a3d5-e44d3016ef5d") : secret "insights-runtime-extractor-tls" not found Jul 06 16:32:31.103999 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:31.103895 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-data-volume\") pod \"insights-runtime-extractor-t6vgq\" (UID: \"ee4780a2-31fd-47ce-a3d5-e44d3016ef5d\") " pod="openshift-insights/insights-runtime-extractor-t6vgq" Jul 06 16:32:31.103999 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:31.103972 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 16:32:31.104272 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:31.104024 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-kube-rbac-proxy-cm podName:ee4780a2-31fd-47ce-a3d5-e44d3016ef5d nodeName:}" failed. No retries permitted until 2026-07-06 16:32:31.604008919 +0000 UTC m=+232.873079949 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t6vgq" (UID: "ee4780a2-31fd-47ce-a3d5-e44d3016ef5d") : configmap "kube-rbac-proxy" not found Jul 06 16:32:31.104272 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:31.104204 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-data-volume\") pod \"insights-runtime-extractor-t6vgq\" (UID: \"ee4780a2-31fd-47ce-a3d5-e44d3016ef5d\") " pod="openshift-insights/insights-runtime-extractor-t6vgq" Jul 06 16:32:31.114082 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:31.114063 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfjbs\" (UniqueName: \"kubernetes.io/projected/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-kube-api-access-vfjbs\") pod \"insights-runtime-extractor-t6vgq\" (UID: \"ee4780a2-31fd-47ce-a3d5-e44d3016ef5d\") " pod="openshift-insights/insights-runtime-extractor-t6vgq" Jul 06 16:32:31.178693 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:31.178615 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:31.230950 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:31.230914 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:31.609192 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:31.609147 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t6vgq\" (UID: \"ee4780a2-31fd-47ce-a3d5-e44d3016ef5d\") " pod="openshift-insights/insights-runtime-extractor-t6vgq" Jul 06 16:32:31.609192 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:31.609214 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t6vgq\" (UID: \"ee4780a2-31fd-47ce-a3d5-e44d3016ef5d\") " pod="openshift-insights/insights-runtime-extractor-t6vgq" Jul 06 16:32:31.609406 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:31.609283 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 16:32:31.609406 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:31.609316 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 16:32:31.609406 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:31.609337 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-kube-rbac-proxy-cm podName:ee4780a2-31fd-47ce-a3d5-e44d3016ef5d nodeName:}" failed. No retries permitted until 2026-07-06 16:32:32.609323517 +0000 UTC m=+233.878394532 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t6vgq" (UID: "ee4780a2-31fd-47ce-a3d5-e44d3016ef5d") : configmap "kube-rbac-proxy" not found Jul 06 16:32:31.609406 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:31.609375 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-insights-runtime-extractor-tls podName:ee4780a2-31fd-47ce-a3d5-e44d3016ef5d nodeName:}" failed. No retries permitted until 2026-07-06 16:32:32.609359777 +0000 UTC m=+233.878430819 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t6vgq" (UID: "ee4780a2-31fd-47ce-a3d5-e44d3016ef5d") : secret "insights-runtime-extractor-tls" not found Jul 06 16:32:31.779445 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:31.779406 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:31.874157 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:31.874073 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:32.617549 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:32.617510 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t6vgq\" (UID: \"ee4780a2-31fd-47ce-a3d5-e44d3016ef5d\") " pod="openshift-insights/insights-runtime-extractor-t6vgq" Jul 06 16:32:32.618059 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:32.617567 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t6vgq\" (UID: \"ee4780a2-31fd-47ce-a3d5-e44d3016ef5d\") " pod="openshift-insights/insights-runtime-extractor-t6vgq" Jul 06 16:32:32.618059 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:32.617654 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 16:32:32.618059 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:32.617663 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 16:32:32.618059 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:32.617716 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-kube-rbac-proxy-cm podName:ee4780a2-31fd-47ce-a3d5-e44d3016ef5d nodeName:}" failed. No retries permitted until 2026-07-06 16:32:34.617701281 +0000 UTC m=+235.886772296 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t6vgq" (UID: "ee4780a2-31fd-47ce-a3d5-e44d3016ef5d") : configmap "kube-rbac-proxy" not found Jul 06 16:32:32.618059 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:32.617728 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-insights-runtime-extractor-tls podName:ee4780a2-31fd-47ce-a3d5-e44d3016ef5d nodeName:}" failed. No retries permitted until 2026-07-06 16:32:34.617723173 +0000 UTC m=+235.886794187 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t6vgq" (UID: "ee4780a2-31fd-47ce-a3d5-e44d3016ef5d") : secret "insights-runtime-extractor-tls" not found Jul 06 16:32:33.323816 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:33.323781 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3bcfe9c-2960-4edd-99bb-078b967271f9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-z2jj5\" (UID: \"c3bcfe9c-2960-4edd-99bb-078b967271f9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-z2jj5" Jul 06 16:32:33.324031 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:33.323968 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 16:32:33.324081 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:33.324034 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3bcfe9c-2960-4edd-99bb-078b967271f9-cluster-monitoring-operator-tls podName:c3bcfe9c-2960-4edd-99bb-078b967271f9 nodeName:}" failed. No retries permitted until 2026-07-06 16:32:41.324018049 +0000 UTC m=+242.593089067 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c3bcfe9c-2960-4edd-99bb-078b967271f9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-z2jj5" (UID: "c3bcfe9c-2960-4edd-99bb-078b967271f9") : secret "cluster-monitoring-operator-tls" not found Jul 06 16:32:33.424785 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:33.424749 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3e38ae9-126b-4c58-ac65-3f00859768f4-service-ca-bundle\") pod \"router-default-7d69cf4657-pdgx6\" (UID: \"b3e38ae9-126b-4c58-ac65-3f00859768f4\") " pod="openshift-ingress/router-default-7d69cf4657-pdgx6" Jul 06 16:32:33.424785 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:33.424791 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3e38ae9-126b-4c58-ac65-3f00859768f4-metrics-certs\") pod \"router-default-7d69cf4657-pdgx6\" (UID: \"b3e38ae9-126b-4c58-ac65-3f00859768f4\") " pod="openshift-ingress/router-default-7d69cf4657-pdgx6" Jul 06 16:32:33.425029 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:33.424821 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fb33df91-0da5-4f00-bd3a-e47e92c42186-registry-tls\") pod \"image-registry-6584475879-hxhhv\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " pod="openshift-image-registry/image-registry-6584475879-hxhhv" Jul 06 16:32:33.425029 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:33.424921 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 16:32:33.425029 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:33.424931 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 16:32:33.425029 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:33.424965 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6584475879-hxhhv: secret "image-registry-tls" not found Jul 06 16:32:33.425029 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:33.424969 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3e38ae9-126b-4c58-ac65-3f00859768f4-service-ca-bundle podName:b3e38ae9-126b-4c58-ac65-3f00859768f4 nodeName:}" failed. No retries permitted until 2026-07-06 16:32:41.424927806 +0000 UTC m=+242.693998822 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b3e38ae9-126b-4c58-ac65-3f00859768f4-service-ca-bundle") pod "router-default-7d69cf4657-pdgx6" (UID: "b3e38ae9-126b-4c58-ac65-3f00859768f4") : configmap references non-existent config key: service-ca.crt Jul 06 16:32:33.425029 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:33.424993 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3e38ae9-126b-4c58-ac65-3f00859768f4-metrics-certs podName:b3e38ae9-126b-4c58-ac65-3f00859768f4 nodeName:}" failed. No retries permitted until 2026-07-06 16:32:41.424980658 +0000 UTC m=+242.694051693 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3e38ae9-126b-4c58-ac65-3f00859768f4-metrics-certs") pod "router-default-7d69cf4657-pdgx6" (UID: "b3e38ae9-126b-4c58-ac65-3f00859768f4") : secret "router-metrics-certs-default" not found Jul 06 16:32:33.425029 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:33.425008 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb33df91-0da5-4f00-bd3a-e47e92c42186-registry-tls podName:fb33df91-0da5-4f00-bd3a-e47e92c42186 nodeName:}" failed. No retries permitted until 2026-07-06 16:32:41.425000958 +0000 UTC m=+242.694071977 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fb33df91-0da5-4f00-bd3a-e47e92c42186-registry-tls") pod "image-registry-6584475879-hxhhv" (UID: "fb33df91-0da5-4f00-bd3a-e47e92c42186") : secret "image-registry-tls" not found Jul 06 16:32:33.875518 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:33.875489 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qq68r_3ceed420-7d00-4dc3-85fd-0fe2db980e33/dns-node-resolver/0.log" Jul 06 16:32:34.636797 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:34.636760 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t6vgq\" (UID: \"ee4780a2-31fd-47ce-a3d5-e44d3016ef5d\") " pod="openshift-insights/insights-runtime-extractor-t6vgq" Jul 06 16:32:34.637008 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:34.636813 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t6vgq\" (UID: \"ee4780a2-31fd-47ce-a3d5-e44d3016ef5d\") " pod="openshift-insights/insights-runtime-extractor-t6vgq" Jul 06 16:32:34.637008 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:34.636888 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 16:32:34.637008 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:34.636921 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 16:32:34.637008 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:34.636963 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-kube-rbac-proxy-cm podName:ee4780a2-31fd-47ce-a3d5-e44d3016ef5d nodeName:}" failed. No retries permitted until 2026-07-06 16:32:38.636927533 +0000 UTC m=+239.905998547 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t6vgq" (UID: "ee4780a2-31fd-47ce-a3d5-e44d3016ef5d") : configmap "kube-rbac-proxy" not found Jul 06 16:32:34.637155 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:34.637010 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-insights-runtime-extractor-tls podName:ee4780a2-31fd-47ce-a3d5-e44d3016ef5d nodeName:}" failed. No retries permitted until 2026-07-06 16:32:38.63699272 +0000 UTC m=+239.906063735 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t6vgq" (UID: "ee4780a2-31fd-47ce-a3d5-e44d3016ef5d") : secret "insights-runtime-extractor-tls" not found Jul 06 16:32:34.677890 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:34.677856 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4r7fj_e2070c7e-34d0-42d4-a85a-aea1b7d4e08c/node-ca/0.log" Jul 06 16:32:35.476430 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:35.476400 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6zmcw_7d109c3a-bd70-4cce-bb25-73238bd1f2af/serve-healthcheck-canary/0.log" Jul 06 16:32:36.280074 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:36.280037 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-z9bg9_a96ad9ee-55e2-46e8-96a1-381dd5af2a2e/kube-storage-version-migrator-operator/0.log" Jul 06 16:32:37.178385 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:37.178355 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:37.726992 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:37.726954 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:38.299406 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:38.299368 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:38.397688 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:38.397652 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:38.497683 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:38.497645 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:38.670631 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:38.670519 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t6vgq\" (UID: \"ee4780a2-31fd-47ce-a3d5-e44d3016ef5d\") " pod="openshift-insights/insights-runtime-extractor-t6vgq" Jul 06 16:32:38.670631 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:38.670589 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t6vgq\" (UID: \"ee4780a2-31fd-47ce-a3d5-e44d3016ef5d\") " pod="openshift-insights/insights-runtime-extractor-t6vgq" Jul 06 16:32:38.670856 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:38.670682 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 16:32:38.670856 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:38.670691 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 16:32:38.670856 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:38.670758 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-kube-rbac-proxy-cm podName:ee4780a2-31fd-47ce-a3d5-e44d3016ef5d nodeName:}" failed. No retries permitted until 2026-07-06 16:32:46.670742692 +0000 UTC m=+247.939813706 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t6vgq" (UID: "ee4780a2-31fd-47ce-a3d5-e44d3016ef5d") : configmap "kube-rbac-proxy" not found Jul 06 16:32:38.670856 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:38.670774 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-insights-runtime-extractor-tls podName:ee4780a2-31fd-47ce-a3d5-e44d3016ef5d nodeName:}" failed. No retries permitted until 2026-07-06 16:32:46.670768024 +0000 UTC m=+247.939839038 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t6vgq" (UID: "ee4780a2-31fd-47ce-a3d5-e44d3016ef5d") : secret "insights-runtime-extractor-tls" not found Jul 06 16:32:39.021656 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:39.021581 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:39.089734 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:39.089707 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:39.992891 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:39.992850 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:40.192035 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:40.191999 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:40.394177 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:40.394137 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:40.592737 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:40.592704 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:40.998340 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:40.998307 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:41.396304 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:41.396265 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3bcfe9c-2960-4edd-99bb-078b967271f9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-z2jj5\" (UID: \"c3bcfe9c-2960-4edd-99bb-078b967271f9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-z2jj5" Jul 06 16:32:41.396526 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:41.396363 2555 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 16:32:41.396526 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:41.396417 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3bcfe9c-2960-4edd-99bb-078b967271f9-cluster-monitoring-operator-tls podName:c3bcfe9c-2960-4edd-99bb-078b967271f9 nodeName:}" failed. No retries permitted until 2026-07-06 16:32:57.396403027 +0000 UTC m=+258.665474042 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c3bcfe9c-2960-4edd-99bb-078b967271f9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-z2jj5" (UID: "c3bcfe9c-2960-4edd-99bb-078b967271f9") : secret "cluster-monitoring-operator-tls" not found Jul 06 16:32:41.497124 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:41.497090 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3e38ae9-126b-4c58-ac65-3f00859768f4-service-ca-bundle\") pod \"router-default-7d69cf4657-pdgx6\" (UID: \"b3e38ae9-126b-4c58-ac65-3f00859768f4\") " pod="openshift-ingress/router-default-7d69cf4657-pdgx6" Jul 06 16:32:41.497265 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:41.497132 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3e38ae9-126b-4c58-ac65-3f00859768f4-metrics-certs\") pod \"router-default-7d69cf4657-pdgx6\" (UID: \"b3e38ae9-126b-4c58-ac65-3f00859768f4\") " pod="openshift-ingress/router-default-7d69cf4657-pdgx6" Jul 06 16:32:41.497265 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:41.497224 2555 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 16:32:41.497265 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:41.497251 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3e38ae9-126b-4c58-ac65-3f00859768f4-service-ca-bundle podName:b3e38ae9-126b-4c58-ac65-3f00859768f4 nodeName:}" failed. No retries permitted until 2026-07-06 16:32:57.497234264 +0000 UTC m=+258.766305279 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b3e38ae9-126b-4c58-ac65-3f00859768f4-service-ca-bundle") pod "router-default-7d69cf4657-pdgx6" (UID: "b3e38ae9-126b-4c58-ac65-3f00859768f4") : configmap references non-existent config key: service-ca.crt Jul 06 16:32:41.497423 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:41.497280 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fb33df91-0da5-4f00-bd3a-e47e92c42186-registry-tls\") pod \"image-registry-6584475879-hxhhv\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " pod="openshift-image-registry/image-registry-6584475879-hxhhv" Jul 06 16:32:41.497423 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:41.497362 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3e38ae9-126b-4c58-ac65-3f00859768f4-metrics-certs podName:b3e38ae9-126b-4c58-ac65-3f00859768f4 nodeName:}" failed. No retries permitted until 2026-07-06 16:32:57.497350838 +0000 UTC m=+258.766421857 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b3e38ae9-126b-4c58-ac65-3f00859768f4-metrics-certs") pod "router-default-7d69cf4657-pdgx6" (UID: "b3e38ae9-126b-4c58-ac65-3f00859768f4") : secret "router-metrics-certs-default" not found Jul 06 16:32:41.497423 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:41.497393 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 16:32:41.497423 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:41.497410 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6584475879-hxhhv: secret "image-registry-tls" not found Jul 06 16:32:41.497576 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:41.497482 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fb33df91-0da5-4f00-bd3a-e47e92c42186-registry-tls podName:fb33df91-0da5-4f00-bd3a-e47e92c42186 nodeName:}" failed. No retries permitted until 2026-07-06 16:32:57.497465259 +0000 UTC m=+258.766536276 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fb33df91-0da5-4f00-bd3a-e47e92c42186-registry-tls") pod "image-registry-6584475879-hxhhv" (UID: "fb33df91-0da5-4f00-bd3a-e47e92c42186") : secret "image-registry-tls" not found Jul 06 16:32:41.788059 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:41.787960 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:41.986028 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:41.985994 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:42.187136 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:42.187099 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:42.240075 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:42.240043 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:42.559905 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:42.559871 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:42.784926 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:42.784895 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:43.001970 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:43.001873 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:44.029318 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:44.029288 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:44.087099 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:44.087045 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:44.185297 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:44.185263 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:44.390366 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:44.390335 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:44.970023 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:44.969988 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:45.028212 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:45.028178 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:45.592709 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:45.592679 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:46.187963 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:46.187906 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:46.289023 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:46.288990 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:46.390510 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:46.390477 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:46.738431 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:46.738383 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t6vgq\" (UID: \"ee4780a2-31fd-47ce-a3d5-e44d3016ef5d\") " pod="openshift-insights/insights-runtime-extractor-t6vgq" Jul 06 16:32:46.738834 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:46.738462 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t6vgq\" (UID: \"ee4780a2-31fd-47ce-a3d5-e44d3016ef5d\") " pod="openshift-insights/insights-runtime-extractor-t6vgq" Jul 06 16:32:46.738834 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:46.738550 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 16:32:46.738834 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:46.738636 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-insights-runtime-extractor-tls podName:ee4780a2-31fd-47ce-a3d5-e44d3016ef5d nodeName:}" failed. No retries permitted until 2026-07-06 16:33:02.738617694 +0000 UTC m=+264.007688729 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t6vgq" (UID: "ee4780a2-31fd-47ce-a3d5-e44d3016ef5d") : secret "insights-runtime-extractor-tls" not found Jul 06 16:32:46.738998 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:46.738982 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t6vgq\" (UID: \"ee4780a2-31fd-47ce-a3d5-e44d3016ef5d\") " pod="openshift-insights/insights-runtime-extractor-t6vgq" Jul 06 16:32:47.006001 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:47.005906 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:47.585008 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:47.584929 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:48.228264 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:48.228233 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:48.283067 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:48.283038 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:48.386812 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:48.386783 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:48.866804 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:48.866773 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:49.403959 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:49.403918 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:49.453988 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:49.453957 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:50.063501 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:50.063457 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0948aaf4-b68e-4587-9a7c-a71b5fb43dda-metrics-certs\") pod \"network-metrics-daemon-rj9l8\" (UID: \"0948aaf4-b68e-4587-9a7c-a71b5fb43dda\") " pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:32:50.065820 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:50.065795 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0948aaf4-b68e-4587-9a7c-a71b5fb43dda-metrics-certs\") pod \"network-metrics-daemon-rj9l8\" (UID: \"0948aaf4-b68e-4587-9a7c-a71b5fb43dda\") " pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:32:50.199074 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:50.199043 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jhwls\"" Jul 06 16:32:50.207673 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:50.207652 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rj9l8" Jul 06 16:32:50.329656 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:50.329581 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rj9l8"] Jul 06 16:32:50.333180 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:32:50.333157 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0948aaf4_b68e_4587_9a7c_a71b5fb43dda.slice/crio-73083b956325e26394fe5206d5cb97c38935c974d2b35872c3b091a32a84c019 WatchSource:0}: Error finding container 73083b956325e26394fe5206d5cb97c38935c974d2b35872c3b091a32a84c019: Status 404 returned error can't find the container with id 73083b956325e26394fe5206d5cb97c38935c974d2b35872c3b091a32a84c019 Jul 06 16:32:51.098742 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:51.098705 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rj9l8" event={"ID":"0948aaf4-b68e-4587-9a7c-a71b5fb43dda","Type":"ContainerStarted","Data":"73083b956325e26394fe5206d5cb97c38935c974d2b35872c3b091a32a84c019"} Jul 06 16:32:51.394340 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:51.394242 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:51.491900 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:51.491868 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:51.591844 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:51.591808 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:51.692001 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:51.691888 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:52.088091 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:52.088054 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:52.104901 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:52.103992 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rj9l8" event={"ID":"0948aaf4-b68e-4587-9a7c-a71b5fb43dda","Type":"ContainerStarted","Data":"7aeec24b83435b3186f070245e152c875707bfdad516120128d76adb64796a7b"} Jul 06 16:32:52.104901 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:52.104053 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rj9l8" event={"ID":"0948aaf4-b68e-4587-9a7c-a71b5fb43dda","Type":"ContainerStarted","Data":"d2e53f9e19f05b36548e003cc284faa353cd04d7746ed884bd71dc3b07a4db49"} Jul 06 16:32:52.120485 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:52.120437 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rj9l8" podStartSLOduration=252.008012901 podStartE2EDuration="4m13.120423172s" totalImagesPullingTime="1.112410271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:28:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:32:52.119700618 +0000 UTC m=+253.388771656" watchObservedRunningTime="2026-07-06 16:32:52.120423172 +0000 UTC m=+253.389494209" Jul 06 16:32:52.146313 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:52.146284 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:52.516040 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:52.515926 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:52.591438 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:52.591398 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6584475879-hxhhv"] Jul 06 16:32:52.591685 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:32:52.591658 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-6584475879-hxhhv" podUID="fb33df91-0da5-4f00-bd3a-e47e92c42186" Jul 06 16:32:52.606202 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:52.606168 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-mf8hj"] Jul 06 16:32:52.608415 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:52.608396 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-mf8hj" Jul 06 16:32:52.610511 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:52.610486 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 16:32:52.610618 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:52.610573 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-xfbks\"" Jul 06 16:32:52.610801 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:52.610789 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 16:32:52.623110 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:52.623090 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-mf8hj"] Jul 06 16:32:52.623861 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:52.623835 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:52.684470 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:52.684434 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfhzw\" (UniqueName: \"kubernetes.io/projected/a4b49e16-f55c-42e6-971d-cad8ebfde1fe-kube-api-access-rfhzw\") pod \"downloads-685bfb5f64-mf8hj\" (UID: \"a4b49e16-f55c-42e6-971d-cad8ebfde1fe\") " pod="openshift-console/downloads-685bfb5f64-mf8hj" Jul 06 16:32:52.750563 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:52.750532 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:52.784891 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:52.784803 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfhzw\" (UniqueName: \"kubernetes.io/projected/a4b49e16-f55c-42e6-971d-cad8ebfde1fe-kube-api-access-rfhzw\") pod \"downloads-685bfb5f64-mf8hj\" (UID: \"a4b49e16-f55c-42e6-971d-cad8ebfde1fe\") " pod="openshift-console/downloads-685bfb5f64-mf8hj" Jul 06 16:32:52.792825 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:52.792802 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfhzw\" (UniqueName: \"kubernetes.io/projected/a4b49e16-f55c-42e6-971d-cad8ebfde1fe-kube-api-access-rfhzw\") pod \"downloads-685bfb5f64-mf8hj\" (UID: \"a4b49e16-f55c-42e6-971d-cad8ebfde1fe\") " pod="openshift-console/downloads-685bfb5f64-mf8hj" Jul 06 16:32:52.848087 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:52.848050 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:52.917217 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:52.917180 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-mf8hj" Jul 06 16:32:53.040815 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:53.040731 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-mf8hj"] Jul 06 16:32:53.043904 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:32:53.043863 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4b49e16_f55c_42e6_971d_cad8ebfde1fe.slice/crio-eee5fae7f2055e7b5b46a666d132576fb0bad91fa9903bf8b0a38284ad46552e WatchSource:0}: Error finding container eee5fae7f2055e7b5b46a666d132576fb0bad91fa9903bf8b0a38284ad46552e: Status 404 returned error can't find the container with id eee5fae7f2055e7b5b46a666d132576fb0bad91fa9903bf8b0a38284ad46552e Jul 06 16:32:53.078776 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:53.078744 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:53.108338 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:53.108307 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-mf8hj" event={"ID":"a4b49e16-f55c-42e6-971d-cad8ebfde1fe","Type":"ContainerStarted","Data":"eee5fae7f2055e7b5b46a666d132576fb0bad91fa9903bf8b0a38284ad46552e"} Jul 06 16:32:53.108781 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:53.108476 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6584475879-hxhhv" Jul 06 16:32:53.114440 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:53.114423 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6584475879-hxhhv" Jul 06 16:32:53.187989 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:53.187936 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fb33df91-0da5-4f00-bd3a-e47e92c42186-trusted-ca\") pod \"fb33df91-0da5-4f00-bd3a-e47e92c42186\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " Jul 06 16:32:53.187989 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:53.187992 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fb33df91-0da5-4f00-bd3a-e47e92c42186-installation-pull-secrets\") pod \"fb33df91-0da5-4f00-bd3a-e47e92c42186\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " Jul 06 16:32:53.188244 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:53.188021 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb33df91-0da5-4f00-bd3a-e47e92c42186-bound-sa-token\") pod \"fb33df91-0da5-4f00-bd3a-e47e92c42186\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " Jul 06 16:32:53.188244 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:53.188052 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fb33df91-0da5-4f00-bd3a-e47e92c42186-image-registry-private-configuration\") pod \"fb33df91-0da5-4f00-bd3a-e47e92c42186\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " Jul 06 16:32:53.188244 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:53.188072 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fb33df91-0da5-4f00-bd3a-e47e92c42186-registry-certificates\") pod \"fb33df91-0da5-4f00-bd3a-e47e92c42186\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " Jul 06 16:32:53.188244 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:53.188217 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fb33df91-0da5-4f00-bd3a-e47e92c42186-ca-trust-extracted\") pod \"fb33df91-0da5-4f00-bd3a-e47e92c42186\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " Jul 06 16:32:53.188440 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:53.188310 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnvvt\" (UniqueName: \"kubernetes.io/projected/fb33df91-0da5-4f00-bd3a-e47e92c42186-kube-api-access-gnvvt\") pod \"fb33df91-0da5-4f00-bd3a-e47e92c42186\" (UID: \"fb33df91-0da5-4f00-bd3a-e47e92c42186\") " Jul 06 16:32:53.188440 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:53.188409 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb33df91-0da5-4f00-bd3a-e47e92c42186-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "fb33df91-0da5-4f00-bd3a-e47e92c42186" (UID: "fb33df91-0da5-4f00-bd3a-e47e92c42186"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 16:32:53.188529 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:53.188441 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb33df91-0da5-4f00-bd3a-e47e92c42186-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "fb33df91-0da5-4f00-bd3a-e47e92c42186" (UID: "fb33df91-0da5-4f00-bd3a-e47e92c42186"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 16:32:53.188675 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:53.188619 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb33df91-0da5-4f00-bd3a-e47e92c42186-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "fb33df91-0da5-4f00-bd3a-e47e92c42186" (UID: "fb33df91-0da5-4f00-bd3a-e47e92c42186"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 16:32:53.188767 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:53.188746 2555 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fb33df91-0da5-4f00-bd3a-e47e92c42186-registry-certificates\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:32:53.188847 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:53.188768 2555 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fb33df91-0da5-4f00-bd3a-e47e92c42186-ca-trust-extracted\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:32:53.188847 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:53.188783 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fb33df91-0da5-4f00-bd3a-e47e92c42186-trusted-ca\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:32:53.190573 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:53.190547 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb33df91-0da5-4f00-bd3a-e47e92c42186-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "fb33df91-0da5-4f00-bd3a-e47e92c42186" (UID: "fb33df91-0da5-4f00-bd3a-e47e92c42186"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 16:32:53.190670 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:53.190595 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb33df91-0da5-4f00-bd3a-e47e92c42186-kube-api-access-gnvvt" (OuterVolumeSpecName: "kube-api-access-gnvvt") pod "fb33df91-0da5-4f00-bd3a-e47e92c42186" (UID: "fb33df91-0da5-4f00-bd3a-e47e92c42186"). InnerVolumeSpecName "kube-api-access-gnvvt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 16:32:53.190762 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:53.190740 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb33df91-0da5-4f00-bd3a-e47e92c42186-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "fb33df91-0da5-4f00-bd3a-e47e92c42186" (UID: "fb33df91-0da5-4f00-bd3a-e47e92c42186"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 16:32:53.190762 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:53.190747 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb33df91-0da5-4f00-bd3a-e47e92c42186-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "fb33df91-0da5-4f00-bd3a-e47e92c42186" (UID: "fb33df91-0da5-4f00-bd3a-e47e92c42186"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 16:32:53.282330 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:53.282294 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:53.289267 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:53.289247 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnvvt\" (UniqueName: \"kubernetes.io/projected/fb33df91-0da5-4f00-bd3a-e47e92c42186-kube-api-access-gnvvt\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:32:53.289267 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:53.289267 2555 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fb33df91-0da5-4f00-bd3a-e47e92c42186-installation-pull-secrets\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:32:53.289350 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:53.289278 2555 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb33df91-0da5-4f00-bd3a-e47e92c42186-bound-sa-token\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:32:53.289350 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:53.289289 2555 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fb33df91-0da5-4f00-bd3a-e47e92c42186-image-registry-private-configuration\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:32:53.711683 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:53.711599 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:54.115106 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:54.112449 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6584475879-hxhhv" Jul 06 16:32:54.139816 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:54.139785 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6584475879-hxhhv"] Jul 06 16:32:54.143798 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:54.143771 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6584475879-hxhhv"] Jul 06 16:32:54.198473 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:54.198446 2555 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fb33df91-0da5-4f00-bd3a-e47e92c42186-registry-tls\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:32:54.311111 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:54.311069 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:54.412351 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:54.412263 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:54.617975 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:54.617925 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:54.678745 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:54.678655 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:55.299802 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:55.299765 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb33df91-0da5-4f00-bd3a-e47e92c42186" path="/var/lib/kubelet/pods/fb33df91-0da5-4f00-bd3a-e47e92c42186/volumes" Jul 06 16:32:57.018327 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:57.018277 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:57.086197 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:57.086157 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:32:57.427955 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:57.427914 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3bcfe9c-2960-4edd-99bb-078b967271f9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-z2jj5\" (UID: \"c3bcfe9c-2960-4edd-99bb-078b967271f9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-z2jj5" Jul 06 16:32:57.430782 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:57.430750 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3bcfe9c-2960-4edd-99bb-078b967271f9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-z2jj5\" (UID: \"c3bcfe9c-2960-4edd-99bb-078b967271f9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-z2jj5" Jul 06 16:32:57.528750 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:57.528624 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3e38ae9-126b-4c58-ac65-3f00859768f4-service-ca-bundle\") pod \"router-default-7d69cf4657-pdgx6\" (UID: \"b3e38ae9-126b-4c58-ac65-3f00859768f4\") " pod="openshift-ingress/router-default-7d69cf4657-pdgx6" Jul 06 16:32:57.528750 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:57.528694 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3e38ae9-126b-4c58-ac65-3f00859768f4-metrics-certs\") pod \"router-default-7d69cf4657-pdgx6\" (UID: \"b3e38ae9-126b-4c58-ac65-3f00859768f4\") " pod="openshift-ingress/router-default-7d69cf4657-pdgx6" Jul 06 16:32:57.529677 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:57.529650 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3e38ae9-126b-4c58-ac65-3f00859768f4-service-ca-bundle\") pod \"router-default-7d69cf4657-pdgx6\" (UID: \"b3e38ae9-126b-4c58-ac65-3f00859768f4\") " pod="openshift-ingress/router-default-7d69cf4657-pdgx6" Jul 06 16:32:57.531555 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:57.531526 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3e38ae9-126b-4c58-ac65-3f00859768f4-metrics-certs\") pod \"router-default-7d69cf4657-pdgx6\" (UID: \"b3e38ae9-126b-4c58-ac65-3f00859768f4\") " pod="openshift-ingress/router-default-7d69cf4657-pdgx6" Jul 06 16:32:57.717593 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:57.717524 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qkdgm\"" Jul 06 16:32:57.726207 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:57.726170 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-z2jj5" Jul 06 16:32:57.835183 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:57.835159 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-5bxmf\"" Jul 06 16:32:57.842120 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:57.842095 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7d69cf4657-pdgx6" Jul 06 16:32:57.873316 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:57.873283 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-z2jj5"] Jul 06 16:32:57.876719 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:32:57.876690 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3bcfe9c_2960_4edd_99bb_078b967271f9.slice/crio-7cd3c5ff5837badbed9c9b6376cc940929ab4d79b749cb6acd36b03de2790530 WatchSource:0}: Error finding container 7cd3c5ff5837badbed9c9b6376cc940929ab4d79b749cb6acd36b03de2790530: Status 404 returned error can't find the container with id 7cd3c5ff5837badbed9c9b6376cc940929ab4d79b749cb6acd36b03de2790530 Jul 06 16:32:57.989319 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:57.989236 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7d69cf4657-pdgx6"] Jul 06 16:32:57.991788 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:32:57.991762 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3e38ae9_126b_4c58_ac65_3f00859768f4.slice/crio-001550f6b8ccb717e13a769ca2a812d3e45e3edfd705b9e7175a8e3dfd829ac2 WatchSource:0}: Error finding container 001550f6b8ccb717e13a769ca2a812d3e45e3edfd705b9e7175a8e3dfd829ac2: Status 404 returned error can't find the container with id 001550f6b8ccb717e13a769ca2a812d3e45e3edfd705b9e7175a8e3dfd829ac2 Jul 06 16:32:58.127852 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:58.127816 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-z2jj5" event={"ID":"c3bcfe9c-2960-4edd-99bb-078b967271f9","Type":"ContainerStarted","Data":"7cd3c5ff5837badbed9c9b6376cc940929ab4d79b749cb6acd36b03de2790530"} Jul 06 16:32:58.129474 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:58.129447 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7d69cf4657-pdgx6" event={"ID":"b3e38ae9-126b-4c58-ac65-3f00859768f4","Type":"ContainerStarted","Data":"ae3483bb9cd44cbef6fbed65df1f1fe8fc7aaac70797e9ebe1baf02a91319c4f"} Jul 06 16:32:58.129602 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:58.129494 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7d69cf4657-pdgx6" event={"ID":"b3e38ae9-126b-4c58-ac65-3f00859768f4","Type":"ContainerStarted","Data":"001550f6b8ccb717e13a769ca2a812d3e45e3edfd705b9e7175a8e3dfd829ac2"} Jul 06 16:32:58.146355 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:58.146206 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7d69cf4657-pdgx6" podStartSLOduration=33.14619039 podStartE2EDuration="33.14619039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:32:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:32:58.145302294 +0000 UTC m=+259.414373330" watchObservedRunningTime="2026-07-06 16:32:58.14619039 +0000 UTC m=+259.415261425" Jul 06 16:32:58.842965 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:58.842910 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7d69cf4657-pdgx6" Jul 06 16:32:58.845581 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:58.845558 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7d69cf4657-pdgx6" Jul 06 16:32:59.133369 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:59.133277 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7d69cf4657-pdgx6" Jul 06 16:32:59.134594 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:32:59.134571 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7d69cf4657-pdgx6" Jul 06 16:33:00.139268 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:00.139227 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-z2jj5" event={"ID":"c3bcfe9c-2960-4edd-99bb-078b967271f9","Type":"ContainerStarted","Data":"ca5af0c207b1efe5a49e00873513968f10ba0d8d66ae0a247c27847671bccd7e"} Jul 06 16:33:00.154698 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:00.154641 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-z2jj5" podStartSLOduration=33.069025754 podStartE2EDuration="35.154624439s" totalImagesPullingTime="2.085598685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:33:00.153748938 +0000 UTC m=+261.422819987" watchObservedRunningTime="2026-07-06 16:33:00.154624439 +0000 UTC m=+261.423695475" Jul 06 16:33:00.284710 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:00.284618 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:00.384066 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:00.384027 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:00.464980 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:00.464932 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-j2qdt"] Jul 06 16:33:00.466955 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:00.466927 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-j2qdt" Jul 06 16:33:00.468882 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:00.468858 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 06 16:33:00.468882 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:00.468869 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-84s98\"" Jul 06 16:33:00.477201 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:00.477174 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-j2qdt"] Jul 06 16:33:00.492671 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:00.492613 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:00.555349 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:00.555320 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e0521ef3-5c23-436b-b48f-80c894b48ff7-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-j2qdt\" (UID: \"e0521ef3-5c23-436b-b48f-80c894b48ff7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-j2qdt" Jul 06 16:33:00.656755 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:00.656713 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e0521ef3-5c23-436b-b48f-80c894b48ff7-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-j2qdt\" (UID: \"e0521ef3-5c23-436b-b48f-80c894b48ff7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-j2qdt" Jul 06 16:33:00.656968 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:33:00.656862 2555 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 06 16:33:00.657043 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:33:00.656973 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0521ef3-5c23-436b-b48f-80c894b48ff7-tls-certificates podName:e0521ef3-5c23-436b-b48f-80c894b48ff7 nodeName:}" failed. No retries permitted until 2026-07-06 16:33:01.156930246 +0000 UTC m=+262.426001267 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/e0521ef3-5c23-436b-b48f-80c894b48ff7-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-j2qdt" (UID: "e0521ef3-5c23-436b-b48f-80c894b48ff7") : secret "prometheus-operator-admission-webhook-tls" not found Jul 06 16:33:01.070105 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:01.070069 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:01.160591 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:01.160556 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e0521ef3-5c23-436b-b48f-80c894b48ff7-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-j2qdt\" (UID: \"e0521ef3-5c23-436b-b48f-80c894b48ff7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-j2qdt" Jul 06 16:33:01.163605 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:01.163577 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e0521ef3-5c23-436b-b48f-80c894b48ff7-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-j2qdt\" (UID: \"e0521ef3-5c23-436b-b48f-80c894b48ff7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-j2qdt" Jul 06 16:33:01.377339 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:01.377259 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-j2qdt" Jul 06 16:33:01.516460 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:01.516422 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-j2qdt"] Jul 06 16:33:01.522716 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:33:01.522665 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0521ef3_5c23_436b_b48f_80c894b48ff7.slice/crio-00e435611a223445b06d36a48a58c4c84956c0cb23d7c517d8b948653c199f9a WatchSource:0}: Error finding container 00e435611a223445b06d36a48a58c4c84956c0cb23d7c517d8b948653c199f9a: Status 404 returned error can't find the container with id 00e435611a223445b06d36a48a58c4c84956c0cb23d7c517d8b948653c199f9a Jul 06 16:33:02.147802 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:02.147762 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-j2qdt" event={"ID":"e0521ef3-5c23-436b-b48f-80c894b48ff7","Type":"ContainerStarted","Data":"00e435611a223445b06d36a48a58c4c84956c0cb23d7c517d8b948653c199f9a"} Jul 06 16:33:02.771859 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:02.771822 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t6vgq\" (UID: \"ee4780a2-31fd-47ce-a3d5-e44d3016ef5d\") " pod="openshift-insights/insights-runtime-extractor-t6vgq" Jul 06 16:33:02.774120 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:02.774098 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee4780a2-31fd-47ce-a3d5-e44d3016ef5d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t6vgq\" (UID: \"ee4780a2-31fd-47ce-a3d5-e44d3016ef5d\") " pod="openshift-insights/insights-runtime-extractor-t6vgq" Jul 06 16:33:03.011807 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.011777 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-285th\"" Jul 06 16:33:03.019774 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.019745 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t6vgq" Jul 06 16:33:03.153187 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.153150 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-j2qdt" event={"ID":"e0521ef3-5c23-436b-b48f-80c894b48ff7","Type":"ContainerStarted","Data":"3d704a8c37f908fa6fdcc151e8b3f91a84867f24d053d726cd56dd7a5484eced"} Jul 06 16:33:03.153388 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.153367 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-j2qdt" Jul 06 16:33:03.157860 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.157827 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-j2qdt" Jul 06 16:33:03.169709 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.169674 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t6vgq"] Jul 06 16:33:03.172142 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.172100 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-j2qdt" podStartSLOduration=1.6764135 podStartE2EDuration="3.172085785s" totalImagesPullingTime="1.495672285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:33:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:33:03.17114007 +0000 UTC m=+264.440211110" watchObservedRunningTime="2026-07-06 16:33:03.172085785 +0000 UTC m=+264.441156821" Jul 06 16:33:03.173687 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:33:03.173661 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee4780a2_31fd_47ce_a3d5_e44d3016ef5d.slice/crio-b4c848c93197ca112b0ecb76f2d09483f9d9a8578b326821bf74ad43c933840f WatchSource:0}: Error finding container b4c848c93197ca112b0ecb76f2d09483f9d9a8578b326821bf74ad43c933840f: Status 404 returned error can't find the container with id b4c848c93197ca112b0ecb76f2d09483f9d9a8578b326821bf74ad43c933840f Jul 06 16:33:03.489435 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.489373 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:03.512284 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.512251 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59c5b88b87-kpkkj"] Jul 06 16:33:03.514641 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.514620 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c5b88b87-kpkkj" Jul 06 16:33:03.516844 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.516820 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 16:33:03.517125 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.517101 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 16:33:03.517228 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.517164 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 16:33:03.517528 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.517486 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 16:33:03.517528 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.517516 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-l5k4m\"" Jul 06 16:33:03.517821 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.517518 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 16:33:03.526145 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.526089 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59c5b88b87-kpkkj"] Jul 06 16:33:03.564003 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.563966 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:03.679496 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.679465 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvdvt\" (UniqueName: \"kubernetes.io/projected/dc190016-0f8b-43e2-b58a-adf06919b33d-kube-api-access-kvdvt\") pod \"console-59c5b88b87-kpkkj\" (UID: \"dc190016-0f8b-43e2-b58a-adf06919b33d\") " pod="openshift-console/console-59c5b88b87-kpkkj" Jul 06 16:33:03.679692 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.679507 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc190016-0f8b-43e2-b58a-adf06919b33d-oauth-serving-cert\") pod \"console-59c5b88b87-kpkkj\" (UID: \"dc190016-0f8b-43e2-b58a-adf06919b33d\") " pod="openshift-console/console-59c5b88b87-kpkkj" Jul 06 16:33:03.679692 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.679558 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc190016-0f8b-43e2-b58a-adf06919b33d-console-oauth-config\") pod \"console-59c5b88b87-kpkkj\" (UID: \"dc190016-0f8b-43e2-b58a-adf06919b33d\") " pod="openshift-console/console-59c5b88b87-kpkkj" Jul 06 16:33:03.679692 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.679598 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc190016-0f8b-43e2-b58a-adf06919b33d-console-serving-cert\") pod \"console-59c5b88b87-kpkkj\" (UID: \"dc190016-0f8b-43e2-b58a-adf06919b33d\") " pod="openshift-console/console-59c5b88b87-kpkkj" Jul 06 16:33:03.679692 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.679634 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc190016-0f8b-43e2-b58a-adf06919b33d-console-config\") pod \"console-59c5b88b87-kpkkj\" (UID: \"dc190016-0f8b-43e2-b58a-adf06919b33d\") " pod="openshift-console/console-59c5b88b87-kpkkj" Jul 06 16:33:03.679855 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.679702 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc190016-0f8b-43e2-b58a-adf06919b33d-service-ca\") pod \"console-59c5b88b87-kpkkj\" (UID: \"dc190016-0f8b-43e2-b58a-adf06919b33d\") " pod="openshift-console/console-59c5b88b87-kpkkj" Jul 06 16:33:03.780425 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.780336 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc190016-0f8b-43e2-b58a-adf06919b33d-oauth-serving-cert\") pod \"console-59c5b88b87-kpkkj\" (UID: \"dc190016-0f8b-43e2-b58a-adf06919b33d\") " pod="openshift-console/console-59c5b88b87-kpkkj" Jul 06 16:33:03.780425 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.780393 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc190016-0f8b-43e2-b58a-adf06919b33d-console-oauth-config\") pod \"console-59c5b88b87-kpkkj\" (UID: \"dc190016-0f8b-43e2-b58a-adf06919b33d\") " pod="openshift-console/console-59c5b88b87-kpkkj" Jul 06 16:33:03.780918 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.780434 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc190016-0f8b-43e2-b58a-adf06919b33d-console-serving-cert\") pod \"console-59c5b88b87-kpkkj\" (UID: \"dc190016-0f8b-43e2-b58a-adf06919b33d\") " pod="openshift-console/console-59c5b88b87-kpkkj" Jul 06 16:33:03.780918 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.780498 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc190016-0f8b-43e2-b58a-adf06919b33d-console-config\") pod \"console-59c5b88b87-kpkkj\" (UID: \"dc190016-0f8b-43e2-b58a-adf06919b33d\") " pod="openshift-console/console-59c5b88b87-kpkkj" Jul 06 16:33:03.780918 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.780532 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc190016-0f8b-43e2-b58a-adf06919b33d-service-ca\") pod \"console-59c5b88b87-kpkkj\" (UID: \"dc190016-0f8b-43e2-b58a-adf06919b33d\") " pod="openshift-console/console-59c5b88b87-kpkkj" Jul 06 16:33:03.780918 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.780578 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvdvt\" (UniqueName: \"kubernetes.io/projected/dc190016-0f8b-43e2-b58a-adf06919b33d-kube-api-access-kvdvt\") pod \"console-59c5b88b87-kpkkj\" (UID: \"dc190016-0f8b-43e2-b58a-adf06919b33d\") " pod="openshift-console/console-59c5b88b87-kpkkj" Jul 06 16:33:03.781167 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.781147 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc190016-0f8b-43e2-b58a-adf06919b33d-oauth-serving-cert\") pod \"console-59c5b88b87-kpkkj\" (UID: \"dc190016-0f8b-43e2-b58a-adf06919b33d\") " pod="openshift-console/console-59c5b88b87-kpkkj" Jul 06 16:33:03.781268 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.781246 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc190016-0f8b-43e2-b58a-adf06919b33d-console-config\") pod \"console-59c5b88b87-kpkkj\" (UID: \"dc190016-0f8b-43e2-b58a-adf06919b33d\") " pod="openshift-console/console-59c5b88b87-kpkkj" Jul 06 16:33:03.781306 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.781246 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc190016-0f8b-43e2-b58a-adf06919b33d-service-ca\") pod \"console-59c5b88b87-kpkkj\" (UID: \"dc190016-0f8b-43e2-b58a-adf06919b33d\") " pod="openshift-console/console-59c5b88b87-kpkkj" Jul 06 16:33:03.783424 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.783401 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc190016-0f8b-43e2-b58a-adf06919b33d-console-oauth-config\") pod \"console-59c5b88b87-kpkkj\" (UID: \"dc190016-0f8b-43e2-b58a-adf06919b33d\") " pod="openshift-console/console-59c5b88b87-kpkkj" Jul 06 16:33:03.783503 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.783402 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc190016-0f8b-43e2-b58a-adf06919b33d-console-serving-cert\") pod \"console-59c5b88b87-kpkkj\" (UID: \"dc190016-0f8b-43e2-b58a-adf06919b33d\") " pod="openshift-console/console-59c5b88b87-kpkkj" Jul 06 16:33:03.790379 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.790351 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvdvt\" (UniqueName: \"kubernetes.io/projected/dc190016-0f8b-43e2-b58a-adf06919b33d-kube-api-access-kvdvt\") pod \"console-59c5b88b87-kpkkj\" (UID: \"dc190016-0f8b-43e2-b58a-adf06919b33d\") " pod="openshift-console/console-59c5b88b87-kpkkj" Jul 06 16:33:03.825412 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.825383 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c5b88b87-kpkkj" Jul 06 16:33:03.974221 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:03.974188 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59c5b88b87-kpkkj"] Jul 06 16:33:03.976985 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:33:03.976960 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc190016_0f8b_43e2_b58a_adf06919b33d.slice/crio-5b960d0230b2a33ce275d4572181f5693d51054b91cd7d0355e863d0ec32a553 WatchSource:0}: Error finding container 5b960d0230b2a33ce275d4572181f5693d51054b91cd7d0355e863d0ec32a553: Status 404 returned error can't find the container with id 5b960d0230b2a33ce275d4572181f5693d51054b91cd7d0355e863d0ec32a553 Jul 06 16:33:04.059368 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:04.059332 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:04.157139 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:04.157100 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c5b88b87-kpkkj" event={"ID":"dc190016-0f8b-43e2-b58a-adf06919b33d","Type":"ContainerStarted","Data":"5b960d0230b2a33ce275d4572181f5693d51054b91cd7d0355e863d0ec32a553"} Jul 06 16:33:04.158082 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:04.158051 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t6vgq" event={"ID":"ee4780a2-31fd-47ce-a3d5-e44d3016ef5d","Type":"ContainerStarted","Data":"b4c848c93197ca112b0ecb76f2d09483f9d9a8578b326821bf74ad43c933840f"} Jul 06 16:33:05.313314 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:05.312135 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8b96b9d76-9nzvd"] Jul 06 16:33:05.314403 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:05.314362 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b96b9d76-9nzvd" Jul 06 16:33:05.323506 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:05.323308 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 16:33:05.329374 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:05.329316 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8b96b9d76-9nzvd"] Jul 06 16:33:05.365812 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:05.365727 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:05.395181 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:05.395150 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-trusted-ca-bundle\") pod \"console-8b96b9d76-9nzvd\" (UID: \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\") " pod="openshift-console/console-8b96b9d76-9nzvd" Jul 06 16:33:05.395361 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:05.395219 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5k84\" (UniqueName: \"kubernetes.io/projected/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-kube-api-access-r5k84\") pod \"console-8b96b9d76-9nzvd\" (UID: \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\") " pod="openshift-console/console-8b96b9d76-9nzvd" Jul 06 16:33:05.395361 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:05.395275 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-service-ca\") pod \"console-8b96b9d76-9nzvd\" (UID: \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\") " pod="openshift-console/console-8b96b9d76-9nzvd" Jul 06 16:33:05.395361 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:05.395325 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-oauth-serving-cert\") pod \"console-8b96b9d76-9nzvd\" (UID: \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\") " pod="openshift-console/console-8b96b9d76-9nzvd" Jul 06 16:33:05.395524 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:05.395358 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-console-config\") pod \"console-8b96b9d76-9nzvd\" (UID: \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\") " pod="openshift-console/console-8b96b9d76-9nzvd" Jul 06 16:33:05.395524 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:05.395389 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-console-oauth-config\") pod \"console-8b96b9d76-9nzvd\" (UID: \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\") " pod="openshift-console/console-8b96b9d76-9nzvd" Jul 06 16:33:05.395524 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:05.395415 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-console-serving-cert\") pod \"console-8b96b9d76-9nzvd\" (UID: \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\") " pod="openshift-console/console-8b96b9d76-9nzvd" Jul 06 16:33:05.487760 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:05.487692 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:05.496485 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:05.496455 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5k84\" (UniqueName: \"kubernetes.io/projected/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-kube-api-access-r5k84\") pod \"console-8b96b9d76-9nzvd\" (UID: \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\") " pod="openshift-console/console-8b96b9d76-9nzvd" Jul 06 16:33:05.496632 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:05.496525 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-service-ca\") pod \"console-8b96b9d76-9nzvd\" (UID: \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\") " pod="openshift-console/console-8b96b9d76-9nzvd" Jul 06 16:33:05.496632 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:05.496576 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-oauth-serving-cert\") pod \"console-8b96b9d76-9nzvd\" (UID: \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\") " pod="openshift-console/console-8b96b9d76-9nzvd" Jul 06 16:33:05.496632 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:05.496604 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-console-config\") pod \"console-8b96b9d76-9nzvd\" (UID: \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\") " pod="openshift-console/console-8b96b9d76-9nzvd" Jul 06 16:33:05.496806 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:05.496635 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-console-oauth-config\") pod \"console-8b96b9d76-9nzvd\" (UID: \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\") " pod="openshift-console/console-8b96b9d76-9nzvd" Jul 06 16:33:05.496806 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:05.496662 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-console-serving-cert\") pod \"console-8b96b9d76-9nzvd\" (UID: \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\") " pod="openshift-console/console-8b96b9d76-9nzvd" Jul 06 16:33:05.496806 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:05.496695 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-trusted-ca-bundle\") pod \"console-8b96b9d76-9nzvd\" (UID: \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\") " pod="openshift-console/console-8b96b9d76-9nzvd" Jul 06 16:33:05.497486 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:05.497436 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-service-ca\") pod \"console-8b96b9d76-9nzvd\" (UID: \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\") " pod="openshift-console/console-8b96b9d76-9nzvd" Jul 06 16:33:05.498309 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:05.497609 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-oauth-serving-cert\") pod \"console-8b96b9d76-9nzvd\" (UID: \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\") " pod="openshift-console/console-8b96b9d76-9nzvd" Jul 06 16:33:05.498309 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:05.497626 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-trusted-ca-bundle\") pod \"console-8b96b9d76-9nzvd\" (UID: \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\") " pod="openshift-console/console-8b96b9d76-9nzvd" Jul 06 16:33:05.498309 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:05.498252 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-console-config\") pod \"console-8b96b9d76-9nzvd\" (UID: \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\") " pod="openshift-console/console-8b96b9d76-9nzvd" Jul 06 16:33:05.500680 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:05.500637 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-console-oauth-config\") pod \"console-8b96b9d76-9nzvd\" (UID: \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\") " pod="openshift-console/console-8b96b9d76-9nzvd" Jul 06 16:33:05.501524 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:05.501506 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-console-serving-cert\") pod \"console-8b96b9d76-9nzvd\" (UID: \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\") " pod="openshift-console/console-8b96b9d76-9nzvd" Jul 06 16:33:05.506128 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:05.506093 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5k84\" (UniqueName: \"kubernetes.io/projected/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-kube-api-access-r5k84\") pod \"console-8b96b9d76-9nzvd\" (UID: \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\") " pod="openshift-console/console-8b96b9d76-9nzvd" Jul 06 16:33:05.630424 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:05.630346 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b96b9d76-9nzvd" Jul 06 16:33:07.915891 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:07.915822 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:08.015741 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:08.015687 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:08.197970 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:08.197863 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:10.316436 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:10.316365 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:10.654598 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:10.654504 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:10.881691 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:10.881650 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:10.951517 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:10.951433 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-97d8m"] Jul 06 16:33:10.955164 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:10.955133 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-97d8m" Jul 06 16:33:10.957465 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:10.957437 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 16:33:10.957592 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:10.957447 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 16:33:10.957694 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:10.957675 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 16:33:10.957921 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:10.957901 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 16:33:10.958025 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:10.957929 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-snrhp\"" Jul 06 16:33:10.981998 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:10.981902 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:11.144683 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.144639 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:11.149264 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.149240 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/643b4a71-d1b2-46fb-9230-e765d4b045f7-node-exporter-tls\") pod \"node-exporter-97d8m\" (UID: \"643b4a71-d1b2-46fb-9230-e765d4b045f7\") " pod="openshift-monitoring/node-exporter-97d8m" Jul 06 16:33:11.149400 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.149274 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/643b4a71-d1b2-46fb-9230-e765d4b045f7-metrics-client-ca\") pod \"node-exporter-97d8m\" (UID: \"643b4a71-d1b2-46fb-9230-e765d4b045f7\") " pod="openshift-monitoring/node-exporter-97d8m" Jul 06 16:33:11.149400 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.149303 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86b9d\" (UniqueName: \"kubernetes.io/projected/643b4a71-d1b2-46fb-9230-e765d4b045f7-kube-api-access-86b9d\") pod \"node-exporter-97d8m\" (UID: \"643b4a71-d1b2-46fb-9230-e765d4b045f7\") " pod="openshift-monitoring/node-exporter-97d8m" Jul 06 16:33:11.149400 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.149355 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/643b4a71-d1b2-46fb-9230-e765d4b045f7-node-exporter-textfile\") pod \"node-exporter-97d8m\" (UID: \"643b4a71-d1b2-46fb-9230-e765d4b045f7\") " pod="openshift-monitoring/node-exporter-97d8m" Jul 06 16:33:11.149564 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.149396 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/643b4a71-d1b2-46fb-9230-e765d4b045f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-97d8m\" (UID: \"643b4a71-d1b2-46fb-9230-e765d4b045f7\") " pod="openshift-monitoring/node-exporter-97d8m" Jul 06 16:33:11.149564 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.149432 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/643b4a71-d1b2-46fb-9230-e765d4b045f7-sys\") pod \"node-exporter-97d8m\" (UID: \"643b4a71-d1b2-46fb-9230-e765d4b045f7\") " pod="openshift-monitoring/node-exporter-97d8m" Jul 06 16:33:11.149564 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.149522 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/643b4a71-d1b2-46fb-9230-e765d4b045f7-root\") pod \"node-exporter-97d8m\" (UID: \"643b4a71-d1b2-46fb-9230-e765d4b045f7\") " pod="openshift-monitoring/node-exporter-97d8m" Jul 06 16:33:11.149668 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.149587 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/643b4a71-d1b2-46fb-9230-e765d4b045f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-97d8m\" (UID: \"643b4a71-d1b2-46fb-9230-e765d4b045f7\") " pod="openshift-monitoring/node-exporter-97d8m" Jul 06 16:33:11.149668 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.149647 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/643b4a71-d1b2-46fb-9230-e765d4b045f7-node-exporter-wtmp\") pod \"node-exporter-97d8m\" (UID: \"643b4a71-d1b2-46fb-9230-e765d4b045f7\") " pod="openshift-monitoring/node-exporter-97d8m" Jul 06 16:33:11.244919 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.244805 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:11.251023 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.251000 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/643b4a71-d1b2-46fb-9230-e765d4b045f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-97d8m\" (UID: \"643b4a71-d1b2-46fb-9230-e765d4b045f7\") " pod="openshift-monitoring/node-exporter-97d8m" Jul 06 16:33:11.251163 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.251051 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/643b4a71-d1b2-46fb-9230-e765d4b045f7-node-exporter-wtmp\") pod \"node-exporter-97d8m\" (UID: \"643b4a71-d1b2-46fb-9230-e765d4b045f7\") " pod="openshift-monitoring/node-exporter-97d8m" Jul 06 16:33:11.251163 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.251097 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/643b4a71-d1b2-46fb-9230-e765d4b045f7-node-exporter-tls\") pod \"node-exporter-97d8m\" (UID: \"643b4a71-d1b2-46fb-9230-e765d4b045f7\") " pod="openshift-monitoring/node-exporter-97d8m" Jul 06 16:33:11.251163 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.251114 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/643b4a71-d1b2-46fb-9230-e765d4b045f7-metrics-client-ca\") pod \"node-exporter-97d8m\" (UID: \"643b4a71-d1b2-46fb-9230-e765d4b045f7\") " pod="openshift-monitoring/node-exporter-97d8m" Jul 06 16:33:11.251304 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:33:11.251245 2555 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 06 16:33:11.251304 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.251251 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86b9d\" (UniqueName: \"kubernetes.io/projected/643b4a71-d1b2-46fb-9230-e765d4b045f7-kube-api-access-86b9d\") pod \"node-exporter-97d8m\" (UID: \"643b4a71-d1b2-46fb-9230-e765d4b045f7\") " pod="openshift-monitoring/node-exporter-97d8m" Jul 06 16:33:11.251304 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.251266 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/643b4a71-d1b2-46fb-9230-e765d4b045f7-node-exporter-wtmp\") pod \"node-exporter-97d8m\" (UID: \"643b4a71-d1b2-46fb-9230-e765d4b045f7\") " pod="openshift-monitoring/node-exporter-97d8m" Jul 06 16:33:11.251304 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.251290 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/643b4a71-d1b2-46fb-9230-e765d4b045f7-node-exporter-textfile\") pod \"node-exporter-97d8m\" (UID: \"643b4a71-d1b2-46fb-9230-e765d4b045f7\") " pod="openshift-monitoring/node-exporter-97d8m" Jul 06 16:33:11.251481 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:33:11.251310 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/643b4a71-d1b2-46fb-9230-e765d4b045f7-node-exporter-tls podName:643b4a71-d1b2-46fb-9230-e765d4b045f7 nodeName:}" failed. No retries permitted until 2026-07-06 16:33:11.751291167 +0000 UTC m=+273.020362186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/643b4a71-d1b2-46fb-9230-e765d4b045f7-node-exporter-tls") pod "node-exporter-97d8m" (UID: "643b4a71-d1b2-46fb-9230-e765d4b045f7") : secret "node-exporter-tls" not found Jul 06 16:33:11.251481 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.251355 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/643b4a71-d1b2-46fb-9230-e765d4b045f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-97d8m\" (UID: \"643b4a71-d1b2-46fb-9230-e765d4b045f7\") " pod="openshift-monitoring/node-exporter-97d8m" Jul 06 16:33:11.251481 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.251388 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/643b4a71-d1b2-46fb-9230-e765d4b045f7-sys\") pod \"node-exporter-97d8m\" (UID: \"643b4a71-d1b2-46fb-9230-e765d4b045f7\") " pod="openshift-monitoring/node-exporter-97d8m" Jul 06 16:33:11.251481 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.251433 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/643b4a71-d1b2-46fb-9230-e765d4b045f7-root\") pod \"node-exporter-97d8m\" (UID: \"643b4a71-d1b2-46fb-9230-e765d4b045f7\") " pod="openshift-monitoring/node-exporter-97d8m" Jul 06 16:33:11.251680 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.251485 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/643b4a71-d1b2-46fb-9230-e765d4b045f7-root\") pod \"node-exporter-97d8m\" (UID: \"643b4a71-d1b2-46fb-9230-e765d4b045f7\") " pod="openshift-monitoring/node-exporter-97d8m" Jul 06 16:33:11.251680 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.251514 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/643b4a71-d1b2-46fb-9230-e765d4b045f7-sys\") pod \"node-exporter-97d8m\" (UID: \"643b4a71-d1b2-46fb-9230-e765d4b045f7\") " pod="openshift-monitoring/node-exporter-97d8m" Jul 06 16:33:11.251680 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.251526 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/643b4a71-d1b2-46fb-9230-e765d4b045f7-node-exporter-textfile\") pod \"node-exporter-97d8m\" (UID: \"643b4a71-d1b2-46fb-9230-e765d4b045f7\") " pod="openshift-monitoring/node-exporter-97d8m" Jul 06 16:33:11.251818 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.251678 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/643b4a71-d1b2-46fb-9230-e765d4b045f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-97d8m\" (UID: \"643b4a71-d1b2-46fb-9230-e765d4b045f7\") " pod="openshift-monitoring/node-exporter-97d8m" Jul 06 16:33:11.251818 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.251697 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/643b4a71-d1b2-46fb-9230-e765d4b045f7-metrics-client-ca\") pod \"node-exporter-97d8m\" (UID: \"643b4a71-d1b2-46fb-9230-e765d4b045f7\") " pod="openshift-monitoring/node-exporter-97d8m" Jul 06 16:33:11.253870 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.253853 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/643b4a71-d1b2-46fb-9230-e765d4b045f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-97d8m\" (UID: \"643b4a71-d1b2-46fb-9230-e765d4b045f7\") " pod="openshift-monitoring/node-exporter-97d8m" Jul 06 16:33:11.262398 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.262380 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86b9d\" (UniqueName: \"kubernetes.io/projected/643b4a71-d1b2-46fb-9230-e765d4b045f7-kube-api-access-86b9d\") pod \"node-exporter-97d8m\" (UID: \"643b4a71-d1b2-46fb-9230-e765d4b045f7\") " pod="openshift-monitoring/node-exporter-97d8m" Jul 06 16:33:11.345704 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.345662 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:11.479834 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.479738 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:11.755799 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.755760 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/643b4a71-d1b2-46fb-9230-e765d4b045f7-node-exporter-tls\") pod \"node-exporter-97d8m\" (UID: \"643b4a71-d1b2-46fb-9230-e765d4b045f7\") " pod="openshift-monitoring/node-exporter-97d8m" Jul 06 16:33:11.756002 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:33:11.755935 2555 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 06 16:33:11.756062 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:33:11.756036 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/643b4a71-d1b2-46fb-9230-e765d4b045f7-node-exporter-tls podName:643b4a71-d1b2-46fb-9230-e765d4b045f7 nodeName:}" failed. No retries permitted until 2026-07-06 16:33:12.756013317 +0000 UTC m=+274.025084334 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/643b4a71-d1b2-46fb-9230-e765d4b045f7-node-exporter-tls") pod "node-exporter-97d8m" (UID: "643b4a71-d1b2-46fb-9230-e765d4b045f7") : secret "node-exporter-tls" not found Jul 06 16:33:11.767253 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.767210 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:11.878644 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.878610 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:11.970208 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.970114 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 16:33:11.975570 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.975551 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:11.977787 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.977758 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 16:33:11.977787 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.977777 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 16:33:11.978212 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.978190 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 16:33:11.978317 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.978225 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 16:33:11.978420 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.978406 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 16:33:11.978701 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.978684 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 16:33:11.978790 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.978712 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 16:33:11.978790 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.978759 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ggsfr\"" Jul 06 16:33:11.979018 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.978997 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 16:33:11.979130 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.978999 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 16:33:11.987128 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:11.987104 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 16:33:12.159782 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.159753 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.159782 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.159789 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b70c6e-516a-465a-a346-88909ff5391a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.160087 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.159835 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.160087 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.159936 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.160087 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.160002 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d8b70c6e-516a-465a-a346-88909ff5391a-config-out\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.160087 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.160044 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d8b70c6e-516a-465a-a346-88909ff5391a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.160087 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.160077 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.160300 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.160133 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-config-volume\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.160300 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.160181 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.160300 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.160216 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvckf\" (UniqueName: \"kubernetes.io/projected/d8b70c6e-516a-465a-a346-88909ff5391a-kube-api-access-gvckf\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.160300 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.160285 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d8b70c6e-516a-465a-a346-88909ff5391a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.160486 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.160322 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-web-config\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.160486 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.160344 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8b70c6e-516a-465a-a346-88909ff5391a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.261095 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.261055 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.261296 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.261117 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.261296 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.261153 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d8b70c6e-516a-465a-a346-88909ff5391a-config-out\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.261296 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.261192 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d8b70c6e-516a-465a-a346-88909ff5391a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.261296 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.261223 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.261528 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.261473 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-config-volume\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.261528 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.261516 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.261627 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.261543 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvckf\" (UniqueName: \"kubernetes.io/projected/d8b70c6e-516a-465a-a346-88909ff5391a-kube-api-access-gvckf\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.261627 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.261588 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d8b70c6e-516a-465a-a346-88909ff5391a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.261725 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.261634 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-web-config\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.261725 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.261669 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8b70c6e-516a-465a-a346-88909ff5391a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.261725 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.261707 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.261878 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.261725 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d8b70c6e-516a-465a-a346-88909ff5391a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.261878 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.261733 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b70c6e-516a-465a-a346-88909ff5391a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.262906 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.262843 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b70c6e-516a-465a-a346-88909ff5391a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.262906 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.262878 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8b70c6e-516a-465a-a346-88909ff5391a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.266213 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.266185 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d8b70c6e-516a-465a-a346-88909ff5391a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.266313 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.266256 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.266374 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.266347 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.266455 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.266427 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.266979 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.266930 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-config-volume\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.267398 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.267365 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.267570 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.267546 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-web-config\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.267983 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.267961 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d8b70c6e-516a-465a-a346-88909ff5391a-config-out\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.268058 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.268002 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.270424 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.270401 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvckf\" (UniqueName: \"kubernetes.io/projected/d8b70c6e-516a-465a-a346-88909ff5391a-kube-api-access-gvckf\") pod \"alertmanager-main-0\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.288283 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.288263 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:33:12.467412 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.467314 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:12.529610 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.529565 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:12.768000 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.767897 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/643b4a71-d1b2-46fb-9230-e765d4b045f7-node-exporter-tls\") pod \"node-exporter-97d8m\" (UID: \"643b4a71-d1b2-46fb-9230-e765d4b045f7\") " pod="openshift-monitoring/node-exporter-97d8m" Jul 06 16:33:12.770685 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:12.770654 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/643b4a71-d1b2-46fb-9230-e765d4b045f7-node-exporter-tls\") pod \"node-exporter-97d8m\" (UID: \"643b4a71-d1b2-46fb-9230-e765d4b045f7\") " pod="openshift-monitoring/node-exporter-97d8m" Jul 06 16:33:13.067346 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:13.067311 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-97d8m" Jul 06 16:33:13.871697 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:13.871651 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:13.894119 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:13.894087 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj"] Jul 06 16:33:13.898300 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:13.898272 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" Jul 06 16:33:13.900493 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:13.900475 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 06 16:33:13.900733 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:13.900714 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 06 16:33:13.900843 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:13.900795 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-cjqkm\"" Jul 06 16:33:13.900843 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:13.900835 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 06 16:33:13.901832 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:13.901808 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 06 16:33:13.901963 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:13.901865 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3mn4q27ae363l\"" Jul 06 16:33:13.901963 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:13.901810 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 06 16:33:13.909166 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:13.909146 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj"] Jul 06 16:33:13.976630 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:13.976595 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72bd5db7-ca8c-4b28-909b-19583ad7159e-metrics-client-ca\") pod \"thanos-querier-6b5bcc8cc5-b8kdj\" (UID: \"72bd5db7-ca8c-4b28-909b-19583ad7159e\") " pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" Jul 06 16:33:13.976802 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:13.976648 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72bd5db7-ca8c-4b28-909b-19583ad7159e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b5bcc8cc5-b8kdj\" (UID: \"72bd5db7-ca8c-4b28-909b-19583ad7159e\") " pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" Jul 06 16:33:13.976802 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:13.976721 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/72bd5db7-ca8c-4b28-909b-19583ad7159e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b5bcc8cc5-b8kdj\" (UID: \"72bd5db7-ca8c-4b28-909b-19583ad7159e\") " pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" Jul 06 16:33:13.976920 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:13.976816 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72bd5db7-ca8c-4b28-909b-19583ad7159e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b5bcc8cc5-b8kdj\" (UID: \"72bd5db7-ca8c-4b28-909b-19583ad7159e\") " pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" Jul 06 16:33:13.976920 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:13.976873 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/72bd5db7-ca8c-4b28-909b-19583ad7159e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b5bcc8cc5-b8kdj\" (UID: \"72bd5db7-ca8c-4b28-909b-19583ad7159e\") " pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" Jul 06 16:33:13.976920 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:13.976903 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvgww\" (UniqueName: \"kubernetes.io/projected/72bd5db7-ca8c-4b28-909b-19583ad7159e-kube-api-access-qvgww\") pod \"thanos-querier-6b5bcc8cc5-b8kdj\" (UID: \"72bd5db7-ca8c-4b28-909b-19583ad7159e\") " pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" Jul 06 16:33:13.977086 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:13.976971 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/72bd5db7-ca8c-4b28-909b-19583ad7159e-secret-thanos-querier-tls\") pod \"thanos-querier-6b5bcc8cc5-b8kdj\" (UID: \"72bd5db7-ca8c-4b28-909b-19583ad7159e\") " pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" Jul 06 16:33:13.977086 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:13.976999 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/72bd5db7-ca8c-4b28-909b-19583ad7159e-secret-grpc-tls\") pod \"thanos-querier-6b5bcc8cc5-b8kdj\" (UID: \"72bd5db7-ca8c-4b28-909b-19583ad7159e\") " pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" Jul 06 16:33:14.020173 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:14.020137 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:14.077993 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:14.077930 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72bd5db7-ca8c-4b28-909b-19583ad7159e-metrics-client-ca\") pod \"thanos-querier-6b5bcc8cc5-b8kdj\" (UID: \"72bd5db7-ca8c-4b28-909b-19583ad7159e\") " pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" Jul 06 16:33:14.078170 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:14.078017 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72bd5db7-ca8c-4b28-909b-19583ad7159e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b5bcc8cc5-b8kdj\" (UID: \"72bd5db7-ca8c-4b28-909b-19583ad7159e\") " pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" Jul 06 16:33:14.078170 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:14.078063 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/72bd5db7-ca8c-4b28-909b-19583ad7159e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b5bcc8cc5-b8kdj\" (UID: \"72bd5db7-ca8c-4b28-909b-19583ad7159e\") " pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" Jul 06 16:33:14.078170 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:14.078116 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72bd5db7-ca8c-4b28-909b-19583ad7159e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b5bcc8cc5-b8kdj\" (UID: \"72bd5db7-ca8c-4b28-909b-19583ad7159e\") " pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" Jul 06 16:33:14.078170 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:14.078157 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/72bd5db7-ca8c-4b28-909b-19583ad7159e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b5bcc8cc5-b8kdj\" (UID: \"72bd5db7-ca8c-4b28-909b-19583ad7159e\") " pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" Jul 06 16:33:14.078391 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:14.078224 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvgww\" (UniqueName: \"kubernetes.io/projected/72bd5db7-ca8c-4b28-909b-19583ad7159e-kube-api-access-qvgww\") pod \"thanos-querier-6b5bcc8cc5-b8kdj\" (UID: \"72bd5db7-ca8c-4b28-909b-19583ad7159e\") " pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" Jul 06 16:33:14.078391 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:14.078303 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/72bd5db7-ca8c-4b28-909b-19583ad7159e-secret-thanos-querier-tls\") pod \"thanos-querier-6b5bcc8cc5-b8kdj\" (UID: \"72bd5db7-ca8c-4b28-909b-19583ad7159e\") " pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" Jul 06 16:33:14.078391 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:14.078328 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/72bd5db7-ca8c-4b28-909b-19583ad7159e-secret-grpc-tls\") pod \"thanos-querier-6b5bcc8cc5-b8kdj\" (UID: \"72bd5db7-ca8c-4b28-909b-19583ad7159e\") " pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" Jul 06 16:33:14.078804 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:14.078751 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72bd5db7-ca8c-4b28-909b-19583ad7159e-metrics-client-ca\") pod \"thanos-querier-6b5bcc8cc5-b8kdj\" (UID: \"72bd5db7-ca8c-4b28-909b-19583ad7159e\") " pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" Jul 06 16:33:14.081333 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:14.081310 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72bd5db7-ca8c-4b28-909b-19583ad7159e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b5bcc8cc5-b8kdj\" (UID: \"72bd5db7-ca8c-4b28-909b-19583ad7159e\") " pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" Jul 06 16:33:14.081333 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:14.081324 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/72bd5db7-ca8c-4b28-909b-19583ad7159e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b5bcc8cc5-b8kdj\" (UID: \"72bd5db7-ca8c-4b28-909b-19583ad7159e\") " pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" Jul 06 16:33:14.081840 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:14.081800 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/72bd5db7-ca8c-4b28-909b-19583ad7159e-secret-thanos-querier-tls\") pod \"thanos-querier-6b5bcc8cc5-b8kdj\" (UID: \"72bd5db7-ca8c-4b28-909b-19583ad7159e\") " pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" Jul 06 16:33:14.081922 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:14.081864 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/72bd5db7-ca8c-4b28-909b-19583ad7159e-secret-grpc-tls\") pod \"thanos-querier-6b5bcc8cc5-b8kdj\" (UID: \"72bd5db7-ca8c-4b28-909b-19583ad7159e\") " pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" Jul 06 16:33:14.082127 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:14.082109 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72bd5db7-ca8c-4b28-909b-19583ad7159e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b5bcc8cc5-b8kdj\" (UID: \"72bd5db7-ca8c-4b28-909b-19583ad7159e\") " pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" Jul 06 16:33:14.082272 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:14.082247 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/72bd5db7-ca8c-4b28-909b-19583ad7159e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b5bcc8cc5-b8kdj\" (UID: \"72bd5db7-ca8c-4b28-909b-19583ad7159e\") " pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" Jul 06 16:33:14.085468 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:14.085435 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:14.086267 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:14.086245 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvgww\" (UniqueName: \"kubernetes.io/projected/72bd5db7-ca8c-4b28-909b-19583ad7159e-kube-api-access-qvgww\") pod \"thanos-querier-6b5bcc8cc5-b8kdj\" (UID: \"72bd5db7-ca8c-4b28-909b-19583ad7159e\") " pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" Jul 06 16:33:14.209929 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:14.209840 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" Jul 06 16:33:14.309352 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:14.309309 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:15.022216 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:15.022170 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:15.370419 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:15.370375 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:15.435495 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:15.435463 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:15.629902 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:15.629826 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:15.704154 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:15.704118 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59c5b88b87-kpkkj"] Jul 06 16:33:15.721170 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:15.721135 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:15.786861 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:15.786831 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:15.847991 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:15.847958 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:16.252270 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:33:16.251851 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod643b4a71_d1b2_46fb_9230_e765d4b045f7.slice/crio-4ecedd983e4f902545195fb78317eaa5a49607c0f4ef177f9ef42981a3231992 WatchSource:0}: Error finding container 4ecedd983e4f902545195fb78317eaa5a49607c0f4ef177f9ef42981a3231992: Status 404 returned error can't find the container with id 4ecedd983e4f902545195fb78317eaa5a49607c0f4ef177f9ef42981a3231992 Jul 06 16:33:16.416158 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:16.415254 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8b96b9d76-9nzvd"] Jul 06 16:33:16.419885 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:33:16.419096 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11af3eb4_d4ea_4ee6_9877_53f439dcbeaa.slice/crio-5826b87d7504a20af74bb4008d3f64f64798a4dff13d7d2ec54b772ef39aeccc WatchSource:0}: Error finding container 5826b87d7504a20af74bb4008d3f64f64798a4dff13d7d2ec54b772ef39aeccc: Status 404 returned error can't find the container with id 5826b87d7504a20af74bb4008d3f64f64798a4dff13d7d2ec54b772ef39aeccc Jul 06 16:33:16.459496 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:16.459469 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 16:33:16.463401 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:33:16.463370 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8b70c6e_516a_465a_a346_88909ff5391a.slice/crio-fce519715b1cf5b0cfc48cb6d2ded09f6aaf9f82bde292f9d07543dad2be7421 WatchSource:0}: Error finding container fce519715b1cf5b0cfc48cb6d2ded09f6aaf9f82bde292f9d07543dad2be7421: Status 404 returned error can't find the container with id fce519715b1cf5b0cfc48cb6d2ded09f6aaf9f82bde292f9d07543dad2be7421 Jul 06 16:33:16.655796 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:16.655756 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj"] Jul 06 16:33:16.658612 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:33:16.658580 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72bd5db7_ca8c_4b28_909b_19583ad7159e.slice/crio-c325d38c09b91f6b32a6abc4d72abea95b0891fd8f418201ff23b3831b1f1a21 WatchSource:0}: Error finding container c325d38c09b91f6b32a6abc4d72abea95b0891fd8f418201ff23b3831b1f1a21: Status 404 returned error can't find the container with id c325d38c09b91f6b32a6abc4d72abea95b0891fd8f418201ff23b3831b1f1a21 Jul 06 16:33:17.173857 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:17.173768 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:17.211589 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:17.211511 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-97d8m" event={"ID":"643b4a71-d1b2-46fb-9230-e765d4b045f7","Type":"ContainerStarted","Data":"4ecedd983e4f902545195fb78317eaa5a49607c0f4ef177f9ef42981a3231992"} Jul 06 16:33:17.213466 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:17.213427 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8b70c6e-516a-465a-a346-88909ff5391a","Type":"ContainerStarted","Data":"fce519715b1cf5b0cfc48cb6d2ded09f6aaf9f82bde292f9d07543dad2be7421"} Jul 06 16:33:17.215609 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:17.215574 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-mf8hj" event={"ID":"a4b49e16-f55c-42e6-971d-cad8ebfde1fe","Type":"ContainerStarted","Data":"2572bb85835ac0e2259adc6077d565b9d29d08cb9cd4e5b72607e85f134ae756"} Jul 06 16:33:17.215985 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:17.215858 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-mf8hj" Jul 06 16:33:17.218538 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:17.218463 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" event={"ID":"72bd5db7-ca8c-4b28-909b-19583ad7159e","Type":"ContainerStarted","Data":"c325d38c09b91f6b32a6abc4d72abea95b0891fd8f418201ff23b3831b1f1a21"} Jul 06 16:33:17.220774 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:17.220738 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b96b9d76-9nzvd" event={"ID":"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa","Type":"ContainerStarted","Data":"6509dfd250d93d7b8c2ed359fcf1e8c022d6e5d0bde3e100a204e9291340729a"} Jul 06 16:33:17.220887 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:17.220785 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b96b9d76-9nzvd" event={"ID":"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa","Type":"ContainerStarted","Data":"5826b87d7504a20af74bb4008d3f64f64798a4dff13d7d2ec54b772ef39aeccc"} Jul 06 16:33:17.223226 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:17.223203 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c5b88b87-kpkkj" event={"ID":"dc190016-0f8b-43e2-b58a-adf06919b33d","Type":"ContainerStarted","Data":"b7d4e677454cc82be2cb9094002b2f08f98bae7b281ee6653e72d3402273b56c"} Jul 06 16:33:17.225525 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:17.225495 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t6vgq" event={"ID":"ee4780a2-31fd-47ce-a3d5-e44d3016ef5d","Type":"ContainerStarted","Data":"f6ef30b9af56f782f5b8f69d85e1a9e665ed2d6668d8f2e81383c1b1288423c3"} Jul 06 16:33:17.235842 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:17.235789 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-mf8hj" Jul 06 16:33:17.236973 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:17.236666 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-mf8hj" podStartSLOduration=1.975000467 podStartE2EDuration="25.236646785s" totalImagesPullingTime="23.261646318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:32:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:33:17.235366121 +0000 UTC m=+278.504437159" watchObservedRunningTime="2026-07-06 16:33:17.236646785 +0000 UTC m=+278.505717823" Jul 06 16:33:17.258010 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:17.257174 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59c5b88b87-kpkkj" podStartSLOduration=1.987727027 podStartE2EDuration="14.257158464s" totalImagesPullingTime="12.269431437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:33:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:33:17.256469475 +0000 UTC m=+278.525540512" watchObservedRunningTime="2026-07-06 16:33:17.257158464 +0000 UTC m=+278.526229501" Jul 06 16:33:17.280794 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:17.280206 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8b96b9d76-9nzvd" podStartSLOduration=12.28018425 podStartE2EDuration="12.28018425s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:33:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:33:17.278724143 +0000 UTC m=+278.547795206" watchObservedRunningTime="2026-07-06 16:33:17.28018425 +0000 UTC m=+278.549255486" Jul 06 16:33:17.957521 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:17.957453 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:18.233332 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:18.233232 2555 generic.go:356] "Generic (PLEG): container finished" podID="643b4a71-d1b2-46fb-9230-e765d4b045f7" containerID="9c85ed911a25875997086c559d82f5c031e7e795884a38e37651079a67a47662" exitCode=0 Jul 06 16:33:18.233599 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:18.233573 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-97d8m" event={"ID":"643b4a71-d1b2-46fb-9230-e765d4b045f7","Type":"ContainerDied","Data":"9c85ed911a25875997086c559d82f5c031e7e795884a38e37651079a67a47662"} Jul 06 16:33:18.237060 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:18.236812 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t6vgq" event={"ID":"ee4780a2-31fd-47ce-a3d5-e44d3016ef5d","Type":"ContainerStarted","Data":"ecfdb3ceb64f43d077c583eade0f7ccc10e37a4fc4ecde19e4deec38ba367f36"} Jul 06 16:33:18.337814 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:18.337782 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:19.245516 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:19.245425 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-97d8m" event={"ID":"643b4a71-d1b2-46fb-9230-e765d4b045f7","Type":"ContainerStarted","Data":"4a35c01657f836c3d01f3af5e60fb0bfd8dbc47ae4044d79a74a69da486510a0"} Jul 06 16:33:19.245516 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:19.245481 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-97d8m" event={"ID":"643b4a71-d1b2-46fb-9230-e765d4b045f7","Type":"ContainerStarted","Data":"601fa48f4639454d901a57123ae62df49790888cf949d755d883a04cf5419f05"} Jul 06 16:33:20.255471 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:20.255427 2555 generic.go:356] "Generic (PLEG): container finished" podID="d8b70c6e-516a-465a-a346-88909ff5391a" containerID="5f315bb86849320b8d8be9587e5311a0896c31c5de5af6ed38c7e9d2c6a221cc" exitCode=0 Jul 06 16:33:20.256638 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:20.256389 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8b70c6e-516a-465a-a346-88909ff5391a","Type":"ContainerDied","Data":"5f315bb86849320b8d8be9587e5311a0896c31c5de5af6ed38c7e9d2c6a221cc"} Jul 06 16:33:20.284458 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:20.284400 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-97d8m" podStartSLOduration=8.599458677 podStartE2EDuration="10.284377658s" totalImagesPullingTime="1.596662387s" totalInitContainerRuntime="88.256594ms" isStatefulPod=true podCreationTimestamp="2026-07-06 16:33:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:33:19.266721511 +0000 UTC m=+280.535792549" watchObservedRunningTime="2026-07-06 16:33:20.284377658 +0000 UTC m=+281.553448688" Jul 06 16:33:20.855116 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:33:20.855074 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hbxj8" podUID="9f53e144-c856-4edf-92a9-bacbe1b5d03e" Jul 06 16:33:21.261118 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:21.261029 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hbxj8" Jul 06 16:33:23.273277 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:23.273237 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" event={"ID":"72bd5db7-ca8c-4b28-909b-19583ad7159e","Type":"ContainerStarted","Data":"ca598930f9d865993272d3760c01ff13f6a6ee6e7e1d496127bd2549b6726289"} Jul 06 16:33:23.273761 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:23.273323 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" event={"ID":"72bd5db7-ca8c-4b28-909b-19583ad7159e","Type":"ContainerStarted","Data":"f652a2e0c50e9f38a49ad6c9e461da74a1f1329f0bb80a26fcefdc23e70baf27"} Jul 06 16:33:23.273761 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:23.273371 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" event={"ID":"72bd5db7-ca8c-4b28-909b-19583ad7159e","Type":"ContainerStarted","Data":"d4d3272f28efba9499986bf33f27374032be5a9d8b5aae4ed906b0aab7711074"} Jul 06 16:33:23.275735 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:23.275700 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t6vgq" event={"ID":"ee4780a2-31fd-47ce-a3d5-e44d3016ef5d","Type":"ContainerStarted","Data":"71174f5d18fc15ed75b0b2c6eadefb0334fcaa43811b4ba1c68f897deff28fd8"} Jul 06 16:33:23.293393 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:23.293346 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-t6vgq" podStartSLOduration=34.241532915 podStartE2EDuration="53.29333116s" totalImagesPullingTime="19.051798245s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 16:32:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:33:23.292158118 +0000 UTC m=+284.561229159" watchObservedRunningTime="2026-07-06 16:33:23.29333116 +0000 UTC m=+284.562402197" Jul 06 16:33:23.826346 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:23.826311 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59c5b88b87-kpkkj" Jul 06 16:33:23.975999 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:23.975957 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f53e144-c856-4edf-92a9-bacbe1b5d03e-metrics-tls\") pod \"dns-default-hbxj8\" (UID: \"9f53e144-c856-4edf-92a9-bacbe1b5d03e\") " pod="openshift-dns/dns-default-hbxj8" Jul 06 16:33:23.978736 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:23.978705 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f53e144-c856-4edf-92a9-bacbe1b5d03e-metrics-tls\") pod \"dns-default-hbxj8\" (UID: \"9f53e144-c856-4edf-92a9-bacbe1b5d03e\") " pod="openshift-dns/dns-default-hbxj8" Jul 06 16:33:24.265045 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:24.264961 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6rxcp\"" Jul 06 16:33:24.273189 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:24.273147 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hbxj8" Jul 06 16:33:25.041320 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:25.038164 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hbxj8"] Jul 06 16:33:25.288592 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:25.288362 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hbxj8" event={"ID":"9f53e144-c856-4edf-92a9-bacbe1b5d03e","Type":"ContainerStarted","Data":"b4695232a5589dd8a1c4a4ccac296b660eeaa70aa9e3eebfc3c156880b22fe7a"} Jul 06 16:33:25.291175 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:25.291099 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8b70c6e-516a-465a-a346-88909ff5391a","Type":"ContainerStarted","Data":"a551f6bb7799c2b7aac16b650978e1fb61bb4457d3c02982023c0523b0edbc6a"} Jul 06 16:33:25.291175 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:25.291152 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8b70c6e-516a-465a-a346-88909ff5391a","Type":"ContainerStarted","Data":"aeb547a50032a6cd566ccd2c2542821955b5048738394f068ac57793d16938d1"} Jul 06 16:33:25.294744 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:25.294719 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" event={"ID":"72bd5db7-ca8c-4b28-909b-19583ad7159e","Type":"ContainerStarted","Data":"b94ec815c9107c89216257e7af91e4618e5ba1197db509b69585a722016019c5"} Jul 06 16:33:25.295223 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:25.295200 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" event={"ID":"72bd5db7-ca8c-4b28-909b-19583ad7159e","Type":"ContainerStarted","Data":"605b9bb2570031cf602d679625fd571e2134848b207e86a2d79a1db3b3d8fdad"} Jul 06 16:33:25.295322 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:25.295252 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" event={"ID":"72bd5db7-ca8c-4b28-909b-19583ad7159e","Type":"ContainerStarted","Data":"01244a9057323febbb4f4ae17ad9c1f8e9d79e9d3bfa06e75eb79c57e2d2517f"} Jul 06 16:33:25.630998 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:25.630926 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8b96b9d76-9nzvd" Jul 06 16:33:25.631112 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:25.631023 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8b96b9d76-9nzvd" Jul 06 16:33:25.637378 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:25.637348 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8b96b9d76-9nzvd" Jul 06 16:33:26.301819 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:26.301780 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8b70c6e-516a-465a-a346-88909ff5391a","Type":"ContainerStarted","Data":"cd2b540c22ef04e811a812c4b3f28c2a860627924cfd38a384e8ad31234f2b31"} Jul 06 16:33:26.302381 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:26.301842 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8b70c6e-516a-465a-a346-88909ff5391a","Type":"ContainerStarted","Data":"cd4666a972762c8c3e304e0ec70014904cd0f44e0b2c330c525f77d36faa2046"} Jul 06 16:33:26.302381 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:26.301870 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8b70c6e-516a-465a-a346-88909ff5391a","Type":"ContainerStarted","Data":"7e998ea62593f490cde6c46406591c3636a5226d76427a5a1264a0d45ace4ee2"} Jul 06 16:33:26.302381 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:26.301899 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8b70c6e-516a-465a-a346-88909ff5391a","Type":"ContainerStarted","Data":"df98d1ffbcfd22b7bb6e9868591f547af4e2c0d5c404f330d7a570f9c6296bf1"} Jul 06 16:33:26.305741 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:26.305721 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8b96b9d76-9nzvd" Jul 06 16:33:26.326817 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:26.326774 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=7.994257803 podStartE2EDuration="15.326760123s" totalImagesPullingTime="7.322340351s" totalInitContainerRuntime="10.161969ms" isStatefulPod=false podCreationTimestamp="2026-07-06 16:33:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:33:26.326330126 +0000 UTC m=+287.595401162" watchObservedRunningTime="2026-07-06 16:33:26.326760123 +0000 UTC m=+287.595831169" Jul 06 16:33:26.366785 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:26.366736 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" podStartSLOduration=5.551850963 podStartE2EDuration="13.366719058s" totalImagesPullingTime="7.814868095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:33:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:33:26.364852734 +0000 UTC m=+287.633923772" watchObservedRunningTime="2026-07-06 16:33:26.366719058 +0000 UTC m=+287.635790111" Jul 06 16:33:26.461002 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:26.460973 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:26.564219 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:26.564130 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:26.711497 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:26.711459 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8b96b9d76-9nzvd"] Jul 06 16:33:26.865123 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:26.865048 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:26.940245 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:26.940215 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:27.241048 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:27.240953 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:27.306273 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:27.306230 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" Jul 06 16:33:27.310003 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:27.309970 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:27.312029 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:27.312009 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6b5bcc8cc5-b8kdj" Jul 06 16:33:28.310378 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:28.310346 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hbxj8" event={"ID":"9f53e144-c856-4edf-92a9-bacbe1b5d03e","Type":"ContainerStarted","Data":"f637757a0c5b31cf0fd7d2bd7243496fc8ad8db9f85512f888680d355aeab310"} Jul 06 16:33:28.310824 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:28.310423 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hbxj8" event={"ID":"9f53e144-c856-4edf-92a9-bacbe1b5d03e","Type":"ContainerStarted","Data":"667b8035a77a816a24d522477e16279a402e246dad4fe0a26c8856da4755b9f0"} Jul 06 16:33:28.345818 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:28.345762 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hbxj8" podStartSLOduration=251.395680463 podStartE2EDuration="4m14.345746216s" totalImagesPullingTime="2.950065753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:29:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:33:28.344169852 +0000 UTC m=+289.613240889" watchObservedRunningTime="2026-07-06 16:33:28.345746216 +0000 UTC m=+289.614817252" Jul 06 16:33:28.771093 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:28.771064 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:28.830625 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:28.830594 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:29.110616 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:29.110583 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:29.210998 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:29.210964 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:29.314775 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:29.314747 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hbxj8" Jul 06 16:33:31.889957 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:31.889917 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:34.375982 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:34.375927 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:34.476294 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:34.476260 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:37.858043 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:37.858010 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:37.959175 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:37.959140 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:39.134690 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:39.134662 2555 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 16:33:39.320213 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:39.320189 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hbxj8" Jul 06 16:33:42.250288 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:42.250249 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-59c5b88b87-kpkkj" podUID="dc190016-0f8b-43e2-b58a-adf06919b33d" containerName="console" containerID="cri-o://b7d4e677454cc82be2cb9094002b2f08f98bae7b281ee6653e72d3402273b56c" gracePeriod=15 Jul 06 16:33:42.550595 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:42.550566 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c5b88b87-kpkkj" Jul 06 16:33:42.646455 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:42.646418 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc190016-0f8b-43e2-b58a-adf06919b33d-console-serving-cert\") pod \"dc190016-0f8b-43e2-b58a-adf06919b33d\" (UID: \"dc190016-0f8b-43e2-b58a-adf06919b33d\") " Jul 06 16:33:42.646455 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:42.646461 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc190016-0f8b-43e2-b58a-adf06919b33d-service-ca\") pod \"dc190016-0f8b-43e2-b58a-adf06919b33d\" (UID: \"dc190016-0f8b-43e2-b58a-adf06919b33d\") " Jul 06 16:33:42.646709 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:42.646511 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc190016-0f8b-43e2-b58a-adf06919b33d-oauth-serving-cert\") pod \"dc190016-0f8b-43e2-b58a-adf06919b33d\" (UID: \"dc190016-0f8b-43e2-b58a-adf06919b33d\") " Jul 06 16:33:42.646709 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:42.646553 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc190016-0f8b-43e2-b58a-adf06919b33d-console-oauth-config\") pod \"dc190016-0f8b-43e2-b58a-adf06919b33d\" (UID: \"dc190016-0f8b-43e2-b58a-adf06919b33d\") " Jul 06 16:33:42.646709 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:42.646620 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc190016-0f8b-43e2-b58a-adf06919b33d-console-config\") pod \"dc190016-0f8b-43e2-b58a-adf06919b33d\" (UID: \"dc190016-0f8b-43e2-b58a-adf06919b33d\") " Jul 06 16:33:42.646709 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:42.646646 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvdvt\" (UniqueName: \"kubernetes.io/projected/dc190016-0f8b-43e2-b58a-adf06919b33d-kube-api-access-kvdvt\") pod \"dc190016-0f8b-43e2-b58a-adf06919b33d\" (UID: \"dc190016-0f8b-43e2-b58a-adf06919b33d\") " Jul 06 16:33:42.646898 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:42.646870 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc190016-0f8b-43e2-b58a-adf06919b33d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dc190016-0f8b-43e2-b58a-adf06919b33d" (UID: "dc190016-0f8b-43e2-b58a-adf06919b33d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 16:33:42.646984 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:42.646922 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc190016-0f8b-43e2-b58a-adf06919b33d-service-ca" (OuterVolumeSpecName: "service-ca") pod "dc190016-0f8b-43e2-b58a-adf06919b33d" (UID: "dc190016-0f8b-43e2-b58a-adf06919b33d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 16:33:42.647046 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:42.647007 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc190016-0f8b-43e2-b58a-adf06919b33d-console-config" (OuterVolumeSpecName: "console-config") pod "dc190016-0f8b-43e2-b58a-adf06919b33d" (UID: "dc190016-0f8b-43e2-b58a-adf06919b33d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 16:33:42.649001 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:42.648972 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc190016-0f8b-43e2-b58a-adf06919b33d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dc190016-0f8b-43e2-b58a-adf06919b33d" (UID: "dc190016-0f8b-43e2-b58a-adf06919b33d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 16:33:42.649131 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:42.649042 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc190016-0f8b-43e2-b58a-adf06919b33d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dc190016-0f8b-43e2-b58a-adf06919b33d" (UID: "dc190016-0f8b-43e2-b58a-adf06919b33d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 16:33:42.649131 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:42.649069 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc190016-0f8b-43e2-b58a-adf06919b33d-kube-api-access-kvdvt" (OuterVolumeSpecName: "kube-api-access-kvdvt") pod "dc190016-0f8b-43e2-b58a-adf06919b33d" (UID: "dc190016-0f8b-43e2-b58a-adf06919b33d"). InnerVolumeSpecName "kube-api-access-kvdvt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 16:33:42.748175 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:42.748137 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc190016-0f8b-43e2-b58a-adf06919b33d-console-serving-cert\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:33:42.748175 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:42.748168 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dc190016-0f8b-43e2-b58a-adf06919b33d-service-ca\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:33:42.748175 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:42.748177 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dc190016-0f8b-43e2-b58a-adf06919b33d-oauth-serving-cert\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:33:42.748175 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:42.748186 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dc190016-0f8b-43e2-b58a-adf06919b33d-console-oauth-config\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:33:42.748430 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:42.748197 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dc190016-0f8b-43e2-b58a-adf06919b33d-console-config\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:33:42.748430 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:42.748205 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvdvt\" (UniqueName: \"kubernetes.io/projected/dc190016-0f8b-43e2-b58a-adf06919b33d-kube-api-access-kvdvt\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:33:43.370296 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:43.370264 2555 generic.go:356] "Generic (PLEG): container finished" podID="dc190016-0f8b-43e2-b58a-adf06919b33d" containerID="b7d4e677454cc82be2cb9094002b2f08f98bae7b281ee6653e72d3402273b56c" exitCode=0 Jul 06 16:33:43.370643 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:43.370307 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c5b88b87-kpkkj" Jul 06 16:33:43.370643 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:43.370339 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c5b88b87-kpkkj" event={"ID":"dc190016-0f8b-43e2-b58a-adf06919b33d","Type":"ContainerDied","Data":"b7d4e677454cc82be2cb9094002b2f08f98bae7b281ee6653e72d3402273b56c"} Jul 06 16:33:43.370643 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:43.370388 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c5b88b87-kpkkj" event={"ID":"dc190016-0f8b-43e2-b58a-adf06919b33d","Type":"ContainerDied","Data":"5b960d0230b2a33ce275d4572181f5693d51054b91cd7d0355e863d0ec32a553"} Jul 06 16:33:43.370643 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:43.370407 2555 scope.go:117] "RemoveContainer" containerID="b7d4e677454cc82be2cb9094002b2f08f98bae7b281ee6653e72d3402273b56c" Jul 06 16:33:43.378656 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:43.378642 2555 scope.go:117] "RemoveContainer" containerID="b7d4e677454cc82be2cb9094002b2f08f98bae7b281ee6653e72d3402273b56c" Jul 06 16:33:43.378881 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:33:43.378860 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7d4e677454cc82be2cb9094002b2f08f98bae7b281ee6653e72d3402273b56c\": container with ID starting with b7d4e677454cc82be2cb9094002b2f08f98bae7b281ee6653e72d3402273b56c not found: ID does not exist" containerID="b7d4e677454cc82be2cb9094002b2f08f98bae7b281ee6653e72d3402273b56c" Jul 06 16:33:43.378924 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:43.378890 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7d4e677454cc82be2cb9094002b2f08f98bae7b281ee6653e72d3402273b56c"} err="failed to get container status \"b7d4e677454cc82be2cb9094002b2f08f98bae7b281ee6653e72d3402273b56c\": rpc error: code = NotFound desc = could not find container \"b7d4e677454cc82be2cb9094002b2f08f98bae7b281ee6653e72d3402273b56c\": container with ID starting with b7d4e677454cc82be2cb9094002b2f08f98bae7b281ee6653e72d3402273b56c not found: ID does not exist" Jul 06 16:33:43.383845 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:43.383825 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59c5b88b87-kpkkj"] Jul 06 16:33:43.386326 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:43.386308 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59c5b88b87-kpkkj"] Jul 06 16:33:45.300846 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:45.300815 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc190016-0f8b-43e2-b58a-adf06919b33d" path="/var/lib/kubelet/pods/dc190016-0f8b-43e2-b58a-adf06919b33d/volumes" Jul 06 16:33:48.442149 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:48.442112 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:48.494508 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:48.494484 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:49.142827 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:49.142795 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:49.199213 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:49.199172 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:53.330046 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:53.330004 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8b96b9d76-9nzvd" podUID="11af3eb4-d4ea-4ee6-9877-53f439dcbeaa" containerName="console" containerID="cri-o://6509dfd250d93d7b8c2ed359fcf1e8c022d6e5d0bde3e100a204e9291340729a" gracePeriod=15 Jul 06 16:33:53.600079 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:53.600024 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b96b9d76-9nzvd" Jul 06 16:33:53.642042 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:53.642012 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-console-oauth-config\") pod \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\" (UID: \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\") " Jul 06 16:33:53.642211 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:53.642072 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-console-serving-cert\") pod \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\" (UID: \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\") " Jul 06 16:33:53.642211 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:53.642108 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-trusted-ca-bundle\") pod \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\" (UID: \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\") " Jul 06 16:33:53.642211 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:53.642138 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-console-config\") pod \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\" (UID: \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\") " Jul 06 16:33:53.642211 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:53.642185 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5k84\" (UniqueName: \"kubernetes.io/projected/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-kube-api-access-r5k84\") pod \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\" (UID: \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\") " Jul 06 16:33:53.642404 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:53.642218 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-service-ca\") pod \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\" (UID: \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\") " Jul 06 16:33:53.642404 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:53.642246 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-oauth-serving-cert\") pod \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\" (UID: \"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa\") " Jul 06 16:33:53.642628 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:53.642595 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-console-config" (OuterVolumeSpecName: "console-config") pod "11af3eb4-d4ea-4ee6-9877-53f439dcbeaa" (UID: "11af3eb4-d4ea-4ee6-9877-53f439dcbeaa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 16:33:53.642756 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:53.642621 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "11af3eb4-d4ea-4ee6-9877-53f439dcbeaa" (UID: "11af3eb4-d4ea-4ee6-9877-53f439dcbeaa"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 16:33:53.642756 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:53.642658 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-service-ca" (OuterVolumeSpecName: "service-ca") pod "11af3eb4-d4ea-4ee6-9877-53f439dcbeaa" (UID: "11af3eb4-d4ea-4ee6-9877-53f439dcbeaa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 16:33:53.642878 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:53.642792 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "11af3eb4-d4ea-4ee6-9877-53f439dcbeaa" (UID: "11af3eb4-d4ea-4ee6-9877-53f439dcbeaa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 16:33:53.644482 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:53.644455 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-kube-api-access-r5k84" (OuterVolumeSpecName: "kube-api-access-r5k84") pod "11af3eb4-d4ea-4ee6-9877-53f439dcbeaa" (UID: "11af3eb4-d4ea-4ee6-9877-53f439dcbeaa"). InnerVolumeSpecName "kube-api-access-r5k84". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 16:33:53.644574 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:53.644479 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "11af3eb4-d4ea-4ee6-9877-53f439dcbeaa" (UID: "11af3eb4-d4ea-4ee6-9877-53f439dcbeaa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 16:33:53.644574 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:53.644500 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "11af3eb4-d4ea-4ee6-9877-53f439dcbeaa" (UID: "11af3eb4-d4ea-4ee6-9877-53f439dcbeaa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 16:33:53.743003 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:53.742973 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5k84\" (UniqueName: \"kubernetes.io/projected/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-kube-api-access-r5k84\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:33:53.743003 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:53.742998 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-service-ca\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:33:53.743003 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:53.743008 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-oauth-serving-cert\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:33:53.743238 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:53.743016 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-console-oauth-config\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:33:53.743238 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:53.743024 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-console-serving-cert\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:33:53.743238 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:53.743032 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-trusted-ca-bundle\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:33:53.743238 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:53.743039 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa-console-config\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:33:54.419603 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:54.419568 2555 generic.go:356] "Generic (PLEG): container finished" podID="11af3eb4-d4ea-4ee6-9877-53f439dcbeaa" containerID="6509dfd250d93d7b8c2ed359fcf1e8c022d6e5d0bde3e100a204e9291340729a" exitCode=0 Jul 06 16:33:54.420063 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:54.419610 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b96b9d76-9nzvd" Jul 06 16:33:54.420063 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:54.419631 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b96b9d76-9nzvd" event={"ID":"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa","Type":"ContainerDied","Data":"6509dfd250d93d7b8c2ed359fcf1e8c022d6e5d0bde3e100a204e9291340729a"} Jul 06 16:33:54.420063 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:54.419671 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b96b9d76-9nzvd" event={"ID":"11af3eb4-d4ea-4ee6-9877-53f439dcbeaa","Type":"ContainerDied","Data":"5826b87d7504a20af74bb4008d3f64f64798a4dff13d7d2ec54b772ef39aeccc"} Jul 06 16:33:54.420063 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:54.419691 2555 scope.go:117] "RemoveContainer" containerID="6509dfd250d93d7b8c2ed359fcf1e8c022d6e5d0bde3e100a204e9291340729a" Jul 06 16:33:54.430641 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:54.430627 2555 scope.go:117] "RemoveContainer" containerID="6509dfd250d93d7b8c2ed359fcf1e8c022d6e5d0bde3e100a204e9291340729a" Jul 06 16:33:54.431018 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:33:54.430993 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6509dfd250d93d7b8c2ed359fcf1e8c022d6e5d0bde3e100a204e9291340729a\": container with ID starting with 6509dfd250d93d7b8c2ed359fcf1e8c022d6e5d0bde3e100a204e9291340729a not found: ID does not exist" containerID="6509dfd250d93d7b8c2ed359fcf1e8c022d6e5d0bde3e100a204e9291340729a" Jul 06 16:33:54.431085 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:54.431027 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6509dfd250d93d7b8c2ed359fcf1e8c022d6e5d0bde3e100a204e9291340729a"} err="failed to get container status \"6509dfd250d93d7b8c2ed359fcf1e8c022d6e5d0bde3e100a204e9291340729a\": rpc error: code = NotFound desc = could not find container \"6509dfd250d93d7b8c2ed359fcf1e8c022d6e5d0bde3e100a204e9291340729a\": container with ID starting with 6509dfd250d93d7b8c2ed359fcf1e8c022d6e5d0bde3e100a204e9291340729a not found: ID does not exist" Jul 06 16:33:54.441965 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:54.441925 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8b96b9d76-9nzvd"] Jul 06 16:33:54.445643 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:54.445625 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8b96b9d76-9nzvd"] Jul 06 16:33:55.300892 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:55.300854 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11af3eb4-d4ea-4ee6-9877-53f439dcbeaa" path="/var/lib/kubelet/pods/11af3eb4-d4ea-4ee6-9877-53f439dcbeaa/volumes" Jul 06 16:33:57.455921 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:57.455883 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:57.557406 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:57.557378 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:33:59.440595 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:59.440521 2555 generic.go:356] "Generic (PLEG): container finished" podID="a96ad9ee-55e2-46e8-96a1-381dd5af2a2e" containerID="6f244a327a2eafbd45b1cfc1eb5f23062536a4bf4ede46f66d07ae634f817278" exitCode=0 Jul 06 16:33:59.440595 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:59.440583 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z9bg9" event={"ID":"a96ad9ee-55e2-46e8-96a1-381dd5af2a2e","Type":"ContainerDied","Data":"6f244a327a2eafbd45b1cfc1eb5f23062536a4bf4ede46f66d07ae634f817278"} Jul 06 16:33:59.441062 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:33:59.440879 2555 scope.go:117] "RemoveContainer" containerID="6f244a327a2eafbd45b1cfc1eb5f23062536a4bf4ede46f66d07ae634f817278" Jul 06 16:34:00.446863 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:00.446831 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-z9bg9" event={"ID":"a96ad9ee-55e2-46e8-96a1-381dd5af2a2e","Type":"ContainerStarted","Data":"949a579615cc8686de7e3898165760451d449ef6769e98b29ae47a600d3346f4"} Jul 06 16:34:01.451807 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:01.451772 2555 generic.go:356] "Generic (PLEG): container finished" podID="971b799f-3189-4871-bb3d-31faf0287f09" containerID="f2ae24dea300a06044e35cfcb5b81c505eaecda2b43b09a3e41b9742a650cbf7" exitCode=0 Jul 06 16:34:01.452325 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:01.451822 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9h6c5" event={"ID":"971b799f-3189-4871-bb3d-31faf0287f09","Type":"ContainerDied","Data":"f2ae24dea300a06044e35cfcb5b81c505eaecda2b43b09a3e41b9742a650cbf7"} Jul 06 16:34:01.452325 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:01.452275 2555 scope.go:117] "RemoveContainer" containerID="f2ae24dea300a06044e35cfcb5b81c505eaecda2b43b09a3e41b9742a650cbf7" Jul 06 16:34:02.458266 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:02.458237 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9h6c5" event={"ID":"971b799f-3189-4871-bb3d-31faf0287f09","Type":"ContainerStarted","Data":"93521c8d4b729d056b43f9d60afcf1eae8bbde39b2a749fa9f1d8272d092a30a"} Jul 06 16:34:27.026435 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:27.026403 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:34:27.090394 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:27.090368 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:34:30.185680 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:30.185602 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:34:30.619370 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:30.619336 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:34:31.248509 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:31.248474 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 16:34:31.248890 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:31.248754 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d8b70c6e-516a-465a-a346-88909ff5391a" containerName="alertmanager" containerID="cri-o://aeb547a50032a6cd566ccd2c2542821955b5048738394f068ac57793d16938d1" gracePeriod=120 Jul 06 16:34:31.248890 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:31.248859 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d8b70c6e-516a-465a-a346-88909ff5391a" containerName="kube-rbac-proxy-web" containerID="cri-o://cd2b540c22ef04e811a812c4b3f28c2a860627924cfd38a384e8ad31234f2b31" gracePeriod=120 Jul 06 16:34:31.249059 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:31.248896 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d8b70c6e-516a-465a-a346-88909ff5391a" containerName="prom-label-proxy" containerID="cri-o://cd4666a972762c8c3e304e0ec70014904cd0f44e0b2c330c525f77d36faa2046" gracePeriod=120 Jul 06 16:34:31.249059 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:31.248900 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d8b70c6e-516a-465a-a346-88909ff5391a" containerName="config-reloader" containerID="cri-o://a551f6bb7799c2b7aac16b650978e1fb61bb4457d3c02982023c0523b0edbc6a" gracePeriod=120 Jul 06 16:34:31.249059 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:31.248841 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d8b70c6e-516a-465a-a346-88909ff5391a" containerName="kube-rbac-proxy-metric" containerID="cri-o://7e998ea62593f490cde6c46406591c3636a5226d76427a5a1264a0d45ace4ee2" gracePeriod=120 Jul 06 16:34:31.249059 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:31.249000 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d8b70c6e-516a-465a-a346-88909ff5391a" containerName="kube-rbac-proxy" containerID="cri-o://df98d1ffbcfd22b7bb6e9868591f547af4e2c0d5c404f330d7a570f9c6296bf1" gracePeriod=120 Jul 06 16:34:31.584448 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:31.584415 2555 generic.go:356] "Generic (PLEG): container finished" podID="d8b70c6e-516a-465a-a346-88909ff5391a" containerID="cd4666a972762c8c3e304e0ec70014904cd0f44e0b2c330c525f77d36faa2046" exitCode=0 Jul 06 16:34:31.584448 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:31.584443 2555 generic.go:356] "Generic (PLEG): container finished" podID="d8b70c6e-516a-465a-a346-88909ff5391a" containerID="df98d1ffbcfd22b7bb6e9868591f547af4e2c0d5c404f330d7a570f9c6296bf1" exitCode=0 Jul 06 16:34:31.584448 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:31.584449 2555 generic.go:356] "Generic (PLEG): container finished" podID="d8b70c6e-516a-465a-a346-88909ff5391a" containerID="a551f6bb7799c2b7aac16b650978e1fb61bb4457d3c02982023c0523b0edbc6a" exitCode=0 Jul 06 16:34:31.584448 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:31.584454 2555 generic.go:356] "Generic (PLEG): container finished" podID="d8b70c6e-516a-465a-a346-88909ff5391a" containerID="aeb547a50032a6cd566ccd2c2542821955b5048738394f068ac57793d16938d1" exitCode=0 Jul 06 16:34:31.584695 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:31.584490 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8b70c6e-516a-465a-a346-88909ff5391a","Type":"ContainerDied","Data":"cd4666a972762c8c3e304e0ec70014904cd0f44e0b2c330c525f77d36faa2046"} Jul 06 16:34:31.584695 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:31.584546 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8b70c6e-516a-465a-a346-88909ff5391a","Type":"ContainerDied","Data":"df98d1ffbcfd22b7bb6e9868591f547af4e2c0d5c404f330d7a570f9c6296bf1"} Jul 06 16:34:31.584695 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:31.584573 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8b70c6e-516a-465a-a346-88909ff5391a","Type":"ContainerDied","Data":"a551f6bb7799c2b7aac16b650978e1fb61bb4457d3c02982023c0523b0edbc6a"} Jul 06 16:34:31.584695 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:31.584596 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8b70c6e-516a-465a-a346-88909ff5391a","Type":"ContainerDied","Data":"aeb547a50032a6cd566ccd2c2542821955b5048738394f068ac57793d16938d1"} Jul 06 16:34:32.492146 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.492123 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.540110 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.540078 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-secret-alertmanager-kube-rbac-proxy-web\") pod \"d8b70c6e-516a-465a-a346-88909ff5391a\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " Jul 06 16:34:32.540110 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.540108 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-config-volume\") pod \"d8b70c6e-516a-465a-a346-88909ff5391a\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " Jul 06 16:34:32.540338 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.540137 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d8b70c6e-516a-465a-a346-88909ff5391a-alertmanager-main-db\") pod \"d8b70c6e-516a-465a-a346-88909ff5391a\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " Jul 06 16:34:32.540338 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.540169 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d8b70c6e-516a-465a-a346-88909ff5391a-tls-assets\") pod \"d8b70c6e-516a-465a-a346-88909ff5391a\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " Jul 06 16:34:32.540338 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.540199 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-secret-alertmanager-kube-rbac-proxy\") pod \"d8b70c6e-516a-465a-a346-88909ff5391a\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " Jul 06 16:34:32.540338 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.540236 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-cluster-tls-config\") pod \"d8b70c6e-516a-465a-a346-88909ff5391a\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " Jul 06 16:34:32.540338 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.540260 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-secret-alertmanager-main-tls\") pod \"d8b70c6e-516a-465a-a346-88909ff5391a\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " Jul 06 16:34:32.540338 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.540285 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d8b70c6e-516a-465a-a346-88909ff5391a-config-out\") pod \"d8b70c6e-516a-465a-a346-88909ff5391a\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " Jul 06 16:34:32.540338 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.540335 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8b70c6e-516a-465a-a346-88909ff5391a-metrics-client-ca\") pod \"d8b70c6e-516a-465a-a346-88909ff5391a\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " Jul 06 16:34:32.540719 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.540370 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-web-config\") pod \"d8b70c6e-516a-465a-a346-88909ff5391a\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " Jul 06 16:34:32.540719 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.540407 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"d8b70c6e-516a-465a-a346-88909ff5391a\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " Jul 06 16:34:32.540719 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.540430 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b70c6e-516a-465a-a346-88909ff5391a-alertmanager-trusted-ca-bundle\") pod \"d8b70c6e-516a-465a-a346-88909ff5391a\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " Jul 06 16:34:32.540719 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.540453 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvckf\" (UniqueName: \"kubernetes.io/projected/d8b70c6e-516a-465a-a346-88909ff5391a-kube-api-access-gvckf\") pod \"d8b70c6e-516a-465a-a346-88909ff5391a\" (UID: \"d8b70c6e-516a-465a-a346-88909ff5391a\") " Jul 06 16:34:32.540719 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.540525 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8b70c6e-516a-465a-a346-88909ff5391a-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "d8b70c6e-516a-465a-a346-88909ff5391a" (UID: "d8b70c6e-516a-465a-a346-88909ff5391a"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 16:34:32.540719 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.540699 2555 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d8b70c6e-516a-465a-a346-88909ff5391a-alertmanager-main-db\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:34:32.542015 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.541708 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8b70c6e-516a-465a-a346-88909ff5391a-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "d8b70c6e-516a-465a-a346-88909ff5391a" (UID: "d8b70c6e-516a-465a-a346-88909ff5391a"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 16:34:32.542514 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.542468 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8b70c6e-516a-465a-a346-88909ff5391a-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "d8b70c6e-516a-465a-a346-88909ff5391a" (UID: "d8b70c6e-516a-465a-a346-88909ff5391a"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 16:34:32.544719 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.544645 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "d8b70c6e-516a-465a-a346-88909ff5391a" (UID: "d8b70c6e-516a-465a-a346-88909ff5391a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 16:34:32.544719 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.544748 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-config-volume" (OuterVolumeSpecName: "config-volume") pod "d8b70c6e-516a-465a-a346-88909ff5391a" (UID: "d8b70c6e-516a-465a-a346-88909ff5391a"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 16:34:32.544719 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.544766 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8b70c6e-516a-465a-a346-88909ff5391a-kube-api-access-gvckf" (OuterVolumeSpecName: "kube-api-access-gvckf") pod "d8b70c6e-516a-465a-a346-88909ff5391a" (UID: "d8b70c6e-516a-465a-a346-88909ff5391a"). InnerVolumeSpecName "kube-api-access-gvckf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 16:34:32.545031 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.545002 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "d8b70c6e-516a-465a-a346-88909ff5391a" (UID: "d8b70c6e-516a-465a-a346-88909ff5391a"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 16:34:32.545155 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.545132 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "d8b70c6e-516a-465a-a346-88909ff5391a" (UID: "d8b70c6e-516a-465a-a346-88909ff5391a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 16:34:32.545487 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.545463 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "d8b70c6e-516a-465a-a346-88909ff5391a" (UID: "d8b70c6e-516a-465a-a346-88909ff5391a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 16:34:32.545570 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.545537 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8b70c6e-516a-465a-a346-88909ff5391a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d8b70c6e-516a-465a-a346-88909ff5391a" (UID: "d8b70c6e-516a-465a-a346-88909ff5391a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 16:34:32.546327 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.546304 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8b70c6e-516a-465a-a346-88909ff5391a-config-out" (OuterVolumeSpecName: "config-out") pod "d8b70c6e-516a-465a-a346-88909ff5391a" (UID: "d8b70c6e-516a-465a-a346-88909ff5391a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 16:34:32.549838 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.549758 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "d8b70c6e-516a-465a-a346-88909ff5391a" (UID: "d8b70c6e-516a-465a-a346-88909ff5391a"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 16:34:32.557583 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.557556 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-web-config" (OuterVolumeSpecName: "web-config") pod "d8b70c6e-516a-465a-a346-88909ff5391a" (UID: "d8b70c6e-516a-465a-a346-88909ff5391a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 16:34:32.592700 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.592639 2555 generic.go:356] "Generic (PLEG): container finished" podID="d8b70c6e-516a-465a-a346-88909ff5391a" containerID="7e998ea62593f490cde6c46406591c3636a5226d76427a5a1264a0d45ace4ee2" exitCode=0 Jul 06 16:34:32.592700 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.592662 2555 generic.go:356] "Generic (PLEG): container finished" podID="d8b70c6e-516a-465a-a346-88909ff5391a" containerID="cd2b540c22ef04e811a812c4b3f28c2a860627924cfd38a384e8ad31234f2b31" exitCode=0 Jul 06 16:34:32.592825 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.592713 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.592825 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.592710 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8b70c6e-516a-465a-a346-88909ff5391a","Type":"ContainerDied","Data":"7e998ea62593f490cde6c46406591c3636a5226d76427a5a1264a0d45ace4ee2"} Jul 06 16:34:32.592825 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.592780 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8b70c6e-516a-465a-a346-88909ff5391a","Type":"ContainerDied","Data":"cd2b540c22ef04e811a812c4b3f28c2a860627924cfd38a384e8ad31234f2b31"} Jul 06 16:34:32.592825 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.592806 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d8b70c6e-516a-465a-a346-88909ff5391a","Type":"ContainerDied","Data":"fce519715b1cf5b0cfc48cb6d2ded09f6aaf9f82bde292f9d07543dad2be7421"} Jul 06 16:34:32.592957 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.592837 2555 scope.go:117] "RemoveContainer" containerID="cd4666a972762c8c3e304e0ec70014904cd0f44e0b2c330c525f77d36faa2046" Jul 06 16:34:32.601190 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.601170 2555 scope.go:117] "RemoveContainer" containerID="7e998ea62593f490cde6c46406591c3636a5226d76427a5a1264a0d45ace4ee2" Jul 06 16:34:32.608334 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.608314 2555 scope.go:117] "RemoveContainer" containerID="df98d1ffbcfd22b7bb6e9868591f547af4e2c0d5c404f330d7a570f9c6296bf1" Jul 06 16:34:32.615041 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.615026 2555 scope.go:117] "RemoveContainer" containerID="cd2b540c22ef04e811a812c4b3f28c2a860627924cfd38a384e8ad31234f2b31" Jul 06 16:34:32.617572 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.617553 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 16:34:32.622060 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.622041 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 16:34:32.622925 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.622913 2555 scope.go:117] "RemoveContainer" containerID="a551f6bb7799c2b7aac16b650978e1fb61bb4457d3c02982023c0523b0edbc6a" Jul 06 16:34:32.629880 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.629848 2555 scope.go:117] "RemoveContainer" containerID="aeb547a50032a6cd566ccd2c2542821955b5048738394f068ac57793d16938d1" Jul 06 16:34:32.636668 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.636652 2555 scope.go:117] "RemoveContainer" containerID="5f315bb86849320b8d8be9587e5311a0896c31c5de5af6ed38c7e9d2c6a221cc" Jul 06 16:34:32.641826 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.641808 2555 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d8b70c6e-516a-465a-a346-88909ff5391a-tls-assets\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:34:32.641903 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.641828 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:34:32.641903 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.641838 2555 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-cluster-tls-config\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:34:32.641903 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.641848 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-secret-alertmanager-main-tls\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:34:32.641903 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.641856 2555 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d8b70c6e-516a-465a-a346-88909ff5391a-config-out\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:34:32.641903 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.641863 2555 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8b70c6e-516a-465a-a346-88909ff5391a-metrics-client-ca\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:34:32.641903 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.641872 2555 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-web-config\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:34:32.641903 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.641880 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:34:32.641903 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.641890 2555 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8b70c6e-516a-465a-a346-88909ff5391a-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:34:32.641903 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.641899 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvckf\" (UniqueName: \"kubernetes.io/projected/d8b70c6e-516a-465a-a346-88909ff5391a-kube-api-access-gvckf\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:34:32.643780 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.642048 2555 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:34:32.643780 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.642335 2555 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d8b70c6e-516a-465a-a346-88909ff5391a-config-volume\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:34:32.643990 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.643864 2555 scope.go:117] "RemoveContainer" containerID="cd4666a972762c8c3e304e0ec70014904cd0f44e0b2c330c525f77d36faa2046" Jul 06 16:34:32.646228 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:34:32.646187 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd4666a972762c8c3e304e0ec70014904cd0f44e0b2c330c525f77d36faa2046\": container with ID starting with cd4666a972762c8c3e304e0ec70014904cd0f44e0b2c330c525f77d36faa2046 not found: ID does not exist" containerID="cd4666a972762c8c3e304e0ec70014904cd0f44e0b2c330c525f77d36faa2046" Jul 06 16:34:32.646314 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.646239 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd4666a972762c8c3e304e0ec70014904cd0f44e0b2c330c525f77d36faa2046"} err="failed to get container status \"cd4666a972762c8c3e304e0ec70014904cd0f44e0b2c330c525f77d36faa2046\": rpc error: code = NotFound desc = could not find container \"cd4666a972762c8c3e304e0ec70014904cd0f44e0b2c330c525f77d36faa2046\": container with ID starting with cd4666a972762c8c3e304e0ec70014904cd0f44e0b2c330c525f77d36faa2046 not found: ID does not exist" Jul 06 16:34:32.646314 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.646267 2555 scope.go:117] "RemoveContainer" containerID="7e998ea62593f490cde6c46406591c3636a5226d76427a5a1264a0d45ace4ee2" Jul 06 16:34:32.646712 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:34:32.646686 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e998ea62593f490cde6c46406591c3636a5226d76427a5a1264a0d45ace4ee2\": container with ID starting with 7e998ea62593f490cde6c46406591c3636a5226d76427a5a1264a0d45ace4ee2 not found: ID does not exist" containerID="7e998ea62593f490cde6c46406591c3636a5226d76427a5a1264a0d45ace4ee2" Jul 06 16:34:32.646789 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.646724 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e998ea62593f490cde6c46406591c3636a5226d76427a5a1264a0d45ace4ee2"} err="failed to get container status \"7e998ea62593f490cde6c46406591c3636a5226d76427a5a1264a0d45ace4ee2\": rpc error: code = NotFound desc = could not find container \"7e998ea62593f490cde6c46406591c3636a5226d76427a5a1264a0d45ace4ee2\": container with ID starting with 7e998ea62593f490cde6c46406591c3636a5226d76427a5a1264a0d45ace4ee2 not found: ID does not exist" Jul 06 16:34:32.646789 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.646745 2555 scope.go:117] "RemoveContainer" containerID="df98d1ffbcfd22b7bb6e9868591f547af4e2c0d5c404f330d7a570f9c6296bf1" Jul 06 16:34:32.647156 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:34:32.647132 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df98d1ffbcfd22b7bb6e9868591f547af4e2c0d5c404f330d7a570f9c6296bf1\": container with ID starting with df98d1ffbcfd22b7bb6e9868591f547af4e2c0d5c404f330d7a570f9c6296bf1 not found: ID does not exist" containerID="df98d1ffbcfd22b7bb6e9868591f547af4e2c0d5c404f330d7a570f9c6296bf1" Jul 06 16:34:32.647233 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.647164 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df98d1ffbcfd22b7bb6e9868591f547af4e2c0d5c404f330d7a570f9c6296bf1"} err="failed to get container status \"df98d1ffbcfd22b7bb6e9868591f547af4e2c0d5c404f330d7a570f9c6296bf1\": rpc error: code = NotFound desc = could not find container \"df98d1ffbcfd22b7bb6e9868591f547af4e2c0d5c404f330d7a570f9c6296bf1\": container with ID starting with df98d1ffbcfd22b7bb6e9868591f547af4e2c0d5c404f330d7a570f9c6296bf1 not found: ID does not exist" Jul 06 16:34:32.647233 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.647183 2555 scope.go:117] "RemoveContainer" containerID="cd2b540c22ef04e811a812c4b3f28c2a860627924cfd38a384e8ad31234f2b31" Jul 06 16:34:32.647797 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:34:32.647772 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd2b540c22ef04e811a812c4b3f28c2a860627924cfd38a384e8ad31234f2b31\": container with ID starting with cd2b540c22ef04e811a812c4b3f28c2a860627924cfd38a384e8ad31234f2b31 not found: ID does not exist" containerID="cd2b540c22ef04e811a812c4b3f28c2a860627924cfd38a384e8ad31234f2b31" Jul 06 16:34:32.647858 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.647806 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd2b540c22ef04e811a812c4b3f28c2a860627924cfd38a384e8ad31234f2b31"} err="failed to get container status \"cd2b540c22ef04e811a812c4b3f28c2a860627924cfd38a384e8ad31234f2b31\": rpc error: code = NotFound desc = could not find container \"cd2b540c22ef04e811a812c4b3f28c2a860627924cfd38a384e8ad31234f2b31\": container with ID starting with cd2b540c22ef04e811a812c4b3f28c2a860627924cfd38a384e8ad31234f2b31 not found: ID does not exist" Jul 06 16:34:32.647858 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.647825 2555 scope.go:117] "RemoveContainer" containerID="a551f6bb7799c2b7aac16b650978e1fb61bb4457d3c02982023c0523b0edbc6a" Jul 06 16:34:32.648112 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:34:32.648090 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a551f6bb7799c2b7aac16b650978e1fb61bb4457d3c02982023c0523b0edbc6a\": container with ID starting with a551f6bb7799c2b7aac16b650978e1fb61bb4457d3c02982023c0523b0edbc6a not found: ID does not exist" containerID="a551f6bb7799c2b7aac16b650978e1fb61bb4457d3c02982023c0523b0edbc6a" Jul 06 16:34:32.648164 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.648119 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a551f6bb7799c2b7aac16b650978e1fb61bb4457d3c02982023c0523b0edbc6a"} err="failed to get container status \"a551f6bb7799c2b7aac16b650978e1fb61bb4457d3c02982023c0523b0edbc6a\": rpc error: code = NotFound desc = could not find container \"a551f6bb7799c2b7aac16b650978e1fb61bb4457d3c02982023c0523b0edbc6a\": container with ID starting with a551f6bb7799c2b7aac16b650978e1fb61bb4457d3c02982023c0523b0edbc6a not found: ID does not exist" Jul 06 16:34:32.648164 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.648139 2555 scope.go:117] "RemoveContainer" containerID="aeb547a50032a6cd566ccd2c2542821955b5048738394f068ac57793d16938d1" Jul 06 16:34:32.648371 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:34:32.648353 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aeb547a50032a6cd566ccd2c2542821955b5048738394f068ac57793d16938d1\": container with ID starting with aeb547a50032a6cd566ccd2c2542821955b5048738394f068ac57793d16938d1 not found: ID does not exist" containerID="aeb547a50032a6cd566ccd2c2542821955b5048738394f068ac57793d16938d1" Jul 06 16:34:32.648412 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.648375 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aeb547a50032a6cd566ccd2c2542821955b5048738394f068ac57793d16938d1"} err="failed to get container status \"aeb547a50032a6cd566ccd2c2542821955b5048738394f068ac57793d16938d1\": rpc error: code = NotFound desc = could not find container \"aeb547a50032a6cd566ccd2c2542821955b5048738394f068ac57793d16938d1\": container with ID starting with aeb547a50032a6cd566ccd2c2542821955b5048738394f068ac57793d16938d1 not found: ID does not exist" Jul 06 16:34:32.648412 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.648390 2555 scope.go:117] "RemoveContainer" containerID="5f315bb86849320b8d8be9587e5311a0896c31c5de5af6ed38c7e9d2c6a221cc" Jul 06 16:34:32.648641 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:34:32.648624 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f315bb86849320b8d8be9587e5311a0896c31c5de5af6ed38c7e9d2c6a221cc\": container with ID starting with 5f315bb86849320b8d8be9587e5311a0896c31c5de5af6ed38c7e9d2c6a221cc not found: ID does not exist" containerID="5f315bb86849320b8d8be9587e5311a0896c31c5de5af6ed38c7e9d2c6a221cc" Jul 06 16:34:32.648683 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.648645 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f315bb86849320b8d8be9587e5311a0896c31c5de5af6ed38c7e9d2c6a221cc"} err="failed to get container status \"5f315bb86849320b8d8be9587e5311a0896c31c5de5af6ed38c7e9d2c6a221cc\": rpc error: code = NotFound desc = could not find container \"5f315bb86849320b8d8be9587e5311a0896c31c5de5af6ed38c7e9d2c6a221cc\": container with ID starting with 5f315bb86849320b8d8be9587e5311a0896c31c5de5af6ed38c7e9d2c6a221cc not found: ID does not exist" Jul 06 16:34:32.648683 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.648658 2555 scope.go:117] "RemoveContainer" containerID="cd4666a972762c8c3e304e0ec70014904cd0f44e0b2c330c525f77d36faa2046" Jul 06 16:34:32.648901 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.648881 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd4666a972762c8c3e304e0ec70014904cd0f44e0b2c330c525f77d36faa2046"} err="failed to get container status \"cd4666a972762c8c3e304e0ec70014904cd0f44e0b2c330c525f77d36faa2046\": rpc error: code = NotFound desc = could not find container \"cd4666a972762c8c3e304e0ec70014904cd0f44e0b2c330c525f77d36faa2046\": container with ID starting with cd4666a972762c8c3e304e0ec70014904cd0f44e0b2c330c525f77d36faa2046 not found: ID does not exist" Jul 06 16:34:32.648978 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.648902 2555 scope.go:117] "RemoveContainer" containerID="7e998ea62593f490cde6c46406591c3636a5226d76427a5a1264a0d45ace4ee2" Jul 06 16:34:32.649155 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.649135 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e998ea62593f490cde6c46406591c3636a5226d76427a5a1264a0d45ace4ee2"} err="failed to get container status \"7e998ea62593f490cde6c46406591c3636a5226d76427a5a1264a0d45ace4ee2\": rpc error: code = NotFound desc = could not find container \"7e998ea62593f490cde6c46406591c3636a5226d76427a5a1264a0d45ace4ee2\": container with ID starting with 7e998ea62593f490cde6c46406591c3636a5226d76427a5a1264a0d45ace4ee2 not found: ID does not exist" Jul 06 16:34:32.649228 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.649157 2555 scope.go:117] "RemoveContainer" containerID="df98d1ffbcfd22b7bb6e9868591f547af4e2c0d5c404f330d7a570f9c6296bf1" Jul 06 16:34:32.649385 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.649366 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df98d1ffbcfd22b7bb6e9868591f547af4e2c0d5c404f330d7a570f9c6296bf1"} err="failed to get container status \"df98d1ffbcfd22b7bb6e9868591f547af4e2c0d5c404f330d7a570f9c6296bf1\": rpc error: code = NotFound desc = could not find container \"df98d1ffbcfd22b7bb6e9868591f547af4e2c0d5c404f330d7a570f9c6296bf1\": container with ID starting with df98d1ffbcfd22b7bb6e9868591f547af4e2c0d5c404f330d7a570f9c6296bf1 not found: ID does not exist" Jul 06 16:34:32.649429 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.649386 2555 scope.go:117] "RemoveContainer" containerID="cd2b540c22ef04e811a812c4b3f28c2a860627924cfd38a384e8ad31234f2b31" Jul 06 16:34:32.649572 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.649554 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd2b540c22ef04e811a812c4b3f28c2a860627924cfd38a384e8ad31234f2b31"} err="failed to get container status \"cd2b540c22ef04e811a812c4b3f28c2a860627924cfd38a384e8ad31234f2b31\": rpc error: code = NotFound desc = could not find container \"cd2b540c22ef04e811a812c4b3f28c2a860627924cfd38a384e8ad31234f2b31\": container with ID starting with cd2b540c22ef04e811a812c4b3f28c2a860627924cfd38a384e8ad31234f2b31 not found: ID does not exist" Jul 06 16:34:32.649639 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.649573 2555 scope.go:117] "RemoveContainer" containerID="a551f6bb7799c2b7aac16b650978e1fb61bb4457d3c02982023c0523b0edbc6a" Jul 06 16:34:32.649780 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.649762 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a551f6bb7799c2b7aac16b650978e1fb61bb4457d3c02982023c0523b0edbc6a"} err="failed to get container status \"a551f6bb7799c2b7aac16b650978e1fb61bb4457d3c02982023c0523b0edbc6a\": rpc error: code = NotFound desc = could not find container \"a551f6bb7799c2b7aac16b650978e1fb61bb4457d3c02982023c0523b0edbc6a\": container with ID starting with a551f6bb7799c2b7aac16b650978e1fb61bb4457d3c02982023c0523b0edbc6a not found: ID does not exist" Jul 06 16:34:32.649835 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.649781 2555 scope.go:117] "RemoveContainer" containerID="aeb547a50032a6cd566ccd2c2542821955b5048738394f068ac57793d16938d1" Jul 06 16:34:32.650009 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.649993 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aeb547a50032a6cd566ccd2c2542821955b5048738394f068ac57793d16938d1"} err="failed to get container status \"aeb547a50032a6cd566ccd2c2542821955b5048738394f068ac57793d16938d1\": rpc error: code = NotFound desc = could not find container \"aeb547a50032a6cd566ccd2c2542821955b5048738394f068ac57793d16938d1\": container with ID starting with aeb547a50032a6cd566ccd2c2542821955b5048738394f068ac57793d16938d1 not found: ID does not exist" Jul 06 16:34:32.650009 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.650008 2555 scope.go:117] "RemoveContainer" containerID="5f315bb86849320b8d8be9587e5311a0896c31c5de5af6ed38c7e9d2c6a221cc" Jul 06 16:34:32.650226 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.650202 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f315bb86849320b8d8be9587e5311a0896c31c5de5af6ed38c7e9d2c6a221cc"} err="failed to get container status \"5f315bb86849320b8d8be9587e5311a0896c31c5de5af6ed38c7e9d2c6a221cc\": rpc error: code = NotFound desc = could not find container \"5f315bb86849320b8d8be9587e5311a0896c31c5de5af6ed38c7e9d2c6a221cc\": container with ID starting with 5f315bb86849320b8d8be9587e5311a0896c31c5de5af6ed38c7e9d2c6a221cc not found: ID does not exist" Jul 06 16:34:32.654327 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.654301 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 16:34:32.654723 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.654710 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8b70c6e-516a-465a-a346-88909ff5391a" containerName="kube-rbac-proxy" Jul 06 16:34:32.654762 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.654725 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8b70c6e-516a-465a-a346-88909ff5391a" containerName="kube-rbac-proxy" Jul 06 16:34:32.654762 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.654735 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8b70c6e-516a-465a-a346-88909ff5391a" containerName="init-config-reloader" Jul 06 16:34:32.654762 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.654740 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8b70c6e-516a-465a-a346-88909ff5391a" containerName="init-config-reloader" Jul 06 16:34:32.654762 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.654749 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8b70c6e-516a-465a-a346-88909ff5391a" containerName="kube-rbac-proxy-web" Jul 06 16:34:32.654762 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.654754 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8b70c6e-516a-465a-a346-88909ff5391a" containerName="kube-rbac-proxy-web" Jul 06 16:34:32.654762 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.654762 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11af3eb4-d4ea-4ee6-9877-53f439dcbeaa" containerName="console" Jul 06 16:34:32.654975 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.654767 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="11af3eb4-d4ea-4ee6-9877-53f439dcbeaa" containerName="console" Jul 06 16:34:32.654975 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.654774 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc190016-0f8b-43e2-b58a-adf06919b33d" containerName="console" Jul 06 16:34:32.654975 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.654778 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc190016-0f8b-43e2-b58a-adf06919b33d" containerName="console" Jul 06 16:34:32.654975 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.654786 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8b70c6e-516a-465a-a346-88909ff5391a" containerName="prom-label-proxy" Jul 06 16:34:32.654975 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.654791 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8b70c6e-516a-465a-a346-88909ff5391a" containerName="prom-label-proxy" Jul 06 16:34:32.654975 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.654799 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8b70c6e-516a-465a-a346-88909ff5391a" containerName="config-reloader" Jul 06 16:34:32.654975 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.654804 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8b70c6e-516a-465a-a346-88909ff5391a" containerName="config-reloader" Jul 06 16:34:32.654975 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.654808 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8b70c6e-516a-465a-a346-88909ff5391a" containerName="kube-rbac-proxy-metric" Jul 06 16:34:32.654975 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.654813 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8b70c6e-516a-465a-a346-88909ff5391a" containerName="kube-rbac-proxy-metric" Jul 06 16:34:32.654975 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.654822 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8b70c6e-516a-465a-a346-88909ff5391a" containerName="alertmanager" Jul 06 16:34:32.654975 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.654827 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8b70c6e-516a-465a-a346-88909ff5391a" containerName="alertmanager" Jul 06 16:34:32.654975 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.654865 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8b70c6e-516a-465a-a346-88909ff5391a" containerName="kube-rbac-proxy" Jul 06 16:34:32.654975 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.654874 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8b70c6e-516a-465a-a346-88909ff5391a" containerName="config-reloader" Jul 06 16:34:32.654975 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.654881 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="11af3eb4-d4ea-4ee6-9877-53f439dcbeaa" containerName="console" Jul 06 16:34:32.654975 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.654885 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8b70c6e-516a-465a-a346-88909ff5391a" containerName="kube-rbac-proxy-web" Jul 06 16:34:32.654975 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.654890 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8b70c6e-516a-465a-a346-88909ff5391a" containerName="alertmanager" Jul 06 16:34:32.654975 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.654895 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8b70c6e-516a-465a-a346-88909ff5391a" containerName="prom-label-proxy" Jul 06 16:34:32.654975 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.654900 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc190016-0f8b-43e2-b58a-adf06919b33d" containerName="console" Jul 06 16:34:32.654975 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.654906 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8b70c6e-516a-465a-a346-88909ff5391a" containerName="kube-rbac-proxy-metric" Jul 06 16:34:32.658274 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.658257 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.661495 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.661479 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 16:34:32.661574 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.661555 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 16:34:32.661639 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.661479 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 16:34:32.661685 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.661652 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 16:34:32.661765 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.661747 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 16:34:32.661850 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.661836 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ggsfr\"" Jul 06 16:34:32.661932 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.661918 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 16:34:32.662044 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.662029 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 16:34:32.662088 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.662061 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 16:34:32.667880 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.667857 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 16:34:32.678895 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.678873 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 16:34:32.743227 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.743189 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e12770d0-5fee-4b5e-9df3-db62ec655e3d-web-config\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.743227 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.743231 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e12770d0-5fee-4b5e-9df3-db62ec655e3d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.743437 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.743258 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e12770d0-5fee-4b5e-9df3-db62ec655e3d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.743437 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.743312 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57jrb\" (UniqueName: \"kubernetes.io/projected/e12770d0-5fee-4b5e-9df3-db62ec655e3d-kube-api-access-57jrb\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.743437 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.743386 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e12770d0-5fee-4b5e-9df3-db62ec655e3d-config-volume\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.743437 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.743414 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e12770d0-5fee-4b5e-9df3-db62ec655e3d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.743437 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.743430 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e12770d0-5fee-4b5e-9df3-db62ec655e3d-config-out\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.743612 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.743447 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e12770d0-5fee-4b5e-9df3-db62ec655e3d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.743612 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.743467 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e12770d0-5fee-4b5e-9df3-db62ec655e3d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.743612 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.743514 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e12770d0-5fee-4b5e-9df3-db62ec655e3d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.743612 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.743570 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e12770d0-5fee-4b5e-9df3-db62ec655e3d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.743612 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.743594 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e12770d0-5fee-4b5e-9df3-db62ec655e3d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.743777 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.743611 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e12770d0-5fee-4b5e-9df3-db62ec655e3d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.844096 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.844020 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e12770d0-5fee-4b5e-9df3-db62ec655e3d-web-config\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.844096 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.844055 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e12770d0-5fee-4b5e-9df3-db62ec655e3d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.844096 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.844073 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e12770d0-5fee-4b5e-9df3-db62ec655e3d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.844279 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.844097 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57jrb\" (UniqueName: \"kubernetes.io/projected/e12770d0-5fee-4b5e-9df3-db62ec655e3d-kube-api-access-57jrb\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.844279 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.844225 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e12770d0-5fee-4b5e-9df3-db62ec655e3d-config-volume\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.844279 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.844269 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e12770d0-5fee-4b5e-9df3-db62ec655e3d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.844437 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.844295 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e12770d0-5fee-4b5e-9df3-db62ec655e3d-config-out\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.844437 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.844323 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e12770d0-5fee-4b5e-9df3-db62ec655e3d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.844437 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.844352 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e12770d0-5fee-4b5e-9df3-db62ec655e3d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.844437 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.844384 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e12770d0-5fee-4b5e-9df3-db62ec655e3d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.844705 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.844438 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e12770d0-5fee-4b5e-9df3-db62ec655e3d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.844705 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.844447 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e12770d0-5fee-4b5e-9df3-db62ec655e3d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.844705 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.844467 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e12770d0-5fee-4b5e-9df3-db62ec655e3d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.844705 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.844507 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e12770d0-5fee-4b5e-9df3-db62ec655e3d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.845696 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.845668 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e12770d0-5fee-4b5e-9df3-db62ec655e3d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.847397 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.847224 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e12770d0-5fee-4b5e-9df3-db62ec655e3d-config-out\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.847397 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.847369 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e12770d0-5fee-4b5e-9df3-db62ec655e3d-config-volume\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.847562 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.847427 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e12770d0-5fee-4b5e-9df3-db62ec655e3d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.847562 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.847508 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e12770d0-5fee-4b5e-9df3-db62ec655e3d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.847562 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.847520 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e12770d0-5fee-4b5e-9df3-db62ec655e3d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.847716 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.847676 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e12770d0-5fee-4b5e-9df3-db62ec655e3d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.847894 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.847870 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e12770d0-5fee-4b5e-9df3-db62ec655e3d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.848016 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.847875 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e12770d0-5fee-4b5e-9df3-db62ec655e3d-web-config\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.848174 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.848158 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e12770d0-5fee-4b5e-9df3-db62ec655e3d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.849455 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.849438 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e12770d0-5fee-4b5e-9df3-db62ec655e3d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.853144 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.853126 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57jrb\" (UniqueName: \"kubernetes.io/projected/e12770d0-5fee-4b5e-9df3-db62ec655e3d-kube-api-access-57jrb\") pod \"alertmanager-main-0\" (UID: \"e12770d0-5fee-4b5e-9df3-db62ec655e3d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:32.967903 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:32.967859 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 16:34:33.106002 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:33.105978 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 16:34:33.107535 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:34:33.107510 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode12770d0_5fee_4b5e_9df3_db62ec655e3d.slice/crio-dc3bfccd1fe662f413acbdb5714124a5229f1ff4a5140ecc4f36493e6e7c80f1 WatchSource:0}: Error finding container dc3bfccd1fe662f413acbdb5714124a5229f1ff4a5140ecc4f36493e6e7c80f1: Status 404 returned error can't find the container with id dc3bfccd1fe662f413acbdb5714124a5229f1ff4a5140ecc4f36493e6e7c80f1 Jul 06 16:34:33.301320 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:33.301288 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8b70c6e-516a-465a-a346-88909ff5391a" path="/var/lib/kubelet/pods/d8b70c6e-516a-465a-a346-88909ff5391a/volumes" Jul 06 16:34:33.599470 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:33.599439 2555 generic.go:356] "Generic (PLEG): container finished" podID="e12770d0-5fee-4b5e-9df3-db62ec655e3d" containerID="628df2cd42c631f1b56c212d34c878678696c5ee04f10cac6a504dc86bb8f3aa" exitCode=0 Jul 06 16:34:33.599837 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:33.599521 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e12770d0-5fee-4b5e-9df3-db62ec655e3d","Type":"ContainerDied","Data":"628df2cd42c631f1b56c212d34c878678696c5ee04f10cac6a504dc86bb8f3aa"} Jul 06 16:34:33.599837 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:33.599590 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e12770d0-5fee-4b5e-9df3-db62ec655e3d","Type":"ContainerStarted","Data":"dc3bfccd1fe662f413acbdb5714124a5229f1ff4a5140ecc4f36493e6e7c80f1"} Jul 06 16:34:34.610792 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:34.610753 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e12770d0-5fee-4b5e-9df3-db62ec655e3d","Type":"ContainerStarted","Data":"f18e9440aa6cc49ebb238860fa40c4efc38b09a4c45fd7a1cfee377a7e5696eb"} Jul 06 16:34:34.611200 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:34.610838 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e12770d0-5fee-4b5e-9df3-db62ec655e3d","Type":"ContainerStarted","Data":"0328786d6dc85b5c49a0b830ebbba3457945337639ec22b6d25407d627020534"} Jul 06 16:34:34.611200 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:34.610864 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e12770d0-5fee-4b5e-9df3-db62ec655e3d","Type":"ContainerStarted","Data":"1b4326200efe126faf37f28e981902e6d38d259f852d7f2128736df49c628142"} Jul 06 16:34:34.611200 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:34.610888 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e12770d0-5fee-4b5e-9df3-db62ec655e3d","Type":"ContainerStarted","Data":"2d1a68fa551c3aa1b63f1f420f09b21039f427ad1384e6a8d10385732d8c2856"} Jul 06 16:34:34.611200 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:34.610912 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e12770d0-5fee-4b5e-9df3-db62ec655e3d","Type":"ContainerStarted","Data":"c56863469e5da2f3159bdd23f74660adc4bbcacba9b5897131ed77cd492a73bb"} Jul 06 16:34:34.611200 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:34.610935 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e12770d0-5fee-4b5e-9df3-db62ec655e3d","Type":"ContainerStarted","Data":"ad4c49298effdc42e06b87ade0fa7f1c2516b751b5d64b037538e69969ab0792"} Jul 06 16:34:34.640577 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:34.640533 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.625743089 podStartE2EDuration="2.6405173s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.774211ms" isStatefulPod=false podCreationTimestamp="2026-07-06 16:34:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:34:34.638310547 +0000 UTC m=+355.907381583" watchObservedRunningTime="2026-07-06 16:34:34.6405173 +0000 UTC m=+355.909588334" Jul 06 16:34:35.288008 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.287969 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-97498c9d-lm82s"] Jul 06 16:34:35.290848 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.290827 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-97498c9d-lm82s" Jul 06 16:34:35.293166 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.293145 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-m8rh2\"" Jul 06 16:34:35.293166 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.293152 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 06 16:34:35.293337 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.293187 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 06 16:34:35.293337 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.293152 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 06 16:34:35.293337 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.293152 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 06 16:34:35.293337 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.293305 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 06 16:34:35.298261 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.298239 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 06 16:34:35.309905 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.309870 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-97498c9d-lm82s"] Jul 06 16:34:35.365019 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.364984 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1497c949-e6ab-49ad-a4cf-d7548b9ad4c8-federate-client-tls\") pod \"telemeter-client-97498c9d-lm82s\" (UID: \"1497c949-e6ab-49ad-a4cf-d7548b9ad4c8\") " pod="openshift-monitoring/telemeter-client-97498c9d-lm82s" Jul 06 16:34:35.365213 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.365031 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1497c949-e6ab-49ad-a4cf-d7548b9ad4c8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-97498c9d-lm82s\" (UID: \"1497c949-e6ab-49ad-a4cf-d7548b9ad4c8\") " pod="openshift-monitoring/telemeter-client-97498c9d-lm82s" Jul 06 16:34:35.365213 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.365053 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1497c949-e6ab-49ad-a4cf-d7548b9ad4c8-telemeter-client-tls\") pod \"telemeter-client-97498c9d-lm82s\" (UID: \"1497c949-e6ab-49ad-a4cf-d7548b9ad4c8\") " pod="openshift-monitoring/telemeter-client-97498c9d-lm82s" Jul 06 16:34:35.365340 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.365258 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1497c949-e6ab-49ad-a4cf-d7548b9ad4c8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-97498c9d-lm82s\" (UID: \"1497c949-e6ab-49ad-a4cf-d7548b9ad4c8\") " pod="openshift-monitoring/telemeter-client-97498c9d-lm82s" Jul 06 16:34:35.365340 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.365297 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1497c949-e6ab-49ad-a4cf-d7548b9ad4c8-serving-certs-ca-bundle\") pod \"telemeter-client-97498c9d-lm82s\" (UID: \"1497c949-e6ab-49ad-a4cf-d7548b9ad4c8\") " pod="openshift-monitoring/telemeter-client-97498c9d-lm82s" Jul 06 16:34:35.365445 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.365394 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1497c949-e6ab-49ad-a4cf-d7548b9ad4c8-metrics-client-ca\") pod \"telemeter-client-97498c9d-lm82s\" (UID: \"1497c949-e6ab-49ad-a4cf-d7548b9ad4c8\") " pod="openshift-monitoring/telemeter-client-97498c9d-lm82s" Jul 06 16:34:35.365496 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.365441 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1497c949-e6ab-49ad-a4cf-d7548b9ad4c8-secret-telemeter-client\") pod \"telemeter-client-97498c9d-lm82s\" (UID: \"1497c949-e6ab-49ad-a4cf-d7548b9ad4c8\") " pod="openshift-monitoring/telemeter-client-97498c9d-lm82s" Jul 06 16:34:35.365573 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.365551 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89rf6\" (UniqueName: \"kubernetes.io/projected/1497c949-e6ab-49ad-a4cf-d7548b9ad4c8-kube-api-access-89rf6\") pod \"telemeter-client-97498c9d-lm82s\" (UID: \"1497c949-e6ab-49ad-a4cf-d7548b9ad4c8\") " pod="openshift-monitoring/telemeter-client-97498c9d-lm82s" Jul 06 16:34:35.465993 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.465916 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89rf6\" (UniqueName: \"kubernetes.io/projected/1497c949-e6ab-49ad-a4cf-d7548b9ad4c8-kube-api-access-89rf6\") pod \"telemeter-client-97498c9d-lm82s\" (UID: \"1497c949-e6ab-49ad-a4cf-d7548b9ad4c8\") " pod="openshift-monitoring/telemeter-client-97498c9d-lm82s" Jul 06 16:34:35.466190 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.466010 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1497c949-e6ab-49ad-a4cf-d7548b9ad4c8-federate-client-tls\") pod \"telemeter-client-97498c9d-lm82s\" (UID: \"1497c949-e6ab-49ad-a4cf-d7548b9ad4c8\") " pod="openshift-monitoring/telemeter-client-97498c9d-lm82s" Jul 06 16:34:35.466190 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.466038 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1497c949-e6ab-49ad-a4cf-d7548b9ad4c8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-97498c9d-lm82s\" (UID: \"1497c949-e6ab-49ad-a4cf-d7548b9ad4c8\") " pod="openshift-monitoring/telemeter-client-97498c9d-lm82s" Jul 06 16:34:35.466190 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.466063 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1497c949-e6ab-49ad-a4cf-d7548b9ad4c8-telemeter-client-tls\") pod \"telemeter-client-97498c9d-lm82s\" (UID: \"1497c949-e6ab-49ad-a4cf-d7548b9ad4c8\") " pod="openshift-monitoring/telemeter-client-97498c9d-lm82s" Jul 06 16:34:35.466190 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.466095 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1497c949-e6ab-49ad-a4cf-d7548b9ad4c8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-97498c9d-lm82s\" (UID: \"1497c949-e6ab-49ad-a4cf-d7548b9ad4c8\") " pod="openshift-monitoring/telemeter-client-97498c9d-lm82s" Jul 06 16:34:35.466190 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.466116 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1497c949-e6ab-49ad-a4cf-d7548b9ad4c8-serving-certs-ca-bundle\") pod \"telemeter-client-97498c9d-lm82s\" (UID: \"1497c949-e6ab-49ad-a4cf-d7548b9ad4c8\") " pod="openshift-monitoring/telemeter-client-97498c9d-lm82s" Jul 06 16:34:35.466190 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.466167 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1497c949-e6ab-49ad-a4cf-d7548b9ad4c8-metrics-client-ca\") pod \"telemeter-client-97498c9d-lm82s\" (UID: \"1497c949-e6ab-49ad-a4cf-d7548b9ad4c8\") " pod="openshift-monitoring/telemeter-client-97498c9d-lm82s" Jul 06 16:34:35.466488 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.466199 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1497c949-e6ab-49ad-a4cf-d7548b9ad4c8-secret-telemeter-client\") pod \"telemeter-client-97498c9d-lm82s\" (UID: \"1497c949-e6ab-49ad-a4cf-d7548b9ad4c8\") " pod="openshift-monitoring/telemeter-client-97498c9d-lm82s" Jul 06 16:34:35.467089 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.467028 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1497c949-e6ab-49ad-a4cf-d7548b9ad4c8-serving-certs-ca-bundle\") pod \"telemeter-client-97498c9d-lm82s\" (UID: \"1497c949-e6ab-49ad-a4cf-d7548b9ad4c8\") " pod="openshift-monitoring/telemeter-client-97498c9d-lm82s" Jul 06 16:34:35.467271 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.467247 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1497c949-e6ab-49ad-a4cf-d7548b9ad4c8-metrics-client-ca\") pod \"telemeter-client-97498c9d-lm82s\" (UID: \"1497c949-e6ab-49ad-a4cf-d7548b9ad4c8\") " pod="openshift-monitoring/telemeter-client-97498c9d-lm82s" Jul 06 16:34:35.467374 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.467354 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1497c949-e6ab-49ad-a4cf-d7548b9ad4c8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-97498c9d-lm82s\" (UID: \"1497c949-e6ab-49ad-a4cf-d7548b9ad4c8\") " pod="openshift-monitoring/telemeter-client-97498c9d-lm82s" Jul 06 16:34:35.468806 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.468742 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1497c949-e6ab-49ad-a4cf-d7548b9ad4c8-telemeter-client-tls\") pod \"telemeter-client-97498c9d-lm82s\" (UID: \"1497c949-e6ab-49ad-a4cf-d7548b9ad4c8\") " pod="openshift-monitoring/telemeter-client-97498c9d-lm82s" Jul 06 16:34:35.468806 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.468763 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1497c949-e6ab-49ad-a4cf-d7548b9ad4c8-federate-client-tls\") pod \"telemeter-client-97498c9d-lm82s\" (UID: \"1497c949-e6ab-49ad-a4cf-d7548b9ad4c8\") " pod="openshift-monitoring/telemeter-client-97498c9d-lm82s" Jul 06 16:34:35.469078 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.469063 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1497c949-e6ab-49ad-a4cf-d7548b9ad4c8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-97498c9d-lm82s\" (UID: \"1497c949-e6ab-49ad-a4cf-d7548b9ad4c8\") " pod="openshift-monitoring/telemeter-client-97498c9d-lm82s" Jul 06 16:34:35.469151 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.469135 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1497c949-e6ab-49ad-a4cf-d7548b9ad4c8-secret-telemeter-client\") pod \"telemeter-client-97498c9d-lm82s\" (UID: \"1497c949-e6ab-49ad-a4cf-d7548b9ad4c8\") " pod="openshift-monitoring/telemeter-client-97498c9d-lm82s" Jul 06 16:34:35.473998 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.473979 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89rf6\" (UniqueName: \"kubernetes.io/projected/1497c949-e6ab-49ad-a4cf-d7548b9ad4c8-kube-api-access-89rf6\") pod \"telemeter-client-97498c9d-lm82s\" (UID: \"1497c949-e6ab-49ad-a4cf-d7548b9ad4c8\") " pod="openshift-monitoring/telemeter-client-97498c9d-lm82s" Jul 06 16:34:35.601531 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.601497 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-97498c9d-lm82s" Jul 06 16:34:35.734410 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.734376 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-97498c9d-lm82s"] Jul 06 16:34:35.737476 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:34:35.737447 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1497c949_e6ab_49ad_a4cf_d7548b9ad4c8.slice/crio-88f34065400f0d1701f18214fe22c1c34311128b85f04f817ec742374b06624d WatchSource:0}: Error finding container 88f34065400f0d1701f18214fe22c1c34311128b85f04f817ec742374b06624d: Status 404 returned error can't find the container with id 88f34065400f0d1701f18214fe22c1c34311128b85f04f817ec742374b06624d Jul 06 16:34:35.739502 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:35.739485 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 16:34:36.619888 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:36.619856 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-97498c9d-lm82s" event={"ID":"1497c949-e6ab-49ad-a4cf-d7548b9ad4c8","Type":"ContainerStarted","Data":"88f34065400f0d1701f18214fe22c1c34311128b85f04f817ec742374b06624d"} Jul 06 16:34:39.635277 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:39.635238 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-97498c9d-lm82s" event={"ID":"1497c949-e6ab-49ad-a4cf-d7548b9ad4c8","Type":"ContainerStarted","Data":"b94dd59b9818131aadde22803f9f2fa361575549d4c0347844ac8d815202920b"} Jul 06 16:34:39.635745 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:39.635296 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-97498c9d-lm82s" event={"ID":"1497c949-e6ab-49ad-a4cf-d7548b9ad4c8","Type":"ContainerStarted","Data":"b010212830a0cf5afdc9742049242a49c9ec2f7eec7b13cdb5835335537a4713"} Jul 06 16:34:39.635745 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:39.635316 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-97498c9d-lm82s" event={"ID":"1497c949-e6ab-49ad-a4cf-d7548b9ad4c8","Type":"ContainerStarted","Data":"1ffa09020ba40468fc11b33a2281ea7e2be47f30ec5521aa083f61a421d334ec"} Jul 06 16:34:39.656959 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:39.656894 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-97498c9d-lm82s" podStartSLOduration=1.484623116 podStartE2EDuration="4.656879503s" totalImagesPullingTime="3.172256387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:34:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:34:39.655899586 +0000 UTC m=+360.924970635" watchObservedRunningTime="2026-07-06 16:34:39.656879503 +0000 UTC m=+360.925950540" Jul 06 16:34:40.448405 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.448370 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59f89c68cc-25qp4"] Jul 06 16:34:40.451197 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.451181 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f89c68cc-25qp4" Jul 06 16:34:40.453321 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.453300 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 16:34:40.453432 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.453374 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 16:34:40.453900 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.453884 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 16:34:40.454029 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.454014 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-l5k4m\"" Jul 06 16:34:40.454092 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.454071 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 16:34:40.454729 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.454713 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 16:34:40.459568 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.459543 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 16:34:40.463897 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.463878 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59f89c68cc-25qp4"] Jul 06 16:34:40.510684 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.510653 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c25bec0-f611-4a1b-a942-739bb3ee9678-trusted-ca-bundle\") pod \"console-59f89c68cc-25qp4\" (UID: \"7c25bec0-f611-4a1b-a942-739bb3ee9678\") " pod="openshift-console/console-59f89c68cc-25qp4" Jul 06 16:34:40.510684 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.510687 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c25bec0-f611-4a1b-a942-739bb3ee9678-console-config\") pod \"console-59f89c68cc-25qp4\" (UID: \"7c25bec0-f611-4a1b-a942-739bb3ee9678\") " pod="openshift-console/console-59f89c68cc-25qp4" Jul 06 16:34:40.510844 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.510722 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c25bec0-f611-4a1b-a942-739bb3ee9678-oauth-serving-cert\") pod \"console-59f89c68cc-25qp4\" (UID: \"7c25bec0-f611-4a1b-a942-739bb3ee9678\") " pod="openshift-console/console-59f89c68cc-25qp4" Jul 06 16:34:40.510844 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.510795 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbd98\" (UniqueName: \"kubernetes.io/projected/7c25bec0-f611-4a1b-a942-739bb3ee9678-kube-api-access-sbd98\") pod \"console-59f89c68cc-25qp4\" (UID: \"7c25bec0-f611-4a1b-a942-739bb3ee9678\") " pod="openshift-console/console-59f89c68cc-25qp4" Jul 06 16:34:40.510925 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.510842 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c25bec0-f611-4a1b-a942-739bb3ee9678-service-ca\") pod \"console-59f89c68cc-25qp4\" (UID: \"7c25bec0-f611-4a1b-a942-739bb3ee9678\") " pod="openshift-console/console-59f89c68cc-25qp4" Jul 06 16:34:40.510925 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.510863 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c25bec0-f611-4a1b-a942-739bb3ee9678-console-serving-cert\") pod \"console-59f89c68cc-25qp4\" (UID: \"7c25bec0-f611-4a1b-a942-739bb3ee9678\") " pod="openshift-console/console-59f89c68cc-25qp4" Jul 06 16:34:40.510925 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.510904 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c25bec0-f611-4a1b-a942-739bb3ee9678-console-oauth-config\") pod \"console-59f89c68cc-25qp4\" (UID: \"7c25bec0-f611-4a1b-a942-739bb3ee9678\") " pod="openshift-console/console-59f89c68cc-25qp4" Jul 06 16:34:40.559078 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.559040 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:34:40.611933 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.611904 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c25bec0-f611-4a1b-a942-739bb3ee9678-trusted-ca-bundle\") pod \"console-59f89c68cc-25qp4\" (UID: \"7c25bec0-f611-4a1b-a942-739bb3ee9678\") " pod="openshift-console/console-59f89c68cc-25qp4" Jul 06 16:34:40.612033 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.611960 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c25bec0-f611-4a1b-a942-739bb3ee9678-console-config\") pod \"console-59f89c68cc-25qp4\" (UID: \"7c25bec0-f611-4a1b-a942-739bb3ee9678\") " pod="openshift-console/console-59f89c68cc-25qp4" Jul 06 16:34:40.612033 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.611996 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c25bec0-f611-4a1b-a942-739bb3ee9678-oauth-serving-cert\") pod \"console-59f89c68cc-25qp4\" (UID: \"7c25bec0-f611-4a1b-a942-739bb3ee9678\") " pod="openshift-console/console-59f89c68cc-25qp4" Jul 06 16:34:40.612033 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.612019 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbd98\" (UniqueName: \"kubernetes.io/projected/7c25bec0-f611-4a1b-a942-739bb3ee9678-kube-api-access-sbd98\") pod \"console-59f89c68cc-25qp4\" (UID: \"7c25bec0-f611-4a1b-a942-739bb3ee9678\") " pod="openshift-console/console-59f89c68cc-25qp4" Jul 06 16:34:40.612140 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.612037 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c25bec0-f611-4a1b-a942-739bb3ee9678-service-ca\") pod \"console-59f89c68cc-25qp4\" (UID: \"7c25bec0-f611-4a1b-a942-739bb3ee9678\") " pod="openshift-console/console-59f89c68cc-25qp4" Jul 06 16:34:40.612140 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.612053 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c25bec0-f611-4a1b-a942-739bb3ee9678-console-serving-cert\") pod \"console-59f89c68cc-25qp4\" (UID: \"7c25bec0-f611-4a1b-a942-739bb3ee9678\") " pod="openshift-console/console-59f89c68cc-25qp4" Jul 06 16:34:40.612140 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.612070 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c25bec0-f611-4a1b-a942-739bb3ee9678-console-oauth-config\") pod \"console-59f89c68cc-25qp4\" (UID: \"7c25bec0-f611-4a1b-a942-739bb3ee9678\") " pod="openshift-console/console-59f89c68cc-25qp4" Jul 06 16:34:40.612888 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.612862 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c25bec0-f611-4a1b-a942-739bb3ee9678-console-config\") pod \"console-59f89c68cc-25qp4\" (UID: \"7c25bec0-f611-4a1b-a942-739bb3ee9678\") " pod="openshift-console/console-59f89c68cc-25qp4" Jul 06 16:34:40.613004 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.612884 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c25bec0-f611-4a1b-a942-739bb3ee9678-service-ca\") pod \"console-59f89c68cc-25qp4\" (UID: \"7c25bec0-f611-4a1b-a942-739bb3ee9678\") " pod="openshift-console/console-59f89c68cc-25qp4" Jul 06 16:34:40.613004 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.612893 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c25bec0-f611-4a1b-a942-739bb3ee9678-trusted-ca-bundle\") pod \"console-59f89c68cc-25qp4\" (UID: \"7c25bec0-f611-4a1b-a942-739bb3ee9678\") " pod="openshift-console/console-59f89c68cc-25qp4" Jul 06 16:34:40.613114 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.613014 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c25bec0-f611-4a1b-a942-739bb3ee9678-oauth-serving-cert\") pod \"console-59f89c68cc-25qp4\" (UID: \"7c25bec0-f611-4a1b-a942-739bb3ee9678\") " pod="openshift-console/console-59f89c68cc-25qp4" Jul 06 16:34:40.614686 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.614665 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c25bec0-f611-4a1b-a942-739bb3ee9678-console-oauth-config\") pod \"console-59f89c68cc-25qp4\" (UID: \"7c25bec0-f611-4a1b-a942-739bb3ee9678\") " pod="openshift-console/console-59f89c68cc-25qp4" Jul 06 16:34:40.614907 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.614886 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c25bec0-f611-4a1b-a942-739bb3ee9678-console-serving-cert\") pod \"console-59f89c68cc-25qp4\" (UID: \"7c25bec0-f611-4a1b-a942-739bb3ee9678\") " pod="openshift-console/console-59f89c68cc-25qp4" Jul 06 16:34:40.620520 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.620496 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbd98\" (UniqueName: \"kubernetes.io/projected/7c25bec0-f611-4a1b-a942-739bb3ee9678-kube-api-access-sbd98\") pod \"console-59f89c68cc-25qp4\" (UID: \"7c25bec0-f611-4a1b-a942-739bb3ee9678\") " pod="openshift-console/console-59f89c68cc-25qp4" Jul 06 16:34:40.763268 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.763186 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f89c68cc-25qp4" Jul 06 16:34:40.777402 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.777371 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:34:40.877365 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.877332 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:34:40.890777 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:40.890756 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59f89c68cc-25qp4"] Jul 06 16:34:40.893208 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:34:40.893185 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c25bec0_f611_4a1b_a942_739bb3ee9678.slice/crio-94031176e095a7b17f33bd903471bdc9e9c79ce2788126cc600eed23f7f4d4d3 WatchSource:0}: Error finding container 94031176e095a7b17f33bd903471bdc9e9c79ce2788126cc600eed23f7f4d4d3: Status 404 returned error can't find the container with id 94031176e095a7b17f33bd903471bdc9e9c79ce2788126cc600eed23f7f4d4d3 Jul 06 16:34:41.251197 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:41.251168 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:34:41.315844 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:41.315815 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:34:41.644783 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:41.644743 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f89c68cc-25qp4" event={"ID":"7c25bec0-f611-4a1b-a942-739bb3ee9678","Type":"ContainerStarted","Data":"8e545f673562814282d56c4d49299d9b61b3e2e6e5c9bcd73a87bbe601a5d443"} Jul 06 16:34:41.644997 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:41.644799 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f89c68cc-25qp4" event={"ID":"7c25bec0-f611-4a1b-a942-739bb3ee9678","Type":"ContainerStarted","Data":"94031176e095a7b17f33bd903471bdc9e9c79ce2788126cc600eed23f7f4d4d3"} Jul 06 16:34:41.662515 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:41.662463 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59f89c68cc-25qp4" podStartSLOduration=1.662448172 podStartE2EDuration="1.662448172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:34:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:34:41.661231553 +0000 UTC m=+362.930302589" watchObservedRunningTime="2026-07-06 16:34:41.662448172 +0000 UTC m=+362.931519209" Jul 06 16:34:50.763599 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:50.763534 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59f89c68cc-25qp4" Jul 06 16:34:50.764030 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:50.763620 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59f89c68cc-25qp4" Jul 06 16:34:50.768251 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:50.768229 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59f89c68cc-25qp4" Jul 06 16:34:51.686697 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:51.686661 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59f89c68cc-25qp4" Jul 06 16:34:51.862419 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:51.862380 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:34:51.962749 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:51.962665 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:34:52.016450 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:34:52.016417 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:35:21.375410 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:21.375377 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:35:21.433270 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:21.433240 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:35:45.482528 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:45.482492 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:35:45.583504 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:45.583468 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:35:48.191932 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:48.191898 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58cd7d9849-ldx89"] Jul 06 16:35:48.195512 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:48.195496 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58cd7d9849-ldx89" Jul 06 16:35:48.206926 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:48.206904 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58cd7d9849-ldx89"] Jul 06 16:35:48.246439 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:48.246411 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:35:48.280578 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:48.280554 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff7bd940-8768-4d04-9197-fddbaecd9c13-console-serving-cert\") pod \"console-58cd7d9849-ldx89\" (UID: \"ff7bd940-8768-4d04-9197-fddbaecd9c13\") " pod="openshift-console/console-58cd7d9849-ldx89" Jul 06 16:35:48.280723 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:48.280585 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff7bd940-8768-4d04-9197-fddbaecd9c13-console-oauth-config\") pod \"console-58cd7d9849-ldx89\" (UID: \"ff7bd940-8768-4d04-9197-fddbaecd9c13\") " pod="openshift-console/console-58cd7d9849-ldx89" Jul 06 16:35:48.280723 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:48.280611 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff7bd940-8768-4d04-9197-fddbaecd9c13-console-config\") pod \"console-58cd7d9849-ldx89\" (UID: \"ff7bd940-8768-4d04-9197-fddbaecd9c13\") " pod="openshift-console/console-58cd7d9849-ldx89" Jul 06 16:35:48.280723 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:48.280675 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff7bd940-8768-4d04-9197-fddbaecd9c13-trusted-ca-bundle\") pod \"console-58cd7d9849-ldx89\" (UID: \"ff7bd940-8768-4d04-9197-fddbaecd9c13\") " pod="openshift-console/console-58cd7d9849-ldx89" Jul 06 16:35:48.280830 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:48.280726 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff7bd940-8768-4d04-9197-fddbaecd9c13-oauth-serving-cert\") pod \"console-58cd7d9849-ldx89\" (UID: \"ff7bd940-8768-4d04-9197-fddbaecd9c13\") " pod="openshift-console/console-58cd7d9849-ldx89" Jul 06 16:35:48.280830 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:48.280749 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff7bd940-8768-4d04-9197-fddbaecd9c13-service-ca\") pod \"console-58cd7d9849-ldx89\" (UID: \"ff7bd940-8768-4d04-9197-fddbaecd9c13\") " pod="openshift-console/console-58cd7d9849-ldx89" Jul 06 16:35:48.280830 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:48.280767 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjqsw\" (UniqueName: \"kubernetes.io/projected/ff7bd940-8768-4d04-9197-fddbaecd9c13-kube-api-access-tjqsw\") pod \"console-58cd7d9849-ldx89\" (UID: \"ff7bd940-8768-4d04-9197-fddbaecd9c13\") " pod="openshift-console/console-58cd7d9849-ldx89" Jul 06 16:35:48.304102 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:48.304075 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:35:48.381795 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:48.381757 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff7bd940-8768-4d04-9197-fddbaecd9c13-console-config\") pod \"console-58cd7d9849-ldx89\" (UID: \"ff7bd940-8768-4d04-9197-fddbaecd9c13\") " pod="openshift-console/console-58cd7d9849-ldx89" Jul 06 16:35:48.382026 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:48.381803 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff7bd940-8768-4d04-9197-fddbaecd9c13-trusted-ca-bundle\") pod \"console-58cd7d9849-ldx89\" (UID: \"ff7bd940-8768-4d04-9197-fddbaecd9c13\") " pod="openshift-console/console-58cd7d9849-ldx89" Jul 06 16:35:48.382026 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:48.381836 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff7bd940-8768-4d04-9197-fddbaecd9c13-oauth-serving-cert\") pod \"console-58cd7d9849-ldx89\" (UID: \"ff7bd940-8768-4d04-9197-fddbaecd9c13\") " pod="openshift-console/console-58cd7d9849-ldx89" Jul 06 16:35:48.382026 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:48.381855 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff7bd940-8768-4d04-9197-fddbaecd9c13-service-ca\") pod \"console-58cd7d9849-ldx89\" (UID: \"ff7bd940-8768-4d04-9197-fddbaecd9c13\") " pod="openshift-console/console-58cd7d9849-ldx89" Jul 06 16:35:48.382026 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:48.381871 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjqsw\" (UniqueName: \"kubernetes.io/projected/ff7bd940-8768-4d04-9197-fddbaecd9c13-kube-api-access-tjqsw\") pod \"console-58cd7d9849-ldx89\" (UID: \"ff7bd940-8768-4d04-9197-fddbaecd9c13\") " pod="openshift-console/console-58cd7d9849-ldx89" Jul 06 16:35:48.382026 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:48.381907 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff7bd940-8768-4d04-9197-fddbaecd9c13-console-serving-cert\") pod \"console-58cd7d9849-ldx89\" (UID: \"ff7bd940-8768-4d04-9197-fddbaecd9c13\") " pod="openshift-console/console-58cd7d9849-ldx89" Jul 06 16:35:48.382312 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:48.382050 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff7bd940-8768-4d04-9197-fddbaecd9c13-console-oauth-config\") pod \"console-58cd7d9849-ldx89\" (UID: \"ff7bd940-8768-4d04-9197-fddbaecd9c13\") " pod="openshift-console/console-58cd7d9849-ldx89" Jul 06 16:35:48.382751 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:48.382722 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff7bd940-8768-4d04-9197-fddbaecd9c13-service-ca\") pod \"console-58cd7d9849-ldx89\" (UID: \"ff7bd940-8768-4d04-9197-fddbaecd9c13\") " pod="openshift-console/console-58cd7d9849-ldx89" Jul 06 16:35:48.382872 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:48.382725 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff7bd940-8768-4d04-9197-fddbaecd9c13-console-config\") pod \"console-58cd7d9849-ldx89\" (UID: \"ff7bd940-8768-4d04-9197-fddbaecd9c13\") " pod="openshift-console/console-58cd7d9849-ldx89" Jul 06 16:35:48.382872 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:48.382805 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff7bd940-8768-4d04-9197-fddbaecd9c13-oauth-serving-cert\") pod \"console-58cd7d9849-ldx89\" (UID: \"ff7bd940-8768-4d04-9197-fddbaecd9c13\") " pod="openshift-console/console-58cd7d9849-ldx89" Jul 06 16:35:48.383035 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:48.383021 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff7bd940-8768-4d04-9197-fddbaecd9c13-trusted-ca-bundle\") pod \"console-58cd7d9849-ldx89\" (UID: \"ff7bd940-8768-4d04-9197-fddbaecd9c13\") " pod="openshift-console/console-58cd7d9849-ldx89" Jul 06 16:35:48.384599 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:48.384578 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff7bd940-8768-4d04-9197-fddbaecd9c13-console-serving-cert\") pod \"console-58cd7d9849-ldx89\" (UID: \"ff7bd940-8768-4d04-9197-fddbaecd9c13\") " pod="openshift-console/console-58cd7d9849-ldx89" Jul 06 16:35:48.384699 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:48.384600 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff7bd940-8768-4d04-9197-fddbaecd9c13-console-oauth-config\") pod \"console-58cd7d9849-ldx89\" (UID: \"ff7bd940-8768-4d04-9197-fddbaecd9c13\") " pod="openshift-console/console-58cd7d9849-ldx89" Jul 06 16:35:48.385638 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:48.385620 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:35:48.389523 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:48.389505 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjqsw\" (UniqueName: \"kubernetes.io/projected/ff7bd940-8768-4d04-9197-fddbaecd9c13-kube-api-access-tjqsw\") pod \"console-58cd7d9849-ldx89\" (UID: \"ff7bd940-8768-4d04-9197-fddbaecd9c13\") " pod="openshift-console/console-58cd7d9849-ldx89" Jul 06 16:35:48.439999 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:48.439969 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:35:48.506042 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:48.505961 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58cd7d9849-ldx89" Jul 06 16:35:48.650289 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:48.650254 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58cd7d9849-ldx89"] Jul 06 16:35:48.653936 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:35:48.653896 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff7bd940_8768_4d04_9197_fddbaecd9c13.slice/crio-2e9041752be3e68c3bfad9d47ac384644fe4f260edfcffb2da5f82de693e9d3f WatchSource:0}: Error finding container 2e9041752be3e68c3bfad9d47ac384644fe4f260edfcffb2da5f82de693e9d3f: Status 404 returned error can't find the container with id 2e9041752be3e68c3bfad9d47ac384644fe4f260edfcffb2da5f82de693e9d3f Jul 06 16:35:48.902194 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:48.902156 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58cd7d9849-ldx89" event={"ID":"ff7bd940-8768-4d04-9197-fddbaecd9c13","Type":"ContainerStarted","Data":"2a0a64deba1ecdf3c62ce53985750f04118b888a3a75473689ae30f055ec269a"} Jul 06 16:35:48.902377 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:48.902207 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58cd7d9849-ldx89" event={"ID":"ff7bd940-8768-4d04-9197-fddbaecd9c13","Type":"ContainerStarted","Data":"2e9041752be3e68c3bfad9d47ac384644fe4f260edfcffb2da5f82de693e9d3f"} Jul 06 16:35:48.919028 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:48.918975 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58cd7d9849-ldx89" podStartSLOduration=0.918928946 podStartE2EDuration="918.928946ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:35:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:35:48.918638891 +0000 UTC m=+430.187709928" watchObservedRunningTime="2026-07-06 16:35:48.918928946 +0000 UTC m=+430.187999985" Jul 06 16:35:48.990901 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:48.990864 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:35:49.046351 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:49.046319 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:35:57.362885 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:57.362853 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:35:57.415071 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:57.415038 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:35:58.506411 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:58.506375 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58cd7d9849-ldx89" Jul 06 16:35:58.506830 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:58.506438 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58cd7d9849-ldx89" Jul 06 16:35:58.510907 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:58.510886 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58cd7d9849-ldx89" Jul 06 16:35:58.953388 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:58.953351 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58cd7d9849-ldx89" Jul 06 16:35:58.999186 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:58.999156 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59f89c68cc-25qp4"] Jul 06 16:35:59.103913 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:59.103885 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:35:59.204206 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:35:59.204110 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:36:03.654005 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:03.653967 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:36:03.713088 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:03.713040 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:36:04.160395 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:04.160351 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:36:04.258072 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:04.258034 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:36:04.489777 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:04.489681 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:36:24.022170 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:24.022104 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-59f89c68cc-25qp4" podUID="7c25bec0-f611-4a1b-a942-739bb3ee9678" containerName="console" containerID="cri-o://8e545f673562814282d56c4d49299d9b61b3e2e6e5c9bcd73a87bbe601a5d443" gracePeriod=15 Jul 06 16:36:24.266989 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:24.266962 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f89c68cc-25qp4" Jul 06 16:36:24.380364 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:24.380330 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c25bec0-f611-4a1b-a942-739bb3ee9678-console-oauth-config\") pod \"7c25bec0-f611-4a1b-a942-739bb3ee9678\" (UID: \"7c25bec0-f611-4a1b-a942-739bb3ee9678\") " Jul 06 16:36:24.380545 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:24.380378 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c25bec0-f611-4a1b-a942-739bb3ee9678-oauth-serving-cert\") pod \"7c25bec0-f611-4a1b-a942-739bb3ee9678\" (UID: \"7c25bec0-f611-4a1b-a942-739bb3ee9678\") " Jul 06 16:36:24.380545 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:24.380400 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c25bec0-f611-4a1b-a942-739bb3ee9678-console-serving-cert\") pod \"7c25bec0-f611-4a1b-a942-739bb3ee9678\" (UID: \"7c25bec0-f611-4a1b-a942-739bb3ee9678\") " Jul 06 16:36:24.380545 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:24.380511 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbd98\" (UniqueName: \"kubernetes.io/projected/7c25bec0-f611-4a1b-a942-739bb3ee9678-kube-api-access-sbd98\") pod \"7c25bec0-f611-4a1b-a942-739bb3ee9678\" (UID: \"7c25bec0-f611-4a1b-a942-739bb3ee9678\") " Jul 06 16:36:24.380545 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:24.380540 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c25bec0-f611-4a1b-a942-739bb3ee9678-service-ca\") pod \"7c25bec0-f611-4a1b-a942-739bb3ee9678\" (UID: \"7c25bec0-f611-4a1b-a942-739bb3ee9678\") " Jul 06 16:36:24.380726 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:24.380571 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c25bec0-f611-4a1b-a942-739bb3ee9678-trusted-ca-bundle\") pod \"7c25bec0-f611-4a1b-a942-739bb3ee9678\" (UID: \"7c25bec0-f611-4a1b-a942-739bb3ee9678\") " Jul 06 16:36:24.380726 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:24.380612 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c25bec0-f611-4a1b-a942-739bb3ee9678-console-config\") pod \"7c25bec0-f611-4a1b-a942-739bb3ee9678\" (UID: \"7c25bec0-f611-4a1b-a942-739bb3ee9678\") " Jul 06 16:36:24.380903 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:24.380870 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c25bec0-f611-4a1b-a942-739bb3ee9678-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7c25bec0-f611-4a1b-a942-739bb3ee9678" (UID: "7c25bec0-f611-4a1b-a942-739bb3ee9678"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 16:36:24.381009 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:24.380975 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c25bec0-f611-4a1b-a942-739bb3ee9678-service-ca" (OuterVolumeSpecName: "service-ca") pod "7c25bec0-f611-4a1b-a942-739bb3ee9678" (UID: "7c25bec0-f611-4a1b-a942-739bb3ee9678"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 16:36:24.381186 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:24.381080 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c25bec0-f611-4a1b-a942-739bb3ee9678-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7c25bec0-f611-4a1b-a942-739bb3ee9678" (UID: "7c25bec0-f611-4a1b-a942-739bb3ee9678"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 16:36:24.381384 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:24.381354 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c25bec0-f611-4a1b-a942-739bb3ee9678-console-config" (OuterVolumeSpecName: "console-config") pod "7c25bec0-f611-4a1b-a942-739bb3ee9678" (UID: "7c25bec0-f611-4a1b-a942-739bb3ee9678"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 16:36:24.382750 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:24.382725 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c25bec0-f611-4a1b-a942-739bb3ee9678-kube-api-access-sbd98" (OuterVolumeSpecName: "kube-api-access-sbd98") pod "7c25bec0-f611-4a1b-a942-739bb3ee9678" (UID: "7c25bec0-f611-4a1b-a942-739bb3ee9678"). InnerVolumeSpecName "kube-api-access-sbd98". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 16:36:24.382750 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:24.382735 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c25bec0-f611-4a1b-a942-739bb3ee9678-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7c25bec0-f611-4a1b-a942-739bb3ee9678" (UID: "7c25bec0-f611-4a1b-a942-739bb3ee9678"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 16:36:24.382894 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:24.382755 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c25bec0-f611-4a1b-a942-739bb3ee9678-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7c25bec0-f611-4a1b-a942-739bb3ee9678" (UID: "7c25bec0-f611-4a1b-a942-739bb3ee9678"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 16:36:24.481610 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:24.481557 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c25bec0-f611-4a1b-a942-739bb3ee9678-console-config\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:36:24.481610 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:24.481605 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c25bec0-f611-4a1b-a942-739bb3ee9678-console-oauth-config\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:36:24.481610 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:24.481620 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c25bec0-f611-4a1b-a942-739bb3ee9678-oauth-serving-cert\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:36:24.481856 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:24.481632 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c25bec0-f611-4a1b-a942-739bb3ee9678-console-serving-cert\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:36:24.481856 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:24.481645 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbd98\" (UniqueName: \"kubernetes.io/projected/7c25bec0-f611-4a1b-a942-739bb3ee9678-kube-api-access-sbd98\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:36:24.481856 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:24.481657 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c25bec0-f611-4a1b-a942-739bb3ee9678-service-ca\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:36:24.481856 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:24.481669 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c25bec0-f611-4a1b-a942-739bb3ee9678-trusted-ca-bundle\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:36:25.054191 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:25.054157 2555 generic.go:356] "Generic (PLEG): container finished" podID="7c25bec0-f611-4a1b-a942-739bb3ee9678" containerID="8e545f673562814282d56c4d49299d9b61b3e2e6e5c9bcd73a87bbe601a5d443" exitCode=0 Jul 06 16:36:25.054637 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:25.054202 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f89c68cc-25qp4" Jul 06 16:36:25.054637 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:25.054252 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f89c68cc-25qp4" event={"ID":"7c25bec0-f611-4a1b-a942-739bb3ee9678","Type":"ContainerDied","Data":"8e545f673562814282d56c4d49299d9b61b3e2e6e5c9bcd73a87bbe601a5d443"} Jul 06 16:36:25.054637 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:25.054301 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f89c68cc-25qp4" event={"ID":"7c25bec0-f611-4a1b-a942-739bb3ee9678","Type":"ContainerDied","Data":"94031176e095a7b17f33bd903471bdc9e9c79ce2788126cc600eed23f7f4d4d3"} Jul 06 16:36:25.054637 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:25.054320 2555 scope.go:117] "RemoveContainer" containerID="8e545f673562814282d56c4d49299d9b61b3e2e6e5c9bcd73a87bbe601a5d443" Jul 06 16:36:25.062921 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:25.062908 2555 scope.go:117] "RemoveContainer" containerID="8e545f673562814282d56c4d49299d9b61b3e2e6e5c9bcd73a87bbe601a5d443" Jul 06 16:36:25.063160 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:36:25.063143 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e545f673562814282d56c4d49299d9b61b3e2e6e5c9bcd73a87bbe601a5d443\": container with ID starting with 8e545f673562814282d56c4d49299d9b61b3e2e6e5c9bcd73a87bbe601a5d443 not found: ID does not exist" containerID="8e545f673562814282d56c4d49299d9b61b3e2e6e5c9bcd73a87bbe601a5d443" Jul 06 16:36:25.063203 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:25.063169 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e545f673562814282d56c4d49299d9b61b3e2e6e5c9bcd73a87bbe601a5d443"} err="failed to get container status \"8e545f673562814282d56c4d49299d9b61b3e2e6e5c9bcd73a87bbe601a5d443\": rpc error: code = NotFound desc = could not find container \"8e545f673562814282d56c4d49299d9b61b3e2e6e5c9bcd73a87bbe601a5d443\": container with ID starting with 8e545f673562814282d56c4d49299d9b61b3e2e6e5c9bcd73a87bbe601a5d443 not found: ID does not exist" Jul 06 16:36:25.074630 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:25.074609 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59f89c68cc-25qp4"] Jul 06 16:36:25.078048 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:25.078030 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59f89c68cc-25qp4"] Jul 06 16:36:25.300694 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:25.300665 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c25bec0-f611-4a1b-a942-739bb3ee9678" path="/var/lib/kubelet/pods/7c25bec0-f611-4a1b-a942-739bb3ee9678/volumes" Jul 06 16:36:31.929127 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:31.929085 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:36:32.083519 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:32.083481 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:36:32.610172 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:32.610136 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smfkf"] Jul 06 16:36:32.610453 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:32.610441 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c25bec0-f611-4a1b-a942-739bb3ee9678" containerName="console" Jul 06 16:36:32.610513 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:32.610455 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c25bec0-f611-4a1b-a942-739bb3ee9678" containerName="console" Jul 06 16:36:32.610555 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:32.610519 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c25bec0-f611-4a1b-a942-739bb3ee9678" containerName="console" Jul 06 16:36:32.613354 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:32.613337 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smfkf" Jul 06 16:36:32.615434 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:32.615410 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 16:36:32.615541 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:32.615417 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 16:36:32.616577 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:32.616014 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xs9hx\"" Jul 06 16:36:32.623400 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:32.623304 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smfkf"] Jul 06 16:36:32.752394 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:32.752351 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9rp6\" (UniqueName: \"kubernetes.io/projected/24131e96-d4a0-4e04-af74-c516f4e3a0df-kube-api-access-p9rp6\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smfkf\" (UID: \"24131e96-d4a0-4e04-af74-c516f4e3a0df\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smfkf" Jul 06 16:36:32.752394 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:32.752392 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24131e96-d4a0-4e04-af74-c516f4e3a0df-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smfkf\" (UID: \"24131e96-d4a0-4e04-af74-c516f4e3a0df\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smfkf" Jul 06 16:36:32.752652 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:32.752515 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24131e96-d4a0-4e04-af74-c516f4e3a0df-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smfkf\" (UID: \"24131e96-d4a0-4e04-af74-c516f4e3a0df\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smfkf" Jul 06 16:36:32.853910 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:32.853884 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24131e96-d4a0-4e04-af74-c516f4e3a0df-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smfkf\" (UID: \"24131e96-d4a0-4e04-af74-c516f4e3a0df\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smfkf" Jul 06 16:36:32.854115 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:32.853964 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9rp6\" (UniqueName: \"kubernetes.io/projected/24131e96-d4a0-4e04-af74-c516f4e3a0df-kube-api-access-p9rp6\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smfkf\" (UID: \"24131e96-d4a0-4e04-af74-c516f4e3a0df\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smfkf" Jul 06 16:36:32.854115 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:32.853997 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24131e96-d4a0-4e04-af74-c516f4e3a0df-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smfkf\" (UID: \"24131e96-d4a0-4e04-af74-c516f4e3a0df\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smfkf" Jul 06 16:36:32.854293 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:32.854272 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24131e96-d4a0-4e04-af74-c516f4e3a0df-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smfkf\" (UID: \"24131e96-d4a0-4e04-af74-c516f4e3a0df\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smfkf" Jul 06 16:36:32.854393 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:32.854375 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24131e96-d4a0-4e04-af74-c516f4e3a0df-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smfkf\" (UID: \"24131e96-d4a0-4e04-af74-c516f4e3a0df\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smfkf" Jul 06 16:36:32.862794 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:32.862727 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9rp6\" (UniqueName: \"kubernetes.io/projected/24131e96-d4a0-4e04-af74-c516f4e3a0df-kube-api-access-p9rp6\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smfkf\" (UID: \"24131e96-d4a0-4e04-af74-c516f4e3a0df\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smfkf" Jul 06 16:36:32.928509 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:32.928480 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smfkf" Jul 06 16:36:33.061878 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:33.061856 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smfkf"] Jul 06 16:36:33.064390 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:36:33.064365 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24131e96_d4a0_4e04_af74_c516f4e3a0df.slice/crio-c24fd4d8e4eeea6a35b67b505c24a2edb9bd77947e28ffb8adf0020d01dd4b78 WatchSource:0}: Error finding container c24fd4d8e4eeea6a35b67b505c24a2edb9bd77947e28ffb8adf0020d01dd4b78: Status 404 returned error can't find the container with id c24fd4d8e4eeea6a35b67b505c24a2edb9bd77947e28ffb8adf0020d01dd4b78 Jul 06 16:36:33.085402 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:33.085375 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smfkf" event={"ID":"24131e96-d4a0-4e04-af74-c516f4e3a0df","Type":"ContainerStarted","Data":"c24fd4d8e4eeea6a35b67b505c24a2edb9bd77947e28ffb8adf0020d01dd4b78"} Jul 06 16:36:41.120080 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:41.120040 2555 generic.go:356] "Generic (PLEG): container finished" podID="24131e96-d4a0-4e04-af74-c516f4e3a0df" containerID="a34ffd92def859ceb6cfb3984edd9cff9742ad2ee5cab53194c19c1b3cbc97a3" exitCode=0 Jul 06 16:36:41.120480 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:41.120133 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smfkf" event={"ID":"24131e96-d4a0-4e04-af74-c516f4e3a0df","Type":"ContainerDied","Data":"a34ffd92def859ceb6cfb3984edd9cff9742ad2ee5cab53194c19c1b3cbc97a3"} Jul 06 16:36:43.129809 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:43.129768 2555 generic.go:356] "Generic (PLEG): container finished" podID="24131e96-d4a0-4e04-af74-c516f4e3a0df" containerID="a638d1e2bd5a07996c92240a6fdb257f524f4212402c8da50d64dc08fd9bd6d1" exitCode=0 Jul 06 16:36:43.130166 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:43.129852 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smfkf" event={"ID":"24131e96-d4a0-4e04-af74-c516f4e3a0df","Type":"ContainerDied","Data":"a638d1e2bd5a07996c92240a6fdb257f524f4212402c8da50d64dc08fd9bd6d1"} Jul 06 16:36:51.888272 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:51.888234 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:36:51.989119 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:51.989074 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:36:52.170101 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:52.170019 2555 generic.go:356] "Generic (PLEG): container finished" podID="24131e96-d4a0-4e04-af74-c516f4e3a0df" containerID="8496ea258fc0ebdb09bcbead92b1387194e8ea699568d0ebf54da139dbcef7b7" exitCode=0 Jul 06 16:36:52.170261 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:52.170100 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smfkf" event={"ID":"24131e96-d4a0-4e04-af74-c516f4e3a0df","Type":"ContainerDied","Data":"8496ea258fc0ebdb09bcbead92b1387194e8ea699568d0ebf54da139dbcef7b7"} Jul 06 16:36:53.299926 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:53.299905 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smfkf" Jul 06 16:36:53.439915 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:53.439817 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24131e96-d4a0-4e04-af74-c516f4e3a0df-util\") pod \"24131e96-d4a0-4e04-af74-c516f4e3a0df\" (UID: \"24131e96-d4a0-4e04-af74-c516f4e3a0df\") " Jul 06 16:36:53.439915 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:53.439885 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24131e96-d4a0-4e04-af74-c516f4e3a0df-bundle\") pod \"24131e96-d4a0-4e04-af74-c516f4e3a0df\" (UID: \"24131e96-d4a0-4e04-af74-c516f4e3a0df\") " Jul 06 16:36:53.440173 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:53.439966 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9rp6\" (UniqueName: \"kubernetes.io/projected/24131e96-d4a0-4e04-af74-c516f4e3a0df-kube-api-access-p9rp6\") pod \"24131e96-d4a0-4e04-af74-c516f4e3a0df\" (UID: \"24131e96-d4a0-4e04-af74-c516f4e3a0df\") " Jul 06 16:36:53.440515 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:53.440493 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24131e96-d4a0-4e04-af74-c516f4e3a0df-bundle" (OuterVolumeSpecName: "bundle") pod "24131e96-d4a0-4e04-af74-c516f4e3a0df" (UID: "24131e96-d4a0-4e04-af74-c516f4e3a0df"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 16:36:53.442191 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:53.442171 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24131e96-d4a0-4e04-af74-c516f4e3a0df-kube-api-access-p9rp6" (OuterVolumeSpecName: "kube-api-access-p9rp6") pod "24131e96-d4a0-4e04-af74-c516f4e3a0df" (UID: "24131e96-d4a0-4e04-af74-c516f4e3a0df"). InnerVolumeSpecName "kube-api-access-p9rp6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 16:36:53.444617 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:53.444579 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24131e96-d4a0-4e04-af74-c516f4e3a0df-util" (OuterVolumeSpecName: "util") pod "24131e96-d4a0-4e04-af74-c516f4e3a0df" (UID: "24131e96-d4a0-4e04-af74-c516f4e3a0df"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 16:36:53.540676 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:53.540640 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9rp6\" (UniqueName: \"kubernetes.io/projected/24131e96-d4a0-4e04-af74-c516f4e3a0df-kube-api-access-p9rp6\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:36:53.540676 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:53.540667 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/24131e96-d4a0-4e04-af74-c516f4e3a0df-util\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:36:53.540676 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:53.540677 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/24131e96-d4a0-4e04-af74-c516f4e3a0df-bundle\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:36:54.179016 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:54.178980 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smfkf" event={"ID":"24131e96-d4a0-4e04-af74-c516f4e3a0df","Type":"ContainerDied","Data":"c24fd4d8e4eeea6a35b67b505c24a2edb9bd77947e28ffb8adf0020d01dd4b78"} Jul 06 16:36:54.179016 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:54.179001 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540smfkf" Jul 06 16:36:54.179215 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:54.179029 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c24fd4d8e4eeea6a35b67b505c24a2edb9bd77947e28ffb8adf0020d01dd4b78" Jul 06 16:36:58.876632 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:58.876594 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:36:59.834484 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:36:59.834451 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:37:00.790684 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:00.790654 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fbvd4"] Jul 06 16:37:00.791083 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:00.790990 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24131e96-d4a0-4e04-af74-c516f4e3a0df" containerName="extract" Jul 06 16:37:00.791083 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:00.791001 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="24131e96-d4a0-4e04-af74-c516f4e3a0df" containerName="extract" Jul 06 16:37:00.791083 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:00.791018 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24131e96-d4a0-4e04-af74-c516f4e3a0df" containerName="util" Jul 06 16:37:00.791083 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:00.791024 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="24131e96-d4a0-4e04-af74-c516f4e3a0df" containerName="util" Jul 06 16:37:00.791083 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:00.791029 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24131e96-d4a0-4e04-af74-c516f4e3a0df" containerName="pull" Jul 06 16:37:00.791083 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:00.791035 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="24131e96-d4a0-4e04-af74-c516f4e3a0df" containerName="pull" Jul 06 16:37:00.791083 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:00.791087 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="24131e96-d4a0-4e04-af74-c516f4e3a0df" containerName="extract" Jul 06 16:37:00.792753 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:00.792738 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fbvd4" Jul 06 16:37:00.794843 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:00.794820 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 06 16:37:00.795594 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:00.795578 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 06 16:37:00.797001 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:00.796984 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-99v4t\"" Jul 06 16:37:00.808084 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:00.808060 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fbvd4"] Jul 06 16:37:00.897240 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:00.897203 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae7a443d-bd9d-4fb4-ab4f-65c03dceb4fa-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fbvd4\" (UID: \"ae7a443d-bd9d-4fb4-ab4f-65c03dceb4fa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fbvd4" Jul 06 16:37:00.897415 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:00.897257 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx8m9\" (UniqueName: \"kubernetes.io/projected/ae7a443d-bd9d-4fb4-ab4f-65c03dceb4fa-kube-api-access-dx8m9\") pod \"cert-manager-operator-controller-manager-55c444bf86-fbvd4\" (UID: \"ae7a443d-bd9d-4fb4-ab4f-65c03dceb4fa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fbvd4" Jul 06 16:37:00.998267 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:00.998239 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae7a443d-bd9d-4fb4-ab4f-65c03dceb4fa-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fbvd4\" (UID: \"ae7a443d-bd9d-4fb4-ab4f-65c03dceb4fa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fbvd4" Jul 06 16:37:00.998427 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:00.998291 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dx8m9\" (UniqueName: \"kubernetes.io/projected/ae7a443d-bd9d-4fb4-ab4f-65c03dceb4fa-kube-api-access-dx8m9\") pod \"cert-manager-operator-controller-manager-55c444bf86-fbvd4\" (UID: \"ae7a443d-bd9d-4fb4-ab4f-65c03dceb4fa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fbvd4" Jul 06 16:37:00.998625 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:00.998607 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae7a443d-bd9d-4fb4-ab4f-65c03dceb4fa-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fbvd4\" (UID: \"ae7a443d-bd9d-4fb4-ab4f-65c03dceb4fa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fbvd4" Jul 06 16:37:01.006195 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:01.006163 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx8m9\" (UniqueName: \"kubernetes.io/projected/ae7a443d-bd9d-4fb4-ab4f-65c03dceb4fa-kube-api-access-dx8m9\") pod \"cert-manager-operator-controller-manager-55c444bf86-fbvd4\" (UID: \"ae7a443d-bd9d-4fb4-ab4f-65c03dceb4fa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fbvd4" Jul 06 16:37:01.101536 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:01.101505 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fbvd4" Jul 06 16:37:01.240335 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:01.240308 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fbvd4"] Jul 06 16:37:01.242854 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:37:01.242830 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae7a443d_bd9d_4fb4_ab4f_65c03dceb4fa.slice/crio-1f5c8478a91d24e9a8a16e8010859d049283f62ffa5abb692abfcce30e786711 WatchSource:0}: Error finding container 1f5c8478a91d24e9a8a16e8010859d049283f62ffa5abb692abfcce30e786711: Status 404 returned error can't find the container with id 1f5c8478a91d24e9a8a16e8010859d049283f62ffa5abb692abfcce30e786711 Jul 06 16:37:02.212889 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:02.212850 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fbvd4" event={"ID":"ae7a443d-bd9d-4fb4-ab4f-65c03dceb4fa","Type":"ContainerStarted","Data":"1f5c8478a91d24e9a8a16e8010859d049283f62ffa5abb692abfcce30e786711"} Jul 06 16:37:02.494361 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:02.494255 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:37:02.594162 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:02.594128 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:37:03.219383 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:03.219351 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fbvd4" event={"ID":"ae7a443d-bd9d-4fb4-ab4f-65c03dceb4fa","Type":"ContainerStarted","Data":"a08f872980c0ca1eb6acabfdf9da10701c3d51402698b90345db97bb69f0eb28"} Jul 06 16:37:03.246866 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:03.246812 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fbvd4" podStartSLOduration=1.473010222 podStartE2EDuration="3.246792066s" totalImagesPullingTime="1.773781844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:37:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:37:03.245687776 +0000 UTC m=+504.514758815" watchObservedRunningTime="2026-07-06 16:37:03.246792066 +0000 UTC m=+504.515863106" Jul 06 16:37:03.673137 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:03.673100 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:37:03.817891 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:03.817853 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:37:04.514821 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:04.514793 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcpb76"] Jul 06 16:37:04.517383 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:04.517368 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcpb76" Jul 06 16:37:04.519823 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:04.519799 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 16:37:04.520637 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:04.520617 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 16:37:04.520869 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:04.520855 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xs9hx\"" Jul 06 16:37:04.534027 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:04.534008 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcpb76"] Jul 06 16:37:04.534554 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:04.534531 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/517963c9-e2e5-457d-984f-8067d5bc6716-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcpb76\" (UID: \"517963c9-e2e5-457d-984f-8067d5bc6716\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcpb76" Jul 06 16:37:04.534629 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:04.534613 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/517963c9-e2e5-457d-984f-8067d5bc6716-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcpb76\" (UID: \"517963c9-e2e5-457d-984f-8067d5bc6716\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcpb76" Jul 06 16:37:04.534680 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:04.534652 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp7tm\" (UniqueName: \"kubernetes.io/projected/517963c9-e2e5-457d-984f-8067d5bc6716-kube-api-access-vp7tm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcpb76\" (UID: \"517963c9-e2e5-457d-984f-8067d5bc6716\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcpb76" Jul 06 16:37:04.635543 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:04.635511 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/517963c9-e2e5-457d-984f-8067d5bc6716-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcpb76\" (UID: \"517963c9-e2e5-457d-984f-8067d5bc6716\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcpb76" Jul 06 16:37:04.635699 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:04.635564 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/517963c9-e2e5-457d-984f-8067d5bc6716-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcpb76\" (UID: \"517963c9-e2e5-457d-984f-8067d5bc6716\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcpb76" Jul 06 16:37:04.635699 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:04.635594 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp7tm\" (UniqueName: \"kubernetes.io/projected/517963c9-e2e5-457d-984f-8067d5bc6716-kube-api-access-vp7tm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcpb76\" (UID: \"517963c9-e2e5-457d-984f-8067d5bc6716\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcpb76" Jul 06 16:37:04.635898 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:04.635880 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/517963c9-e2e5-457d-984f-8067d5bc6716-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcpb76\" (UID: \"517963c9-e2e5-457d-984f-8067d5bc6716\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcpb76" Jul 06 16:37:04.635973 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:04.635933 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/517963c9-e2e5-457d-984f-8067d5bc6716-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcpb76\" (UID: \"517963c9-e2e5-457d-984f-8067d5bc6716\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcpb76" Jul 06 16:37:04.643877 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:04.643848 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp7tm\" (UniqueName: \"kubernetes.io/projected/517963c9-e2e5-457d-984f-8067d5bc6716-kube-api-access-vp7tm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcpb76\" (UID: \"517963c9-e2e5-457d-984f-8067d5bc6716\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcpb76" Jul 06 16:37:04.718826 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:04.718794 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:37:04.825274 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:04.825238 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:37:04.825993 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:04.825973 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcpb76" Jul 06 16:37:04.955917 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:04.955894 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcpb76"] Jul 06 16:37:04.957868 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:37:04.957837 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod517963c9_e2e5_457d_984f_8067d5bc6716.slice/crio-6f74bba1296e952db851ba99fc96e26ceef5d8e45bb86c2678440bd062925bc0 WatchSource:0}: Error finding container 6f74bba1296e952db851ba99fc96e26ceef5d8e45bb86c2678440bd062925bc0: Status 404 returned error can't find the container with id 6f74bba1296e952db851ba99fc96e26ceef5d8e45bb86c2678440bd062925bc0 Jul 06 16:37:05.230325 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:05.230235 2555 generic.go:356] "Generic (PLEG): container finished" podID="517963c9-e2e5-457d-984f-8067d5bc6716" containerID="3588c75fd3317dac0b41cb6ba738c666dbaa2bf5956b8af63619937f2be33df2" exitCode=0 Jul 06 16:37:05.230325 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:05.230305 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcpb76" event={"ID":"517963c9-e2e5-457d-984f-8067d5bc6716","Type":"ContainerDied","Data":"3588c75fd3317dac0b41cb6ba738c666dbaa2bf5956b8af63619937f2be33df2"} Jul 06 16:37:05.230507 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:05.230344 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcpb76" event={"ID":"517963c9-e2e5-457d-984f-8067d5bc6716","Type":"ContainerStarted","Data":"6f74bba1296e952db851ba99fc96e26ceef5d8e45bb86c2678440bd062925bc0"} Jul 06 16:37:06.748980 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:06.748918 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:37:07.021346 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:07.021276 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gh6wj"] Jul 06 16:37:07.023363 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:07.023347 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-gh6wj" Jul 06 16:37:07.026638 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:07.026388 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-6cc5b\"" Jul 06 16:37:07.026638 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:07.026404 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 06 16:37:07.026638 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:07.026446 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 06 16:37:07.034461 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:07.034437 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gh6wj"] Jul 06 16:37:07.054207 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:07.054183 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97e0aaa6-ce27-48ee-a595-dc32513ba5f4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gh6wj\" (UID: \"97e0aaa6-ce27-48ee-a595-dc32513ba5f4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gh6wj" Jul 06 16:37:07.054315 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:07.054235 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6d4m\" (UniqueName: \"kubernetes.io/projected/97e0aaa6-ce27-48ee-a595-dc32513ba5f4-kube-api-access-v6d4m\") pod \"cert-manager-webhook-6486ffd997-gh6wj\" (UID: \"97e0aaa6-ce27-48ee-a595-dc32513ba5f4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gh6wj" Jul 06 16:37:07.135217 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:07.135163 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:37:07.155539 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:07.155516 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97e0aaa6-ce27-48ee-a595-dc32513ba5f4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gh6wj\" (UID: \"97e0aaa6-ce27-48ee-a595-dc32513ba5f4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gh6wj" Jul 06 16:37:07.155650 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:07.155569 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6d4m\" (UniqueName: \"kubernetes.io/projected/97e0aaa6-ce27-48ee-a595-dc32513ba5f4-kube-api-access-v6d4m\") pod \"cert-manager-webhook-6486ffd997-gh6wj\" (UID: \"97e0aaa6-ce27-48ee-a595-dc32513ba5f4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gh6wj" Jul 06 16:37:07.163851 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:07.163827 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97e0aaa6-ce27-48ee-a595-dc32513ba5f4-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-gh6wj\" (UID: \"97e0aaa6-ce27-48ee-a595-dc32513ba5f4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gh6wj" Jul 06 16:37:07.164008 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:07.163990 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6d4m\" (UniqueName: \"kubernetes.io/projected/97e0aaa6-ce27-48ee-a595-dc32513ba5f4-kube-api-access-v6d4m\") pod \"cert-manager-webhook-6486ffd997-gh6wj\" (UID: \"97e0aaa6-ce27-48ee-a595-dc32513ba5f4\") " pod="cert-manager/cert-manager-webhook-6486ffd997-gh6wj" Jul 06 16:37:07.240906 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:07.240878 2555 generic.go:356] "Generic (PLEG): container finished" podID="517963c9-e2e5-457d-984f-8067d5bc6716" containerID="a12ca41701952c86e0203501feff8e595ffb0cd0f703921f9ed7184c68db8d46" exitCode=0 Jul 06 16:37:07.241039 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:07.240926 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcpb76" event={"ID":"517963c9-e2e5-457d-984f-8067d5bc6716","Type":"ContainerDied","Data":"a12ca41701952c86e0203501feff8e595ffb0cd0f703921f9ed7184c68db8d46"} Jul 06 16:37:07.318086 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:07.318053 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:37:07.347091 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:07.347064 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-gh6wj" Jul 06 16:37:07.418429 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:07.418397 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:37:07.481328 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:07.481306 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-gh6wj"] Jul 06 16:37:07.484515 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:37:07.484489 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97e0aaa6_ce27_48ee_a595_dc32513ba5f4.slice/crio-df7bbbbbcadac4067d7f119477eafb742ff284b11dcc1b00156650c240585c70 WatchSource:0}: Error finding container df7bbbbbcadac4067d7f119477eafb742ff284b11dcc1b00156650c240585c70: Status 404 returned error can't find the container with id df7bbbbbcadac4067d7f119477eafb742ff284b11dcc1b00156650c240585c70 Jul 06 16:37:07.605954 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:07.605908 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nqrvj"] Jul 06 16:37:07.608404 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:07.608388 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nqrvj" Jul 06 16:37:07.610806 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:07.610785 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-lgh6j\"" Jul 06 16:37:07.618454 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:07.618436 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nqrvj"] Jul 06 16:37:07.659831 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:07.659809 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62273f05-282e-43fc-9960-04c208f20834-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nqrvj\" (UID: \"62273f05-282e-43fc-9960-04c208f20834\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nqrvj" Jul 06 16:37:07.659969 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:07.659851 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r64x2\" (UniqueName: \"kubernetes.io/projected/62273f05-282e-43fc-9960-04c208f20834-kube-api-access-r64x2\") pod \"cert-manager-cainjector-559cdd8c87-nqrvj\" (UID: \"62273f05-282e-43fc-9960-04c208f20834\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nqrvj" Jul 06 16:37:07.760461 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:07.760435 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62273f05-282e-43fc-9960-04c208f20834-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nqrvj\" (UID: \"62273f05-282e-43fc-9960-04c208f20834\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nqrvj" Jul 06 16:37:07.760754 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:07.760474 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r64x2\" (UniqueName: \"kubernetes.io/projected/62273f05-282e-43fc-9960-04c208f20834-kube-api-access-r64x2\") pod \"cert-manager-cainjector-559cdd8c87-nqrvj\" (UID: \"62273f05-282e-43fc-9960-04c208f20834\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nqrvj" Jul 06 16:37:07.768993 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:07.768971 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/62273f05-282e-43fc-9960-04c208f20834-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nqrvj\" (UID: \"62273f05-282e-43fc-9960-04c208f20834\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nqrvj" Jul 06 16:37:07.769185 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:07.769169 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r64x2\" (UniqueName: \"kubernetes.io/projected/62273f05-282e-43fc-9960-04c208f20834-kube-api-access-r64x2\") pod \"cert-manager-cainjector-559cdd8c87-nqrvj\" (UID: \"62273f05-282e-43fc-9960-04c208f20834\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nqrvj" Jul 06 16:37:07.917540 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:07.917465 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nqrvj" Jul 06 16:37:08.046110 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:08.046086 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nqrvj"] Jul 06 16:37:08.048712 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:37:08.048689 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62273f05_282e_43fc_9960_04c208f20834.slice/crio-b6294dda3ab6c2f4c86fa1043c8b4f39d6536f9f15f63a76755cbbfd2e009f19 WatchSource:0}: Error finding container b6294dda3ab6c2f4c86fa1043c8b4f39d6536f9f15f63a76755cbbfd2e009f19: Status 404 returned error can't find the container with id b6294dda3ab6c2f4c86fa1043c8b4f39d6536f9f15f63a76755cbbfd2e009f19 Jul 06 16:37:08.248456 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:08.248365 2555 generic.go:356] "Generic (PLEG): container finished" podID="517963c9-e2e5-457d-984f-8067d5bc6716" containerID="e9d1a5579e3d54d443015dbbcc8f443a58fe2fa4d6265bc6d69fd8a9c7d32e0b" exitCode=0 Jul 06 16:37:08.248619 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:08.248457 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcpb76" event={"ID":"517963c9-e2e5-457d-984f-8067d5bc6716","Type":"ContainerDied","Data":"e9d1a5579e3d54d443015dbbcc8f443a58fe2fa4d6265bc6d69fd8a9c7d32e0b"} Jul 06 16:37:08.249867 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:08.249840 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nqrvj" event={"ID":"62273f05-282e-43fc-9960-04c208f20834","Type":"ContainerStarted","Data":"b6294dda3ab6c2f4c86fa1043c8b4f39d6536f9f15f63a76755cbbfd2e009f19"} Jul 06 16:37:08.251201 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:08.251171 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-gh6wj" event={"ID":"97e0aaa6-ce27-48ee-a595-dc32513ba5f4","Type":"ContainerStarted","Data":"df7bbbbbcadac4067d7f119477eafb742ff284b11dcc1b00156650c240585c70"} Jul 06 16:37:09.269912 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:09.269878 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:37:09.370324 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:09.370138 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:37:09.421833 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:09.421802 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcpb76" Jul 06 16:37:09.476025 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:09.475978 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/517963c9-e2e5-457d-984f-8067d5bc6716-util\") pod \"517963c9-e2e5-457d-984f-8067d5bc6716\" (UID: \"517963c9-e2e5-457d-984f-8067d5bc6716\") " Jul 06 16:37:09.476214 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:09.476030 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/517963c9-e2e5-457d-984f-8067d5bc6716-bundle\") pod \"517963c9-e2e5-457d-984f-8067d5bc6716\" (UID: \"517963c9-e2e5-457d-984f-8067d5bc6716\") " Jul 06 16:37:09.476214 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:09.476074 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vp7tm\" (UniqueName: \"kubernetes.io/projected/517963c9-e2e5-457d-984f-8067d5bc6716-kube-api-access-vp7tm\") pod \"517963c9-e2e5-457d-984f-8067d5bc6716\" (UID: \"517963c9-e2e5-457d-984f-8067d5bc6716\") " Jul 06 16:37:09.476600 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:09.476567 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/517963c9-e2e5-457d-984f-8067d5bc6716-bundle" (OuterVolumeSpecName: "bundle") pod "517963c9-e2e5-457d-984f-8067d5bc6716" (UID: "517963c9-e2e5-457d-984f-8067d5bc6716"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 16:37:09.480056 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:09.479188 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/517963c9-e2e5-457d-984f-8067d5bc6716-kube-api-access-vp7tm" (OuterVolumeSpecName: "kube-api-access-vp7tm") pod "517963c9-e2e5-457d-984f-8067d5bc6716" (UID: "517963c9-e2e5-457d-984f-8067d5bc6716"). InnerVolumeSpecName "kube-api-access-vp7tm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 16:37:09.484473 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:09.484448 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/517963c9-e2e5-457d-984f-8067d5bc6716-util" (OuterVolumeSpecName: "util") pod "517963c9-e2e5-457d-984f-8067d5bc6716" (UID: "517963c9-e2e5-457d-984f-8067d5bc6716"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 16:37:09.577754 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:09.577721 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/517963c9-e2e5-457d-984f-8067d5bc6716-util\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:37:09.577754 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:09.577757 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/517963c9-e2e5-457d-984f-8067d5bc6716-bundle\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:37:09.578033 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:09.577772 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vp7tm\" (UniqueName: \"kubernetes.io/projected/517963c9-e2e5-457d-984f-8067d5bc6716-kube-api-access-vp7tm\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:37:10.270454 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:10.270400 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcpb76" event={"ID":"517963c9-e2e5-457d-984f-8067d5bc6716","Type":"ContainerDied","Data":"6f74bba1296e952db851ba99fc96e26ceef5d8e45bb86c2678440bd062925bc0"} Jul 06 16:37:10.270454 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:10.270446 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcpb76" Jul 06 16:37:10.270986 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:10.270512 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f74bba1296e952db851ba99fc96e26ceef5d8e45bb86c2678440bd062925bc0" Jul 06 16:37:11.210696 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:11.210647 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:37:11.266176 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:11.266142 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:37:11.276555 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:11.276521 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nqrvj" event={"ID":"62273f05-282e-43fc-9960-04c208f20834","Type":"ContainerStarted","Data":"28517bc37952436d3f476031a81e76d1b719b7f4beed60347ae868f2647fe4a6"} Jul 06 16:37:11.278074 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:11.278049 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-gh6wj" event={"ID":"97e0aaa6-ce27-48ee-a595-dc32513ba5f4","Type":"ContainerStarted","Data":"fec330f5adab66cea380c97d43e576b17b4d097459640e541f41e3442991893f"} Jul 06 16:37:11.278185 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:11.278168 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-gh6wj" Jul 06 16:37:11.301604 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:11.301555 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nqrvj" podStartSLOduration=1.9299036539999999 podStartE2EDuration="4.301541933s" totalImagesPullingTime="2.371638279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:37:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:37:11.29976958 +0000 UTC m=+512.568840868" watchObservedRunningTime="2026-07-06 16:37:11.301541933 +0000 UTC m=+512.570612970" Jul 06 16:37:11.330340 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:11.330257 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-gh6wj" podStartSLOduration=1.407444457 podStartE2EDuration="4.330237875s" totalImagesPullingTime="2.922793418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:37:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:37:11.329206927 +0000 UTC m=+512.598277968" watchObservedRunningTime="2026-07-06 16:37:11.330237875 +0000 UTC m=+512.599308892" Jul 06 16:37:14.680099 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:14.680061 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:37:14.779740 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:14.779701 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:37:15.346519 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:15.346489 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:37:15.932172 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:15.932133 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:37:15.992279 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:15.992240 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hgzz4"] Jul 06 16:37:15.992656 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:15.992639 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="517963c9-e2e5-457d-984f-8067d5bc6716" containerName="extract" Jul 06 16:37:15.992746 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:15.992659 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="517963c9-e2e5-457d-984f-8067d5bc6716" containerName="extract" Jul 06 16:37:15.992746 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:15.992677 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="517963c9-e2e5-457d-984f-8067d5bc6716" containerName="util" Jul 06 16:37:15.992746 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:15.992685 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="517963c9-e2e5-457d-984f-8067d5bc6716" containerName="util" Jul 06 16:37:15.992746 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:15.992701 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="517963c9-e2e5-457d-984f-8067d5bc6716" containerName="pull" Jul 06 16:37:15.992746 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:15.992710 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="517963c9-e2e5-457d-984f-8067d5bc6716" containerName="pull" Jul 06 16:37:15.993014 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:15.992795 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="517963c9-e2e5-457d-984f-8067d5bc6716" containerName="extract" Jul 06 16:37:15.995722 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:15.995704 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-hgzz4" Jul 06 16:37:15.998149 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:15.998131 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-p8dn9\"" Jul 06 16:37:16.004314 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:16.004285 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hgzz4"] Jul 06 16:37:16.032416 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:16.032388 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kpph\" (UniqueName: \"kubernetes.io/projected/45887d4a-dd63-4e22-8b73-09c7ea059927-kube-api-access-9kpph\") pod \"cert-manager-55b4d954d5-hgzz4\" (UID: \"45887d4a-dd63-4e22-8b73-09c7ea059927\") " pod="cert-manager/cert-manager-55b4d954d5-hgzz4" Jul 06 16:37:16.032574 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:16.032445 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45887d4a-dd63-4e22-8b73-09c7ea059927-bound-sa-token\") pod \"cert-manager-55b4d954d5-hgzz4\" (UID: \"45887d4a-dd63-4e22-8b73-09c7ea059927\") " pod="cert-manager/cert-manager-55b4d954d5-hgzz4" Jul 06 16:37:16.133756 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:16.133720 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45887d4a-dd63-4e22-8b73-09c7ea059927-bound-sa-token\") pod \"cert-manager-55b4d954d5-hgzz4\" (UID: \"45887d4a-dd63-4e22-8b73-09c7ea059927\") " pod="cert-manager/cert-manager-55b4d954d5-hgzz4" Jul 06 16:37:16.133881 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:16.133796 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kpph\" (UniqueName: \"kubernetes.io/projected/45887d4a-dd63-4e22-8b73-09c7ea059927-kube-api-access-9kpph\") pod \"cert-manager-55b4d954d5-hgzz4\" (UID: \"45887d4a-dd63-4e22-8b73-09c7ea059927\") " pod="cert-manager/cert-manager-55b4d954d5-hgzz4" Jul 06 16:37:16.142542 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:16.142518 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45887d4a-dd63-4e22-8b73-09c7ea059927-bound-sa-token\") pod \"cert-manager-55b4d954d5-hgzz4\" (UID: \"45887d4a-dd63-4e22-8b73-09c7ea059927\") " pod="cert-manager/cert-manager-55b4d954d5-hgzz4" Jul 06 16:37:16.142668 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:16.142590 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kpph\" (UniqueName: \"kubernetes.io/projected/45887d4a-dd63-4e22-8b73-09c7ea059927-kube-api-access-9kpph\") pod \"cert-manager-55b4d954d5-hgzz4\" (UID: \"45887d4a-dd63-4e22-8b73-09c7ea059927\") " pod="cert-manager/cert-manager-55b4d954d5-hgzz4" Jul 06 16:37:16.305061 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:16.305032 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-hgzz4" Jul 06 16:37:16.435315 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:16.435292 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hgzz4"] Jul 06 16:37:16.437601 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:37:16.437572 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45887d4a_dd63_4e22_8b73_09c7ea059927.slice/crio-4b3715afe553dc8a0da0fc6e27c2ec2549b4c6be0bd1b381b2bc9ca91a0d24ba WatchSource:0}: Error finding container 4b3715afe553dc8a0da0fc6e27c2ec2549b4c6be0bd1b381b2bc9ca91a0d24ba: Status 404 returned error can't find the container with id 4b3715afe553dc8a0da0fc6e27c2ec2549b4c6be0bd1b381b2bc9ca91a0d24ba Jul 06 16:37:17.285539 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:17.285509 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-gh6wj" Jul 06 16:37:17.307513 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:17.307479 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-hgzz4" event={"ID":"45887d4a-dd63-4e22-8b73-09c7ea059927","Type":"ContainerStarted","Data":"4e117f5c772de1528a4f0348a003943bac793aadda6c35b802b58eabdbec706b"} Jul 06 16:37:17.307680 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:17.307520 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-hgzz4" event={"ID":"45887d4a-dd63-4e22-8b73-09c7ea059927","Type":"ContainerStarted","Data":"4b3715afe553dc8a0da0fc6e27c2ec2549b4c6be0bd1b381b2bc9ca91a0d24ba"} Jul 06 16:37:17.321425 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:17.321376 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-hgzz4" podStartSLOduration=2.321361073 podStartE2EDuration="2.321361073s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:37:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:37:17.32009384 +0000 UTC m=+518.589164877" watchObservedRunningTime="2026-07-06 16:37:17.321361073 +0000 UTC m=+518.590432110" Jul 06 16:37:22.543601 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:22.543538 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:37:22.643690 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:22.643663 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:37:24.147455 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:24.147427 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9dhj"] Jul 06 16:37:24.150200 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:24.150178 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9dhj" Jul 06 16:37:24.152200 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:24.152180 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 16:37:24.152317 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:24.152233 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xs9hx\"" Jul 06 16:37:24.152872 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:24.152856 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 16:37:24.159321 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:24.159297 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9dhj"] Jul 06 16:37:24.199993 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:24.199935 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06b51534-819f-4b56-8094-9c26c770e985-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9dhj\" (UID: \"06b51534-819f-4b56-8094-9c26c770e985\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9dhj" Jul 06 16:37:24.199993 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:24.199998 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7mkh\" (UniqueName: \"kubernetes.io/projected/06b51534-819f-4b56-8094-9c26c770e985-kube-api-access-m7mkh\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9dhj\" (UID: \"06b51534-819f-4b56-8094-9c26c770e985\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9dhj" Jul 06 16:37:24.200196 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:24.200102 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06b51534-819f-4b56-8094-9c26c770e985-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9dhj\" (UID: \"06b51534-819f-4b56-8094-9c26c770e985\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9dhj" Jul 06 16:37:24.274453 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:24.274415 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:37:24.300529 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:24.300503 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06b51534-819f-4b56-8094-9c26c770e985-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9dhj\" (UID: \"06b51534-819f-4b56-8094-9c26c770e985\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9dhj" Jul 06 16:37:24.300645 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:24.300553 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06b51534-819f-4b56-8094-9c26c770e985-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9dhj\" (UID: \"06b51534-819f-4b56-8094-9c26c770e985\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9dhj" Jul 06 16:37:24.300645 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:24.300578 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7mkh\" (UniqueName: \"kubernetes.io/projected/06b51534-819f-4b56-8094-9c26c770e985-kube-api-access-m7mkh\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9dhj\" (UID: \"06b51534-819f-4b56-8094-9c26c770e985\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9dhj" Jul 06 16:37:24.300872 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:24.300847 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06b51534-819f-4b56-8094-9c26c770e985-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9dhj\" (UID: \"06b51534-819f-4b56-8094-9c26c770e985\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9dhj" Jul 06 16:37:24.301003 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:24.300892 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06b51534-819f-4b56-8094-9c26c770e985-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9dhj\" (UID: \"06b51534-819f-4b56-8094-9c26c770e985\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9dhj" Jul 06 16:37:24.309613 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:24.309591 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7mkh\" (UniqueName: \"kubernetes.io/projected/06b51534-819f-4b56-8094-9c26c770e985-kube-api-access-m7mkh\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9dhj\" (UID: \"06b51534-819f-4b56-8094-9c26c770e985\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9dhj" Jul 06 16:37:24.460606 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:24.460512 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9dhj" Jul 06 16:37:24.593112 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:24.593090 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9dhj"] Jul 06 16:37:24.594890 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:37:24.594867 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06b51534_819f_4b56_8094_9c26c770e985.slice/crio-a4eb8f8a70e3f0cbd45f9687d33cf133dea597bf1be771f414cbc5dddc82d939 WatchSource:0}: Error finding container a4eb8f8a70e3f0cbd45f9687d33cf133dea597bf1be771f414cbc5dddc82d939: Status 404 returned error can't find the container with id a4eb8f8a70e3f0cbd45f9687d33cf133dea597bf1be771f414cbc5dddc82d939 Jul 06 16:37:25.347769 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:25.347735 2555 generic.go:356] "Generic (PLEG): container finished" podID="06b51534-819f-4b56-8094-9c26c770e985" containerID="fc16b95010ee44be4e3b52c08b4f800898d53b18a990ee18a8910d54e1738bd4" exitCode=0 Jul 06 16:37:25.348173 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:25.347822 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9dhj" event={"ID":"06b51534-819f-4b56-8094-9c26c770e985","Type":"ContainerDied","Data":"fc16b95010ee44be4e3b52c08b4f800898d53b18a990ee18a8910d54e1738bd4"} Jul 06 16:37:25.348173 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:25.347875 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9dhj" event={"ID":"06b51534-819f-4b56-8094-9c26c770e985","Type":"ContainerStarted","Data":"a4eb8f8a70e3f0cbd45f9687d33cf133dea597bf1be771f414cbc5dddc82d939"} Jul 06 16:37:26.355361 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:26.355322 2555 generic.go:356] "Generic (PLEG): container finished" podID="06b51534-819f-4b56-8094-9c26c770e985" containerID="50afe0de99db89930011f62a8356154b8ce05a09522b0bca068a01f2b6446364" exitCode=0 Jul 06 16:37:26.355841 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:26.355365 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9dhj" event={"ID":"06b51534-819f-4b56-8094-9c26c770e985","Type":"ContainerDied","Data":"50afe0de99db89930011f62a8356154b8ce05a09522b0bca068a01f2b6446364"} Jul 06 16:37:27.361584 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:27.361543 2555 generic.go:356] "Generic (PLEG): container finished" podID="06b51534-819f-4b56-8094-9c26c770e985" containerID="bd3526466493bc626849bb6fa81bdd39c2a1a88e9fae49385aaa36303dfafc3a" exitCode=0 Jul 06 16:37:27.361987 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:27.361630 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9dhj" event={"ID":"06b51534-819f-4b56-8094-9c26c770e985","Type":"ContainerDied","Data":"bd3526466493bc626849bb6fa81bdd39c2a1a88e9fae49385aaa36303dfafc3a"} Jul 06 16:37:28.511602 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:28.511582 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9dhj" Jul 06 16:37:28.637887 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:28.637797 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06b51534-819f-4b56-8094-9c26c770e985-bundle\") pod \"06b51534-819f-4b56-8094-9c26c770e985\" (UID: \"06b51534-819f-4b56-8094-9c26c770e985\") " Jul 06 16:37:28.637887 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:28.637869 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06b51534-819f-4b56-8094-9c26c770e985-util\") pod \"06b51534-819f-4b56-8094-9c26c770e985\" (UID: \"06b51534-819f-4b56-8094-9c26c770e985\") " Jul 06 16:37:28.637887 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:28.637889 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7mkh\" (UniqueName: \"kubernetes.io/projected/06b51534-819f-4b56-8094-9c26c770e985-kube-api-access-m7mkh\") pod \"06b51534-819f-4b56-8094-9c26c770e985\" (UID: \"06b51534-819f-4b56-8094-9c26c770e985\") " Jul 06 16:37:28.638583 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:28.638561 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06b51534-819f-4b56-8094-9c26c770e985-bundle" (OuterVolumeSpecName: "bundle") pod "06b51534-819f-4b56-8094-9c26c770e985" (UID: "06b51534-819f-4b56-8094-9c26c770e985"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 16:37:28.640155 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:28.640133 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06b51534-819f-4b56-8094-9c26c770e985-kube-api-access-m7mkh" (OuterVolumeSpecName: "kube-api-access-m7mkh") pod "06b51534-819f-4b56-8094-9c26c770e985" (UID: "06b51534-819f-4b56-8094-9c26c770e985"). InnerVolumeSpecName "kube-api-access-m7mkh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 16:37:28.643519 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:28.643495 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06b51534-819f-4b56-8094-9c26c770e985-util" (OuterVolumeSpecName: "util") pod "06b51534-819f-4b56-8094-9c26c770e985" (UID: "06b51534-819f-4b56-8094-9c26c770e985"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 16:37:28.738589 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:28.738540 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/06b51534-819f-4b56-8094-9c26c770e985-bundle\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:37:28.738589 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:28.738582 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/06b51534-819f-4b56-8094-9c26c770e985-util\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:37:28.738589 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:28.738595 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7mkh\" (UniqueName: \"kubernetes.io/projected/06b51534-819f-4b56-8094-9c26c770e985-kube-api-access-m7mkh\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:37:29.371985 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:29.371955 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9dhj" Jul 06 16:37:29.372152 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:29.371929 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afc9dhj" event={"ID":"06b51534-819f-4b56-8094-9c26c770e985","Type":"ContainerDied","Data":"a4eb8f8a70e3f0cbd45f9687d33cf133dea597bf1be771f414cbc5dddc82d939"} Jul 06 16:37:29.372152 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:29.372072 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4eb8f8a70e3f0cbd45f9687d33cf133dea597bf1be771f414cbc5dddc82d939" Jul 06 16:37:40.291534 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:40.291495 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:37:41.252673 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:41.252640 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bb6889b66-wn5m5"] Jul 06 16:37:41.252994 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:41.252981 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06b51534-819f-4b56-8094-9c26c770e985" containerName="util" Jul 06 16:37:41.253046 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:41.252996 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="06b51534-819f-4b56-8094-9c26c770e985" containerName="util" Jul 06 16:37:41.253046 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:41.253005 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06b51534-819f-4b56-8094-9c26c770e985" containerName="extract" Jul 06 16:37:41.253046 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:41.253010 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="06b51534-819f-4b56-8094-9c26c770e985" containerName="extract" Jul 06 16:37:41.253046 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:41.253028 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06b51534-819f-4b56-8094-9c26c770e985" containerName="pull" Jul 06 16:37:41.253046 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:41.253034 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="06b51534-819f-4b56-8094-9c26c770e985" containerName="pull" Jul 06 16:37:41.253190 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:41.253080 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="06b51534-819f-4b56-8094-9c26c770e985" containerName="extract" Jul 06 16:37:41.257597 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:41.257581 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-wn5m5" Jul 06 16:37:41.267870 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:41.267850 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 16:37:41.270363 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:41.270347 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 16:37:41.271018 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:41.271000 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 16:37:41.271105 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:41.271055 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-nfd8f\"" Jul 06 16:37:41.271200 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:41.271187 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 16:37:41.290446 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:41.290426 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bb6889b66-wn5m5"] Jul 06 16:37:41.349991 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:41.349964 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/178930b2-46c5-4565-ac97-946b2ea1b015-webhook-cert\") pod \"opendatahub-operator-controller-manager-bb6889b66-wn5m5\" (UID: \"178930b2-46c5-4565-ac97-946b2ea1b015\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-wn5m5" Jul 06 16:37:41.349991 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:41.350001 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm4qv\" (UniqueName: \"kubernetes.io/projected/178930b2-46c5-4565-ac97-946b2ea1b015-kube-api-access-sm4qv\") pod \"opendatahub-operator-controller-manager-bb6889b66-wn5m5\" (UID: \"178930b2-46c5-4565-ac97-946b2ea1b015\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-wn5m5" Jul 06 16:37:41.350392 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:41.350025 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/178930b2-46c5-4565-ac97-946b2ea1b015-manifests\") pod \"opendatahub-operator-controller-manager-bb6889b66-wn5m5\" (UID: \"178930b2-46c5-4565-ac97-946b2ea1b015\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-wn5m5" Jul 06 16:37:41.350392 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:41.350118 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/178930b2-46c5-4565-ac97-946b2ea1b015-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bb6889b66-wn5m5\" (UID: \"178930b2-46c5-4565-ac97-946b2ea1b015\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-wn5m5" Jul 06 16:37:41.350392 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:41.350176 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/178930b2-46c5-4565-ac97-946b2ea1b015-tmp\") pod \"opendatahub-operator-controller-manager-bb6889b66-wn5m5\" (UID: \"178930b2-46c5-4565-ac97-946b2ea1b015\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-wn5m5" Jul 06 16:37:41.451168 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:41.451139 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm4qv\" (UniqueName: \"kubernetes.io/projected/178930b2-46c5-4565-ac97-946b2ea1b015-kube-api-access-sm4qv\") pod \"opendatahub-operator-controller-manager-bb6889b66-wn5m5\" (UID: \"178930b2-46c5-4565-ac97-946b2ea1b015\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-wn5m5" Jul 06 16:37:41.451326 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:41.451174 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/178930b2-46c5-4565-ac97-946b2ea1b015-manifests\") pod \"opendatahub-operator-controller-manager-bb6889b66-wn5m5\" (UID: \"178930b2-46c5-4565-ac97-946b2ea1b015\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-wn5m5" Jul 06 16:37:41.451326 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:41.451219 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/178930b2-46c5-4565-ac97-946b2ea1b015-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bb6889b66-wn5m5\" (UID: \"178930b2-46c5-4565-ac97-946b2ea1b015\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-wn5m5" Jul 06 16:37:41.451326 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:41.451271 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/178930b2-46c5-4565-ac97-946b2ea1b015-tmp\") pod \"opendatahub-operator-controller-manager-bb6889b66-wn5m5\" (UID: \"178930b2-46c5-4565-ac97-946b2ea1b015\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-wn5m5" Jul 06 16:37:41.451326 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:41.451323 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/178930b2-46c5-4565-ac97-946b2ea1b015-webhook-cert\") pod \"opendatahub-operator-controller-manager-bb6889b66-wn5m5\" (UID: \"178930b2-46c5-4565-ac97-946b2ea1b015\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-wn5m5" Jul 06 16:37:41.451659 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:41.451631 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/178930b2-46c5-4565-ac97-946b2ea1b015-manifests\") pod \"opendatahub-operator-controller-manager-bb6889b66-wn5m5\" (UID: \"178930b2-46c5-4565-ac97-946b2ea1b015\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-wn5m5" Jul 06 16:37:41.453727 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:41.453695 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/178930b2-46c5-4565-ac97-946b2ea1b015-tmp\") pod \"opendatahub-operator-controller-manager-bb6889b66-wn5m5\" (UID: \"178930b2-46c5-4565-ac97-946b2ea1b015\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-wn5m5" Jul 06 16:37:41.453884 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:41.453864 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/178930b2-46c5-4565-ac97-946b2ea1b015-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bb6889b66-wn5m5\" (UID: \"178930b2-46c5-4565-ac97-946b2ea1b015\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-wn5m5" Jul 06 16:37:41.454040 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:41.454021 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/178930b2-46c5-4565-ac97-946b2ea1b015-webhook-cert\") pod \"opendatahub-operator-controller-manager-bb6889b66-wn5m5\" (UID: \"178930b2-46c5-4565-ac97-946b2ea1b015\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-wn5m5" Jul 06 16:37:41.458543 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:41.458523 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm4qv\" (UniqueName: \"kubernetes.io/projected/178930b2-46c5-4565-ac97-946b2ea1b015-kube-api-access-sm4qv\") pod \"opendatahub-operator-controller-manager-bb6889b66-wn5m5\" (UID: \"178930b2-46c5-4565-ac97-946b2ea1b015\") " pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-wn5m5" Jul 06 16:37:41.568037 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:41.568013 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-wn5m5" Jul 06 16:37:41.706150 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:41.706131 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bb6889b66-wn5m5"] Jul 06 16:37:41.708176 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:37:41.708150 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod178930b2_46c5_4565_ac97_946b2ea1b015.slice/crio-ffaf8a73c2c3f4e630802153ff8dd440e4008fc40eb99730bf098586a982da0b WatchSource:0}: Error finding container ffaf8a73c2c3f4e630802153ff8dd440e4008fc40eb99730bf098586a982da0b: Status 404 returned error can't find the container with id ffaf8a73c2c3f4e630802153ff8dd440e4008fc40eb99730bf098586a982da0b Jul 06 16:37:42.430506 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:42.430468 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-wn5m5" event={"ID":"178930b2-46c5-4565-ac97-946b2ea1b015","Type":"ContainerStarted","Data":"ffaf8a73c2c3f4e630802153ff8dd440e4008fc40eb99730bf098586a982da0b"} Jul 06 16:37:43.964786 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:43.964745 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:37:45.447274 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:45.447197 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-wn5m5" event={"ID":"178930b2-46c5-4565-ac97-946b2ea1b015","Type":"ContainerStarted","Data":"4585d219625332c84135f78d959c6875b438c76fa34b4bc8944bf13a1c2f0cb3"} Jul 06 16:37:46.454289 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:46.454255 2555 generic.go:356] "Generic (PLEG): container finished" podID="178930b2-46c5-4565-ac97-946b2ea1b015" containerID="4585d219625332c84135f78d959c6875b438c76fa34b4bc8944bf13a1c2f0cb3" exitCode=0 Jul 06 16:37:46.454722 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:46.454327 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-wn5m5" event={"ID":"178930b2-46c5-4565-ac97-946b2ea1b015","Type":"ContainerDied","Data":"4585d219625332c84135f78d959c6875b438c76fa34b4bc8944bf13a1c2f0cb3"} Jul 06 16:37:47.462437 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:47.462409 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-wn5m5" event={"ID":"178930b2-46c5-4565-ac97-946b2ea1b015","Type":"ContainerStarted","Data":"89f3a0d72d041bb15317c65177bbab9fafe84915d694af7e6f48822afb852a06"} Jul 06 16:37:47.462901 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:47.462568 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-wn5m5" Jul 06 16:37:47.483685 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:47.483639 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-wn5m5" podStartSLOduration=1.665166259 podStartE2EDuration="6.48362363s" totalImagesPullingTime="3.746156243s" totalInitContainerRuntime="1.072301128s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:37:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:37:47.482245486 +0000 UTC m=+548.751316527" watchObservedRunningTime="2026-07-06 16:37:47.48362363 +0000 UTC m=+548.752694671" Jul 06 16:37:50.522549 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:50.522518 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:37:50.615482 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:50.615452 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:37:53.328445 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:53.328409 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:37:53.424190 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:53.424157 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:37:58.468970 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:37:58.468918 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bb6889b66-wn5m5" Jul 06 16:38:02.522254 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:02.522216 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:38:02.634821 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:02.634784 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:38:02.925553 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:02.925515 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:38:03.099064 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:03.099033 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-75577b88c-dvhj4"] Jul 06 16:38:03.102466 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:03.102442 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75577b88c-dvhj4" Jul 06 16:38:03.105308 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:03.105283 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 06 16:38:03.105429 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:03.105409 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-8sq6n\"" Jul 06 16:38:03.106175 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:03.106154 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 06 16:38:03.121015 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:03.120991 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc2383c3-10e9-4407-ba1d-fab1ac05c225-tls-certs\") pod \"kube-auth-proxy-75577b88c-dvhj4\" (UID: \"dc2383c3-10e9-4407-ba1d-fab1ac05c225\") " pod="openshift-ingress/kube-auth-proxy-75577b88c-dvhj4" Jul 06 16:38:03.121115 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:03.121048 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdjkw\" (UniqueName: \"kubernetes.io/projected/dc2383c3-10e9-4407-ba1d-fab1ac05c225-kube-api-access-wdjkw\") pod \"kube-auth-proxy-75577b88c-dvhj4\" (UID: \"dc2383c3-10e9-4407-ba1d-fab1ac05c225\") " pod="openshift-ingress/kube-auth-proxy-75577b88c-dvhj4" Jul 06 16:38:03.121181 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:03.121164 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc2383c3-10e9-4407-ba1d-fab1ac05c225-tmp\") pod \"kube-auth-proxy-75577b88c-dvhj4\" (UID: \"dc2383c3-10e9-4407-ba1d-fab1ac05c225\") " pod="openshift-ingress/kube-auth-proxy-75577b88c-dvhj4" Jul 06 16:38:03.127585 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:03.127554 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75577b88c-dvhj4"] Jul 06 16:38:03.147384 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:03.147357 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:38:03.222408 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:03.222320 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc2383c3-10e9-4407-ba1d-fab1ac05c225-tmp\") pod \"kube-auth-proxy-75577b88c-dvhj4\" (UID: \"dc2383c3-10e9-4407-ba1d-fab1ac05c225\") " pod="openshift-ingress/kube-auth-proxy-75577b88c-dvhj4" Jul 06 16:38:03.222408 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:03.222381 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc2383c3-10e9-4407-ba1d-fab1ac05c225-tls-certs\") pod \"kube-auth-proxy-75577b88c-dvhj4\" (UID: \"dc2383c3-10e9-4407-ba1d-fab1ac05c225\") " pod="openshift-ingress/kube-auth-proxy-75577b88c-dvhj4" Jul 06 16:38:03.222596 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:03.222424 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdjkw\" (UniqueName: \"kubernetes.io/projected/dc2383c3-10e9-4407-ba1d-fab1ac05c225-kube-api-access-wdjkw\") pod \"kube-auth-proxy-75577b88c-dvhj4\" (UID: \"dc2383c3-10e9-4407-ba1d-fab1ac05c225\") " pod="openshift-ingress/kube-auth-proxy-75577b88c-dvhj4" Jul 06 16:38:03.224685 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:03.224655 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dc2383c3-10e9-4407-ba1d-fab1ac05c225-tmp\") pod \"kube-auth-proxy-75577b88c-dvhj4\" (UID: \"dc2383c3-10e9-4407-ba1d-fab1ac05c225\") " pod="openshift-ingress/kube-auth-proxy-75577b88c-dvhj4" Jul 06 16:38:03.224874 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:03.224856 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dc2383c3-10e9-4407-ba1d-fab1ac05c225-tls-certs\") pod \"kube-auth-proxy-75577b88c-dvhj4\" (UID: \"dc2383c3-10e9-4407-ba1d-fab1ac05c225\") " pod="openshift-ingress/kube-auth-proxy-75577b88c-dvhj4" Jul 06 16:38:03.233734 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:03.233712 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdjkw\" (UniqueName: \"kubernetes.io/projected/dc2383c3-10e9-4407-ba1d-fab1ac05c225-kube-api-access-wdjkw\") pod \"kube-auth-proxy-75577b88c-dvhj4\" (UID: \"dc2383c3-10e9-4407-ba1d-fab1ac05c225\") " pod="openshift-ingress/kube-auth-proxy-75577b88c-dvhj4" Jul 06 16:38:03.376908 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:03.376872 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:38:03.412570 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:03.412534 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75577b88c-dvhj4" Jul 06 16:38:03.498226 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:03.498184 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:38:03.572161 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:03.572127 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75577b88c-dvhj4"] Jul 06 16:38:03.574451 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:38:03.574407 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc2383c3_10e9_4407_ba1d_fab1ac05c225.slice/crio-4f0193e535f2cadcef80c537bd33e76e96043c3b7ceb24e93bb6b297a1b38a97 WatchSource:0}: Error finding container 4f0193e535f2cadcef80c537bd33e76e96043c3b7ceb24e93bb6b297a1b38a97: Status 404 returned error can't find the container with id 4f0193e535f2cadcef80c537bd33e76e96043c3b7ceb24e93bb6b297a1b38a97 Jul 06 16:38:03.595981 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:03.595928 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:38:03.689835 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:03.689798 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:38:04.236132 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:04.236100 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:38:04.552187 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:04.552148 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75577b88c-dvhj4" event={"ID":"dc2383c3-10e9-4407-ba1d-fab1ac05c225","Type":"ContainerStarted","Data":"4f0193e535f2cadcef80c537bd33e76e96043c3b7ceb24e93bb6b297a1b38a97"} Jul 06 16:38:04.647550 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:04.647517 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:38:04.738373 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:04.738341 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:38:04.817248 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:04.817138 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:38:05.667300 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:05.667266 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:38:08.575851 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:08.575811 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75577b88c-dvhj4" event={"ID":"dc2383c3-10e9-4407-ba1d-fab1ac05c225","Type":"ContainerStarted","Data":"c095592bf1db1be5567690eba98bde21531e537704845461fa8e29224a0e9090"} Jul 06 16:38:08.592084 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:08.592024 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-75577b88c-dvhj4" podStartSLOduration=1.11331484 podStartE2EDuration="5.592003862s" totalImagesPullingTime="4.478689022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:38:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:38:08.590550027 +0000 UTC m=+569.859621075" watchObservedRunningTime="2026-07-06 16:38:08.592003862 +0000 UTC m=+569.861074899" Jul 06 16:38:10.826433 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:10.826397 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9d2z"] Jul 06 16:38:10.829847 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:10.829831 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9d2z" Jul 06 16:38:10.831860 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:10.831839 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 06 16:38:10.832451 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:10.832435 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-w7nwh\"" Jul 06 16:38:10.832544 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:10.832509 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 06 16:38:10.832971 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:10.832955 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 06 16:38:10.833122 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:10.833101 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 16:38:10.844500 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:10.844477 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9d2z"] Jul 06 16:38:10.893194 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:10.893159 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdwjh\" (UniqueName: \"kubernetes.io/projected/386d2c59-227d-4f7d-9074-8ad1be90384a-kube-api-access-hdwjh\") pod \"istiod-openshift-gateway-94bb8fbfd-p9d2z\" (UID: \"386d2c59-227d-4f7d-9074-8ad1be90384a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9d2z" Jul 06 16:38:10.893391 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:10.893205 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/386d2c59-227d-4f7d-9074-8ad1be90384a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-p9d2z\" (UID: \"386d2c59-227d-4f7d-9074-8ad1be90384a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9d2z" Jul 06 16:38:10.893391 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:10.893295 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/386d2c59-227d-4f7d-9074-8ad1be90384a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-p9d2z\" (UID: \"386d2c59-227d-4f7d-9074-8ad1be90384a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9d2z" Jul 06 16:38:10.893391 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:10.893340 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/386d2c59-227d-4f7d-9074-8ad1be90384a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-p9d2z\" (UID: \"386d2c59-227d-4f7d-9074-8ad1be90384a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9d2z" Jul 06 16:38:10.893538 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:10.893482 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/386d2c59-227d-4f7d-9074-8ad1be90384a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-p9d2z\" (UID: \"386d2c59-227d-4f7d-9074-8ad1be90384a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9d2z" Jul 06 16:38:10.893585 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:10.893537 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/386d2c59-227d-4f7d-9074-8ad1be90384a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-p9d2z\" (UID: \"386d2c59-227d-4f7d-9074-8ad1be90384a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9d2z" Jul 06 16:38:10.893585 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:10.893561 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/386d2c59-227d-4f7d-9074-8ad1be90384a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-p9d2z\" (UID: \"386d2c59-227d-4f7d-9074-8ad1be90384a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9d2z" Jul 06 16:38:10.994376 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:10.994340 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/386d2c59-227d-4f7d-9074-8ad1be90384a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-p9d2z\" (UID: \"386d2c59-227d-4f7d-9074-8ad1be90384a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9d2z" Jul 06 16:38:10.994376 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:10.994373 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/386d2c59-227d-4f7d-9074-8ad1be90384a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-p9d2z\" (UID: \"386d2c59-227d-4f7d-9074-8ad1be90384a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9d2z" Jul 06 16:38:10.994603 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:10.994415 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdwjh\" (UniqueName: \"kubernetes.io/projected/386d2c59-227d-4f7d-9074-8ad1be90384a-kube-api-access-hdwjh\") pod \"istiod-openshift-gateway-94bb8fbfd-p9d2z\" (UID: \"386d2c59-227d-4f7d-9074-8ad1be90384a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9d2z" Jul 06 16:38:10.994603 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:10.994435 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/386d2c59-227d-4f7d-9074-8ad1be90384a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-p9d2z\" (UID: \"386d2c59-227d-4f7d-9074-8ad1be90384a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9d2z" Jul 06 16:38:10.994603 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:10.994457 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/386d2c59-227d-4f7d-9074-8ad1be90384a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-p9d2z\" (UID: \"386d2c59-227d-4f7d-9074-8ad1be90384a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9d2z" Jul 06 16:38:10.994603 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:10.994473 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/386d2c59-227d-4f7d-9074-8ad1be90384a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-p9d2z\" (UID: \"386d2c59-227d-4f7d-9074-8ad1be90384a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9d2z" Jul 06 16:38:10.994603 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:10.994536 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/386d2c59-227d-4f7d-9074-8ad1be90384a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-p9d2z\" (UID: \"386d2c59-227d-4f7d-9074-8ad1be90384a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9d2z" Jul 06 16:38:10.995199 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:10.995170 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/386d2c59-227d-4f7d-9074-8ad1be90384a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-p9d2z\" (UID: \"386d2c59-227d-4f7d-9074-8ad1be90384a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9d2z" Jul 06 16:38:10.997005 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:10.996980 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/386d2c59-227d-4f7d-9074-8ad1be90384a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-p9d2z\" (UID: \"386d2c59-227d-4f7d-9074-8ad1be90384a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9d2z" Jul 06 16:38:10.997122 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:10.997103 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/386d2c59-227d-4f7d-9074-8ad1be90384a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-p9d2z\" (UID: \"386d2c59-227d-4f7d-9074-8ad1be90384a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9d2z" Jul 06 16:38:10.997320 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:10.997307 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/386d2c59-227d-4f7d-9074-8ad1be90384a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-p9d2z\" (UID: \"386d2c59-227d-4f7d-9074-8ad1be90384a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9d2z" Jul 06 16:38:10.997528 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:10.997507 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/386d2c59-227d-4f7d-9074-8ad1be90384a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-p9d2z\" (UID: \"386d2c59-227d-4f7d-9074-8ad1be90384a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9d2z" Jul 06 16:38:11.006801 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:11.006769 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/386d2c59-227d-4f7d-9074-8ad1be90384a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-p9d2z\" (UID: \"386d2c59-227d-4f7d-9074-8ad1be90384a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9d2z" Jul 06 16:38:11.016265 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:11.016236 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdwjh\" (UniqueName: \"kubernetes.io/projected/386d2c59-227d-4f7d-9074-8ad1be90384a-kube-api-access-hdwjh\") pod \"istiod-openshift-gateway-94bb8fbfd-p9d2z\" (UID: \"386d2c59-227d-4f7d-9074-8ad1be90384a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9d2z" Jul 06 16:38:11.139370 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:11.139289 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9d2z" Jul 06 16:38:11.278060 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:11.278033 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9d2z"] Jul 06 16:38:11.279408 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:38:11.279382 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod386d2c59_227d_4f7d_9074_8ad1be90384a.slice/crio-06628ce8d39f1dbcc788ec720620ba292eaf9609841dd6b830ea1608cdb952aa WatchSource:0}: Error finding container 06628ce8d39f1dbcc788ec720620ba292eaf9609841dd6b830ea1608cdb952aa: Status 404 returned error can't find the container with id 06628ce8d39f1dbcc788ec720620ba292eaf9609841dd6b830ea1608cdb952aa Jul 06 16:38:11.591164 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:11.591128 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9d2z" event={"ID":"386d2c59-227d-4f7d-9074-8ad1be90384a","Type":"ContainerStarted","Data":"06628ce8d39f1dbcc788ec720620ba292eaf9609841dd6b830ea1608cdb952aa"} Jul 06 16:38:12.027160 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:12.027086 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:38:12.215397 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:12.215339 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:38:12.393429 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:12.393401 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:38:12.497915 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:12.497887 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:38:12.669684 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:12.669574 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:38:13.989000 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:13.988966 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:38:14.090408 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:14.090349 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 16:38:14.090541 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:14.090426 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 16:38:14.125119 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:14.125083 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:38:14.608657 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:14.608621 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9d2z" event={"ID":"386d2c59-227d-4f7d-9074-8ad1be90384a","Type":"ContainerStarted","Data":"2c2034e37017c075c199ac5fad8919073118793383efd8581ae53aca6b46be9a"} Jul 06 16:38:14.608880 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:14.608751 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9d2z" Jul 06 16:38:14.632735 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:14.632685 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9d2z" podStartSLOduration=1.824109156 podStartE2EDuration="4.632669826s" totalImagesPullingTime="2.80856067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:38:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:38:14.630897353 +0000 UTC m=+575.899968391" watchObservedRunningTime="2026-07-06 16:38:14.632669826 +0000 UTC m=+575.901740862" Jul 06 16:38:15.615712 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:15.615686 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9d2z" Jul 06 16:38:16.078017 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:16.077977 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:38:16.170014 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:38:16.169963 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:04.048110 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:04.047996 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:04.146963 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:04.146903 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:04.214258 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:04.214228 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:04.746540 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:04.746506 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t2sr9"] Jul 06 16:39:04.749554 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:04.749538 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t2sr9" Jul 06 16:39:04.751836 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:04.751813 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 16:39:04.752014 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:04.751996 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 16:39:04.752455 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:04.752442 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-rhkxg\"" Jul 06 16:39:04.758984 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:04.758963 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t2sr9"] Jul 06 16:39:04.853209 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:04.853173 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzhb2\" (UniqueName: \"kubernetes.io/projected/6143e2b5-42c6-4511-ab11-f735cd42fff9-kube-api-access-rzhb2\") pod \"kuadrant-operator-catalog-t2sr9\" (UID: \"6143e2b5-42c6-4511-ab11-f735cd42fff9\") " pod="kuadrant-system/kuadrant-operator-catalog-t2sr9" Jul 06 16:39:04.954097 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:04.954061 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzhb2\" (UniqueName: \"kubernetes.io/projected/6143e2b5-42c6-4511-ab11-f735cd42fff9-kube-api-access-rzhb2\") pod \"kuadrant-operator-catalog-t2sr9\" (UID: \"6143e2b5-42c6-4511-ab11-f735cd42fff9\") " pod="kuadrant-system/kuadrant-operator-catalog-t2sr9" Jul 06 16:39:04.961783 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:04.961758 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzhb2\" (UniqueName: \"kubernetes.io/projected/6143e2b5-42c6-4511-ab11-f735cd42fff9-kube-api-access-rzhb2\") pod \"kuadrant-operator-catalog-t2sr9\" (UID: \"6143e2b5-42c6-4511-ab11-f735cd42fff9\") " pod="kuadrant-system/kuadrant-operator-catalog-t2sr9" Jul 06 16:39:05.058738 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:05.058701 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t2sr9" Jul 06 16:39:05.190585 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:05.190563 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t2sr9"] Jul 06 16:39:05.192645 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:39:05.192621 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6143e2b5_42c6_4511_ab11_f735cd42fff9.slice/crio-b3559884833b8ec4e13e65865ba7ff194b8d0202165b72bebb8646c683841b08 WatchSource:0}: Error finding container b3559884833b8ec4e13e65865ba7ff194b8d0202165b72bebb8646c683841b08: Status 404 returned error can't find the container with id b3559884833b8ec4e13e65865ba7ff194b8d0202165b72bebb8646c683841b08 Jul 06 16:39:05.854959 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:05.854909 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t2sr9" event={"ID":"6143e2b5-42c6-4511-ab11-f735cd42fff9","Type":"ContainerStarted","Data":"b3559884833b8ec4e13e65865ba7ff194b8d0202165b72bebb8646c683841b08"} Jul 06 16:39:07.867640 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:07.867603 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t2sr9" event={"ID":"6143e2b5-42c6-4511-ab11-f735cd42fff9","Type":"ContainerStarted","Data":"67003e86a03da19b1a1a85649d4f94c7f882cfc8f0c3f3f86f2c0df91e2a1c06"} Jul 06 16:39:07.884061 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:07.884015 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-t2sr9" podStartSLOduration=1.845657735 podStartE2EDuration="3.883998953s" totalImagesPullingTime="2.038341218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:39:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:39:07.88207185 +0000 UTC m=+629.151142897" watchObservedRunningTime="2026-07-06 16:39:07.883998953 +0000 UTC m=+629.153069990" Jul 06 16:39:15.059726 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:15.059686 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-t2sr9" Jul 06 16:39:15.060195 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:15.059788 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-t2sr9" Jul 06 16:39:15.082333 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:15.082305 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-t2sr9" Jul 06 16:39:15.928251 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:15.928224 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-t2sr9" Jul 06 16:39:19.755073 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:19.755040 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5"] Jul 06 16:39:19.758916 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:19.758898 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5" Jul 06 16:39:19.760837 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:19.760818 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-c9sg5\"" Jul 06 16:39:19.765656 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:19.765629 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5"] Jul 06 16:39:19.888117 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:19.888077 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rgsl\" (UniqueName: \"kubernetes.io/projected/3bc7247c-6828-4d27-97dd-ceb7fecc9377-kube-api-access-4rgsl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5\" (UID: \"3bc7247c-6828-4d27-97dd-ceb7fecc9377\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5" Jul 06 16:39:19.888117 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:19.888124 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bc7247c-6828-4d27-97dd-ceb7fecc9377-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5\" (UID: \"3bc7247c-6828-4d27-97dd-ceb7fecc9377\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5" Jul 06 16:39:19.888343 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:19.888151 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bc7247c-6828-4d27-97dd-ceb7fecc9377-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5\" (UID: \"3bc7247c-6828-4d27-97dd-ceb7fecc9377\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5" Jul 06 16:39:19.989691 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:19.989656 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rgsl\" (UniqueName: \"kubernetes.io/projected/3bc7247c-6828-4d27-97dd-ceb7fecc9377-kube-api-access-4rgsl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5\" (UID: \"3bc7247c-6828-4d27-97dd-ceb7fecc9377\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5" Jul 06 16:39:19.989691 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:19.989705 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bc7247c-6828-4d27-97dd-ceb7fecc9377-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5\" (UID: \"3bc7247c-6828-4d27-97dd-ceb7fecc9377\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5" Jul 06 16:39:19.989957 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:19.989830 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bc7247c-6828-4d27-97dd-ceb7fecc9377-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5\" (UID: \"3bc7247c-6828-4d27-97dd-ceb7fecc9377\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5" Jul 06 16:39:19.990162 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:19.990141 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bc7247c-6828-4d27-97dd-ceb7fecc9377-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5\" (UID: \"3bc7247c-6828-4d27-97dd-ceb7fecc9377\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5" Jul 06 16:39:19.990200 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:19.990174 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bc7247c-6828-4d27-97dd-ceb7fecc9377-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5\" (UID: \"3bc7247c-6828-4d27-97dd-ceb7fecc9377\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5" Jul 06 16:39:19.998637 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:19.998617 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rgsl\" (UniqueName: \"kubernetes.io/projected/3bc7247c-6828-4d27-97dd-ceb7fecc9377-kube-api-access-4rgsl\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5\" (UID: \"3bc7247c-6828-4d27-97dd-ceb7fecc9377\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5" Jul 06 16:39:20.068794 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:20.068763 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5" Jul 06 16:39:20.199394 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:20.199368 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5"] Jul 06 16:39:20.201111 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:39:20.201088 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bc7247c_6828_4d27_97dd_ceb7fecc9377.slice/crio-da8ea94f6e972cf76204699dbc532b7c313c4520e313c882977318930a2a7458 WatchSource:0}: Error finding container da8ea94f6e972cf76204699dbc532b7c313c4520e313c882977318930a2a7458: Status 404 returned error can't find the container with id da8ea94f6e972cf76204699dbc532b7c313c4520e313c882977318930a2a7458 Jul 06 16:39:20.556260 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:20.556227 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf"] Jul 06 16:39:20.559685 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:20.559666 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf" Jul 06 16:39:20.568474 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:20.568449 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf"] Jul 06 16:39:20.694790 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:20.694749 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e40881b-0a53-4413-9dfa-51371af7dcf5-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf\" (UID: \"2e40881b-0a53-4413-9dfa-51371af7dcf5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf" Jul 06 16:39:20.694998 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:20.694810 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5psrl\" (UniqueName: \"kubernetes.io/projected/2e40881b-0a53-4413-9dfa-51371af7dcf5-kube-api-access-5psrl\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf\" (UID: \"2e40881b-0a53-4413-9dfa-51371af7dcf5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf" Jul 06 16:39:20.694998 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:20.694915 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e40881b-0a53-4413-9dfa-51371af7dcf5-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf\" (UID: \"2e40881b-0a53-4413-9dfa-51371af7dcf5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf" Jul 06 16:39:20.796227 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:20.796189 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e40881b-0a53-4413-9dfa-51371af7dcf5-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf\" (UID: \"2e40881b-0a53-4413-9dfa-51371af7dcf5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf" Jul 06 16:39:20.796636 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:20.796266 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e40881b-0a53-4413-9dfa-51371af7dcf5-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf\" (UID: \"2e40881b-0a53-4413-9dfa-51371af7dcf5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf" Jul 06 16:39:20.796636 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:20.796321 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5psrl\" (UniqueName: \"kubernetes.io/projected/2e40881b-0a53-4413-9dfa-51371af7dcf5-kube-api-access-5psrl\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf\" (UID: \"2e40881b-0a53-4413-9dfa-51371af7dcf5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf" Jul 06 16:39:20.796636 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:20.796545 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e40881b-0a53-4413-9dfa-51371af7dcf5-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf\" (UID: \"2e40881b-0a53-4413-9dfa-51371af7dcf5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf" Jul 06 16:39:20.796636 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:20.796592 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e40881b-0a53-4413-9dfa-51371af7dcf5-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf\" (UID: \"2e40881b-0a53-4413-9dfa-51371af7dcf5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf" Jul 06 16:39:20.804253 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:20.804233 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5psrl\" (UniqueName: \"kubernetes.io/projected/2e40881b-0a53-4413-9dfa-51371af7dcf5-kube-api-access-5psrl\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf\" (UID: \"2e40881b-0a53-4413-9dfa-51371af7dcf5\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf" Jul 06 16:39:20.869459 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:20.869377 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf" Jul 06 16:39:20.934675 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:20.934647 2555 generic.go:356] "Generic (PLEG): container finished" podID="3bc7247c-6828-4d27-97dd-ceb7fecc9377" containerID="be8efe95921b094e0e4a817cb4f0db07e59bf7bd8b591bd31f08bb1763e4044e" exitCode=0 Jul 06 16:39:20.934794 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:20.934732 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5" event={"ID":"3bc7247c-6828-4d27-97dd-ceb7fecc9377","Type":"ContainerDied","Data":"be8efe95921b094e0e4a817cb4f0db07e59bf7bd8b591bd31f08bb1763e4044e"} Jul 06 16:39:20.934794 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:20.934787 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5" event={"ID":"3bc7247c-6828-4d27-97dd-ceb7fecc9377","Type":"ContainerStarted","Data":"da8ea94f6e972cf76204699dbc532b7c313c4520e313c882977318930a2a7458"} Jul 06 16:39:21.002543 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:21.002520 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf"] Jul 06 16:39:21.004337 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:39:21.004302 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e40881b_0a53_4413_9dfa_51371af7dcf5.slice/crio-c4e4fa166397bf95075a8b53c09ab0ad0083596c47412e23b185b8dabae15373 WatchSource:0}: Error finding container c4e4fa166397bf95075a8b53c09ab0ad0083596c47412e23b185b8dabae15373: Status 404 returned error can't find the container with id c4e4fa166397bf95075a8b53c09ab0ad0083596c47412e23b185b8dabae15373 Jul 06 16:39:21.152897 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:21.152818 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8"] Jul 06 16:39:21.156428 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:21.156406 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8" Jul 06 16:39:21.163315 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:21.163292 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8"] Jul 06 16:39:21.300805 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:21.300774 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b66e74f7-5670-4edf-a020-f26f310b3d60-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8\" (UID: \"b66e74f7-5670-4edf-a020-f26f310b3d60\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8" Jul 06 16:39:21.301004 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:21.300827 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b66e74f7-5670-4edf-a020-f26f310b3d60-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8\" (UID: \"b66e74f7-5670-4edf-a020-f26f310b3d60\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8" Jul 06 16:39:21.301004 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:21.300855 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlmxn\" (UniqueName: \"kubernetes.io/projected/b66e74f7-5670-4edf-a020-f26f310b3d60-kube-api-access-vlmxn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8\" (UID: \"b66e74f7-5670-4edf-a020-f26f310b3d60\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8" Jul 06 16:39:21.401510 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:21.401473 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b66e74f7-5670-4edf-a020-f26f310b3d60-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8\" (UID: \"b66e74f7-5670-4edf-a020-f26f310b3d60\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8" Jul 06 16:39:21.401510 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:21.401506 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlmxn\" (UniqueName: \"kubernetes.io/projected/b66e74f7-5670-4edf-a020-f26f310b3d60-kube-api-access-vlmxn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8\" (UID: \"b66e74f7-5670-4edf-a020-f26f310b3d60\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8" Jul 06 16:39:21.401746 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:21.401641 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b66e74f7-5670-4edf-a020-f26f310b3d60-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8\" (UID: \"b66e74f7-5670-4edf-a020-f26f310b3d60\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8" Jul 06 16:39:21.401894 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:21.401863 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b66e74f7-5670-4edf-a020-f26f310b3d60-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8\" (UID: \"b66e74f7-5670-4edf-a020-f26f310b3d60\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8" Jul 06 16:39:21.402045 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:21.401933 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b66e74f7-5670-4edf-a020-f26f310b3d60-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8\" (UID: \"b66e74f7-5670-4edf-a020-f26f310b3d60\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8" Jul 06 16:39:21.410239 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:21.410189 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlmxn\" (UniqueName: \"kubernetes.io/projected/b66e74f7-5670-4edf-a020-f26f310b3d60-kube-api-access-vlmxn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8\" (UID: \"b66e74f7-5670-4edf-a020-f26f310b3d60\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8" Jul 06 16:39:21.471200 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:21.471172 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8" Jul 06 16:39:21.555875 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:21.555846 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd"] Jul 06 16:39:21.560786 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:21.560768 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd" Jul 06 16:39:21.570130 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:21.570106 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd"] Jul 06 16:39:21.609227 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:21.609199 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8"] Jul 06 16:39:21.611158 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:39:21.611132 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb66e74f7_5670_4edf_a020_f26f310b3d60.slice/crio-dd96d20afd343b9e43a348984d8f57a7e2efd5cbb603c58ef04ef267ff3b9761 WatchSource:0}: Error finding container dd96d20afd343b9e43a348984d8f57a7e2efd5cbb603c58ef04ef267ff3b9761: Status 404 returned error can't find the container with id dd96d20afd343b9e43a348984d8f57a7e2efd5cbb603c58ef04ef267ff3b9761 Jul 06 16:39:21.703615 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:21.703582 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcfjr\" (UniqueName: \"kubernetes.io/projected/6d3cc162-d1c5-4084-8137-a95baa651ca7-kube-api-access-vcfjr\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd\" (UID: \"6d3cc162-d1c5-4084-8137-a95baa651ca7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd" Jul 06 16:39:21.703774 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:21.703627 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d3cc162-d1c5-4084-8137-a95baa651ca7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd\" (UID: \"6d3cc162-d1c5-4084-8137-a95baa651ca7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd" Jul 06 16:39:21.703838 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:21.703802 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d3cc162-d1c5-4084-8137-a95baa651ca7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd\" (UID: \"6d3cc162-d1c5-4084-8137-a95baa651ca7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd" Jul 06 16:39:21.804568 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:21.804526 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d3cc162-d1c5-4084-8137-a95baa651ca7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd\" (UID: \"6d3cc162-d1c5-4084-8137-a95baa651ca7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd" Jul 06 16:39:21.805045 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:21.804589 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcfjr\" (UniqueName: \"kubernetes.io/projected/6d3cc162-d1c5-4084-8137-a95baa651ca7-kube-api-access-vcfjr\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd\" (UID: \"6d3cc162-d1c5-4084-8137-a95baa651ca7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd" Jul 06 16:39:21.805045 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:21.804608 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d3cc162-d1c5-4084-8137-a95baa651ca7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd\" (UID: \"6d3cc162-d1c5-4084-8137-a95baa651ca7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd" Jul 06 16:39:21.805045 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:21.804851 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d3cc162-d1c5-4084-8137-a95baa651ca7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd\" (UID: \"6d3cc162-d1c5-4084-8137-a95baa651ca7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd" Jul 06 16:39:21.805045 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:21.804872 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d3cc162-d1c5-4084-8137-a95baa651ca7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd\" (UID: \"6d3cc162-d1c5-4084-8137-a95baa651ca7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd" Jul 06 16:39:21.813095 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:21.813063 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcfjr\" (UniqueName: \"kubernetes.io/projected/6d3cc162-d1c5-4084-8137-a95baa651ca7-kube-api-access-vcfjr\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd\" (UID: \"6d3cc162-d1c5-4084-8137-a95baa651ca7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd" Jul 06 16:39:21.873012 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:21.872982 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd" Jul 06 16:39:21.942128 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:21.942101 2555 generic.go:356] "Generic (PLEG): container finished" podID="b66e74f7-5670-4edf-a020-f26f310b3d60" containerID="5d2accc5452b709061eb383500f59a1c8d80d276c97cbb5f1ce378f39756649d" exitCode=0 Jul 06 16:39:21.942259 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:21.942180 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8" event={"ID":"b66e74f7-5670-4edf-a020-f26f310b3d60","Type":"ContainerDied","Data":"5d2accc5452b709061eb383500f59a1c8d80d276c97cbb5f1ce378f39756649d"} Jul 06 16:39:21.942259 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:21.942235 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8" event={"ID":"b66e74f7-5670-4edf-a020-f26f310b3d60","Type":"ContainerStarted","Data":"dd96d20afd343b9e43a348984d8f57a7e2efd5cbb603c58ef04ef267ff3b9761"} Jul 06 16:39:21.943874 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:21.943851 2555 generic.go:356] "Generic (PLEG): container finished" podID="2e40881b-0a53-4413-9dfa-51371af7dcf5" containerID="437baf4bd1a96ee0356afa10e6dc521edd61f36a3028e5718da22fc655dfaa67" exitCode=0 Jul 06 16:39:21.944013 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:21.943899 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf" event={"ID":"2e40881b-0a53-4413-9dfa-51371af7dcf5","Type":"ContainerDied","Data":"437baf4bd1a96ee0356afa10e6dc521edd61f36a3028e5718da22fc655dfaa67"} Jul 06 16:39:21.944013 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:21.943971 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf" event={"ID":"2e40881b-0a53-4413-9dfa-51371af7dcf5","Type":"ContainerStarted","Data":"c4e4fa166397bf95075a8b53c09ab0ad0083596c47412e23b185b8dabae15373"} Jul 06 16:39:22.007343 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:22.007320 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd"] Jul 06 16:39:22.008970 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:39:22.008920 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d3cc162_d1c5_4084_8137_a95baa651ca7.slice/crio-a78f5f79977d9c7c0a3fda7a189ccfe2edefdeaadc3f38c40de009e4a7a36050 WatchSource:0}: Error finding container a78f5f79977d9c7c0a3fda7a189ccfe2edefdeaadc3f38c40de009e4a7a36050: Status 404 returned error can't find the container with id a78f5f79977d9c7c0a3fda7a189ccfe2edefdeaadc3f38c40de009e4a7a36050 Jul 06 16:39:22.950694 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:22.950664 2555 generic.go:356] "Generic (PLEG): container finished" podID="2e40881b-0a53-4413-9dfa-51371af7dcf5" containerID="e0262f99159414a7b2d7b8c1859961ca50bf5b514142c6c200efe21d4137f51b" exitCode=0 Jul 06 16:39:22.951090 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:22.950747 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf" event={"ID":"2e40881b-0a53-4413-9dfa-51371af7dcf5","Type":"ContainerDied","Data":"e0262f99159414a7b2d7b8c1859961ca50bf5b514142c6c200efe21d4137f51b"} Jul 06 16:39:22.952712 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:22.952691 2555 generic.go:356] "Generic (PLEG): container finished" podID="b66e74f7-5670-4edf-a020-f26f310b3d60" containerID="6ed22daa5c89369ff18d2ee54f2e01c517e9fcdc82cf989c291fa5347f13a3ad" exitCode=0 Jul 06 16:39:22.952790 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:22.952768 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8" event={"ID":"b66e74f7-5670-4edf-a020-f26f310b3d60","Type":"ContainerDied","Data":"6ed22daa5c89369ff18d2ee54f2e01c517e9fcdc82cf989c291fa5347f13a3ad"} Jul 06 16:39:22.954359 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:22.954342 2555 generic.go:356] "Generic (PLEG): container finished" podID="6d3cc162-d1c5-4084-8137-a95baa651ca7" containerID="bdb39f285dcc4e525a85faffe2251d5538e16bb4b39d43b9ee2faa83f296b08a" exitCode=0 Jul 06 16:39:22.954448 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:22.954377 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd" event={"ID":"6d3cc162-d1c5-4084-8137-a95baa651ca7","Type":"ContainerDied","Data":"bdb39f285dcc4e525a85faffe2251d5538e16bb4b39d43b9ee2faa83f296b08a"} Jul 06 16:39:22.954448 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:22.954406 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd" event={"ID":"6d3cc162-d1c5-4084-8137-a95baa651ca7","Type":"ContainerStarted","Data":"a78f5f79977d9c7c0a3fda7a189ccfe2edefdeaadc3f38c40de009e4a7a36050"} Jul 06 16:39:23.962567 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:23.962471 2555 generic.go:356] "Generic (PLEG): container finished" podID="6d3cc162-d1c5-4084-8137-a95baa651ca7" containerID="8ab46bf5ff40a064979f2fd78676dc4f7771cc3d960427be8f36c4f9bce6e322" exitCode=0 Jul 06 16:39:23.963043 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:23.962594 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd" event={"ID":"6d3cc162-d1c5-4084-8137-a95baa651ca7","Type":"ContainerDied","Data":"8ab46bf5ff40a064979f2fd78676dc4f7771cc3d960427be8f36c4f9bce6e322"} Jul 06 16:39:23.964922 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:23.964899 2555 generic.go:356] "Generic (PLEG): container finished" podID="2e40881b-0a53-4413-9dfa-51371af7dcf5" containerID="b2e734263298312d684ffcac546ef0ae1b7307288b4e5101cd51165a40254322" exitCode=0 Jul 06 16:39:23.965047 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:23.964980 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf" event={"ID":"2e40881b-0a53-4413-9dfa-51371af7dcf5","Type":"ContainerDied","Data":"b2e734263298312d684ffcac546ef0ae1b7307288b4e5101cd51165a40254322"} Jul 06 16:39:23.966839 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:23.966813 2555 generic.go:356] "Generic (PLEG): container finished" podID="3bc7247c-6828-4d27-97dd-ceb7fecc9377" containerID="5e6ed3ccc95930e7a77c95b671d26633d2458ffbe1c7c3aeb4382445faae7d62" exitCode=0 Jul 06 16:39:23.966917 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:23.966892 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5" event={"ID":"3bc7247c-6828-4d27-97dd-ceb7fecc9377","Type":"ContainerDied","Data":"5e6ed3ccc95930e7a77c95b671d26633d2458ffbe1c7c3aeb4382445faae7d62"} Jul 06 16:39:23.969277 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:23.969256 2555 generic.go:356] "Generic (PLEG): container finished" podID="b66e74f7-5670-4edf-a020-f26f310b3d60" containerID="35b130a62553547d034195b36c7112442aa00299e77a94f987b57d66784ab21d" exitCode=0 Jul 06 16:39:23.969360 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:23.969299 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8" event={"ID":"b66e74f7-5670-4edf-a020-f26f310b3d60","Type":"ContainerDied","Data":"35b130a62553547d034195b36c7112442aa00299e77a94f987b57d66784ab21d"} Jul 06 16:39:24.977263 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:24.977232 2555 generic.go:356] "Generic (PLEG): container finished" podID="3bc7247c-6828-4d27-97dd-ceb7fecc9377" containerID="e70141cd480003e644cf9b3d02d5cfbff12ae46bb8b0f1379cdb9a042ca5352a" exitCode=0 Jul 06 16:39:24.977776 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:24.977318 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5" event={"ID":"3bc7247c-6828-4d27-97dd-ceb7fecc9377","Type":"ContainerDied","Data":"e70141cd480003e644cf9b3d02d5cfbff12ae46bb8b0f1379cdb9a042ca5352a"} Jul 06 16:39:24.979316 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:24.979295 2555 generic.go:356] "Generic (PLEG): container finished" podID="6d3cc162-d1c5-4084-8137-a95baa651ca7" containerID="6339c785b1d1880b2fdb573f4cbca46132ee6132282e3e9d994ec7a73a6ead90" exitCode=0 Jul 06 16:39:24.979413 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:24.979361 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd" event={"ID":"6d3cc162-d1c5-4084-8137-a95baa651ca7","Type":"ContainerDied","Data":"6339c785b1d1880b2fdb573f4cbca46132ee6132282e3e9d994ec7a73a6ead90"} Jul 06 16:39:25.119487 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:25.119460 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf" Jul 06 16:39:25.149574 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:25.149550 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8" Jul 06 16:39:25.246151 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:25.246069 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e40881b-0a53-4413-9dfa-51371af7dcf5-util\") pod \"2e40881b-0a53-4413-9dfa-51371af7dcf5\" (UID: \"2e40881b-0a53-4413-9dfa-51371af7dcf5\") " Jul 06 16:39:25.246151 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:25.246110 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b66e74f7-5670-4edf-a020-f26f310b3d60-util\") pod \"b66e74f7-5670-4edf-a020-f26f310b3d60\" (UID: \"b66e74f7-5670-4edf-a020-f26f310b3d60\") " Jul 06 16:39:25.246151 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:25.246138 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e40881b-0a53-4413-9dfa-51371af7dcf5-bundle\") pod \"2e40881b-0a53-4413-9dfa-51371af7dcf5\" (UID: \"2e40881b-0a53-4413-9dfa-51371af7dcf5\") " Jul 06 16:39:25.246452 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:25.246187 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5psrl\" (UniqueName: \"kubernetes.io/projected/2e40881b-0a53-4413-9dfa-51371af7dcf5-kube-api-access-5psrl\") pod \"2e40881b-0a53-4413-9dfa-51371af7dcf5\" (UID: \"2e40881b-0a53-4413-9dfa-51371af7dcf5\") " Jul 06 16:39:25.246452 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:25.246241 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlmxn\" (UniqueName: \"kubernetes.io/projected/b66e74f7-5670-4edf-a020-f26f310b3d60-kube-api-access-vlmxn\") pod \"b66e74f7-5670-4edf-a020-f26f310b3d60\" (UID: \"b66e74f7-5670-4edf-a020-f26f310b3d60\") " Jul 06 16:39:25.246452 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:25.246272 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b66e74f7-5670-4edf-a020-f26f310b3d60-bundle\") pod \"b66e74f7-5670-4edf-a020-f26f310b3d60\" (UID: \"b66e74f7-5670-4edf-a020-f26f310b3d60\") " Jul 06 16:39:25.246888 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:25.246840 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b66e74f7-5670-4edf-a020-f26f310b3d60-bundle" (OuterVolumeSpecName: "bundle") pod "b66e74f7-5670-4edf-a020-f26f310b3d60" (UID: "b66e74f7-5670-4edf-a020-f26f310b3d60"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 16:39:25.246888 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:25.246845 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e40881b-0a53-4413-9dfa-51371af7dcf5-bundle" (OuterVolumeSpecName: "bundle") pod "2e40881b-0a53-4413-9dfa-51371af7dcf5" (UID: "2e40881b-0a53-4413-9dfa-51371af7dcf5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 16:39:25.248561 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:25.248534 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b66e74f7-5670-4edf-a020-f26f310b3d60-kube-api-access-vlmxn" (OuterVolumeSpecName: "kube-api-access-vlmxn") pod "b66e74f7-5670-4edf-a020-f26f310b3d60" (UID: "b66e74f7-5670-4edf-a020-f26f310b3d60"). InnerVolumeSpecName "kube-api-access-vlmxn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 16:39:25.248991 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:25.248969 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e40881b-0a53-4413-9dfa-51371af7dcf5-kube-api-access-5psrl" (OuterVolumeSpecName: "kube-api-access-5psrl") pod "2e40881b-0a53-4413-9dfa-51371af7dcf5" (UID: "2e40881b-0a53-4413-9dfa-51371af7dcf5"). InnerVolumeSpecName "kube-api-access-5psrl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 16:39:25.251487 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:25.251469 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e40881b-0a53-4413-9dfa-51371af7dcf5-util" (OuterVolumeSpecName: "util") pod "2e40881b-0a53-4413-9dfa-51371af7dcf5" (UID: "2e40881b-0a53-4413-9dfa-51371af7dcf5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 16:39:25.252239 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:25.252221 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b66e74f7-5670-4edf-a020-f26f310b3d60-util" (OuterVolumeSpecName: "util") pod "b66e74f7-5670-4edf-a020-f26f310b3d60" (UID: "b66e74f7-5670-4edf-a020-f26f310b3d60"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 16:39:25.347878 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:25.347845 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlmxn\" (UniqueName: \"kubernetes.io/projected/b66e74f7-5670-4edf-a020-f26f310b3d60-kube-api-access-vlmxn\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:39:25.347878 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:25.347871 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b66e74f7-5670-4edf-a020-f26f310b3d60-bundle\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:39:25.347878 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:25.347882 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e40881b-0a53-4413-9dfa-51371af7dcf5-util\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:39:25.348112 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:25.347891 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b66e74f7-5670-4edf-a020-f26f310b3d60-util\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:39:25.348112 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:25.347898 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e40881b-0a53-4413-9dfa-51371af7dcf5-bundle\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:39:25.348112 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:25.347905 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5psrl\" (UniqueName: \"kubernetes.io/projected/2e40881b-0a53-4413-9dfa-51371af7dcf5-kube-api-access-5psrl\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:39:25.986030 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:25.986001 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf" Jul 06 16:39:25.986459 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:25.986000 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf" event={"ID":"2e40881b-0a53-4413-9dfa-51371af7dcf5","Type":"ContainerDied","Data":"c4e4fa166397bf95075a8b53c09ab0ad0083596c47412e23b185b8dabae15373"} Jul 06 16:39:25.986459 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:25.986158 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c4e4fa166397bf95075a8b53c09ab0ad0083596c47412e23b185b8dabae15373" Jul 06 16:39:25.988219 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:25.988183 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8" event={"ID":"b66e74f7-5670-4edf-a020-f26f310b3d60","Type":"ContainerDied","Data":"dd96d20afd343b9e43a348984d8f57a7e2efd5cbb603c58ef04ef267ff3b9761"} Jul 06 16:39:25.988351 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:25.988224 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd96d20afd343b9e43a348984d8f57a7e2efd5cbb603c58ef04ef267ff3b9761" Jul 06 16:39:25.988397 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:25.988353 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8" Jul 06 16:39:26.125714 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:26.125688 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd" Jul 06 16:39:26.152856 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:26.152828 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5" Jul 06 16:39:26.253973 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:26.253852 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d3cc162-d1c5-4084-8137-a95baa651ca7-util\") pod \"6d3cc162-d1c5-4084-8137-a95baa651ca7\" (UID: \"6d3cc162-d1c5-4084-8137-a95baa651ca7\") " Jul 06 16:39:26.253973 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:26.253906 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcfjr\" (UniqueName: \"kubernetes.io/projected/6d3cc162-d1c5-4084-8137-a95baa651ca7-kube-api-access-vcfjr\") pod \"6d3cc162-d1c5-4084-8137-a95baa651ca7\" (UID: \"6d3cc162-d1c5-4084-8137-a95baa651ca7\") " Jul 06 16:39:26.253973 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:26.253935 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rgsl\" (UniqueName: \"kubernetes.io/projected/3bc7247c-6828-4d27-97dd-ceb7fecc9377-kube-api-access-4rgsl\") pod \"3bc7247c-6828-4d27-97dd-ceb7fecc9377\" (UID: \"3bc7247c-6828-4d27-97dd-ceb7fecc9377\") " Jul 06 16:39:26.254274 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:26.253992 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bc7247c-6828-4d27-97dd-ceb7fecc9377-bundle\") pod \"3bc7247c-6828-4d27-97dd-ceb7fecc9377\" (UID: \"3bc7247c-6828-4d27-97dd-ceb7fecc9377\") " Jul 06 16:39:26.254274 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:26.254048 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bc7247c-6828-4d27-97dd-ceb7fecc9377-util\") pod \"3bc7247c-6828-4d27-97dd-ceb7fecc9377\" (UID: \"3bc7247c-6828-4d27-97dd-ceb7fecc9377\") " Jul 06 16:39:26.254274 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:26.254078 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d3cc162-d1c5-4084-8137-a95baa651ca7-bundle\") pod \"6d3cc162-d1c5-4084-8137-a95baa651ca7\" (UID: \"6d3cc162-d1c5-4084-8137-a95baa651ca7\") " Jul 06 16:39:26.254547 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:26.254516 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bc7247c-6828-4d27-97dd-ceb7fecc9377-bundle" (OuterVolumeSpecName: "bundle") pod "3bc7247c-6828-4d27-97dd-ceb7fecc9377" (UID: "3bc7247c-6828-4d27-97dd-ceb7fecc9377"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 16:39:26.254842 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:26.254693 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d3cc162-d1c5-4084-8137-a95baa651ca7-bundle" (OuterVolumeSpecName: "bundle") pod "6d3cc162-d1c5-4084-8137-a95baa651ca7" (UID: "6d3cc162-d1c5-4084-8137-a95baa651ca7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 16:39:26.256277 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:26.256249 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d3cc162-d1c5-4084-8137-a95baa651ca7-kube-api-access-vcfjr" (OuterVolumeSpecName: "kube-api-access-vcfjr") pod "6d3cc162-d1c5-4084-8137-a95baa651ca7" (UID: "6d3cc162-d1c5-4084-8137-a95baa651ca7"). InnerVolumeSpecName "kube-api-access-vcfjr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 16:39:26.256540 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:26.256522 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bc7247c-6828-4d27-97dd-ceb7fecc9377-kube-api-access-4rgsl" (OuterVolumeSpecName: "kube-api-access-4rgsl") pod "3bc7247c-6828-4d27-97dd-ceb7fecc9377" (UID: "3bc7247c-6828-4d27-97dd-ceb7fecc9377"). InnerVolumeSpecName "kube-api-access-4rgsl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 16:39:26.259686 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:26.259666 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bc7247c-6828-4d27-97dd-ceb7fecc9377-util" (OuterVolumeSpecName: "util") pod "3bc7247c-6828-4d27-97dd-ceb7fecc9377" (UID: "3bc7247c-6828-4d27-97dd-ceb7fecc9377"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 16:39:26.262298 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:26.262275 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d3cc162-d1c5-4084-8137-a95baa651ca7-util" (OuterVolumeSpecName: "util") pod "6d3cc162-d1c5-4084-8137-a95baa651ca7" (UID: "6d3cc162-d1c5-4084-8137-a95baa651ca7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 16:39:26.355738 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:26.355697 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bc7247c-6828-4d27-97dd-ceb7fecc9377-util\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:39:26.355738 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:26.355732 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d3cc162-d1c5-4084-8137-a95baa651ca7-bundle\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:39:26.355738 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:26.355742 2555 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d3cc162-d1c5-4084-8137-a95baa651ca7-util\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:39:26.355738 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:26.355750 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcfjr\" (UniqueName: \"kubernetes.io/projected/6d3cc162-d1c5-4084-8137-a95baa651ca7-kube-api-access-vcfjr\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:39:26.356012 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:26.355760 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rgsl\" (UniqueName: \"kubernetes.io/projected/3bc7247c-6828-4d27-97dd-ceb7fecc9377-kube-api-access-4rgsl\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:39:26.356012 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:26.355768 2555 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bc7247c-6828-4d27-97dd-ceb7fecc9377-bundle\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:39:26.994810 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:26.994779 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5" Jul 06 16:39:26.994810 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:26.994801 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5" event={"ID":"3bc7247c-6828-4d27-97dd-ceb7fecc9377","Type":"ContainerDied","Data":"da8ea94f6e972cf76204699dbc532b7c313c4520e313c882977318930a2a7458"} Jul 06 16:39:26.995337 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:26.994847 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da8ea94f6e972cf76204699dbc532b7c313c4520e313c882977318930a2a7458" Jul 06 16:39:26.996794 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:26.996776 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd" Jul 06 16:39:26.996794 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:26.996781 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd" event={"ID":"6d3cc162-d1c5-4084-8137-a95baa651ca7","Type":"ContainerDied","Data":"a78f5f79977d9c7c0a3fda7a189ccfe2edefdeaadc3f38c40de009e4a7a36050"} Jul 06 16:39:26.996916 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:26.996812 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a78f5f79977d9c7c0a3fda7a189ccfe2edefdeaadc3f38c40de009e4a7a36050" Jul 06 16:39:32.942024 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:32.941990 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:33.549167 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:33.549123 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:37.007262 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.007232 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9mn9v"] Jul 06 16:39:37.007717 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.007566 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b66e74f7-5670-4edf-a020-f26f310b3d60" containerName="util" Jul 06 16:39:37.007717 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.007576 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b66e74f7-5670-4edf-a020-f26f310b3d60" containerName="util" Jul 06 16:39:37.007717 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.007584 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e40881b-0a53-4413-9dfa-51371af7dcf5" containerName="pull" Jul 06 16:39:37.007717 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.007589 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e40881b-0a53-4413-9dfa-51371af7dcf5" containerName="pull" Jul 06 16:39:37.007717 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.007596 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b66e74f7-5670-4edf-a020-f26f310b3d60" containerName="extract" Jul 06 16:39:37.007717 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.007601 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b66e74f7-5670-4edf-a020-f26f310b3d60" containerName="extract" Jul 06 16:39:37.007717 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.007607 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b66e74f7-5670-4edf-a020-f26f310b3d60" containerName="pull" Jul 06 16:39:37.007717 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.007613 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="b66e74f7-5670-4edf-a020-f26f310b3d60" containerName="pull" Jul 06 16:39:37.007717 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.007620 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d3cc162-d1c5-4084-8137-a95baa651ca7" containerName="pull" Jul 06 16:39:37.007717 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.007625 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d3cc162-d1c5-4084-8137-a95baa651ca7" containerName="pull" Jul 06 16:39:37.007717 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.007634 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e40881b-0a53-4413-9dfa-51371af7dcf5" containerName="extract" Jul 06 16:39:37.007717 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.007638 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e40881b-0a53-4413-9dfa-51371af7dcf5" containerName="extract" Jul 06 16:39:37.007717 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.007645 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d3cc162-d1c5-4084-8137-a95baa651ca7" containerName="util" Jul 06 16:39:37.007717 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.007649 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d3cc162-d1c5-4084-8137-a95baa651ca7" containerName="util" Jul 06 16:39:37.007717 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.007656 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bc7247c-6828-4d27-97dd-ceb7fecc9377" containerName="util" Jul 06 16:39:37.007717 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.007661 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bc7247c-6828-4d27-97dd-ceb7fecc9377" containerName="util" Jul 06 16:39:37.007717 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.007668 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d3cc162-d1c5-4084-8137-a95baa651ca7" containerName="extract" Jul 06 16:39:37.007717 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.007674 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d3cc162-d1c5-4084-8137-a95baa651ca7" containerName="extract" Jul 06 16:39:37.007717 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.007684 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e40881b-0a53-4413-9dfa-51371af7dcf5" containerName="util" Jul 06 16:39:37.007717 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.007690 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e40881b-0a53-4413-9dfa-51371af7dcf5" containerName="util" Jul 06 16:39:37.007717 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.007696 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bc7247c-6828-4d27-97dd-ceb7fecc9377" containerName="pull" Jul 06 16:39:37.007717 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.007701 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bc7247c-6828-4d27-97dd-ceb7fecc9377" containerName="pull" Jul 06 16:39:37.007717 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.007707 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bc7247c-6828-4d27-97dd-ceb7fecc9377" containerName="extract" Jul 06 16:39:37.007717 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.007711 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bc7247c-6828-4d27-97dd-ceb7fecc9377" containerName="extract" Jul 06 16:39:37.008507 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.007762 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d3cc162-d1c5-4084-8137-a95baa651ca7" containerName="extract" Jul 06 16:39:37.008507 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.007772 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bc7247c-6828-4d27-97dd-ceb7fecc9377" containerName="extract" Jul 06 16:39:37.008507 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.007777 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="b66e74f7-5670-4edf-a020-f26f310b3d60" containerName="extract" Jul 06 16:39:37.008507 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.007783 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e40881b-0a53-4413-9dfa-51371af7dcf5" containerName="extract" Jul 06 16:39:37.011497 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.011481 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9mn9v" Jul 06 16:39:37.014591 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.014568 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-9xnzr\"" Jul 06 16:39:37.023798 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.023777 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9mn9v"] Jul 06 16:39:37.051153 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.051125 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4cj8\" (UniqueName: \"kubernetes.io/projected/fdd650b4-fa3a-402f-9bb7-e72526f213c1-kube-api-access-t4cj8\") pod \"authorino-operator-75cc8d5cb7-9mn9v\" (UID: \"fdd650b4-fa3a-402f-9bb7-e72526f213c1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9mn9v" Jul 06 16:39:37.151534 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.151501 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4cj8\" (UniqueName: \"kubernetes.io/projected/fdd650b4-fa3a-402f-9bb7-e72526f213c1-kube-api-access-t4cj8\") pod \"authorino-operator-75cc8d5cb7-9mn9v\" (UID: \"fdd650b4-fa3a-402f-9bb7-e72526f213c1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9mn9v" Jul 06 16:39:37.163812 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.163789 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4cj8\" (UniqueName: \"kubernetes.io/projected/fdd650b4-fa3a-402f-9bb7-e72526f213c1-kube-api-access-t4cj8\") pod \"authorino-operator-75cc8d5cb7-9mn9v\" (UID: \"fdd650b4-fa3a-402f-9bb7-e72526f213c1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9mn9v" Jul 06 16:39:37.321659 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.321629 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9mn9v" Jul 06 16:39:37.458651 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.458628 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9mn9v"] Jul 06 16:39:37.460398 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:39:37.460370 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdd650b4_fa3a_402f_9bb7_e72526f213c1.slice/crio-d4f800dc9093e1360b5a9095eb5a1404ccd82fe332b4a4f87d67b23319116cb6 WatchSource:0}: Error finding container d4f800dc9093e1360b5a9095eb5a1404ccd82fe332b4a4f87d67b23319116cb6: Status 404 returned error can't find the container with id d4f800dc9093e1360b5a9095eb5a1404ccd82fe332b4a4f87d67b23319116cb6 Jul 06 16:39:37.462348 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:37.462331 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 16:39:38.057510 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:38.057473 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9mn9v" event={"ID":"fdd650b4-fa3a-402f-9bb7-e72526f213c1","Type":"ContainerStarted","Data":"d4f800dc9093e1360b5a9095eb5a1404ccd82fe332b4a4f87d67b23319116cb6"} Jul 06 16:39:38.353366 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:38.353266 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:40.070008 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:40.069963 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9mn9v" event={"ID":"fdd650b4-fa3a-402f-9bb7-e72526f213c1","Type":"ContainerStarted","Data":"6d12a70a3f9c4be6586bbd8da544eed8cea93fadd9b84b8ac60833ecea6fcd77"} Jul 06 16:39:40.070415 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:40.070046 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9mn9v" Jul 06 16:39:40.090958 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:40.090879 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9mn9v" podStartSLOduration=2.09716658 podStartE2EDuration="4.090858947s" totalImagesPullingTime="1.993692367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:39:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:39:40.086744967 +0000 UTC m=+661.355816002" watchObservedRunningTime="2026-07-06 16:39:40.090858947 +0000 UTC m=+661.359929984" Jul 06 16:39:40.584908 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:40.584867 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:40.685170 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:40.685134 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:40.950615 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:40.950526 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:42.798098 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:42.798064 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:43.799426 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:43.799392 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cdcb85c55-nwh89"] Jul 06 16:39:43.805213 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:43.805189 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cdcb85c55-nwh89" Jul 06 16:39:43.816687 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:43.816662 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cdcb85c55-nwh89"] Jul 06 16:39:43.859765 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:43.859732 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:43.911967 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:43.911918 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14-console-oauth-config\") pod \"console-7cdcb85c55-nwh89\" (UID: \"96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14\") " pod="openshift-console/console-7cdcb85c55-nwh89" Jul 06 16:39:43.912152 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:43.911989 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14-console-config\") pod \"console-7cdcb85c55-nwh89\" (UID: \"96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14\") " pod="openshift-console/console-7cdcb85c55-nwh89" Jul 06 16:39:43.912152 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:43.912011 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14-service-ca\") pod \"console-7cdcb85c55-nwh89\" (UID: \"96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14\") " pod="openshift-console/console-7cdcb85c55-nwh89" Jul 06 16:39:43.912152 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:43.912030 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14-trusted-ca-bundle\") pod \"console-7cdcb85c55-nwh89\" (UID: \"96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14\") " pod="openshift-console/console-7cdcb85c55-nwh89" Jul 06 16:39:43.912152 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:43.912062 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14-oauth-serving-cert\") pod \"console-7cdcb85c55-nwh89\" (UID: \"96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14\") " pod="openshift-console/console-7cdcb85c55-nwh89" Jul 06 16:39:43.912152 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:43.912125 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8vv7\" (UniqueName: \"kubernetes.io/projected/96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14-kube-api-access-l8vv7\") pod \"console-7cdcb85c55-nwh89\" (UID: \"96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14\") " pod="openshift-console/console-7cdcb85c55-nwh89" Jul 06 16:39:43.912316 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:43.912177 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14-console-serving-cert\") pod \"console-7cdcb85c55-nwh89\" (UID: \"96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14\") " pod="openshift-console/console-7cdcb85c55-nwh89" Jul 06 16:39:43.993787 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:43.993751 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:44.012853 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:44.012821 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14-console-config\") pod \"console-7cdcb85c55-nwh89\" (UID: \"96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14\") " pod="openshift-console/console-7cdcb85c55-nwh89" Jul 06 16:39:44.012853 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:44.012858 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14-service-ca\") pod \"console-7cdcb85c55-nwh89\" (UID: \"96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14\") " pod="openshift-console/console-7cdcb85c55-nwh89" Jul 06 16:39:44.013092 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:44.012888 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14-trusted-ca-bundle\") pod \"console-7cdcb85c55-nwh89\" (UID: \"96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14\") " pod="openshift-console/console-7cdcb85c55-nwh89" Jul 06 16:39:44.013092 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:44.012934 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14-oauth-serving-cert\") pod \"console-7cdcb85c55-nwh89\" (UID: \"96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14\") " pod="openshift-console/console-7cdcb85c55-nwh89" Jul 06 16:39:44.013092 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:44.013002 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8vv7\" (UniqueName: \"kubernetes.io/projected/96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14-kube-api-access-l8vv7\") pod \"console-7cdcb85c55-nwh89\" (UID: \"96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14\") " pod="openshift-console/console-7cdcb85c55-nwh89" Jul 06 16:39:44.013092 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:44.013040 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14-console-serving-cert\") pod \"console-7cdcb85c55-nwh89\" (UID: \"96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14\") " pod="openshift-console/console-7cdcb85c55-nwh89" Jul 06 16:39:44.013092 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:44.013069 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14-console-oauth-config\") pod \"console-7cdcb85c55-nwh89\" (UID: \"96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14\") " pod="openshift-console/console-7cdcb85c55-nwh89" Jul 06 16:39:44.013700 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:44.013674 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14-service-ca\") pod \"console-7cdcb85c55-nwh89\" (UID: \"96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14\") " pod="openshift-console/console-7cdcb85c55-nwh89" Jul 06 16:39:44.013821 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:44.013742 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14-console-config\") pod \"console-7cdcb85c55-nwh89\" (UID: \"96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14\") " pod="openshift-console/console-7cdcb85c55-nwh89" Jul 06 16:39:44.013821 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:44.013763 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14-oauth-serving-cert\") pod \"console-7cdcb85c55-nwh89\" (UID: \"96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14\") " pod="openshift-console/console-7cdcb85c55-nwh89" Jul 06 16:39:44.014083 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:44.014064 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14-trusted-ca-bundle\") pod \"console-7cdcb85c55-nwh89\" (UID: \"96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14\") " pod="openshift-console/console-7cdcb85c55-nwh89" Jul 06 16:39:44.015618 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:44.015587 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14-console-serving-cert\") pod \"console-7cdcb85c55-nwh89\" (UID: \"96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14\") " pod="openshift-console/console-7cdcb85c55-nwh89" Jul 06 16:39:44.015712 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:44.015634 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14-console-oauth-config\") pod \"console-7cdcb85c55-nwh89\" (UID: \"96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14\") " pod="openshift-console/console-7cdcb85c55-nwh89" Jul 06 16:39:44.020995 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:44.020978 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8vv7\" (UniqueName: \"kubernetes.io/projected/96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14-kube-api-access-l8vv7\") pod \"console-7cdcb85c55-nwh89\" (UID: \"96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14\") " pod="openshift-console/console-7cdcb85c55-nwh89" Jul 06 16:39:44.094058 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:44.093968 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:44.115152 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:44.115125 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cdcb85c55-nwh89" Jul 06 16:39:44.261922 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:44.260278 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cdcb85c55-nwh89"] Jul 06 16:39:44.264576 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:39:44.264550 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96f95c5b_bf9c_44ee_ab8f_92a0b3f6ad14.slice/crio-8db38266689ffdf37c296c1d03e9b31ae6dae8288174382900858df913ddb55f WatchSource:0}: Error finding container 8db38266689ffdf37c296c1d03e9b31ae6dae8288174382900858df913ddb55f: Status 404 returned error can't find the container with id 8db38266689ffdf37c296c1d03e9b31ae6dae8288174382900858df913ddb55f Jul 06 16:39:44.597024 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:44.596995 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:44.697445 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:44.697411 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:45.002684 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:45.002582 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:45.096932 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:45.096894 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cdcb85c55-nwh89" event={"ID":"96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14","Type":"ContainerStarted","Data":"9b818d538dd4e8637f79fa3e9b306246ee6e9da008f96d2ee6355e037c67f202"} Jul 06 16:39:45.097109 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:45.097000 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cdcb85c55-nwh89" event={"ID":"96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14","Type":"ContainerStarted","Data":"8db38266689ffdf37c296c1d03e9b31ae6dae8288174382900858df913ddb55f"} Jul 06 16:39:45.120169 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:45.120114 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7cdcb85c55-nwh89" podStartSLOduration=2.120097303 podStartE2EDuration="2.120097303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:39:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:39:45.117025209 +0000 UTC m=+666.386096246" watchObservedRunningTime="2026-07-06 16:39:45.120097303 +0000 UTC m=+666.389168462" Jul 06 16:39:45.186045 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:45.186013 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qz7zm"] Jul 06 16:39:45.189914 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:45.189899 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qz7zm" Jul 06 16:39:45.194067 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:45.194048 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nbnjh\"" Jul 06 16:39:45.201801 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:45.201778 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qz7zm"] Jul 06 16:39:45.226119 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:45.226082 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bggf\" (UniqueName: \"kubernetes.io/projected/15b0c32a-7959-4704-b994-01a4e94d68c2-kube-api-access-8bggf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qz7zm\" (UID: \"15b0c32a-7959-4704-b994-01a4e94d68c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qz7zm" Jul 06 16:39:45.226269 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:45.226151 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15b0c32a-7959-4704-b994-01a4e94d68c2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qz7zm\" (UID: \"15b0c32a-7959-4704-b994-01a4e94d68c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qz7zm" Jul 06 16:39:45.327628 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:45.327593 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bggf\" (UniqueName: \"kubernetes.io/projected/15b0c32a-7959-4704-b994-01a4e94d68c2-kube-api-access-8bggf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qz7zm\" (UID: \"15b0c32a-7959-4704-b994-01a4e94d68c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qz7zm" Jul 06 16:39:45.327804 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:45.327649 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15b0c32a-7959-4704-b994-01a4e94d68c2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qz7zm\" (UID: \"15b0c32a-7959-4704-b994-01a4e94d68c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qz7zm" Jul 06 16:39:45.328005 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:45.327990 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15b0c32a-7959-4704-b994-01a4e94d68c2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qz7zm\" (UID: \"15b0c32a-7959-4704-b994-01a4e94d68c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qz7zm" Jul 06 16:39:45.336293 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:45.336265 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bggf\" (UniqueName: \"kubernetes.io/projected/15b0c32a-7959-4704-b994-01a4e94d68c2-kube-api-access-8bggf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qz7zm\" (UID: \"15b0c32a-7959-4704-b994-01a4e94d68c2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qz7zm" Jul 06 16:39:45.500612 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:45.500576 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qz7zm" Jul 06 16:39:45.652986 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:45.652936 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qz7zm"] Jul 06 16:39:45.656640 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:39:45.656600 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15b0c32a_7959_4704_b994_01a4e94d68c2.slice/crio-6ba2f9e740ef8f3b254ebbd05fc19a2ec77976591b7d5a0bc485fb19319ddea7 WatchSource:0}: Error finding container 6ba2f9e740ef8f3b254ebbd05fc19a2ec77976591b7d5a0bc485fb19319ddea7: Status 404 returned error can't find the container with id 6ba2f9e740ef8f3b254ebbd05fc19a2ec77976591b7d5a0bc485fb19319ddea7 Jul 06 16:39:46.105273 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:46.105237 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qz7zm" event={"ID":"15b0c32a-7959-4704-b994-01a4e94d68c2","Type":"ContainerStarted","Data":"6ba2f9e740ef8f3b254ebbd05fc19a2ec77976591b7d5a0bc485fb19319ddea7"} Jul 06 16:39:46.165471 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:46.165443 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:47.451552 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:47.451524 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:49.349359 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:49.349329 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:49.449705 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:49.449669 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:49.741768 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:49.741678 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:49.841188 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:49.841150 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:51.077869 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:51.077835 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9mn9v" Jul 06 16:39:52.345255 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:52.345221 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:53.143038 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:53.143006 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qz7zm" event={"ID":"15b0c32a-7959-4704-b994-01a4e94d68c2","Type":"ContainerStarted","Data":"883ee6abf5f6787f473c3a84a023f3b48c85aee429818bd422ea5bf6837654ba"} Jul 06 16:39:53.143232 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:53.143215 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qz7zm" Jul 06 16:39:53.161965 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:53.161886 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qz7zm" podStartSLOduration=1.158357877 podStartE2EDuration="8.161871644s" totalImagesPullingTime="7.003513767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:39:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:39:53.158656108 +0000 UTC m=+674.427727144" watchObservedRunningTime="2026-07-06 16:39:53.161871644 +0000 UTC m=+674.430942681" Jul 06 16:39:53.350582 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:53.350550 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:53.460000 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:53.459898 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:53.970669 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:53.970642 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:54.115528 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:54.115492 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cdcb85c55-nwh89" Jul 06 16:39:54.115710 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:54.115542 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7cdcb85c55-nwh89" Jul 06 16:39:54.120256 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:54.120233 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7cdcb85c55-nwh89" Jul 06 16:39:54.152964 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:54.152919 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7cdcb85c55-nwh89" Jul 06 16:39:54.196687 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:54.196526 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58cd7d9849-ldx89"] Jul 06 16:39:54.312518 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:54.312481 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:54.409189 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:54.409133 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:54.513618 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:54.513585 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:55.581452 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:55.581401 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:55.714099 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:55.714066 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:55.815155 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:55.815115 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:55.930235 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:55.930154 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:56.548736 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:56.548709 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:39:56.606231 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:39:56.606194 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:40:01.927193 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:01.927153 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:40:03.063200 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:03.063161 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:40:03.224688 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:03.224658 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:40:04.151059 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:04.151026 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qz7zm" Jul 06 16:40:06.061550 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:06.061518 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qz7zm"] Jul 06 16:40:06.061989 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:06.061684 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qz7zm" podUID="15b0c32a-7959-4704-b994-01a4e94d68c2" containerName="manager" containerID="cri-o://883ee6abf5f6787f473c3a84a023f3b48c85aee429818bd422ea5bf6837654ba" gracePeriod=2 Jul 06 16:40:06.067799 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:06.067775 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qz7zm"] Jul 06 16:40:06.094285 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:06.094257 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wb5n4"] Jul 06 16:40:06.094876 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:06.094808 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15b0c32a-7959-4704-b994-01a4e94d68c2" containerName="manager" Jul 06 16:40:06.094876 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:06.094832 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="15b0c32a-7959-4704-b994-01a4e94d68c2" containerName="manager" Jul 06 16:40:06.095102 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:06.094999 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="15b0c32a-7959-4704-b994-01a4e94d68c2" containerName="manager" Jul 06 16:40:06.097353 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:06.097332 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wb5n4" Jul 06 16:40:06.118864 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:06.118830 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wb5n4"] Jul 06 16:40:06.134708 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:40:06.134672 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qz7zm\" is forbidden: User \"system:node:ip-10-0-140-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-222.ec2.internal' and this object" podUID="15b0c32a-7959-4704-b994-01a4e94d68c2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qz7zm" Jul 06 16:40:06.211633 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:06.211603 2555 generic.go:356] "Generic (PLEG): container finished" podID="15b0c32a-7959-4704-b994-01a4e94d68c2" containerID="883ee6abf5f6787f473c3a84a023f3b48c85aee429818bd422ea5bf6837654ba" exitCode=0 Jul 06 16:40:06.220128 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:06.220101 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/de85f89f-7145-4ced-91a1-7c600d3c2853-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wb5n4\" (UID: \"de85f89f-7145-4ced-91a1-7c600d3c2853\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wb5n4" Jul 06 16:40:06.220256 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:06.220221 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmzc9\" (UniqueName: \"kubernetes.io/projected/de85f89f-7145-4ced-91a1-7c600d3c2853-kube-api-access-bmzc9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wb5n4\" (UID: \"de85f89f-7145-4ced-91a1-7c600d3c2853\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wb5n4" Jul 06 16:40:06.295823 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:06.295801 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qz7zm" Jul 06 16:40:06.297520 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:40:06.297498 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qz7zm\" is forbidden: User \"system:node:ip-10-0-140-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-222.ec2.internal' and this object" podUID="15b0c32a-7959-4704-b994-01a4e94d68c2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qz7zm" Jul 06 16:40:06.321346 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:06.321280 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmzc9\" (UniqueName: \"kubernetes.io/projected/de85f89f-7145-4ced-91a1-7c600d3c2853-kube-api-access-bmzc9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wb5n4\" (UID: \"de85f89f-7145-4ced-91a1-7c600d3c2853\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wb5n4" Jul 06 16:40:06.321346 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:06.321320 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/de85f89f-7145-4ced-91a1-7c600d3c2853-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wb5n4\" (UID: \"de85f89f-7145-4ced-91a1-7c600d3c2853\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wb5n4" Jul 06 16:40:06.321690 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:06.321673 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/de85f89f-7145-4ced-91a1-7c600d3c2853-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wb5n4\" (UID: \"de85f89f-7145-4ced-91a1-7c600d3c2853\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wb5n4" Jul 06 16:40:06.332558 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:06.332538 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmzc9\" (UniqueName: \"kubernetes.io/projected/de85f89f-7145-4ced-91a1-7c600d3c2853-kube-api-access-bmzc9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wb5n4\" (UID: \"de85f89f-7145-4ced-91a1-7c600d3c2853\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wb5n4" Jul 06 16:40:06.422304 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:06.422258 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8bggf\" (UniqueName: \"kubernetes.io/projected/15b0c32a-7959-4704-b994-01a4e94d68c2-kube-api-access-8bggf\") pod \"15b0c32a-7959-4704-b994-01a4e94d68c2\" (UID: \"15b0c32a-7959-4704-b994-01a4e94d68c2\") " Jul 06 16:40:06.422593 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:06.422367 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15b0c32a-7959-4704-b994-01a4e94d68c2-extensions-socket-volume\") pod \"15b0c32a-7959-4704-b994-01a4e94d68c2\" (UID: \"15b0c32a-7959-4704-b994-01a4e94d68c2\") " Jul 06 16:40:06.423108 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:06.422920 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15b0c32a-7959-4704-b994-01a4e94d68c2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "15b0c32a-7959-4704-b994-01a4e94d68c2" (UID: "15b0c32a-7959-4704-b994-01a4e94d68c2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 16:40:06.423253 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:06.423157 2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15b0c32a-7959-4704-b994-01a4e94d68c2-extensions-socket-volume\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:40:06.424586 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:06.424560 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15b0c32a-7959-4704-b994-01a4e94d68c2-kube-api-access-8bggf" (OuterVolumeSpecName: "kube-api-access-8bggf") pod "15b0c32a-7959-4704-b994-01a4e94d68c2" (UID: "15b0c32a-7959-4704-b994-01a4e94d68c2"). InnerVolumeSpecName "kube-api-access-8bggf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 16:40:06.439233 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:06.439207 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wb5n4" Jul 06 16:40:06.524614 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:06.524583 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bggf\" (UniqueName: \"kubernetes.io/projected/15b0c32a-7959-4704-b994-01a4e94d68c2-kube-api-access-8bggf\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:40:06.606140 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:06.604480 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wb5n4"] Jul 06 16:40:07.219046 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:07.219018 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qz7zm" Jul 06 16:40:07.219046 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:07.219049 2555 scope.go:117] "RemoveContainer" containerID="883ee6abf5f6787f473c3a84a023f3b48c85aee429818bd422ea5bf6837654ba" Jul 06 16:40:07.221051 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:07.221019 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wb5n4" event={"ID":"de85f89f-7145-4ced-91a1-7c600d3c2853","Type":"ContainerStarted","Data":"78b6e26e44dba9959166218d6c6aa471482972eeb966cdf173f92b1467fcff85"} Jul 06 16:40:07.221169 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:07.221079 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wb5n4" event={"ID":"de85f89f-7145-4ced-91a1-7c600d3c2853","Type":"ContainerStarted","Data":"a8f5079d6e7d71360f2059a154dfa98404c2aa3b814dde89f258e0495e5e1dab"} Jul 06 16:40:07.221169 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:07.221112 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wb5n4" Jul 06 16:40:07.221259 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:40:07.221180 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qz7zm\" is forbidden: User \"system:node:ip-10-0-140-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-222.ec2.internal' and this object" podUID="15b0c32a-7959-4704-b994-01a4e94d68c2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qz7zm" Jul 06 16:40:07.222971 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:40:07.222928 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qz7zm\" is forbidden: User \"system:node:ip-10-0-140-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-222.ec2.internal' and this object" podUID="15b0c32a-7959-4704-b994-01a4e94d68c2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qz7zm" Jul 06 16:40:07.247476 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:40:07.247450 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qz7zm\" is forbidden: User \"system:node:ip-10-0-140-222.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-222.ec2.internal' and this object" podUID="15b0c32a-7959-4704-b994-01a4e94d68c2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qz7zm" Jul 06 16:40:07.248773 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:07.248734 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wb5n4" podStartSLOduration=1.248721396 podStartE2EDuration="1.248721396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:40:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:40:07.245432151 +0000 UTC m=+688.514503189" watchObservedRunningTime="2026-07-06 16:40:07.248721396 +0000 UTC m=+688.517792433" Jul 06 16:40:07.302433 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:07.302400 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15b0c32a-7959-4704-b994-01a4e94d68c2" path="/var/lib/kubelet/pods/15b0c32a-7959-4704-b994-01a4e94d68c2/volumes" Jul 06 16:40:08.606783 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:08.606746 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:40:08.707923 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:08.707896 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:40:09.204819 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:09.204791 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:40:09.282371 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:09.282336 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:40:12.650184 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:12.650150 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:40:12.755342 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:12.755312 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:40:13.115936 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:13.115892 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:40:17.282348 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:17.282311 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:40:17.381093 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:17.381062 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:40:18.230969 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:18.230917 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wb5n4" Jul 06 16:40:19.223960 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:19.223899 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-58cd7d9849-ldx89" podUID="ff7bd940-8768-4d04-9197-fddbaecd9c13" containerName="console" containerID="cri-o://2a0a64deba1ecdf3c62ce53985750f04118b888a3a75473689ae30f055ec269a" gracePeriod=15 Jul 06 16:40:19.470051 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:19.470030 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58cd7d9849-ldx89" Jul 06 16:40:19.542286 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:19.542204 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff7bd940-8768-4d04-9197-fddbaecd9c13-service-ca\") pod \"ff7bd940-8768-4d04-9197-fddbaecd9c13\" (UID: \"ff7bd940-8768-4d04-9197-fddbaecd9c13\") " Jul 06 16:40:19.542286 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:19.542268 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff7bd940-8768-4d04-9197-fddbaecd9c13-console-oauth-config\") pod \"ff7bd940-8768-4d04-9197-fddbaecd9c13\" (UID: \"ff7bd940-8768-4d04-9197-fddbaecd9c13\") " Jul 06 16:40:19.542507 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:19.542328 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff7bd940-8768-4d04-9197-fddbaecd9c13-oauth-serving-cert\") pod \"ff7bd940-8768-4d04-9197-fddbaecd9c13\" (UID: \"ff7bd940-8768-4d04-9197-fddbaecd9c13\") " Jul 06 16:40:19.542507 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:19.542361 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjqsw\" (UniqueName: \"kubernetes.io/projected/ff7bd940-8768-4d04-9197-fddbaecd9c13-kube-api-access-tjqsw\") pod \"ff7bd940-8768-4d04-9197-fddbaecd9c13\" (UID: \"ff7bd940-8768-4d04-9197-fddbaecd9c13\") " Jul 06 16:40:19.542507 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:19.542392 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff7bd940-8768-4d04-9197-fddbaecd9c13-console-config\") pod \"ff7bd940-8768-4d04-9197-fddbaecd9c13\" (UID: \"ff7bd940-8768-4d04-9197-fddbaecd9c13\") " Jul 06 16:40:19.542507 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:19.542426 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff7bd940-8768-4d04-9197-fddbaecd9c13-trusted-ca-bundle\") pod \"ff7bd940-8768-4d04-9197-fddbaecd9c13\" (UID: \"ff7bd940-8768-4d04-9197-fddbaecd9c13\") " Jul 06 16:40:19.542715 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:19.542609 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff7bd940-8768-4d04-9197-fddbaecd9c13-service-ca" (OuterVolumeSpecName: "service-ca") pod "ff7bd940-8768-4d04-9197-fddbaecd9c13" (UID: "ff7bd940-8768-4d04-9197-fddbaecd9c13"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 16:40:19.542781 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:19.542772 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ff7bd940-8768-4d04-9197-fddbaecd9c13-service-ca\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:40:19.542836 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:19.542800 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff7bd940-8768-4d04-9197-fddbaecd9c13-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ff7bd940-8768-4d04-9197-fddbaecd9c13" (UID: "ff7bd940-8768-4d04-9197-fddbaecd9c13"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 16:40:19.542890 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:19.542834 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff7bd940-8768-4d04-9197-fddbaecd9c13-console-config" (OuterVolumeSpecName: "console-config") pod "ff7bd940-8768-4d04-9197-fddbaecd9c13" (UID: "ff7bd940-8768-4d04-9197-fddbaecd9c13"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 16:40:19.542890 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:19.542855 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff7bd940-8768-4d04-9197-fddbaecd9c13-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ff7bd940-8768-4d04-9197-fddbaecd9c13" (UID: "ff7bd940-8768-4d04-9197-fddbaecd9c13"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 16:40:19.544600 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:19.544569 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff7bd940-8768-4d04-9197-fddbaecd9c13-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ff7bd940-8768-4d04-9197-fddbaecd9c13" (UID: "ff7bd940-8768-4d04-9197-fddbaecd9c13"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 16:40:19.544600 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:19.544571 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff7bd940-8768-4d04-9197-fddbaecd9c13-kube-api-access-tjqsw" (OuterVolumeSpecName: "kube-api-access-tjqsw") pod "ff7bd940-8768-4d04-9197-fddbaecd9c13" (UID: "ff7bd940-8768-4d04-9197-fddbaecd9c13"). InnerVolumeSpecName "kube-api-access-tjqsw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 16:40:19.643075 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:19.643041 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff7bd940-8768-4d04-9197-fddbaecd9c13-console-serving-cert\") pod \"ff7bd940-8768-4d04-9197-fddbaecd9c13\" (UID: \"ff7bd940-8768-4d04-9197-fddbaecd9c13\") " Jul 06 16:40:19.643261 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:19.643239 2555 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ff7bd940-8768-4d04-9197-fddbaecd9c13-oauth-serving-cert\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:40:19.643261 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:19.643251 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjqsw\" (UniqueName: \"kubernetes.io/projected/ff7bd940-8768-4d04-9197-fddbaecd9c13-kube-api-access-tjqsw\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:40:19.643261 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:19.643262 2555 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ff7bd940-8768-4d04-9197-fddbaecd9c13-console-config\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:40:19.643426 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:19.643270 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ff7bd940-8768-4d04-9197-fddbaecd9c13-trusted-ca-bundle\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:40:19.643426 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:19.643279 2555 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ff7bd940-8768-4d04-9197-fddbaecd9c13-console-oauth-config\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:40:19.645204 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:19.645180 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff7bd940-8768-4d04-9197-fddbaecd9c13-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ff7bd940-8768-4d04-9197-fddbaecd9c13" (UID: "ff7bd940-8768-4d04-9197-fddbaecd9c13"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 16:40:19.743921 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:19.743880 2555 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff7bd940-8768-4d04-9197-fddbaecd9c13-console-serving-cert\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:40:20.295556 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:20.295525 2555 generic.go:356] "Generic (PLEG): container finished" podID="ff7bd940-8768-4d04-9197-fddbaecd9c13" containerID="2a0a64deba1ecdf3c62ce53985750f04118b888a3a75473689ae30f055ec269a" exitCode=0 Jul 06 16:40:20.296000 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:20.295573 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58cd7d9849-ldx89" Jul 06 16:40:20.296000 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:20.295618 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58cd7d9849-ldx89" event={"ID":"ff7bd940-8768-4d04-9197-fddbaecd9c13","Type":"ContainerDied","Data":"2a0a64deba1ecdf3c62ce53985750f04118b888a3a75473689ae30f055ec269a"} Jul 06 16:40:20.296000 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:20.295667 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58cd7d9849-ldx89" event={"ID":"ff7bd940-8768-4d04-9197-fddbaecd9c13","Type":"ContainerDied","Data":"2e9041752be3e68c3bfad9d47ac384644fe4f260edfcffb2da5f82de693e9d3f"} Jul 06 16:40:20.296000 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:20.295688 2555 scope.go:117] "RemoveContainer" containerID="2a0a64deba1ecdf3c62ce53985750f04118b888a3a75473689ae30f055ec269a" Jul 06 16:40:20.304803 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:20.304784 2555 scope.go:117] "RemoveContainer" containerID="2a0a64deba1ecdf3c62ce53985750f04118b888a3a75473689ae30f055ec269a" Jul 06 16:40:20.305103 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:40:20.305086 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a0a64deba1ecdf3c62ce53985750f04118b888a3a75473689ae30f055ec269a\": container with ID starting with 2a0a64deba1ecdf3c62ce53985750f04118b888a3a75473689ae30f055ec269a not found: ID does not exist" containerID="2a0a64deba1ecdf3c62ce53985750f04118b888a3a75473689ae30f055ec269a" Jul 06 16:40:20.305177 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:20.305111 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a0a64deba1ecdf3c62ce53985750f04118b888a3a75473689ae30f055ec269a"} err="failed to get container status \"2a0a64deba1ecdf3c62ce53985750f04118b888a3a75473689ae30f055ec269a\": rpc error: code = NotFound desc = could not find container \"2a0a64deba1ecdf3c62ce53985750f04118b888a3a75473689ae30f055ec269a\": container with ID starting with 2a0a64deba1ecdf3c62ce53985750f04118b888a3a75473689ae30f055ec269a not found: ID does not exist" Jul 06 16:40:20.321621 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:20.321596 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58cd7d9849-ldx89"] Jul 06 16:40:20.331216 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:20.331192 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58cd7d9849-ldx89"] Jul 06 16:40:21.301301 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:21.301267 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff7bd940-8768-4d04-9197-fddbaecd9c13" path="/var/lib/kubelet/pods/ff7bd940-8768-4d04-9197-fddbaecd9c13/volumes" Jul 06 16:40:22.837314 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:22.837284 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:40:22.939002 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:22.938962 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:40:36.568928 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:36.568890 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wb5n4"] Jul 06 16:40:36.569459 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:36.569107 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wb5n4" podUID="de85f89f-7145-4ced-91a1-7c600d3c2853" containerName="manager" containerID="cri-o://78b6e26e44dba9959166218d6c6aa471482972eeb966cdf173f92b1467fcff85" gracePeriod=10 Jul 06 16:40:36.801541 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:36.801390 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4vpk8"] Jul 06 16:40:36.802251 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:36.802214 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff7bd940-8768-4d04-9197-fddbaecd9c13" containerName="console" Jul 06 16:40:36.802251 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:36.802251 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff7bd940-8768-4d04-9197-fddbaecd9c13" containerName="console" Jul 06 16:40:36.802529 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:36.802511 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff7bd940-8768-4d04-9197-fddbaecd9c13" containerName="console" Jul 06 16:40:36.805557 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:36.805529 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4vpk8" Jul 06 16:40:36.821972 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:36.821882 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4vpk8"] Jul 06 16:40:36.834185 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:36.834156 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wb5n4" Jul 06 16:40:36.884102 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:36.884073 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/de85f89f-7145-4ced-91a1-7c600d3c2853-extensions-socket-volume\") pod \"de85f89f-7145-4ced-91a1-7c600d3c2853\" (UID: \"de85f89f-7145-4ced-91a1-7c600d3c2853\") " Jul 06 16:40:36.884251 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:36.884107 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmzc9\" (UniqueName: \"kubernetes.io/projected/de85f89f-7145-4ced-91a1-7c600d3c2853-kube-api-access-bmzc9\") pod \"de85f89f-7145-4ced-91a1-7c600d3c2853\" (UID: \"de85f89f-7145-4ced-91a1-7c600d3c2853\") " Jul 06 16:40:36.884440 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:36.884421 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7bf39b3-22b7-451a-a722-1f7d5891ceef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4vpk8\" (UID: \"e7bf39b3-22b7-451a-a722-1f7d5891ceef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4vpk8" Jul 06 16:40:36.884527 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:36.884434 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de85f89f-7145-4ced-91a1-7c600d3c2853-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "de85f89f-7145-4ced-91a1-7c600d3c2853" (UID: "de85f89f-7145-4ced-91a1-7c600d3c2853"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 16:40:36.884527 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:36.884461 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpfdw\" (UniqueName: \"kubernetes.io/projected/e7bf39b3-22b7-451a-a722-1f7d5891ceef-kube-api-access-tpfdw\") pod \"kuadrant-operator-controller-manager-86878c769f-4vpk8\" (UID: \"e7bf39b3-22b7-451a-a722-1f7d5891ceef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4vpk8" Jul 06 16:40:36.884527 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:36.884514 2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/de85f89f-7145-4ced-91a1-7c600d3c2853-extensions-socket-volume\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:40:36.886241 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:36.886214 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de85f89f-7145-4ced-91a1-7c600d3c2853-kube-api-access-bmzc9" (OuterVolumeSpecName: "kube-api-access-bmzc9") pod "de85f89f-7145-4ced-91a1-7c600d3c2853" (UID: "de85f89f-7145-4ced-91a1-7c600d3c2853"). InnerVolumeSpecName "kube-api-access-bmzc9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 16:40:36.985768 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:36.985729 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7bf39b3-22b7-451a-a722-1f7d5891ceef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4vpk8\" (UID: \"e7bf39b3-22b7-451a-a722-1f7d5891ceef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4vpk8" Jul 06 16:40:36.985768 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:36.985772 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpfdw\" (UniqueName: \"kubernetes.io/projected/e7bf39b3-22b7-451a-a722-1f7d5891ceef-kube-api-access-tpfdw\") pod \"kuadrant-operator-controller-manager-86878c769f-4vpk8\" (UID: \"e7bf39b3-22b7-451a-a722-1f7d5891ceef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4vpk8" Jul 06 16:40:36.986043 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:36.985845 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmzc9\" (UniqueName: \"kubernetes.io/projected/de85f89f-7145-4ced-91a1-7c600d3c2853-kube-api-access-bmzc9\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:40:36.986127 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:36.986107 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7bf39b3-22b7-451a-a722-1f7d5891ceef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-4vpk8\" (UID: \"e7bf39b3-22b7-451a-a722-1f7d5891ceef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4vpk8" Jul 06 16:40:36.994250 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:36.994218 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpfdw\" (UniqueName: \"kubernetes.io/projected/e7bf39b3-22b7-451a-a722-1f7d5891ceef-kube-api-access-tpfdw\") pod \"kuadrant-operator-controller-manager-86878c769f-4vpk8\" (UID: \"e7bf39b3-22b7-451a-a722-1f7d5891ceef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4vpk8" Jul 06 16:40:37.130769 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:37.130690 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4vpk8" Jul 06 16:40:37.265957 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:37.265914 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4vpk8"] Jul 06 16:40:37.267607 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:40:37.267583 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7bf39b3_22b7_451a_a722_1f7d5891ceef.slice/crio-798170393ce428290d08389df0eb53ec8c1d191ed3b0f434654805355648e540 WatchSource:0}: Error finding container 798170393ce428290d08389df0eb53ec8c1d191ed3b0f434654805355648e540: Status 404 returned error can't find the container with id 798170393ce428290d08389df0eb53ec8c1d191ed3b0f434654805355648e540 Jul 06 16:40:37.387827 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:37.387723 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4vpk8" event={"ID":"e7bf39b3-22b7-451a-a722-1f7d5891ceef","Type":"ContainerStarted","Data":"83ea964966b2a0843de37776cc95fc9ad783ea0961fa59b8e9d213a63432d6d9"} Jul 06 16:40:37.387827 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:37.387789 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4vpk8" event={"ID":"e7bf39b3-22b7-451a-a722-1f7d5891ceef","Type":"ContainerStarted","Data":"798170393ce428290d08389df0eb53ec8c1d191ed3b0f434654805355648e540"} Jul 06 16:40:37.387827 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:37.387820 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4vpk8" Jul 06 16:40:37.389033 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:37.389007 2555 generic.go:356] "Generic (PLEG): container finished" podID="de85f89f-7145-4ced-91a1-7c600d3c2853" containerID="78b6e26e44dba9959166218d6c6aa471482972eeb966cdf173f92b1467fcff85" exitCode=0 Jul 06 16:40:37.389139 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:37.389038 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wb5n4" Jul 06 16:40:37.389139 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:37.389088 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wb5n4" event={"ID":"de85f89f-7145-4ced-91a1-7c600d3c2853","Type":"ContainerDied","Data":"78b6e26e44dba9959166218d6c6aa471482972eeb966cdf173f92b1467fcff85"} Jul 06 16:40:37.389139 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:37.389136 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wb5n4" event={"ID":"de85f89f-7145-4ced-91a1-7c600d3c2853","Type":"ContainerDied","Data":"a8f5079d6e7d71360f2059a154dfa98404c2aa3b814dde89f258e0495e5e1dab"} Jul 06 16:40:37.389241 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:37.389161 2555 scope.go:117] "RemoveContainer" containerID="78b6e26e44dba9959166218d6c6aa471482972eeb966cdf173f92b1467fcff85" Jul 06 16:40:37.398113 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:37.398096 2555 scope.go:117] "RemoveContainer" containerID="78b6e26e44dba9959166218d6c6aa471482972eeb966cdf173f92b1467fcff85" Jul 06 16:40:37.398368 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:40:37.398351 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78b6e26e44dba9959166218d6c6aa471482972eeb966cdf173f92b1467fcff85\": container with ID starting with 78b6e26e44dba9959166218d6c6aa471482972eeb966cdf173f92b1467fcff85 not found: ID does not exist" containerID="78b6e26e44dba9959166218d6c6aa471482972eeb966cdf173f92b1467fcff85" Jul 06 16:40:37.398430 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:37.398380 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78b6e26e44dba9959166218d6c6aa471482972eeb966cdf173f92b1467fcff85"} err="failed to get container status \"78b6e26e44dba9959166218d6c6aa471482972eeb966cdf173f92b1467fcff85\": rpc error: code = NotFound desc = could not find container \"78b6e26e44dba9959166218d6c6aa471482972eeb966cdf173f92b1467fcff85\": container with ID starting with 78b6e26e44dba9959166218d6c6aa471482972eeb966cdf173f92b1467fcff85 not found: ID does not exist" Jul 06 16:40:37.422594 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:37.422547 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4vpk8" podStartSLOduration=1.422530442 podStartE2EDuration="1.422530442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:40:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:40:37.421639569 +0000 UTC m=+718.690710599" watchObservedRunningTime="2026-07-06 16:40:37.422530442 +0000 UTC m=+718.691601483" Jul 06 16:40:37.448105 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:37.448079 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wb5n4"] Jul 06 16:40:37.476565 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:37.476536 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wb5n4"] Jul 06 16:40:39.302002 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:39.301974 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de85f89f-7145-4ced-91a1-7c600d3c2853" path="/var/lib/kubelet/pods/de85f89f-7145-4ced-91a1-7c600d3c2853/volumes" Jul 06 16:40:41.499647 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:41.499604 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:40:41.951010 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:41.950971 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:40:48.398442 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:48.398414 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4vpk8" Jul 06 16:40:52.939730 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:52.939693 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:40:53.092390 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:53.092347 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:40:55.785215 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:55.785180 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:40:55.791968 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:55.791923 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b4rb4"] Jul 06 16:40:55.792443 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:55.792424 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de85f89f-7145-4ced-91a1-7c600d3c2853" containerName="manager" Jul 06 16:40:55.792443 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:55.792445 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="de85f89f-7145-4ced-91a1-7c600d3c2853" containerName="manager" Jul 06 16:40:55.792569 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:55.792532 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="de85f89f-7145-4ced-91a1-7c600d3c2853" containerName="manager" Jul 06 16:40:55.797285 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:55.797270 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-b4rb4" Jul 06 16:40:55.799315 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:55.799282 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 06 16:40:55.799315 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:55.799296 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-c9sg5\"" Jul 06 16:40:55.805756 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:55.805734 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b4rb4"] Jul 06 16:40:55.895811 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:55.895779 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b4rb4"] Jul 06 16:40:55.903662 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:55.903627 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:40:55.949051 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:55.949020 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4b35c21c-6f05-47a8-a190-1a7bf21958eb-config-file\") pod \"limitador-limitador-64c94fd64f-b4rb4\" (UID: \"4b35c21c-6f05-47a8-a190-1a7bf21958eb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-b4rb4" Jul 06 16:40:55.949255 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:55.949112 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g58vg\" (UniqueName: \"kubernetes.io/projected/4b35c21c-6f05-47a8-a190-1a7bf21958eb-kube-api-access-g58vg\") pod \"limitador-limitador-64c94fd64f-b4rb4\" (UID: \"4b35c21c-6f05-47a8-a190-1a7bf21958eb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-b4rb4" Jul 06 16:40:56.004091 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:56.004049 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:40:56.049512 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:56.049487 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g58vg\" (UniqueName: \"kubernetes.io/projected/4b35c21c-6f05-47a8-a190-1a7bf21958eb-kube-api-access-g58vg\") pod \"limitador-limitador-64c94fd64f-b4rb4\" (UID: \"4b35c21c-6f05-47a8-a190-1a7bf21958eb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-b4rb4" Jul 06 16:40:56.049688 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:56.049544 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4b35c21c-6f05-47a8-a190-1a7bf21958eb-config-file\") pod \"limitador-limitador-64c94fd64f-b4rb4\" (UID: \"4b35c21c-6f05-47a8-a190-1a7bf21958eb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-b4rb4" Jul 06 16:40:56.050187 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:56.050169 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4b35c21c-6f05-47a8-a190-1a7bf21958eb-config-file\") pod \"limitador-limitador-64c94fd64f-b4rb4\" (UID: \"4b35c21c-6f05-47a8-a190-1a7bf21958eb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-b4rb4" Jul 06 16:40:56.057027 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:56.057005 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g58vg\" (UniqueName: \"kubernetes.io/projected/4b35c21c-6f05-47a8-a190-1a7bf21958eb-kube-api-access-g58vg\") pod \"limitador-limitador-64c94fd64f-b4rb4\" (UID: \"4b35c21c-6f05-47a8-a190-1a7bf21958eb\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-b4rb4" Jul 06 16:40:56.108097 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:56.108065 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-b4rb4" Jul 06 16:40:56.282001 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:56.281927 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b4rb4"] Jul 06 16:40:56.284352 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:40:56.284327 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b35c21c_6f05_47a8_a190_1a7bf21958eb.slice/crio-79d49e944b9f6c5fb5bac7b723fb4727912c65e064f9d7ea90e164eebbc329c2 WatchSource:0}: Error finding container 79d49e944b9f6c5fb5bac7b723fb4727912c65e064f9d7ea90e164eebbc329c2: Status 404 returned error can't find the container with id 79d49e944b9f6c5fb5bac7b723fb4727912c65e064f9d7ea90e164eebbc329c2 Jul 06 16:40:56.492621 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:56.492527 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-b4rb4" event={"ID":"4b35c21c-6f05-47a8-a190-1a7bf21958eb","Type":"ContainerStarted","Data":"79d49e944b9f6c5fb5bac7b723fb4727912c65e064f9d7ea90e164eebbc329c2"} Jul 06 16:40:56.650656 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:56.650621 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:40:56.722810 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:56.722775 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:40:59.513207 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:59.513119 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-b4rb4" event={"ID":"4b35c21c-6f05-47a8-a190-1a7bf21958eb","Type":"ContainerStarted","Data":"f82ff634d548b088b921a35e701e170de23868a859b765c0586a0332a8fc6a42"} Jul 06 16:40:59.513568 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:59.513266 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-b4rb4" Jul 06 16:40:59.529577 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:40:59.529522 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-b4rb4" podStartSLOduration=1.7450788990000001 podStartE2EDuration="4.529506279s" totalImagesPullingTime="2.78442738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:40:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:40:59.527857277 +0000 UTC m=+740.796928314" watchObservedRunningTime="2026-07-06 16:40:59.529506279 +0000 UTC m=+740.798577315" Jul 06 16:41:10.523909 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:10.523881 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-b4rb4" Jul 06 16:41:11.732208 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:11.732173 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b4rb4"] Jul 06 16:41:11.732630 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:11.732354 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-b4rb4" podUID="4b35c21c-6f05-47a8-a190-1a7bf21958eb" containerName="limitador" containerID="cri-o://f82ff634d548b088b921a35e701e170de23868a859b765c0586a0332a8fc6a42" gracePeriod=30 Jul 06 16:41:12.279668 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:12.279643 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-b4rb4" Jul 06 16:41:12.298484 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:12.298458 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g58vg\" (UniqueName: \"kubernetes.io/projected/4b35c21c-6f05-47a8-a190-1a7bf21958eb-kube-api-access-g58vg\") pod \"4b35c21c-6f05-47a8-a190-1a7bf21958eb\" (UID: \"4b35c21c-6f05-47a8-a190-1a7bf21958eb\") " Jul 06 16:41:12.298645 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:12.298520 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4b35c21c-6f05-47a8-a190-1a7bf21958eb-config-file\") pod \"4b35c21c-6f05-47a8-a190-1a7bf21958eb\" (UID: \"4b35c21c-6f05-47a8-a190-1a7bf21958eb\") " Jul 06 16:41:12.298996 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:12.298866 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b35c21c-6f05-47a8-a190-1a7bf21958eb-config-file" (OuterVolumeSpecName: "config-file") pod "4b35c21c-6f05-47a8-a190-1a7bf21958eb" (UID: "4b35c21c-6f05-47a8-a190-1a7bf21958eb"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 16:41:12.300896 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:12.300870 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b35c21c-6f05-47a8-a190-1a7bf21958eb-kube-api-access-g58vg" (OuterVolumeSpecName: "kube-api-access-g58vg") pod "4b35c21c-6f05-47a8-a190-1a7bf21958eb" (UID: "4b35c21c-6f05-47a8-a190-1a7bf21958eb"). InnerVolumeSpecName "kube-api-access-g58vg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 16:41:12.400230 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:12.400194 2555 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4b35c21c-6f05-47a8-a190-1a7bf21958eb-config-file\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:41:12.400230 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:12.400231 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g58vg\" (UniqueName: \"kubernetes.io/projected/4b35c21c-6f05-47a8-a190-1a7bf21958eb-kube-api-access-g58vg\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:41:12.584902 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:12.584812 2555 generic.go:356] "Generic (PLEG): container finished" podID="4b35c21c-6f05-47a8-a190-1a7bf21958eb" containerID="f82ff634d548b088b921a35e701e170de23868a859b765c0586a0332a8fc6a42" exitCode=0 Jul 06 16:41:12.584902 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:12.584856 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-b4rb4" Jul 06 16:41:12.584902 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:12.584873 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-b4rb4" event={"ID":"4b35c21c-6f05-47a8-a190-1a7bf21958eb","Type":"ContainerDied","Data":"f82ff634d548b088b921a35e701e170de23868a859b765c0586a0332a8fc6a42"} Jul 06 16:41:12.585167 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:12.584974 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-b4rb4" event={"ID":"4b35c21c-6f05-47a8-a190-1a7bf21958eb","Type":"ContainerDied","Data":"79d49e944b9f6c5fb5bac7b723fb4727912c65e064f9d7ea90e164eebbc329c2"} Jul 06 16:41:12.585167 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:12.585003 2555 scope.go:117] "RemoveContainer" containerID="f82ff634d548b088b921a35e701e170de23868a859b765c0586a0332a8fc6a42" Jul 06 16:41:12.594176 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:12.594158 2555 scope.go:117] "RemoveContainer" containerID="f82ff634d548b088b921a35e701e170de23868a859b765c0586a0332a8fc6a42" Jul 06 16:41:12.594428 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:41:12.594407 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f82ff634d548b088b921a35e701e170de23868a859b765c0586a0332a8fc6a42\": container with ID starting with f82ff634d548b088b921a35e701e170de23868a859b765c0586a0332a8fc6a42 not found: ID does not exist" containerID="f82ff634d548b088b921a35e701e170de23868a859b765c0586a0332a8fc6a42" Jul 06 16:41:12.594510 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:12.594440 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f82ff634d548b088b921a35e701e170de23868a859b765c0586a0332a8fc6a42"} err="failed to get container status \"f82ff634d548b088b921a35e701e170de23868a859b765c0586a0332a8fc6a42\": rpc error: code = NotFound desc = could not find container \"f82ff634d548b088b921a35e701e170de23868a859b765c0586a0332a8fc6a42\": container with ID starting with f82ff634d548b088b921a35e701e170de23868a859b765c0586a0332a8fc6a42 not found: ID does not exist" Jul 06 16:41:12.606904 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:12.606877 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b4rb4"] Jul 06 16:41:12.609791 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:12.609770 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-b4rb4"] Jul 06 16:41:13.301935 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:13.301901 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b35c21c-6f05-47a8-a190-1a7bf21958eb" path="/var/lib/kubelet/pods/4b35c21c-6f05-47a8-a190-1a7bf21958eb/volumes" Jul 06 16:41:16.385146 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:16.385116 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-g7xdk"] Jul 06 16:41:16.385586 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:16.385486 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b35c21c-6f05-47a8-a190-1a7bf21958eb" containerName="limitador" Jul 06 16:41:16.385586 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:16.385498 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b35c21c-6f05-47a8-a190-1a7bf21958eb" containerName="limitador" Jul 06 16:41:16.385586 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:16.385563 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b35c21c-6f05-47a8-a190-1a7bf21958eb" containerName="limitador" Jul 06 16:41:16.390138 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:16.390117 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-g7xdk" Jul 06 16:41:16.392209 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:16.392187 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 06 16:41:16.392209 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:16.392207 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ztxgm\"" Jul 06 16:41:16.396395 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:16.396370 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-g7xdk"] Jul 06 16:41:16.425250 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:16.425215 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:41:16.434299 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:16.434277 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dztf8\" (UniqueName: \"kubernetes.io/projected/51315930-951d-4794-94c3-fea496f88aad-kube-api-access-dztf8\") pod \"postgres-69fb4594cf-g7xdk\" (UID: \"51315930-951d-4794-94c3-fea496f88aad\") " pod="opendatahub/postgres-69fb4594cf-g7xdk" Jul 06 16:41:16.434384 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:16.434371 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/51315930-951d-4794-94c3-fea496f88aad-data\") pod \"postgres-69fb4594cf-g7xdk\" (UID: \"51315930-951d-4794-94c3-fea496f88aad\") " pod="opendatahub/postgres-69fb4594cf-g7xdk" Jul 06 16:41:16.534787 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:16.534760 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/51315930-951d-4794-94c3-fea496f88aad-data\") pod \"postgres-69fb4594cf-g7xdk\" (UID: \"51315930-951d-4794-94c3-fea496f88aad\") " pod="opendatahub/postgres-69fb4594cf-g7xdk" Jul 06 16:41:16.534971 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:16.534834 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dztf8\" (UniqueName: \"kubernetes.io/projected/51315930-951d-4794-94c3-fea496f88aad-kube-api-access-dztf8\") pod \"postgres-69fb4594cf-g7xdk\" (UID: \"51315930-951d-4794-94c3-fea496f88aad\") " pod="opendatahub/postgres-69fb4594cf-g7xdk" Jul 06 16:41:16.535142 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:16.535125 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/51315930-951d-4794-94c3-fea496f88aad-data\") pod \"postgres-69fb4594cf-g7xdk\" (UID: \"51315930-951d-4794-94c3-fea496f88aad\") " pod="opendatahub/postgres-69fb4594cf-g7xdk" Jul 06 16:41:16.548298 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:16.548271 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dztf8\" (UniqueName: \"kubernetes.io/projected/51315930-951d-4794-94c3-fea496f88aad-kube-api-access-dztf8\") pod \"postgres-69fb4594cf-g7xdk\" (UID: \"51315930-951d-4794-94c3-fea496f88aad\") " pod="opendatahub/postgres-69fb4594cf-g7xdk" Jul 06 16:41:16.703272 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:16.703195 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-g7xdk" Jul 06 16:41:17.045085 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:17.045064 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-g7xdk"] Jul 06 16:41:17.047069 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:41:17.047041 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51315930_951d_4794_94c3_fea496f88aad.slice/crio-a6ec56468c86c731f2ea17cca1813ab6461bc5e55713b01c352621da8ebb933b WatchSource:0}: Error finding container a6ec56468c86c731f2ea17cca1813ab6461bc5e55713b01c352621da8ebb933b: Status 404 returned error can't find the container with id a6ec56468c86c731f2ea17cca1813ab6461bc5e55713b01c352621da8ebb933b Jul 06 16:41:17.615413 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:17.615380 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-g7xdk" event={"ID":"51315930-951d-4794-94c3-fea496f88aad","Type":"ContainerStarted","Data":"a6ec56468c86c731f2ea17cca1813ab6461bc5e55713b01c352621da8ebb933b"} Jul 06 16:41:22.649864 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:22.649820 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-g7xdk" event={"ID":"51315930-951d-4794-94c3-fea496f88aad","Type":"ContainerStarted","Data":"43568d232be7e601cfa6169a46eac382af34d2954388d31c6f53af4370fa84f4"} Jul 06 16:41:22.650715 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:22.649896 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-g7xdk" Jul 06 16:41:22.666352 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:22.666307 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-g7xdk" podStartSLOduration=1.872481082 podStartE2EDuration="6.666292415s" totalImagesPullingTime="4.793811333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:41:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:41:22.665258602 +0000 UTC m=+763.934329636" watchObservedRunningTime="2026-07-06 16:41:22.666292415 +0000 UTC m=+763.935363451" Jul 06 16:41:28.686120 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:28.686084 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-g7xdk" Jul 06 16:41:29.001917 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:29.001806 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:41:29.249152 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:29.249120 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:41:35.413501 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:35.413458 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:41:35.425816 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:35.425793 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bd8558449-sp8v5"] Jul 06 16:41:35.436359 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:35.436332 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bd8558449-sp8v5" Jul 06 16:41:35.439499 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:35.439474 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 06 16:41:35.439634 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:35.439585 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-66c55\"" Jul 06 16:41:35.439634 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:35.439597 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 06 16:41:35.442713 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:35.442687 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bd8558449-sp8v5"] Jul 06 16:41:35.509260 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:35.509227 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrn4h\" (UniqueName: \"kubernetes.io/projected/e8e1a660-5de1-4af0-a6c2-6029bd8801df-kube-api-access-xrn4h\") pod \"maas-controller-7bd8558449-sp8v5\" (UID: \"e8e1a660-5de1-4af0-a6c2-6029bd8801df\") " pod="opendatahub/maas-controller-7bd8558449-sp8v5" Jul 06 16:41:35.509260 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:35.509264 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e1a660-5de1-4af0-a6c2-6029bd8801df-service-ca\") pod \"maas-controller-7bd8558449-sp8v5\" (UID: \"e8e1a660-5de1-4af0-a6c2-6029bd8801df\") " pod="opendatahub/maas-controller-7bd8558449-sp8v5" Jul 06 16:41:35.509491 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:35.509369 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8e1a660-5de1-4af0-a6c2-6029bd8801df-webhook-cert\") pod \"maas-controller-7bd8558449-sp8v5\" (UID: \"e8e1a660-5de1-4af0-a6c2-6029bd8801df\") " pod="opendatahub/maas-controller-7bd8558449-sp8v5" Jul 06 16:41:35.510309 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:35.510286 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:41:35.610573 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:35.610537 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrn4h\" (UniqueName: \"kubernetes.io/projected/e8e1a660-5de1-4af0-a6c2-6029bd8801df-kube-api-access-xrn4h\") pod \"maas-controller-7bd8558449-sp8v5\" (UID: \"e8e1a660-5de1-4af0-a6c2-6029bd8801df\") " pod="opendatahub/maas-controller-7bd8558449-sp8v5" Jul 06 16:41:35.610756 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:35.610585 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e1a660-5de1-4af0-a6c2-6029bd8801df-service-ca\") pod \"maas-controller-7bd8558449-sp8v5\" (UID: \"e8e1a660-5de1-4af0-a6c2-6029bd8801df\") " pod="opendatahub/maas-controller-7bd8558449-sp8v5" Jul 06 16:41:35.610756 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:35.610626 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8e1a660-5de1-4af0-a6c2-6029bd8801df-webhook-cert\") pod \"maas-controller-7bd8558449-sp8v5\" (UID: \"e8e1a660-5de1-4af0-a6c2-6029bd8801df\") " pod="opendatahub/maas-controller-7bd8558449-sp8v5" Jul 06 16:41:35.610909 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:41:35.610767 2555 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 06 16:41:35.610909 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:41:35.610833 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8e1a660-5de1-4af0-a6c2-6029bd8801df-webhook-cert podName:e8e1a660-5de1-4af0-a6c2-6029bd8801df nodeName:}" failed. No retries permitted until 2026-07-06 16:41:36.110814593 +0000 UTC m=+777.379885608 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/e8e1a660-5de1-4af0-a6c2-6029bd8801df-webhook-cert") pod "maas-controller-7bd8558449-sp8v5" (UID: "e8e1a660-5de1-4af0-a6c2-6029bd8801df") : secret "maas-controller-webhook-cert" not found Jul 06 16:41:35.611428 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:35.611411 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e1a660-5de1-4af0-a6c2-6029bd8801df-service-ca\") pod \"maas-controller-7bd8558449-sp8v5\" (UID: \"e8e1a660-5de1-4af0-a6c2-6029bd8801df\") " pod="opendatahub/maas-controller-7bd8558449-sp8v5" Jul 06 16:41:35.612194 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:35.612160 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:41:35.620222 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:35.620200 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrn4h\" (UniqueName: \"kubernetes.io/projected/e8e1a660-5de1-4af0-a6c2-6029bd8801df-kube-api-access-xrn4h\") pod \"maas-controller-7bd8558449-sp8v5\" (UID: \"e8e1a660-5de1-4af0-a6c2-6029bd8801df\") " pod="opendatahub/maas-controller-7bd8558449-sp8v5" Jul 06 16:41:35.911655 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:35.911623 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:41:36.114033 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:36.114001 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8e1a660-5de1-4af0-a6c2-6029bd8801df-webhook-cert\") pod \"maas-controller-7bd8558449-sp8v5\" (UID: \"e8e1a660-5de1-4af0-a6c2-6029bd8801df\") " pod="opendatahub/maas-controller-7bd8558449-sp8v5" Jul 06 16:41:36.116532 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:36.116515 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8e1a660-5de1-4af0-a6c2-6029bd8801df-webhook-cert\") pod \"maas-controller-7bd8558449-sp8v5\" (UID: \"e8e1a660-5de1-4af0-a6c2-6029bd8801df\") " pod="opendatahub/maas-controller-7bd8558449-sp8v5" Jul 06 16:41:36.348097 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:36.348055 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bd8558449-sp8v5" Jul 06 16:41:36.481268 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:36.481244 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bd8558449-sp8v5"] Jul 06 16:41:36.483091 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:41:36.483065 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8e1a660_5de1_4af0_a6c2_6029bd8801df.slice/crio-cac82d7f01c95e9c4ef3c7ace4013696ccc4019006f558bb1f521872cc39255c WatchSource:0}: Error finding container cac82d7f01c95e9c4ef3c7ace4013696ccc4019006f558bb1f521872cc39255c: Status 404 returned error can't find the container with id cac82d7f01c95e9c4ef3c7ace4013696ccc4019006f558bb1f521872cc39255c Jul 06 16:41:36.725163 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:36.725073 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bd8558449-sp8v5" event={"ID":"e8e1a660-5de1-4af0-a6c2-6029bd8801df","Type":"ContainerStarted","Data":"cac82d7f01c95e9c4ef3c7ace4013696ccc4019006f558bb1f521872cc39255c"} Jul 06 16:41:38.870588 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:38.870550 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:41:38.959203 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:38.959098 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:41:39.744411 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:39.744375 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bd8558449-sp8v5" event={"ID":"e8e1a660-5de1-4af0-a6c2-6029bd8801df","Type":"ContainerStarted","Data":"66348c1ce48033c7dd34a4570c17368ef74bc6b4b4ad47061cd7ceca9439eaf7"} Jul 06 16:41:39.744577 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:39.744505 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bd8558449-sp8v5" Jul 06 16:41:39.759989 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:39.759923 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7bd8558449-sp8v5" podStartSLOduration=2.56458189 podStartE2EDuration="4.759904486s" totalImagesPullingTime="2.195322596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:41:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:41:39.759086704 +0000 UTC m=+781.028157753" watchObservedRunningTime="2026-07-06 16:41:39.759904486 +0000 UTC m=+781.028975534" Jul 06 16:41:49.985016 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:49.984973 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bd8558449-sp8v5"] Jul 06 16:41:49.985526 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:49.985264 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7bd8558449-sp8v5" podUID="e8e1a660-5de1-4af0-a6c2-6029bd8801df" containerName="manager" containerID="cri-o://66348c1ce48033c7dd34a4570c17368ef74bc6b4b4ad47061cd7ceca9439eaf7" gracePeriod=30 Jul 06 16:41:49.992733 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:49.992708 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bd8558449-sp8v5" Jul 06 16:41:50.234896 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:50.234875 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bd8558449-sp8v5" Jul 06 16:41:50.254078 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:50.253998 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8e1a660-5de1-4af0-a6c2-6029bd8801df-webhook-cert\") pod \"e8e1a660-5de1-4af0-a6c2-6029bd8801df\" (UID: \"e8e1a660-5de1-4af0-a6c2-6029bd8801df\") " Jul 06 16:41:50.254218 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:50.254092 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e1a660-5de1-4af0-a6c2-6029bd8801df-service-ca\") pod \"e8e1a660-5de1-4af0-a6c2-6029bd8801df\" (UID: \"e8e1a660-5de1-4af0-a6c2-6029bd8801df\") " Jul 06 16:41:50.254218 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:50.254116 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrn4h\" (UniqueName: \"kubernetes.io/projected/e8e1a660-5de1-4af0-a6c2-6029bd8801df-kube-api-access-xrn4h\") pod \"e8e1a660-5de1-4af0-a6c2-6029bd8801df\" (UID: \"e8e1a660-5de1-4af0-a6c2-6029bd8801df\") " Jul 06 16:41:50.254668 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:50.254644 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8e1a660-5de1-4af0-a6c2-6029bd8801df-service-ca" (OuterVolumeSpecName: "service-ca") pod "e8e1a660-5de1-4af0-a6c2-6029bd8801df" (UID: "e8e1a660-5de1-4af0-a6c2-6029bd8801df"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 16:41:50.256553 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:50.256521 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8e1a660-5de1-4af0-a6c2-6029bd8801df-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e8e1a660-5de1-4af0-a6c2-6029bd8801df" (UID: "e8e1a660-5de1-4af0-a6c2-6029bd8801df"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 16:41:50.256654 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:50.256604 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8e1a660-5de1-4af0-a6c2-6029bd8801df-kube-api-access-xrn4h" (OuterVolumeSpecName: "kube-api-access-xrn4h") pod "e8e1a660-5de1-4af0-a6c2-6029bd8801df" (UID: "e8e1a660-5de1-4af0-a6c2-6029bd8801df"). InnerVolumeSpecName "kube-api-access-xrn4h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 16:41:50.355468 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:50.355423 2555 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e1a660-5de1-4af0-a6c2-6029bd8801df-service-ca\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:41:50.355468 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:50.355454 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrn4h\" (UniqueName: \"kubernetes.io/projected/e8e1a660-5de1-4af0-a6c2-6029bd8801df-kube-api-access-xrn4h\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:41:50.355468 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:50.355467 2555 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8e1a660-5de1-4af0-a6c2-6029bd8801df-webhook-cert\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:41:50.804894 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:50.804857 2555 generic.go:356] "Generic (PLEG): container finished" podID="e8e1a660-5de1-4af0-a6c2-6029bd8801df" containerID="66348c1ce48033c7dd34a4570c17368ef74bc6b4b4ad47061cd7ceca9439eaf7" exitCode=0 Jul 06 16:41:50.805100 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:50.804904 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bd8558449-sp8v5" Jul 06 16:41:50.805100 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:50.804969 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bd8558449-sp8v5" event={"ID":"e8e1a660-5de1-4af0-a6c2-6029bd8801df","Type":"ContainerDied","Data":"66348c1ce48033c7dd34a4570c17368ef74bc6b4b4ad47061cd7ceca9439eaf7"} Jul 06 16:41:50.805100 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:50.805021 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bd8558449-sp8v5" event={"ID":"e8e1a660-5de1-4af0-a6c2-6029bd8801df","Type":"ContainerDied","Data":"cac82d7f01c95e9c4ef3c7ace4013696ccc4019006f558bb1f521872cc39255c"} Jul 06 16:41:50.805100 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:50.805043 2555 scope.go:117] "RemoveContainer" containerID="66348c1ce48033c7dd34a4570c17368ef74bc6b4b4ad47061cd7ceca9439eaf7" Jul 06 16:41:50.816110 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:50.816088 2555 scope.go:117] "RemoveContainer" containerID="66348c1ce48033c7dd34a4570c17368ef74bc6b4b4ad47061cd7ceca9439eaf7" Jul 06 16:41:50.816393 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:41:50.816374 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66348c1ce48033c7dd34a4570c17368ef74bc6b4b4ad47061cd7ceca9439eaf7\": container with ID starting with 66348c1ce48033c7dd34a4570c17368ef74bc6b4b4ad47061cd7ceca9439eaf7 not found: ID does not exist" containerID="66348c1ce48033c7dd34a4570c17368ef74bc6b4b4ad47061cd7ceca9439eaf7" Jul 06 16:41:50.816471 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:50.816407 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66348c1ce48033c7dd34a4570c17368ef74bc6b4b4ad47061cd7ceca9439eaf7"} err="failed to get container status \"66348c1ce48033c7dd34a4570c17368ef74bc6b4b4ad47061cd7ceca9439eaf7\": rpc error: code = NotFound desc = could not find container \"66348c1ce48033c7dd34a4570c17368ef74bc6b4b4ad47061cd7ceca9439eaf7\": container with ID starting with 66348c1ce48033c7dd34a4570c17368ef74bc6b4b4ad47061cd7ceca9439eaf7 not found: ID does not exist" Jul 06 16:41:50.827135 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:50.827101 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bd8558449-sp8v5"] Jul 06 16:41:50.829665 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:50.829644 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7bd8558449-sp8v5"] Jul 06 16:41:51.302819 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:41:51.302787 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8e1a660-5de1-4af0-a6c2-6029bd8801df" path="/var/lib/kubelet/pods/e8e1a660-5de1-4af0-a6c2-6029bd8801df/volumes" Jul 06 16:42:11.384590 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:42:11.384486 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:42:11.861703 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:42:11.861671 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:42:12.139462 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:42:12.139378 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:42:12.313097 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:42:12.313062 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:42:12.413760 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:42:12.413662 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:42:12.458009 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:42:12.457974 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-k7nxx"] Jul 06 16:42:12.458471 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:42:12.458456 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8e1a660-5de1-4af0-a6c2-6029bd8801df" containerName="manager" Jul 06 16:42:12.458528 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:42:12.458473 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8e1a660-5de1-4af0-a6c2-6029bd8801df" containerName="manager" Jul 06 16:42:12.458569 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:42:12.458552 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8e1a660-5de1-4af0-a6c2-6029bd8801df" containerName="manager" Jul 06 16:42:12.464344 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:42:12.464321 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-k7nxx" Jul 06 16:42:12.466495 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:42:12.466469 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-57dzr\"" Jul 06 16:42:12.466621 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:42:12.466570 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 06 16:42:12.476071 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:42:12.476048 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-k7nxx"] Jul 06 16:42:12.546255 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:42:12.546214 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6qxn\" (UniqueName: \"kubernetes.io/projected/4628caff-24fd-4c97-b04e-17163a771267-kube-api-access-s6qxn\") pod \"payload-processing-58f86c7798-k7nxx\" (UID: \"4628caff-24fd-4c97-b04e-17163a771267\") " pod="openshift-ingress/payload-processing-58f86c7798-k7nxx" Jul 06 16:42:12.546486 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:42:12.546273 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4628caff-24fd-4c97-b04e-17163a771267-plugins-config-volume\") pod \"payload-processing-58f86c7798-k7nxx\" (UID: \"4628caff-24fd-4c97-b04e-17163a771267\") " pod="openshift-ingress/payload-processing-58f86c7798-k7nxx" Jul 06 16:42:12.647288 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:42:12.647258 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6qxn\" (UniqueName: \"kubernetes.io/projected/4628caff-24fd-4c97-b04e-17163a771267-kube-api-access-s6qxn\") pod \"payload-processing-58f86c7798-k7nxx\" (UID: \"4628caff-24fd-4c97-b04e-17163a771267\") " pod="openshift-ingress/payload-processing-58f86c7798-k7nxx" Jul 06 16:42:12.647447 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:42:12.647298 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4628caff-24fd-4c97-b04e-17163a771267-plugins-config-volume\") pod \"payload-processing-58f86c7798-k7nxx\" (UID: \"4628caff-24fd-4c97-b04e-17163a771267\") " pod="openshift-ingress/payload-processing-58f86c7798-k7nxx" Jul 06 16:42:12.647921 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:42:12.647903 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4628caff-24fd-4c97-b04e-17163a771267-plugins-config-volume\") pod \"payload-processing-58f86c7798-k7nxx\" (UID: \"4628caff-24fd-4c97-b04e-17163a771267\") " pod="openshift-ingress/payload-processing-58f86c7798-k7nxx" Jul 06 16:42:12.654933 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:42:12.654909 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6qxn\" (UniqueName: \"kubernetes.io/projected/4628caff-24fd-4c97-b04e-17163a771267-kube-api-access-s6qxn\") pod \"payload-processing-58f86c7798-k7nxx\" (UID: \"4628caff-24fd-4c97-b04e-17163a771267\") " pod="openshift-ingress/payload-processing-58f86c7798-k7nxx" Jul 06 16:42:12.776442 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:42:12.776350 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-k7nxx" Jul 06 16:42:12.910595 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:42:12.910566 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-k7nxx"] Jul 06 16:42:12.912218 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:42:12.912194 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4628caff_24fd_4c97_b04e_17163a771267.slice/crio-93ebe379f49a2c36c7c0f67f9173a2f972147578f68be8e0f84bb81f1940bd28 WatchSource:0}: Error finding container 93ebe379f49a2c36c7c0f67f9173a2f972147578f68be8e0f84bb81f1940bd28: Status 404 returned error can't find the container with id 93ebe379f49a2c36c7c0f67f9173a2f972147578f68be8e0f84bb81f1940bd28 Jul 06 16:42:12.924529 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:42:12.924498 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-k7nxx" event={"ID":"4628caff-24fd-4c97-b04e-17163a771267","Type":"ContainerStarted","Data":"93ebe379f49a2c36c7c0f67f9173a2f972147578f68be8e0f84bb81f1940bd28"} Jul 06 16:42:14.942173 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:42:14.942138 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-k7nxx" event={"ID":"4628caff-24fd-4c97-b04e-17163a771267","Type":"ContainerStarted","Data":"fbad81d2e7d032cdc1b19af4895514a109278b92aced4be8b5cdbd7792977a87"} Jul 06 16:42:14.942578 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:42:14.942234 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-k7nxx" Jul 06 16:42:14.956459 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:42:14.956409 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-k7nxx" podStartSLOduration=1.349013227 podStartE2EDuration="2.956392087s" totalImagesPullingTime="1.60737886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:42:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:42:14.955652315 +0000 UTC m=+816.224723355" watchObservedRunningTime="2026-07-06 16:42:14.956392087 +0000 UTC m=+816.225463124" Jul 06 16:42:22.249517 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:42:22.249482 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:42:22.341370 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:42:22.341341 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:42:25.949511 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:42:25.949483 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-k7nxx" Jul 06 16:42:31.431004 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:42:31.430970 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:43:02.390820 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:02.390782 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-9nch4"] Jul 06 16:43:02.395924 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:02.395902 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9nch4" Jul 06 16:43:02.398255 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:02.398223 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-692dm\"" Jul 06 16:43:02.398386 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:02.398256 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 16:43:02.398870 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:02.398850 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 16:43:02.398970 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:02.398927 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 06 16:43:02.404767 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:02.404720 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-9nch4"] Jul 06 16:43:02.409383 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:02.409348 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:43:02.505805 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:02.505770 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9nch4\" (UID: \"2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9nch4" Jul 06 16:43:02.506020 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:02.505888 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9nch4\" (UID: \"2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9nch4" Jul 06 16:43:02.506020 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:02.505964 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2hw9\" (UniqueName: \"kubernetes.io/projected/2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90-kube-api-access-t2hw9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9nch4\" (UID: \"2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9nch4" Jul 06 16:43:02.506127 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:02.506052 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9nch4\" (UID: \"2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9nch4" Jul 06 16:43:02.506127 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:02.506094 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9nch4\" (UID: \"2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9nch4" Jul 06 16:43:02.506208 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:02.506143 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9nch4\" (UID: \"2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9nch4" Jul 06 16:43:02.606867 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:02.606827 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2hw9\" (UniqueName: \"kubernetes.io/projected/2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90-kube-api-access-t2hw9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9nch4\" (UID: \"2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9nch4" Jul 06 16:43:02.607097 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:02.606892 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9nch4\" (UID: \"2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9nch4" Jul 06 16:43:02.607097 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:02.606928 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9nch4\" (UID: \"2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9nch4" Jul 06 16:43:02.607097 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:02.607063 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9nch4\" (UID: \"2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9nch4" Jul 06 16:43:02.607264 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:02.607108 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9nch4\" (UID: \"2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9nch4" Jul 06 16:43:02.607264 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:02.607155 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9nch4\" (UID: \"2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9nch4" Jul 06 16:43:02.607399 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:02.607371 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9nch4\" (UID: \"2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9nch4" Jul 06 16:43:02.607518 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:02.607439 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9nch4\" (UID: \"2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9nch4" Jul 06 16:43:02.607569 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:02.607517 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9nch4\" (UID: \"2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9nch4" Jul 06 16:43:02.609442 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:02.609421 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9nch4\" (UID: \"2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9nch4" Jul 06 16:43:02.609635 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:02.609617 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9nch4\" (UID: \"2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9nch4" Jul 06 16:43:02.615126 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:02.615103 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2hw9\" (UniqueName: \"kubernetes.io/projected/2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90-kube-api-access-t2hw9\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9nch4\" (UID: \"2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9nch4" Jul 06 16:43:02.708752 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:02.708668 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9nch4" Jul 06 16:43:02.849170 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:02.849146 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-9nch4"] Jul 06 16:43:02.851006 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:43:02.850975 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e7a6615_e067_4ef7_a4ac_1ec27b9bbc90.slice/crio-3aac3e8b4c52bd7783dce26c7883b9614dcd6ea8e5050abce7be161622e91785 WatchSource:0}: Error finding container 3aac3e8b4c52bd7783dce26c7883b9614dcd6ea8e5050abce7be161622e91785: Status 404 returned error can't find the container with id 3aac3e8b4c52bd7783dce26c7883b9614dcd6ea8e5050abce7be161622e91785 Jul 06 16:43:03.208267 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:03.208226 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9nch4" event={"ID":"2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90","Type":"ContainerStarted","Data":"3aac3e8b4c52bd7783dce26c7883b9614dcd6ea8e5050abce7be161622e91785"} Jul 06 16:43:04.215357 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:04.215265 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9nch4" event={"ID":"2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90","Type":"ContainerStarted","Data":"64566ccecde585dddce1a55e21a9c8469e5aad9bd21f48ee06dd1af60822d526"} Jul 06 16:43:04.232818 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:04.232770 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9nch4" podStartSLOduration=1.152653091 podStartE2EDuration="2.23275397s" totalImagesPullingTime="1.080100879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:43:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:43:04.231374739 +0000 UTC m=+865.500445778" watchObservedRunningTime="2026-07-06 16:43:04.23275397 +0000 UTC m=+865.501825006" Jul 06 16:43:12.709250 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:12.709209 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9nch4" Jul 06 16:43:12.709725 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:12.709277 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9nch4" Jul 06 16:43:12.721386 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:12.721357 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9nch4" Jul 06 16:43:13.276531 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:13.276503 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9nch4" Jul 06 16:43:13.287624 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:13.287556 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-qd8lz"] Jul 06 16:43:13.291441 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:13.291423 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qd8lz" Jul 06 16:43:13.293884 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:13.293863 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 06 16:43:13.304322 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:13.304300 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-qd8lz"] Jul 06 16:43:13.380246 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:13.380203 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:43:13.408382 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:13.408354 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79542ff8-0016-4d35-915b-a208c89b9195-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qd8lz\" (UID: \"79542ff8-0016-4d35-915b-a208c89b9195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qd8lz" Jul 06 16:43:13.408533 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:13.408391 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79542ff8-0016-4d35-915b-a208c89b9195-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qd8lz\" (UID: \"79542ff8-0016-4d35-915b-a208c89b9195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qd8lz" Jul 06 16:43:13.408533 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:13.408427 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmpbr\" (UniqueName: \"kubernetes.io/projected/79542ff8-0016-4d35-915b-a208c89b9195-kube-api-access-fmpbr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qd8lz\" (UID: \"79542ff8-0016-4d35-915b-a208c89b9195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qd8lz" Jul 06 16:43:13.408672 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:13.408614 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79542ff8-0016-4d35-915b-a208c89b9195-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qd8lz\" (UID: \"79542ff8-0016-4d35-915b-a208c89b9195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qd8lz" Jul 06 16:43:13.408672 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:13.408648 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79542ff8-0016-4d35-915b-a208c89b9195-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qd8lz\" (UID: \"79542ff8-0016-4d35-915b-a208c89b9195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qd8lz" Jul 06 16:43:13.408765 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:13.408743 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79542ff8-0016-4d35-915b-a208c89b9195-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qd8lz\" (UID: \"79542ff8-0016-4d35-915b-a208c89b9195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qd8lz" Jul 06 16:43:13.509281 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:13.509247 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79542ff8-0016-4d35-915b-a208c89b9195-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qd8lz\" (UID: \"79542ff8-0016-4d35-915b-a208c89b9195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qd8lz" Jul 06 16:43:13.509281 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:13.509285 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79542ff8-0016-4d35-915b-a208c89b9195-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qd8lz\" (UID: \"79542ff8-0016-4d35-915b-a208c89b9195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qd8lz" Jul 06 16:43:13.509513 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:13.509310 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmpbr\" (UniqueName: \"kubernetes.io/projected/79542ff8-0016-4d35-915b-a208c89b9195-kube-api-access-fmpbr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qd8lz\" (UID: \"79542ff8-0016-4d35-915b-a208c89b9195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qd8lz" Jul 06 16:43:13.509513 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:13.509356 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79542ff8-0016-4d35-915b-a208c89b9195-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qd8lz\" (UID: \"79542ff8-0016-4d35-915b-a208c89b9195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qd8lz" Jul 06 16:43:13.509513 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:13.509376 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79542ff8-0016-4d35-915b-a208c89b9195-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qd8lz\" (UID: \"79542ff8-0016-4d35-915b-a208c89b9195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qd8lz" Jul 06 16:43:13.509513 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:13.509401 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79542ff8-0016-4d35-915b-a208c89b9195-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qd8lz\" (UID: \"79542ff8-0016-4d35-915b-a208c89b9195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qd8lz" Jul 06 16:43:13.509713 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:13.509691 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79542ff8-0016-4d35-915b-a208c89b9195-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qd8lz\" (UID: \"79542ff8-0016-4d35-915b-a208c89b9195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qd8lz" Jul 06 16:43:13.509762 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:13.509729 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79542ff8-0016-4d35-915b-a208c89b9195-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qd8lz\" (UID: \"79542ff8-0016-4d35-915b-a208c89b9195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qd8lz" Jul 06 16:43:13.509808 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:13.509792 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79542ff8-0016-4d35-915b-a208c89b9195-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qd8lz\" (UID: \"79542ff8-0016-4d35-915b-a208c89b9195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qd8lz" Jul 06 16:43:13.511716 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:13.511695 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79542ff8-0016-4d35-915b-a208c89b9195-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qd8lz\" (UID: \"79542ff8-0016-4d35-915b-a208c89b9195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qd8lz" Jul 06 16:43:13.511863 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:13.511846 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79542ff8-0016-4d35-915b-a208c89b9195-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qd8lz\" (UID: \"79542ff8-0016-4d35-915b-a208c89b9195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qd8lz" Jul 06 16:43:13.519081 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:13.519059 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmpbr\" (UniqueName: \"kubernetes.io/projected/79542ff8-0016-4d35-915b-a208c89b9195-kube-api-access-fmpbr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-qd8lz\" (UID: \"79542ff8-0016-4d35-915b-a208c89b9195\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qd8lz" Jul 06 16:43:13.603030 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:13.602997 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qd8lz" Jul 06 16:43:13.741149 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:13.741124 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-qd8lz"] Jul 06 16:43:13.741838 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:43:13.741817 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79542ff8_0016_4d35_915b_a208c89b9195.slice/crio-439657f728ce7e46c41417416609ed882f5ae20a8ed2fc41c3518675f2a04e23 WatchSource:0}: Error finding container 439657f728ce7e46c41417416609ed882f5ae20a8ed2fc41c3518675f2a04e23: Status 404 returned error can't find the container with id 439657f728ce7e46c41417416609ed882f5ae20a8ed2fc41c3518675f2a04e23 Jul 06 16:43:14.272664 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:14.272583 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qd8lz" event={"ID":"79542ff8-0016-4d35-915b-a208c89b9195","Type":"ContainerStarted","Data":"0b2a84157f1e488a5e85355f21dfbba8dd0229fab8470217d6fdff22fd35b8dd"} Jul 06 16:43:14.272664 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:14.272649 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qd8lz" event={"ID":"79542ff8-0016-4d35-915b-a208c89b9195","Type":"ContainerStarted","Data":"439657f728ce7e46c41417416609ed882f5ae20a8ed2fc41c3518675f2a04e23"} Jul 06 16:43:14.293284 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:14.293233 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qd8lz" podStartSLOduration=1.098466628 podStartE2EDuration="1.293217913s" totalImagesPullingTime="194.751285ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:43:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:43:14.290753959 +0000 UTC m=+875.559824998" watchObservedRunningTime="2026-07-06 16:43:14.293217913 +0000 UTC m=+875.562288970" Jul 06 16:43:23.603908 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:23.603863 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qd8lz" Jul 06 16:43:23.604406 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:23.603971 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qd8lz" Jul 06 16:43:23.616649 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:23.616626 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qd8lz" Jul 06 16:43:24.338389 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:24.338358 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-qd8lz" Jul 06 16:43:26.318900 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:26.318868 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:43:34.416808 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:34.416713 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:43:38.383075 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:38.383038 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:43:38.626161 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:43:38.626128 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:44:07.220262 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:44:07.220227 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:44:07.287467 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:44:07.287438 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:44:29.866678 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:44:29.866637 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:44:29.960425 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:44:29.960391 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:44:31.133404 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:44:31.133372 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:44:31.223764 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:44:31.223725 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:45:00.146894 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:00.146815 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722605-db4d8"] Jul 06 16:45:00.150589 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:00.150570 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722605-db4d8" Jul 06 16:45:00.152615 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:00.152598 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-jdcs4\"" Jul 06 16:45:00.158244 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:00.158220 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722605-db4d8"] Jul 06 16:45:00.202742 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:00.202712 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5xcl\" (UniqueName: \"kubernetes.io/projected/ea04b203-271a-42e3-9480-01bde1dbba79-kube-api-access-l5xcl\") pod \"maas-api-key-cleanup-29722605-db4d8\" (UID: \"ea04b203-271a-42e3-9480-01bde1dbba79\") " pod="opendatahub/maas-api-key-cleanup-29722605-db4d8" Jul 06 16:45:00.303458 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:00.303418 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5xcl\" (UniqueName: \"kubernetes.io/projected/ea04b203-271a-42e3-9480-01bde1dbba79-kube-api-access-l5xcl\") pod \"maas-api-key-cleanup-29722605-db4d8\" (UID: \"ea04b203-271a-42e3-9480-01bde1dbba79\") " pod="opendatahub/maas-api-key-cleanup-29722605-db4d8" Jul 06 16:45:00.312799 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:00.312776 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5xcl\" (UniqueName: \"kubernetes.io/projected/ea04b203-271a-42e3-9480-01bde1dbba79-kube-api-access-l5xcl\") pod \"maas-api-key-cleanup-29722605-db4d8\" (UID: \"ea04b203-271a-42e3-9480-01bde1dbba79\") " pod="opendatahub/maas-api-key-cleanup-29722605-db4d8" Jul 06 16:45:00.463047 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:00.462960 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722605-db4d8" Jul 06 16:45:00.600109 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:00.600079 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722605-db4d8"] Jul 06 16:45:00.601000 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:45:00.600974 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea04b203_271a_42e3_9480_01bde1dbba79.slice/crio-756222b9e6a4082ab3ca052f6157d47b8bdd975637429d78493c26e315870898 WatchSource:0}: Error finding container 756222b9e6a4082ab3ca052f6157d47b8bdd975637429d78493c26e315870898: Status 404 returned error can't find the container with id 756222b9e6a4082ab3ca052f6157d47b8bdd975637429d78493c26e315870898 Jul 06 16:45:00.603036 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:00.603021 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 16:45:00.877868 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:00.877836 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722605-db4d8" event={"ID":"ea04b203-271a-42e3-9480-01bde1dbba79","Type":"ContainerStarted","Data":"756222b9e6a4082ab3ca052f6157d47b8bdd975637429d78493c26e315870898"} Jul 06 16:45:03.895794 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:03.895761 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722605-db4d8" event={"ID":"ea04b203-271a-42e3-9480-01bde1dbba79","Type":"ContainerStarted","Data":"33ded180002608302b6fda715e577663466287918f740c16df4ceed56d331d7f"} Jul 06 16:45:03.913589 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:03.913542 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29722605-db4d8" podStartSLOduration=1.287775898 podStartE2EDuration="3.91352693s" totalImagesPullingTime="2.625751032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:45:03.911483326 +0000 UTC m=+985.180554362" watchObservedRunningTime="2026-07-06 16:45:03.91352693 +0000 UTC m=+985.182597999" Jul 06 16:45:04.902805 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:04.902770 2555 generic.go:356] "Generic (PLEG): container finished" podID="ea04b203-271a-42e3-9480-01bde1dbba79" containerID="33ded180002608302b6fda715e577663466287918f740c16df4ceed56d331d7f" exitCode=0 Jul 06 16:45:04.903222 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:04.902841 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722605-db4d8" event={"ID":"ea04b203-271a-42e3-9480-01bde1dbba79","Type":"ContainerDied","Data":"33ded180002608302b6fda715e577663466287918f740c16df4ceed56d331d7f"} Jul 06 16:45:06.044983 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:06.044928 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722605-db4d8" Jul 06 16:45:06.157602 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:06.157574 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5xcl\" (UniqueName: \"kubernetes.io/projected/ea04b203-271a-42e3-9480-01bde1dbba79-kube-api-access-l5xcl\") pod \"ea04b203-271a-42e3-9480-01bde1dbba79\" (UID: \"ea04b203-271a-42e3-9480-01bde1dbba79\") " Jul 06 16:45:06.159726 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:06.159666 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea04b203-271a-42e3-9480-01bde1dbba79-kube-api-access-l5xcl" (OuterVolumeSpecName: "kube-api-access-l5xcl") pod "ea04b203-271a-42e3-9480-01bde1dbba79" (UID: "ea04b203-271a-42e3-9480-01bde1dbba79"). InnerVolumeSpecName "kube-api-access-l5xcl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 16:45:06.259092 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:06.259057 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5xcl\" (UniqueName: \"kubernetes.io/projected/ea04b203-271a-42e3-9480-01bde1dbba79-kube-api-access-l5xcl\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:45:06.915410 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:06.915379 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722605-db4d8" event={"ID":"ea04b203-271a-42e3-9480-01bde1dbba79","Type":"ContainerDied","Data":"756222b9e6a4082ab3ca052f6157d47b8bdd975637429d78493c26e315870898"} Jul 06 16:45:06.915410 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:06.915411 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722605-db4d8" Jul 06 16:45:06.915664 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:06.915430 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="756222b9e6a4082ab3ca052f6157d47b8bdd975637429d78493c26e315870898" Jul 06 16:45:29.316577 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:29.316541 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:45:37.759871 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:37.759832 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:45:37.829914 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:37.829879 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:45:43.164688 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:43.164644 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:45:44.698781 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:44.698739 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:45:44.822902 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:44.822865 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75bdb5777f-6466d"] Jul 06 16:45:44.823277 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:44.823264 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea04b203-271a-42e3-9480-01bde1dbba79" containerName="cleanup" Jul 06 16:45:44.823322 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:44.823279 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea04b203-271a-42e3-9480-01bde1dbba79" containerName="cleanup" Jul 06 16:45:44.823357 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:44.823349 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea04b203-271a-42e3-9480-01bde1dbba79" containerName="cleanup" Jul 06 16:45:44.825396 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:44.825381 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75bdb5777f-6466d" Jul 06 16:45:44.828241 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:44.828220 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-66c55\"" Jul 06 16:45:44.828381 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:44.828274 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 06 16:45:44.828381 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:44.828280 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 06 16:45:44.834143 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:44.834117 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75bdb5777f-6466d"] Jul 06 16:45:44.918339 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:44.918303 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db3cb52c-1ad0-481b-85b7-1a61ca7b24a4-service-ca\") pod \"maas-controller-75bdb5777f-6466d\" (UID: \"db3cb52c-1ad0-481b-85b7-1a61ca7b24a4\") " pod="opendatahub/maas-controller-75bdb5777f-6466d" Jul 06 16:45:44.918510 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:44.918418 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db3cb52c-1ad0-481b-85b7-1a61ca7b24a4-webhook-cert\") pod \"maas-controller-75bdb5777f-6466d\" (UID: \"db3cb52c-1ad0-481b-85b7-1a61ca7b24a4\") " pod="opendatahub/maas-controller-75bdb5777f-6466d" Jul 06 16:45:44.918510 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:44.918459 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7f8s\" (UniqueName: \"kubernetes.io/projected/db3cb52c-1ad0-481b-85b7-1a61ca7b24a4-kube-api-access-r7f8s\") pod \"maas-controller-75bdb5777f-6466d\" (UID: \"db3cb52c-1ad0-481b-85b7-1a61ca7b24a4\") " pod="opendatahub/maas-controller-75bdb5777f-6466d" Jul 06 16:45:45.019161 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:45.019068 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db3cb52c-1ad0-481b-85b7-1a61ca7b24a4-service-ca\") pod \"maas-controller-75bdb5777f-6466d\" (UID: \"db3cb52c-1ad0-481b-85b7-1a61ca7b24a4\") " pod="opendatahub/maas-controller-75bdb5777f-6466d" Jul 06 16:45:45.019161 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:45.019151 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db3cb52c-1ad0-481b-85b7-1a61ca7b24a4-webhook-cert\") pod \"maas-controller-75bdb5777f-6466d\" (UID: \"db3cb52c-1ad0-481b-85b7-1a61ca7b24a4\") " pod="opendatahub/maas-controller-75bdb5777f-6466d" Jul 06 16:45:45.019352 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:45.019184 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7f8s\" (UniqueName: \"kubernetes.io/projected/db3cb52c-1ad0-481b-85b7-1a61ca7b24a4-kube-api-access-r7f8s\") pod \"maas-controller-75bdb5777f-6466d\" (UID: \"db3cb52c-1ad0-481b-85b7-1a61ca7b24a4\") " pod="opendatahub/maas-controller-75bdb5777f-6466d" Jul 06 16:45:45.019715 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:45.019679 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/db3cb52c-1ad0-481b-85b7-1a61ca7b24a4-service-ca\") pod \"maas-controller-75bdb5777f-6466d\" (UID: \"db3cb52c-1ad0-481b-85b7-1a61ca7b24a4\") " pod="opendatahub/maas-controller-75bdb5777f-6466d" Jul 06 16:45:45.021674 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:45.021648 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db3cb52c-1ad0-481b-85b7-1a61ca7b24a4-webhook-cert\") pod \"maas-controller-75bdb5777f-6466d\" (UID: \"db3cb52c-1ad0-481b-85b7-1a61ca7b24a4\") " pod="opendatahub/maas-controller-75bdb5777f-6466d" Jul 06 16:45:45.027648 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:45.027629 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7f8s\" (UniqueName: \"kubernetes.io/projected/db3cb52c-1ad0-481b-85b7-1a61ca7b24a4-kube-api-access-r7f8s\") pod \"maas-controller-75bdb5777f-6466d\" (UID: \"db3cb52c-1ad0-481b-85b7-1a61ca7b24a4\") " pod="opendatahub/maas-controller-75bdb5777f-6466d" Jul 06 16:45:45.136857 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:45.136826 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75bdb5777f-6466d" Jul 06 16:45:45.274748 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:45.274722 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75bdb5777f-6466d"] Jul 06 16:45:45.276159 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:45:45.276133 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb3cb52c_1ad0_481b_85b7_1a61ca7b24a4.slice/crio-17074b0073ac43b6f310ecbd651ba2aa460a87da0c272aa0e8c01fcd28dfdc1c WatchSource:0}: Error finding container 17074b0073ac43b6f310ecbd651ba2aa460a87da0c272aa0e8c01fcd28dfdc1c: Status 404 returned error can't find the container with id 17074b0073ac43b6f310ecbd651ba2aa460a87da0c272aa0e8c01fcd28dfdc1c Jul 06 16:45:46.132568 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:46.132530 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75bdb5777f-6466d" event={"ID":"db3cb52c-1ad0-481b-85b7-1a61ca7b24a4","Type":"ContainerStarted","Data":"0541b4e7300fa1ba7bb99f8f612ff376136bb0bb81fed82b0d5805b63c2d2908"} Jul 06 16:45:46.133024 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:46.132590 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75bdb5777f-6466d" event={"ID":"db3cb52c-1ad0-481b-85b7-1a61ca7b24a4","Type":"ContainerStarted","Data":"17074b0073ac43b6f310ecbd651ba2aa460a87da0c272aa0e8c01fcd28dfdc1c"} Jul 06 16:45:46.133024 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:46.132676 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75bdb5777f-6466d" Jul 06 16:45:46.150781 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:46.150731 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75bdb5777f-6466d" podStartSLOduration=1.8244456489999998 podStartE2EDuration="2.150716022s" totalImagesPullingTime="326.270373ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:45:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:45:46.148832867 +0000 UTC m=+1027.417903907" watchObservedRunningTime="2026-07-06 16:45:46.150716022 +0000 UTC m=+1027.419787059" Jul 06 16:45:57.144614 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:45:57.144582 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75bdb5777f-6466d" Jul 06 16:46:25.824258 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:46:25.824221 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:46:25.964252 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:46:25.964218 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:46:26.066632 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:46:26.066603 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:46:31.836010 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:46:31.835902 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:46:31.953833 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:46:31.953799 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:46:32.037237 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:46:32.037192 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:46:32.196164 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:46:32.196064 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:46:37.943630 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:46:37.943598 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:46:38.010535 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:46:38.010483 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:47:33.543319 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:47:33.543290 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:48:11.026602 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:48:11.026515 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:49:42.059710 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:49:42.059623 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:50:29.817489 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:50:29.817449 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4vpk8"] Jul 06 16:50:29.818044 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:50:29.817715 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4vpk8" podUID="e7bf39b3-22b7-451a-a722-1f7d5891ceef" containerName="manager" containerID="cri-o://83ea964966b2a0843de37776cc95fc9ad783ea0961fa59b8e9d213a63432d6d9" gracePeriod=10 Jul 06 16:50:31.979392 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:50:31.979367 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4vpk8" Jul 06 16:50:32.045450 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:50:32.045429 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpfdw\" (UniqueName: \"kubernetes.io/projected/e7bf39b3-22b7-451a-a722-1f7d5891ceef-kube-api-access-tpfdw\") pod \"e7bf39b3-22b7-451a-a722-1f7d5891ceef\" (UID: \"e7bf39b3-22b7-451a-a722-1f7d5891ceef\") " Jul 06 16:50:32.045625 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:50:32.045471 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7bf39b3-22b7-451a-a722-1f7d5891ceef-extensions-socket-volume\") pod \"e7bf39b3-22b7-451a-a722-1f7d5891ceef\" (UID: \"e7bf39b3-22b7-451a-a722-1f7d5891ceef\") " Jul 06 16:50:32.045903 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:50:32.045878 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7bf39b3-22b7-451a-a722-1f7d5891ceef-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e7bf39b3-22b7-451a-a722-1f7d5891ceef" (UID: "e7bf39b3-22b7-451a-a722-1f7d5891ceef"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 16:50:32.047609 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:50:32.047587 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7bf39b3-22b7-451a-a722-1f7d5891ceef-kube-api-access-tpfdw" (OuterVolumeSpecName: "kube-api-access-tpfdw") pod "e7bf39b3-22b7-451a-a722-1f7d5891ceef" (UID: "e7bf39b3-22b7-451a-a722-1f7d5891ceef"). InnerVolumeSpecName "kube-api-access-tpfdw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 16:50:32.146593 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:50:32.146563 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpfdw\" (UniqueName: \"kubernetes.io/projected/e7bf39b3-22b7-451a-a722-1f7d5891ceef-kube-api-access-tpfdw\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:50:32.146593 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:50:32.146587 2555 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7bf39b3-22b7-451a-a722-1f7d5891ceef-extensions-socket-volume\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 16:50:32.738290 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:50:32.738251 2555 generic.go:356] "Generic (PLEG): container finished" podID="e7bf39b3-22b7-451a-a722-1f7d5891ceef" containerID="83ea964966b2a0843de37776cc95fc9ad783ea0961fa59b8e9d213a63432d6d9" exitCode=0 Jul 06 16:50:32.738290 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:50:32.738290 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4vpk8" Jul 06 16:50:32.738496 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:50:32.738314 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4vpk8" event={"ID":"e7bf39b3-22b7-451a-a722-1f7d5891ceef","Type":"ContainerDied","Data":"83ea964966b2a0843de37776cc95fc9ad783ea0961fa59b8e9d213a63432d6d9"} Jul 06 16:50:32.738496 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:50:32.738362 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4vpk8" event={"ID":"e7bf39b3-22b7-451a-a722-1f7d5891ceef","Type":"ContainerDied","Data":"798170393ce428290d08389df0eb53ec8c1d191ed3b0f434654805355648e540"} Jul 06 16:50:32.738496 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:50:32.738387 2555 scope.go:117] "RemoveContainer" containerID="83ea964966b2a0843de37776cc95fc9ad783ea0961fa59b8e9d213a63432d6d9" Jul 06 16:50:32.748630 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:50:32.748612 2555 scope.go:117] "RemoveContainer" containerID="83ea964966b2a0843de37776cc95fc9ad783ea0961fa59b8e9d213a63432d6d9" Jul 06 16:50:32.748881 ip-10-0-140-222 kubenswrapper[2555]: E0706 16:50:32.748861 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83ea964966b2a0843de37776cc95fc9ad783ea0961fa59b8e9d213a63432d6d9\": container with ID starting with 83ea964966b2a0843de37776cc95fc9ad783ea0961fa59b8e9d213a63432d6d9 not found: ID does not exist" containerID="83ea964966b2a0843de37776cc95fc9ad783ea0961fa59b8e9d213a63432d6d9" Jul 06 16:50:32.748924 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:50:32.748891 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83ea964966b2a0843de37776cc95fc9ad783ea0961fa59b8e9d213a63432d6d9"} err="failed to get container status \"83ea964966b2a0843de37776cc95fc9ad783ea0961fa59b8e9d213a63432d6d9\": rpc error: code = NotFound desc = could not find container \"83ea964966b2a0843de37776cc95fc9ad783ea0961fa59b8e9d213a63432d6d9\": container with ID starting with 83ea964966b2a0843de37776cc95fc9ad783ea0961fa59b8e9d213a63432d6d9 not found: ID does not exist" Jul 06 16:50:32.759410 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:50:32.759384 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4vpk8"] Jul 06 16:50:32.762875 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:50:32.762856 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-4vpk8"] Jul 06 16:50:33.302162 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:50:33.302124 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7bf39b3-22b7-451a-a722-1f7d5891ceef" path="/var/lib/kubelet/pods/e7bf39b3-22b7-451a-a722-1f7d5891ceef/volumes" Jul 06 16:51:31.019301 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:51:31.019262 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fgmbb"] Jul 06 16:51:31.019747 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:51:31.019643 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7bf39b3-22b7-451a-a722-1f7d5891ceef" containerName="manager" Jul 06 16:51:31.019747 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:51:31.019653 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7bf39b3-22b7-451a-a722-1f7d5891ceef" containerName="manager" Jul 06 16:51:31.019747 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:51:31.019736 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7bf39b3-22b7-451a-a722-1f7d5891ceef" containerName="manager" Jul 06 16:51:31.022653 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:51:31.022637 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fgmbb" Jul 06 16:51:31.024775 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:51:31.024755 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nbnjh\"" Jul 06 16:51:31.035568 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:51:31.035541 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fgmbb"] Jul 06 16:51:31.084991 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:51:31.084959 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/291667be-a8e9-44ed-8b03-c045ca927cf7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fgmbb\" (UID: \"291667be-a8e9-44ed-8b03-c045ca927cf7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fgmbb" Jul 06 16:51:31.085140 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:51:31.085024 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsr7b\" (UniqueName: \"kubernetes.io/projected/291667be-a8e9-44ed-8b03-c045ca927cf7-kube-api-access-bsr7b\") pod \"kuadrant-operator-controller-manager-86878c769f-fgmbb\" (UID: \"291667be-a8e9-44ed-8b03-c045ca927cf7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fgmbb" Jul 06 16:51:31.185797 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:51:31.185765 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/291667be-a8e9-44ed-8b03-c045ca927cf7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fgmbb\" (UID: \"291667be-a8e9-44ed-8b03-c045ca927cf7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fgmbb" Jul 06 16:51:31.185963 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:51:31.185816 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsr7b\" (UniqueName: \"kubernetes.io/projected/291667be-a8e9-44ed-8b03-c045ca927cf7-kube-api-access-bsr7b\") pod \"kuadrant-operator-controller-manager-86878c769f-fgmbb\" (UID: \"291667be-a8e9-44ed-8b03-c045ca927cf7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fgmbb" Jul 06 16:51:31.186169 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:51:31.186151 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/291667be-a8e9-44ed-8b03-c045ca927cf7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fgmbb\" (UID: \"291667be-a8e9-44ed-8b03-c045ca927cf7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fgmbb" Jul 06 16:51:31.194400 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:51:31.194376 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsr7b\" (UniqueName: \"kubernetes.io/projected/291667be-a8e9-44ed-8b03-c045ca927cf7-kube-api-access-bsr7b\") pod \"kuadrant-operator-controller-manager-86878c769f-fgmbb\" (UID: \"291667be-a8e9-44ed-8b03-c045ca927cf7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fgmbb" Jul 06 16:51:31.332977 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:51:31.332949 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fgmbb" Jul 06 16:51:31.481189 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:51:31.481165 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fgmbb"] Jul 06 16:51:31.483485 ip-10-0-140-222 kubenswrapper[2555]: W0706 16:51:31.483459 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod291667be_a8e9_44ed_8b03_c045ca927cf7.slice/crio-d2bf098a8050beb3559ad5e79a00bce679a25882bd45c234797a61ab204210e7 WatchSource:0}: Error finding container d2bf098a8050beb3559ad5e79a00bce679a25882bd45c234797a61ab204210e7: Status 404 returned error can't find the container with id d2bf098a8050beb3559ad5e79a00bce679a25882bd45c234797a61ab204210e7 Jul 06 16:51:32.072040 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:51:32.072008 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fgmbb" event={"ID":"291667be-a8e9-44ed-8b03-c045ca927cf7","Type":"ContainerStarted","Data":"23a73a0bfdc762e94c0fa88cab1a861f515c6b8436eb0e7bf9b7e35a31d25e8a"} Jul 06 16:51:32.072428 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:51:32.072063 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fgmbb" event={"ID":"291667be-a8e9-44ed-8b03-c045ca927cf7","Type":"ContainerStarted","Data":"d2bf098a8050beb3559ad5e79a00bce679a25882bd45c234797a61ab204210e7"} Jul 06 16:51:32.072428 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:51:32.072102 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fgmbb" Jul 06 16:51:32.090375 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:51:32.090323 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fgmbb" podStartSLOduration=2.090306088 podStartE2EDuration="2.090306088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 16:51:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 16:51:32.088122903 +0000 UTC m=+1373.357193940" watchObservedRunningTime="2026-07-06 16:51:32.090306088 +0000 UTC m=+1373.359377125" Jul 06 16:51:43.079935 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:51:43.079907 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fgmbb" Jul 06 16:52:38.151772 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:52:38.151691 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:53:31.766631 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:53:31.766582 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:53:32.735346 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:53:32.735312 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:57:44.549770 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:57:44.549733 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:57:54.239748 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:57:54.239705 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:02.533885 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:02.533832 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:07.651062 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:07.651029 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:08.354290 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:08.354254 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:08.410578 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:08.410539 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:10.556214 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:10.556176 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:10.657411 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:10.657366 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:10.996348 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:10.996245 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:16.717491 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:16.717458 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:16.816033 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:16.816004 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:16.936718 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:16.936685 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:16.997712 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:16.997621 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:18.145761 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:18.145727 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:18.239680 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:18.239642 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:18.345036 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:18.345003 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:18.779043 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:18.779004 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:18.917064 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:18.917030 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:19.016093 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:19.016062 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:20.524541 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:20.524079 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:26.240226 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:26.240190 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:26.299189 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:26.299153 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:26.409205 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:26.409164 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:26.518312 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:26.518228 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:30.506743 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:30.506709 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:32.448699 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:32.448652 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:32.521456 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:32.521423 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:32.659190 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:32.659151 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:32.716592 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:32.716497 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:34.098462 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:34.098424 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:34.401011 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:34.400892 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:34.609171 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:34.609128 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:34.686179 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:34.686098 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:35.689761 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:35.689729 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:41.988655 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:41.988609 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:42.089416 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:42.089378 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:43.211592 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:43.211552 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:43.338123 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:43.338078 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:46.563639 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:46.563607 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:49.261480 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:49.261447 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:49.319448 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:49.319418 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:49.438035 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:49.437994 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:49.548048 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:49.548009 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:50.694174 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:50.694142 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:50.786839 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:50.786806 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:50.849440 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:50.849409 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:51.240844 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:51.240807 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:51.365972 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:51.365925 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:51.485261 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:51.485228 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:52.541804 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:52.541772 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:58.140684 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:58.140647 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:58.240594 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:58.240562 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:58.318866 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:58.318834 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:58.407892 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:58.407817 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:58:59.743663 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:58:59.743613 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:59:04.169443 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:59:04.169400 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:59:04.268243 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:59:04.268209 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:59:04.632375 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:59:04.632342 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:59:04.729864 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:59:04.729823 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:59:04.829566 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:59:04.829526 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:59:06.195917 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:59:06.195872 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:59:06.496147 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:59:06.496055 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:59:11.852695 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:59:11.852654 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:59:11.916599 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:59:11.916565 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:59:12.001188 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:59:12.001156 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:59:12.100931 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:59:12.100897 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:59:12.163749 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:59:12.163659 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:59:12.558602 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:59:12.558571 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:59:39.605504 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:59:39.605462 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:59:45.268522 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:59:45.268477 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:59:45.373658 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:59:45.373621 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 16:59:45.469042 ip-10-0-140-222 kubenswrapper[2555]: I0706 16:59:45.469009 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:00.137048 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:00.136967 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722620-pd9dq"] Jul 06 17:00:00.140762 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:00.140744 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722620-pd9dq" Jul 06 17:00:00.143186 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:00.143167 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-jdcs4\"" Jul 06 17:00:00.148256 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:00.148230 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722620-pd9dq"] Jul 06 17:00:00.229161 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:00.229121 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzvkd\" (UniqueName: \"kubernetes.io/projected/0b36f51d-42f8-421c-a47d-96c64cd5928e-kube-api-access-lzvkd\") pod \"maas-api-key-cleanup-29722620-pd9dq\" (UID: \"0b36f51d-42f8-421c-a47d-96c64cd5928e\") " pod="opendatahub/maas-api-key-cleanup-29722620-pd9dq" Jul 06 17:00:00.330150 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:00.330108 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzvkd\" (UniqueName: \"kubernetes.io/projected/0b36f51d-42f8-421c-a47d-96c64cd5928e-kube-api-access-lzvkd\") pod \"maas-api-key-cleanup-29722620-pd9dq\" (UID: \"0b36f51d-42f8-421c-a47d-96c64cd5928e\") " pod="opendatahub/maas-api-key-cleanup-29722620-pd9dq" Jul 06 17:00:00.338105 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:00.338073 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzvkd\" (UniqueName: \"kubernetes.io/projected/0b36f51d-42f8-421c-a47d-96c64cd5928e-kube-api-access-lzvkd\") pod \"maas-api-key-cleanup-29722620-pd9dq\" (UID: \"0b36f51d-42f8-421c-a47d-96c64cd5928e\") " pod="opendatahub/maas-api-key-cleanup-29722620-pd9dq" Jul 06 17:00:00.452550 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:00.452468 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722620-pd9dq" Jul 06 17:00:00.795688 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:00.795662 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722620-pd9dq"] Jul 06 17:00:00.797466 ip-10-0-140-222 kubenswrapper[2555]: W0706 17:00:00.797443 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b36f51d_42f8_421c_a47d_96c64cd5928e.slice/crio-d3a2de0bd88b99c9fc85192d73988828be509d0a0706aedda9c842b7a3e1840c WatchSource:0}: Error finding container d3a2de0bd88b99c9fc85192d73988828be509d0a0706aedda9c842b7a3e1840c: Status 404 returned error can't find the container with id d3a2de0bd88b99c9fc85192d73988828be509d0a0706aedda9c842b7a3e1840c Jul 06 17:00:00.912274 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:00.912239 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722620-pd9dq" event={"ID":"0b36f51d-42f8-421c-a47d-96c64cd5928e","Type":"ContainerStarted","Data":"d3a2de0bd88b99c9fc85192d73988828be509d0a0706aedda9c842b7a3e1840c"} Jul 06 17:00:01.450750 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:01.450658 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:01.919502 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:01.919469 2555 generic.go:356] "Generic (PLEG): container finished" podID="0b36f51d-42f8-421c-a47d-96c64cd5928e" containerID="11d29643bd7f3f39d8288636ec40018326509aaa9128e1ae6c2ee55f4f94732a" exitCode=0 Jul 06 17:00:01.919685 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:01.919521 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722620-pd9dq" event={"ID":"0b36f51d-42f8-421c-a47d-96c64cd5928e","Type":"ContainerDied","Data":"11d29643bd7f3f39d8288636ec40018326509aaa9128e1ae6c2ee55f4f94732a"} Jul 06 17:00:03.062462 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:03.062437 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722620-pd9dq" Jul 06 17:00:03.157592 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:03.157565 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzvkd\" (UniqueName: \"kubernetes.io/projected/0b36f51d-42f8-421c-a47d-96c64cd5928e-kube-api-access-lzvkd\") pod \"0b36f51d-42f8-421c-a47d-96c64cd5928e\" (UID: \"0b36f51d-42f8-421c-a47d-96c64cd5928e\") " Jul 06 17:00:03.159762 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:03.159723 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b36f51d-42f8-421c-a47d-96c64cd5928e-kube-api-access-lzvkd" (OuterVolumeSpecName: "kube-api-access-lzvkd") pod "0b36f51d-42f8-421c-a47d-96c64cd5928e" (UID: "0b36f51d-42f8-421c-a47d-96c64cd5928e"). InnerVolumeSpecName "kube-api-access-lzvkd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:00:03.259228 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:03.259138 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzvkd\" (UniqueName: \"kubernetes.io/projected/0b36f51d-42f8-421c-a47d-96c64cd5928e-kube-api-access-lzvkd\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 17:00:03.934794 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:03.934766 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722620-pd9dq" Jul 06 17:00:03.935024 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:03.934789 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722620-pd9dq" event={"ID":"0b36f51d-42f8-421c-a47d-96c64cd5928e","Type":"ContainerDied","Data":"d3a2de0bd88b99c9fc85192d73988828be509d0a0706aedda9c842b7a3e1840c"} Jul 06 17:00:03.935024 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:03.934974 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d3a2de0bd88b99c9fc85192d73988828be509d0a0706aedda9c842b7a3e1840c" Jul 06 17:00:07.464219 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:07.464189 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:07.567060 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:07.567032 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:18.097308 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:18.097269 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:18.917409 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:18.917366 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:24.524617 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:24.524582 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:24.710582 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:24.710529 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:24.806695 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:24.806654 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:25.172974 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:25.172849 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:25.675377 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:25.675341 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:25.777993 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:25.777931 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:25.877888 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:25.877856 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:27.509901 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:27.509866 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:33.311524 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:33.311491 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:33.376544 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:33.376509 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:34.037719 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:34.037687 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:37.604336 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:37.604299 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:37.660641 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:37.660600 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:39.776507 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:39.776475 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:39.848798 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:39.848771 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:40.003924 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:40.003881 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:40.324014 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:40.323985 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:40.456044 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:40.455995 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:43.748199 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:43.748165 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:43.897321 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:43.897287 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:44.320356 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:44.320324 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:44.414347 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:44.414310 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:48.015643 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:48.015609 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:48.744293 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:48.744243 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:48.842308 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:48.842266 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:49.204158 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:49.204129 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:54.992808 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:54.992769 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:55.077316 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:55.077279 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:55.597921 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:55.597888 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:55.899717 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:55.899627 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:00:56.001227 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:00:56.001192 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:01:01.549225 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:01:01.549181 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:01:01.610146 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:01:01.610111 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:01:01.834271 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:01:01.834168 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:01:02.118230 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:01:02.118133 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:01:02.236157 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:01:02.236109 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:01:02.335279 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:01:02.335245 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:01:02.497862 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:01:02.497769 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:01:08.022100 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:01:08.022058 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:01:08.122656 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:01:08.122622 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:01:08.476461 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:01:08.476424 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:01:08.644087 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:01:08.644051 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:01:08.741656 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:01:08.741568 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:01:08.842577 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:01:08.842543 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:01:14.958399 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:01:14.958355 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:01:15.034997 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:01:15.034963 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:01:21.986252 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:01:21.986201 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:01:22.326822 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:01:22.326781 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:01:22.509220 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:01:22.509178 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:01:25.706377 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:01:25.706337 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:01:25.815726 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:01:25.815692 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:01:25.927993 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:01:25.927958 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:01:27.059139 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:01:27.059105 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:01:27.184119 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:01:27.184030 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:01:30.265397 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:01:30.265308 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:01:48.109538 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:01:48.109509 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:02:13.112588 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:02:13.112550 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:02:13.414131 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:02:13.414047 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:02:19.183481 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:02:19.183434 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:02:24.365075 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:02:24.365011 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:02:58.146708 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:02:58.146672 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:02:58.690425 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:02:58.690388 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:03:03.854262 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:03:03.854136 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:03:26.163786 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:03:26.163739 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:03:26.264328 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:03:26.264295 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:03:26.461097 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:03:26.460998 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:03:26.681505 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:03:26.681466 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:03:27.754935 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:03:27.754889 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:03:27.857453 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:03:27.857415 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:03:27.956015 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:03:27.955988 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:03:28.663428 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:03:28.663392 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:03:28.761783 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:03:28.761747 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:03:28.862120 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:03:28.862081 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:03:30.250924 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:03:30.250889 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:03:36.120288 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:03:36.120253 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:03:37.277928 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:03:37.277896 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:03:43.405105 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:03:43.405071 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:03:43.504491 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:03:43.504445 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:03:53.328791 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:03:53.328746 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:03:53.681376 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:03:53.681262 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:04:14.640751 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:04:14.640703 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:04:20.441494 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:04:20.441462 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:04:20.541904 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:04:20.541863 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:04:20.810044 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:04:20.810010 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:04:21.119532 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:04:21.119455 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:04:21.455048 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:04:21.454932 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:04:24.562313 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:04:24.562274 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:04:24.659745 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:04:24.659714 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:04:24.826307 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:04:24.826229 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:04:25.023583 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:04:25.023551 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:04:25.428154 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:04:25.428107 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:04:25.530452 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:04:25.530401 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:04:29.100420 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:04:29.100385 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:04:29.434330 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:04:29.434209 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:04:29.769724 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:04:29.769578 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:04:29.976273 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:04:29.976231 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:04:32.609990 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:04:32.609917 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:04:32.706767 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:04:32.706733 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:04:32.916086 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:04:32.915997 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:04:33.362837 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:04:33.362804 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:04:33.461648 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:04:33.461614 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:04:37.123623 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:04:37.123570 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:04:41.833069 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:04:41.833020 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:04:46.141898 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:04:46.141834 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:04:46.242031 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:04:46.241983 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:04:55.001611 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:04:55.001572 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:04:55.102056 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:04:55.102021 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:05:08.717109 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:08.717062 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:05:35.727339 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:35.727298 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:05:35.959427 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:35.959389 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7"] Jul 06 17:05:35.959836 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:35.959818 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b36f51d-42f8-421c-a47d-96c64cd5928e" containerName="cleanup" Jul 06 17:05:35.959836 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:35.959837 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b36f51d-42f8-421c-a47d-96c64cd5928e" containerName="cleanup" Jul 06 17:05:35.960023 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:35.959912 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b36f51d-42f8-421c-a47d-96c64cd5928e" containerName="cleanup" Jul 06 17:05:35.963157 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:35.963126 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:05:35.965283 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:35.965261 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-reuse-6ae947-openshift-default-dockercfg-k98fz\"" Jul 06 17:05:35.974226 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:35.974204 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7"] Jul 06 17:05:35.985462 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:35.985356 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:05:36.099865 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:36.099828 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-workload-socket\") pod \"e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:05:36.099865 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:36.099864 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-istio-podinfo\") pod \"e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:05:36.100130 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:36.099886 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-istio-token\") pod \"e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:05:36.100130 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:36.100003 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-credential-socket\") pod \"e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:05:36.100130 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:36.100031 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-istio-envoy\") pod \"e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:05:36.100130 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:36.100068 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hfwz\" (UniqueName: \"kubernetes.io/projected/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-kube-api-access-5hfwz\") pod \"e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:05:36.100290 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:36.100150 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-workload-certs\") pod \"e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:05:36.100290 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:36.100181 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-istio-data\") pod \"e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:05:36.100290 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:36.100204 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-istiod-ca-cert\") pod \"e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:05:36.200736 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:36.200702 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-workload-socket\") pod \"e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:05:36.200736 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:36.200738 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-istio-podinfo\") pod \"e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:05:36.201035 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:36.200764 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-istio-token\") pod \"e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:05:36.201035 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:36.200802 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-credential-socket\") pod \"e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:05:36.201035 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:36.200824 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-istio-envoy\") pod \"e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:05:36.201035 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:36.200868 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hfwz\" (UniqueName: \"kubernetes.io/projected/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-kube-api-access-5hfwz\") pod \"e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:05:36.201035 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:36.200981 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-workload-certs\") pod \"e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:05:36.201035 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:36.201026 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-istio-data\") pod \"e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:05:36.201346 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:36.201063 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-istiod-ca-cert\") pod \"e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:05:36.201346 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:36.201160 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-workload-socket\") pod \"e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:05:36.201346 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:36.201180 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-credential-socket\") pod \"e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:05:36.201508 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:36.201440 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-workload-certs\") pod \"e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:05:36.201574 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:36.201518 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-istio-data\") pod \"e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:05:36.201783 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:36.201760 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-istiod-ca-cert\") pod \"e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:05:36.203362 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:36.203345 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-istio-envoy\") pod \"e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:05:36.203475 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:36.203461 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-istio-podinfo\") pod \"e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:05:36.211400 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:36.211376 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hfwz\" (UniqueName: \"kubernetes.io/projected/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-kube-api-access-5hfwz\") pod \"e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:05:36.211687 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:36.211671 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-istio-token\") pod \"e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:05:36.276056 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:36.275966 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:05:36.417108 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:36.417081 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7"] Jul 06 17:05:36.419019 ip-10-0-140-222 kubenswrapper[2555]: W0706 17:05:36.418990 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01f0d32b_6cec_4cec_895c_3a4a42a9b2ef.slice/crio-fbc7f7aa415977f997290f53955bb407fd412af6b305362c78a05163dead146f WatchSource:0}: Error finding container fbc7f7aa415977f997290f53955bb407fd412af6b305362c78a05163dead146f: Status 404 returned error can't find the container with id fbc7f7aa415977f997290f53955bb407fd412af6b305362c78a05163dead146f Jul 06 17:05:36.421045 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:36.421031 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 17:05:36.569965 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:36.569916 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:05:36.834705 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:05:36.834612 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" event={"ID":"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef","Type":"ContainerStarted","Data":"fbc7f7aa415977f997290f53955bb407fd412af6b305362c78a05163dead146f"} Jul 06 17:06:08.746427 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:08.746341 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:06:08.848625 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:08.848596 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:06:19.730773 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:19.730738 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 17:06:19.731081 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:19.730807 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 17:06:19.731081 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:19.730836 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 17:06:20.093457 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:20.093421 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" event={"ID":"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef","Type":"ContainerStarted","Data":"37edf83ec9bcc4bd3bcc15c8ef6855bb56d1f3bffc06ac161bc3fdbaa57ceb92"} Jul 06 17:06:20.112832 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:20.112781 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" podStartSLOduration=1.803557817 podStartE2EDuration="45.112763738s" totalImagesPullingTime="43.309205921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:05:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:06:20.109936563 +0000 UTC m=+2261.379007600" watchObservedRunningTime="2026-07-06 17:06:20.112763738 +0000 UTC m=+2261.381834775" Jul 06 17:06:20.276658 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:20.276623 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:06:20.281054 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:20.281030 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:06:21.098653 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:21.098624 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:06:21.099518 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:21.099502 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:06:22.321817 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:22.321779 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:06:22.430117 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:22.430087 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:06:22.526915 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:22.526884 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:06:22.592399 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:22.592306 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:06:22.974295 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:22.974201 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:06:23.074614 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:23.074583 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:06:26.774201 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:26.774138 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:06:27.614912 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:27.614880 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:06:37.141121 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:37.141072 2555 patch_prober.go:28] interesting pod/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 06 17:06:37.141617 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:37.141150 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" podUID="01f0d32b-6cec-4cec-895c-3a4a42a9b2ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 06 17:06:39.205003 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:39.204936 2555 generic.go:356] "Generic (PLEG): container finished" podID="01f0d32b-6cec-4cec-895c-3a4a42a9b2ef" containerID="37edf83ec9bcc4bd3bcc15c8ef6855bb56d1f3bffc06ac161bc3fdbaa57ceb92" exitCode=0 Jul 06 17:06:39.205564 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:39.205050 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" event={"ID":"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef","Type":"ContainerDied","Data":"37edf83ec9bcc4bd3bcc15c8ef6855bb56d1f3bffc06ac161bc3fdbaa57ceb92"} Jul 06 17:06:39.205564 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:39.205547 2555 scope.go:117] "RemoveContainer" containerID="37edf83ec9bcc4bd3bcc15c8ef6855bb56d1f3bffc06ac161bc3fdbaa57ceb92" Jul 06 17:06:39.207511 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:39.207481 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 17:06:39.207620 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:39.207558 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 17:06:39.207620 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:39.207605 2555 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 06 17:06:40.212299 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:40.212259 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" event={"ID":"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef","Type":"ContainerStarted","Data":"ba480cd3b20c60d6ef9a245735b4b52edb015ca48bbe875ba0f313ef13b24891"} Jul 06 17:06:40.277211 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:40.277171 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:06:40.277437 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:40.277414 2555 patch_prober.go:28] interesting pod/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 06 17:06:40.277490 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:40.277465 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" podUID="01f0d32b-6cec-4cec-895c-3a4a42a9b2ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 06 17:06:41.276740 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:41.276705 2555 patch_prober.go:28] interesting pod/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 06 17:06:41.277162 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:41.276756 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" podUID="01f0d32b-6cec-4cec-895c-3a4a42a9b2ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 06 17:06:41.906770 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:41.906715 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:06:42.277110 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:42.277017 2555 patch_prober.go:28] interesting pod/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 06 17:06:42.277485 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:42.277115 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" podUID="01f0d32b-6cec-4cec-895c-3a4a42a9b2ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 06 17:06:43.277235 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:43.277198 2555 patch_prober.go:28] interesting pod/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 06 17:06:43.277703 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:43.277262 2555 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" podUID="01f0d32b-6cec-4cec-895c-3a4a42a9b2ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 06 17:06:44.279821 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:44.279790 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:06:44.280236 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:44.280126 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:06:44.280673 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:06:44.280654 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:07:04.117572 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:04.117532 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:07:04.424634 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:04.424531 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:07:04.522487 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:04.522457 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:07:05.186601 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:05.186563 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:07:09.508322 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:09.508289 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:07:42.927637 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:42.927545 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:07:45.689801 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:45.689771 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:07:46.551238 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:46.551197 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:07:51.958112 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:51.958065 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:07:52.013727 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:52.013690 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:07:52.213031 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:52.212931 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7"] Jul 06 17:07:52.213263 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:52.213235 2555 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" podUID="01f0d32b-6cec-4cec-895c-3a4a42a9b2ef" containerName="istio-proxy" containerID="cri-o://ba480cd3b20c60d6ef9a245735b4b52edb015ca48bbe875ba0f313ef13b24891" gracePeriod=30 Jul 06 17:07:52.232378 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:52.232340 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:07:52.457707 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:52.457676 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:07:53.390115 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:53.390083 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:07:54.309531 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:54.309498 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:07:54.503752 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:54.503719 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:07:54.904346 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:54.904310 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:07:55.004741 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:55.004706 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:07:55.162893 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:55.162791 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:07:57.474853 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.474792 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:07:57.537095 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.537062 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-workload-certs\") pod \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " Jul 06 17:07:57.537269 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.537104 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-istiod-ca-cert\") pod \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " Jul 06 17:07:57.537269 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.537163 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-credential-socket\") pod \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " Jul 06 17:07:57.537269 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.537200 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-istio-token\") pod \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " Jul 06 17:07:57.537269 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.537242 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hfwz\" (UniqueName: \"kubernetes.io/projected/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-kube-api-access-5hfwz\") pod \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " Jul 06 17:07:57.537269 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.537269 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-istio-envoy\") pod \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " Jul 06 17:07:57.537551 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.537321 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-istio-data\") pod \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " Jul 06 17:07:57.537551 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.537363 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-workload-socket\") pod \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " Jul 06 17:07:57.537551 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.537389 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-istio-podinfo\") pod \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\" (UID: \"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef\") " Jul 06 17:07:57.537710 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.537357 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "01f0d32b-6cec-4cec-895c-3a4a42a9b2ef" (UID: "01f0d32b-6cec-4cec-895c-3a4a42a9b2ef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:07:57.537710 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.537694 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "01f0d32b-6cec-4cec-895c-3a4a42a9b2ef" (UID: "01f0d32b-6cec-4cec-895c-3a4a42a9b2ef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 17:07:57.537909 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.537761 2555 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-workload-certs\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 17:07:57.537909 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.537626 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "01f0d32b-6cec-4cec-895c-3a4a42a9b2ef" (UID: "01f0d32b-6cec-4cec-895c-3a4a42a9b2ef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:07:57.538653 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.538563 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-istio-data" (OuterVolumeSpecName: "istio-data") pod "01f0d32b-6cec-4cec-895c-3a4a42a9b2ef" (UID: "01f0d32b-6cec-4cec-895c-3a4a42a9b2ef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:07:57.538653 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.538626 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "01f0d32b-6cec-4cec-895c-3a4a42a9b2ef" (UID: "01f0d32b-6cec-4cec-895c-3a4a42a9b2ef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:07:57.540419 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.540390 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-kube-api-access-5hfwz" (OuterVolumeSpecName: "kube-api-access-5hfwz") pod "01f0d32b-6cec-4cec-895c-3a4a42a9b2ef" (UID: "01f0d32b-6cec-4cec-895c-3a4a42a9b2ef"). InnerVolumeSpecName "kube-api-access-5hfwz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:07:57.540703 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.540675 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "01f0d32b-6cec-4cec-895c-3a4a42a9b2ef" (UID: "01f0d32b-6cec-4cec-895c-3a4a42a9b2ef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 17:07:57.541081 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.541053 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-istio-token" (OuterVolumeSpecName: "istio-token") pod "01f0d32b-6cec-4cec-895c-3a4a42a9b2ef" (UID: "01f0d32b-6cec-4cec-895c-3a4a42a9b2ef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:07:57.541240 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.541223 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "01f0d32b-6cec-4cec-895c-3a4a42a9b2ef" (UID: "01f0d32b-6cec-4cec-895c-3a4a42a9b2ef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 17:07:57.639094 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.639059 2555 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-istio-data\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 17:07:57.639094 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.639085 2555 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-workload-socket\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 17:07:57.639094 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.639094 2555 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-istio-podinfo\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 17:07:57.639094 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.639103 2555 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-istiod-ca-cert\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 17:07:57.639459 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.639111 2555 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-credential-socket\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 17:07:57.639459 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.639121 2555 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-istio-token\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 17:07:57.639459 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.639129 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hfwz\" (UniqueName: \"kubernetes.io/projected/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-kube-api-access-5hfwz\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 17:07:57.639459 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.639138 2555 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef-istio-envoy\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 17:07:57.663630 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.663601 2555 generic.go:356] "Generic (PLEG): container finished" podID="01f0d32b-6cec-4cec-895c-3a4a42a9b2ef" containerID="ba480cd3b20c60d6ef9a245735b4b52edb015ca48bbe875ba0f313ef13b24891" exitCode=0 Jul 06 17:07:57.663776 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.663654 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" Jul 06 17:07:57.663776 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.663689 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" event={"ID":"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef","Type":"ContainerDied","Data":"ba480cd3b20c60d6ef9a245735b4b52edb015ca48bbe875ba0f313ef13b24891"} Jul 06 17:07:57.663776 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.663745 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7" event={"ID":"01f0d32b-6cec-4cec-895c-3a4a42a9b2ef","Type":"ContainerDied","Data":"fbc7f7aa415977f997290f53955bb407fd412af6b305362c78a05163dead146f"} Jul 06 17:07:57.663902 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.663776 2555 scope.go:117] "RemoveContainer" containerID="ba480cd3b20c60d6ef9a245735b4b52edb015ca48bbe875ba0f313ef13b24891" Jul 06 17:07:57.673794 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.673778 2555 scope.go:117] "RemoveContainer" containerID="37edf83ec9bcc4bd3bcc15c8ef6855bb56d1f3bffc06ac161bc3fdbaa57ceb92" Jul 06 17:07:57.682708 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.682678 2555 scope.go:117] "RemoveContainer" containerID="ba480cd3b20c60d6ef9a245735b4b52edb015ca48bbe875ba0f313ef13b24891" Jul 06 17:07:57.683195 ip-10-0-140-222 kubenswrapper[2555]: E0706 17:07:57.683058 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba480cd3b20c60d6ef9a245735b4b52edb015ca48bbe875ba0f313ef13b24891\": container with ID starting with ba480cd3b20c60d6ef9a245735b4b52edb015ca48bbe875ba0f313ef13b24891 not found: ID does not exist" containerID="ba480cd3b20c60d6ef9a245735b4b52edb015ca48bbe875ba0f313ef13b24891" Jul 06 17:07:57.683195 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.683095 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba480cd3b20c60d6ef9a245735b4b52edb015ca48bbe875ba0f313ef13b24891"} err="failed to get container status \"ba480cd3b20c60d6ef9a245735b4b52edb015ca48bbe875ba0f313ef13b24891\": rpc error: code = NotFound desc = could not find container \"ba480cd3b20c60d6ef9a245735b4b52edb015ca48bbe875ba0f313ef13b24891\": container with ID starting with ba480cd3b20c60d6ef9a245735b4b52edb015ca48bbe875ba0f313ef13b24891 not found: ID does not exist" Jul 06 17:07:57.683195 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.683118 2555 scope.go:117] "RemoveContainer" containerID="37edf83ec9bcc4bd3bcc15c8ef6855bb56d1f3bffc06ac161bc3fdbaa57ceb92" Jul 06 17:07:57.683407 ip-10-0-140-222 kubenswrapper[2555]: E0706 17:07:57.683381 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37edf83ec9bcc4bd3bcc15c8ef6855bb56d1f3bffc06ac161bc3fdbaa57ceb92\": container with ID starting with 37edf83ec9bcc4bd3bcc15c8ef6855bb56d1f3bffc06ac161bc3fdbaa57ceb92 not found: ID does not exist" containerID="37edf83ec9bcc4bd3bcc15c8ef6855bb56d1f3bffc06ac161bc3fdbaa57ceb92" Jul 06 17:07:57.683476 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.683409 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37edf83ec9bcc4bd3bcc15c8ef6855bb56d1f3bffc06ac161bc3fdbaa57ceb92"} err="failed to get container status \"37edf83ec9bcc4bd3bcc15c8ef6855bb56d1f3bffc06ac161bc3fdbaa57ceb92\": rpc error: code = NotFound desc = could not find container \"37edf83ec9bcc4bd3bcc15c8ef6855bb56d1f3bffc06ac161bc3fdbaa57ceb92\": container with ID starting with 37edf83ec9bcc4bd3bcc15c8ef6855bb56d1f3bffc06ac161bc3fdbaa57ceb92 not found: ID does not exist" Jul 06 17:07:57.685874 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.685855 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7"] Jul 06 17:07:57.689153 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:57.689132 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-reuse-6ae947-openshift-default-64f57cb58c-pccm7"] Jul 06 17:07:59.303069 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:59.303034 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01f0d32b-6cec-4cec-895c-3a4a42a9b2ef" path="/var/lib/kubelet/pods/01f0d32b-6cec-4cec-895c-3a4a42a9b2ef/volumes" Jul 06 17:07:59.984218 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:07:59.984186 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:08:24.911898 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:08:24.911857 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:08:36.662325 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:08:36.662279 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:08:36.818187 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:08:36.818138 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:08:37.070682 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:08:37.070646 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:08:37.397588 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:08:37.397492 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:08:38.866269 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:08:38.866228 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:08:43.538329 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:08:43.538284 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:08:43.609374 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:08:43.609335 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:08:43.804201 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:08:43.804152 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:08:44.035553 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:08:44.035513 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:08:44.379757 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:08:44.379726 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:08:44.700016 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:08:44.699902 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:08:44.874910 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:08:44.874874 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:08:47.903114 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:08:47.903081 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:08:47.991041 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:08:47.990921 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:08:48.050547 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:08:48.050511 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:08:48.321171 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:08:48.321138 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:08:48.508690 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:08:48.508657 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:08:48.651806 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:08:48.651720 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:08:52.446073 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:08:52.446033 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:08:52.913157 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:08:52.913120 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:08:53.219364 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:08:53.219275 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:08:53.339052 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:08:53.339017 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:08:55.966481 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:08:55.966448 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:08:56.065904 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:08:56.065867 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:08:56.300020 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:08:56.299988 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:08:56.680633 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:08:56.680546 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:08:56.784143 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:08:56.784110 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:08:56.883000 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:08:56.882964 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:00.501405 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:00.501320 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:08.780764 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:08.780729 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:09.155995 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:09.155963 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:09.253838 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:09.253799 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:09.354029 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:09.353988 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:09.455270 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:09.455171 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:14.959781 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:14.959747 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:15.061685 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:15.061618 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:15.225044 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:15.224935 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:15.451275 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:15.451235 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:15.810794 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:15.810753 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:16.156772 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:16.156672 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:16.257670 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:16.257635 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:16.358643 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:16.358582 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:16.472997 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:16.472884 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:21.937616 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:21.937574 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:21.997098 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:21.997071 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:22.213898 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:22.213819 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:22.440323 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:22.440272 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:22.778709 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:22.778667 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:23.112279 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:23.112250 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:23.455205 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:23.455105 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:26.221212 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:26.221177 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:26.308641 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:26.308590 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:26.371072 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:26.371034 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:26.550084 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:26.550056 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:26.862258 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:26.862163 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:26.965058 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:26.965019 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:30.783257 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:30.783221 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:31.140683 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:31.140643 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:31.466187 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:31.466100 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:31.929108 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:31.929076 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:34.228666 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:34.228626 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:34.310861 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:34.310823 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:34.382323 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:34.382276 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:34.621588 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:34.621556 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:35.021277 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:35.021155 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:35.126454 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:35.126416 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:38.780313 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:38.780256 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:47.743684 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:47.743632 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:47.844157 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:47.844119 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:54.412165 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:54.412130 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:55.749456 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:55.749418 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:09:55.853797 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:09:55.853731 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:10:24.999241 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:10:24.999211 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:11:09.543241 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:11:09.543204 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:11:09.599143 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:11:09.599113 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:11:12.911213 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:11:12.911169 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:12:15.042760 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:12:15.042667 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:12:15.143485 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:12:15.143442 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:12:22.492229 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:12:22.492200 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:12:23.314808 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:12:23.314777 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:12:27.700588 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:12:27.700551 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:12:51.810776 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:12:51.810744 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:12:51.911424 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:12:51.911372 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:12:56.527352 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:12:56.527314 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:13:44.834458 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:13:44.834421 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:13:46.282999 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:13:46.282968 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:13:54.715460 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:13:54.715424 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:14:12.167730 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:14:12.167692 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:14:36.592803 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:14:36.592760 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:14:43.084337 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:14:43.084293 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:14:48.441868 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:14:48.441821 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:14:48.542183 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:14:48.542137 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:14:56.461041 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:14:56.461000 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:14:56.560929 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:14:56.560894 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:15:00.138072 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:00.137990 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-0874ce-29722635-m2chj"] Jul 06 17:15:00.138459 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:00.138401 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01f0d32b-6cec-4cec-895c-3a4a42a9b2ef" containerName="istio-proxy" Jul 06 17:15:00.138459 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:00.138413 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="01f0d32b-6cec-4cec-895c-3a4a42a9b2ef" containerName="istio-proxy" Jul 06 17:15:00.138459 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:00.138435 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01f0d32b-6cec-4cec-895c-3a4a42a9b2ef" containerName="istio-proxy" Jul 06 17:15:00.138459 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:00.138441 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="01f0d32b-6cec-4cec-895c-3a4a42a9b2ef" containerName="istio-proxy" Jul 06 17:15:00.138599 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:00.138500 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="01f0d32b-6cec-4cec-895c-3a4a42a9b2ef" containerName="istio-proxy" Jul 06 17:15:00.138599 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:00.138508 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="01f0d32b-6cec-4cec-895c-3a4a42a9b2ef" containerName="istio-proxy" Jul 06 17:15:00.142067 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:00.142044 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-0874ce-29722635-m2chj" Jul 06 17:15:00.143332 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:00.143310 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-d073f6-29722635-szzww"] Jul 06 17:15:00.143992 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:00.143933 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-jdcs4\"" Jul 06 17:15:00.158053 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:00.155315 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722635-kd84x"] Jul 06 17:15:00.158511 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:00.158489 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-d073f6-29722635-szzww" Jul 06 17:15:00.164754 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:00.164728 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-0874ce-29722635-m2chj"] Jul 06 17:15:00.164931 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:00.164912 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722635-kd84x" Jul 06 17:15:00.165931 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:00.165910 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-d073f6-29722635-szzww"] Jul 06 17:15:00.169023 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:00.168931 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722635-kd84x"] Jul 06 17:15:00.243045 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:00.243010 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b5jk\" (UniqueName: \"kubernetes.io/projected/2e21b345-44a1-4f4c-ac8b-453bbc39a129-kube-api-access-9b5jk\") pod \"maas-api-key-cleanup-e2e-shared-b-d073f6-29722635-szzww\" (UID: \"2e21b345-44a1-4f4c-ac8b-453bbc39a129\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-d073f6-29722635-szzww" Jul 06 17:15:00.243227 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:00.243063 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lphxp\" (UniqueName: \"kubernetes.io/projected/a2125cf4-9172-48a1-9dba-f24e009066c9-kube-api-access-lphxp\") pod \"maas-api-key-cleanup-e2e-shared-a-0874ce-29722635-m2chj\" (UID: \"a2125cf4-9172-48a1-9dba-f24e009066c9\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-0874ce-29722635-m2chj" Jul 06 17:15:00.343959 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:00.343912 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvd9j\" (UniqueName: \"kubernetes.io/projected/6998820f-fd9f-417d-8e2d-1a3c25917da2-kube-api-access-hvd9j\") pod \"maas-api-key-cleanup-29722635-kd84x\" (UID: \"6998820f-fd9f-417d-8e2d-1a3c25917da2\") " pod="opendatahub/maas-api-key-cleanup-29722635-kd84x" Jul 06 17:15:00.344170 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:00.343970 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b5jk\" (UniqueName: \"kubernetes.io/projected/2e21b345-44a1-4f4c-ac8b-453bbc39a129-kube-api-access-9b5jk\") pod \"maas-api-key-cleanup-e2e-shared-b-d073f6-29722635-szzww\" (UID: \"2e21b345-44a1-4f4c-ac8b-453bbc39a129\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-d073f6-29722635-szzww" Jul 06 17:15:00.344170 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:00.344058 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lphxp\" (UniqueName: \"kubernetes.io/projected/a2125cf4-9172-48a1-9dba-f24e009066c9-kube-api-access-lphxp\") pod \"maas-api-key-cleanup-e2e-shared-a-0874ce-29722635-m2chj\" (UID: \"a2125cf4-9172-48a1-9dba-f24e009066c9\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-0874ce-29722635-m2chj" Jul 06 17:15:00.353177 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:00.353148 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b5jk\" (UniqueName: \"kubernetes.io/projected/2e21b345-44a1-4f4c-ac8b-453bbc39a129-kube-api-access-9b5jk\") pod \"maas-api-key-cleanup-e2e-shared-b-d073f6-29722635-szzww\" (UID: \"2e21b345-44a1-4f4c-ac8b-453bbc39a129\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-d073f6-29722635-szzww" Jul 06 17:15:00.353656 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:00.353633 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lphxp\" (UniqueName: \"kubernetes.io/projected/a2125cf4-9172-48a1-9dba-f24e009066c9-kube-api-access-lphxp\") pod \"maas-api-key-cleanup-e2e-shared-a-0874ce-29722635-m2chj\" (UID: \"a2125cf4-9172-48a1-9dba-f24e009066c9\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-0874ce-29722635-m2chj" Jul 06 17:15:00.445517 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:00.445418 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvd9j\" (UniqueName: \"kubernetes.io/projected/6998820f-fd9f-417d-8e2d-1a3c25917da2-kube-api-access-hvd9j\") pod \"maas-api-key-cleanup-29722635-kd84x\" (UID: \"6998820f-fd9f-417d-8e2d-1a3c25917da2\") " pod="opendatahub/maas-api-key-cleanup-29722635-kd84x" Jul 06 17:15:00.453493 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:00.453449 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvd9j\" (UniqueName: \"kubernetes.io/projected/6998820f-fd9f-417d-8e2d-1a3c25917da2-kube-api-access-hvd9j\") pod \"maas-api-key-cleanup-29722635-kd84x\" (UID: \"6998820f-fd9f-417d-8e2d-1a3c25917da2\") " pod="opendatahub/maas-api-key-cleanup-29722635-kd84x" Jul 06 17:15:00.456171 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:00.456150 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-0874ce-29722635-m2chj" Jul 06 17:15:00.473405 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:00.473382 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-d073f6-29722635-szzww" Jul 06 17:15:00.480445 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:00.480419 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722635-kd84x" Jul 06 17:15:00.631975 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:00.631919 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-0874ce-29722635-m2chj"] Jul 06 17:15:00.633721 ip-10-0-140-222 kubenswrapper[2555]: W0706 17:15:00.633694 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2125cf4_9172_48a1_9dba_f24e009066c9.slice/crio-c5b8f95034e6394e34fcee7a36af62a592a4c822046e838e3f0ef4f51eebd830 WatchSource:0}: Error finding container c5b8f95034e6394e34fcee7a36af62a592a4c822046e838e3f0ef4f51eebd830: Status 404 returned error can't find the container with id c5b8f95034e6394e34fcee7a36af62a592a4c822046e838e3f0ef4f51eebd830 Jul 06 17:15:00.871031 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:00.870980 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-d073f6-29722635-szzww"] Jul 06 17:15:00.873370 ip-10-0-140-222 kubenswrapper[2555]: W0706 17:15:00.873342 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e21b345_44a1_4f4c_ac8b_453bbc39a129.slice/crio-790eaca0db8e965c868e53d391e9cdfcfbf9b93bd51e07efc32120dc5447cc45 WatchSource:0}: Error finding container 790eaca0db8e965c868e53d391e9cdfcfbf9b93bd51e07efc32120dc5447cc45: Status 404 returned error can't find the container with id 790eaca0db8e965c868e53d391e9cdfcfbf9b93bd51e07efc32120dc5447cc45 Jul 06 17:15:00.874457 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:00.874408 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722635-kd84x"] Jul 06 17:15:00.874911 ip-10-0-140-222 kubenswrapper[2555]: W0706 17:15:00.874884 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6998820f_fd9f_417d_8e2d_1a3c25917da2.slice/crio-c86e2ea7c69592c926e2e70631cab30d9b4d6e8eff60d4a592e2727bc1bf2c45 WatchSource:0}: Error finding container c86e2ea7c69592c926e2e70631cab30d9b4d6e8eff60d4a592e2727bc1bf2c45: Status 404 returned error can't find the container with id c86e2ea7c69592c926e2e70631cab30d9b4d6e8eff60d4a592e2727bc1bf2c45 Jul 06 17:15:01.056638 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:01.056609 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-0874ce-29722635-m2chj" event={"ID":"a2125cf4-9172-48a1-9dba-f24e009066c9","Type":"ContainerStarted","Data":"34ab4e4a95098b8a4dc754b2453eaf1127af53ef17fc47d12901e631548603e2"} Jul 06 17:15:01.056804 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:01.056666 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-0874ce-29722635-m2chj" event={"ID":"a2125cf4-9172-48a1-9dba-f24e009066c9","Type":"ContainerStarted","Data":"c5b8f95034e6394e34fcee7a36af62a592a4c822046e838e3f0ef4f51eebd830"} Jul 06 17:15:01.057874 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:01.057850 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-d073f6-29722635-szzww" event={"ID":"2e21b345-44a1-4f4c-ac8b-453bbc39a129","Type":"ContainerStarted","Data":"790eaca0db8e965c868e53d391e9cdfcfbf9b93bd51e07efc32120dc5447cc45"} Jul 06 17:15:01.059064 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:01.059033 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722635-kd84x" event={"ID":"6998820f-fd9f-417d-8e2d-1a3c25917da2","Type":"ContainerStarted","Data":"c86e2ea7c69592c926e2e70631cab30d9b4d6e8eff60d4a592e2727bc1bf2c45"} Jul 06 17:15:01.072040 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:01.072000 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-0874ce-29722635-m2chj" podStartSLOduration=1.071986419 podStartE2EDuration="1.071986419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 17:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:15:01.069604037 +0000 UTC m=+2782.338675079" watchObservedRunningTime="2026-07-06 17:15:01.071986419 +0000 UTC m=+2782.341057455" Jul 06 17:15:02.066544 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:02.066514 2555 generic.go:356] "Generic (PLEG): container finished" podID="a2125cf4-9172-48a1-9dba-f24e009066c9" containerID="34ab4e4a95098b8a4dc754b2453eaf1127af53ef17fc47d12901e631548603e2" exitCode=0 Jul 06 17:15:02.067036 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:02.066565 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-0874ce-29722635-m2chj" event={"ID":"a2125cf4-9172-48a1-9dba-f24e009066c9","Type":"ContainerDied","Data":"34ab4e4a95098b8a4dc754b2453eaf1127af53ef17fc47d12901e631548603e2"} Jul 06 17:15:02.068178 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:02.068159 2555 generic.go:356] "Generic (PLEG): container finished" podID="2e21b345-44a1-4f4c-ac8b-453bbc39a129" containerID="1d4bf69014763c8455c8ef0975d7329ae1f5487f22abeeb20a87382661ae62aa" exitCode=0 Jul 06 17:15:02.068280 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:02.068239 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-d073f6-29722635-szzww" event={"ID":"2e21b345-44a1-4f4c-ac8b-453bbc39a129","Type":"ContainerDied","Data":"1d4bf69014763c8455c8ef0975d7329ae1f5487f22abeeb20a87382661ae62aa"} Jul 06 17:15:02.069772 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:02.069752 2555 generic.go:356] "Generic (PLEG): container finished" podID="6998820f-fd9f-417d-8e2d-1a3c25917da2" containerID="0edf0e790475697957a0cbbba3aceb0e58ec6c2adb8085e47bcaad293ff6d38a" exitCode=0 Jul 06 17:15:02.069873 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:02.069794 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722635-kd84x" event={"ID":"6998820f-fd9f-417d-8e2d-1a3c25917da2","Type":"ContainerDied","Data":"0edf0e790475697957a0cbbba3aceb0e58ec6c2adb8085e47bcaad293ff6d38a"} Jul 06 17:15:03.219517 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:03.219491 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-0874ce-29722635-m2chj" Jul 06 17:15:03.277229 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:03.277164 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-d073f6-29722635-szzww" Jul 06 17:15:03.281415 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:03.281392 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722635-kd84x" Jul 06 17:15:03.374762 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:03.374664 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lphxp\" (UniqueName: \"kubernetes.io/projected/a2125cf4-9172-48a1-9dba-f24e009066c9-kube-api-access-lphxp\") pod \"a2125cf4-9172-48a1-9dba-f24e009066c9\" (UID: \"a2125cf4-9172-48a1-9dba-f24e009066c9\") " Jul 06 17:15:03.374762 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:03.374723 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvd9j\" (UniqueName: \"kubernetes.io/projected/6998820f-fd9f-417d-8e2d-1a3c25917da2-kube-api-access-hvd9j\") pod \"6998820f-fd9f-417d-8e2d-1a3c25917da2\" (UID: \"6998820f-fd9f-417d-8e2d-1a3c25917da2\") " Jul 06 17:15:03.375046 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:03.374779 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9b5jk\" (UniqueName: \"kubernetes.io/projected/2e21b345-44a1-4f4c-ac8b-453bbc39a129-kube-api-access-9b5jk\") pod \"2e21b345-44a1-4f4c-ac8b-453bbc39a129\" (UID: \"2e21b345-44a1-4f4c-ac8b-453bbc39a129\") " Jul 06 17:15:03.377063 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:03.377037 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e21b345-44a1-4f4c-ac8b-453bbc39a129-kube-api-access-9b5jk" (OuterVolumeSpecName: "kube-api-access-9b5jk") pod "2e21b345-44a1-4f4c-ac8b-453bbc39a129" (UID: "2e21b345-44a1-4f4c-ac8b-453bbc39a129"). InnerVolumeSpecName "kube-api-access-9b5jk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:15:03.377163 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:03.377059 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6998820f-fd9f-417d-8e2d-1a3c25917da2-kube-api-access-hvd9j" (OuterVolumeSpecName: "kube-api-access-hvd9j") pod "6998820f-fd9f-417d-8e2d-1a3c25917da2" (UID: "6998820f-fd9f-417d-8e2d-1a3c25917da2"). InnerVolumeSpecName "kube-api-access-hvd9j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:15:03.377163 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:03.377090 2555 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2125cf4-9172-48a1-9dba-f24e009066c9-kube-api-access-lphxp" (OuterVolumeSpecName: "kube-api-access-lphxp") pod "a2125cf4-9172-48a1-9dba-f24e009066c9" (UID: "a2125cf4-9172-48a1-9dba-f24e009066c9"). InnerVolumeSpecName "kube-api-access-lphxp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 17:15:03.476569 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:03.476515 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9b5jk\" (UniqueName: \"kubernetes.io/projected/2e21b345-44a1-4f4c-ac8b-453bbc39a129-kube-api-access-9b5jk\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 17:15:03.476569 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:03.476550 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lphxp\" (UniqueName: \"kubernetes.io/projected/a2125cf4-9172-48a1-9dba-f24e009066c9-kube-api-access-lphxp\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 17:15:03.476569 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:03.476567 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvd9j\" (UniqueName: \"kubernetes.io/projected/6998820f-fd9f-417d-8e2d-1a3c25917da2-kube-api-access-hvd9j\") on node \"ip-10-0-140-222.ec2.internal\" DevicePath \"\"" Jul 06 17:15:04.082706 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:04.082667 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722635-kd84x" Jul 06 17:15:04.082706 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:04.082689 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722635-kd84x" event={"ID":"6998820f-fd9f-417d-8e2d-1a3c25917da2","Type":"ContainerDied","Data":"c86e2ea7c69592c926e2e70631cab30d9b4d6e8eff60d4a592e2727bc1bf2c45"} Jul 06 17:15:04.082969 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:04.082767 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c86e2ea7c69592c926e2e70631cab30d9b4d6e8eff60d4a592e2727bc1bf2c45" Jul 06 17:15:04.084001 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:04.083980 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-0874ce-29722635-m2chj" Jul 06 17:15:04.084126 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:04.084015 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-0874ce-29722635-m2chj" event={"ID":"a2125cf4-9172-48a1-9dba-f24e009066c9","Type":"ContainerDied","Data":"c5b8f95034e6394e34fcee7a36af62a592a4c822046e838e3f0ef4f51eebd830"} Jul 06 17:15:04.084126 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:04.084061 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5b8f95034e6394e34fcee7a36af62a592a4c822046e838e3f0ef4f51eebd830" Jul 06 17:15:04.085437 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:04.085420 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-d073f6-29722635-szzww" Jul 06 17:15:04.085528 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:04.085432 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-d073f6-29722635-szzww" event={"ID":"2e21b345-44a1-4f4c-ac8b-453bbc39a129","Type":"ContainerDied","Data":"790eaca0db8e965c868e53d391e9cdfcfbf9b93bd51e07efc32120dc5447cc45"} Jul 06 17:15:04.085528 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:04.085471 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="790eaca0db8e965c868e53d391e9cdfcfbf9b93bd51e07efc32120dc5447cc45" Jul 06 17:15:20.789804 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:20.789766 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:15:21.693787 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:21.693744 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:15:27.466749 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:27.466692 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:15:27.866887 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:27.866849 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:15:27.967476 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:27.967434 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:15:28.111025 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:28.110988 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-0874ce-29722635-m2chj"] Jul 06 17:15:28.113345 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:28.113317 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:15:28.114021 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:28.114000 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-0874ce-29722635-m2chj"] Jul 06 17:15:29.302230 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:29.302199 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2125cf4-9172-48a1-9dba-f24e009066c9" path="/var/lib/kubelet/pods/a2125cf4-9172-48a1-9dba-f24e009066c9/volumes" Jul 06 17:15:32.938620 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:32.938572 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:15:38.642894 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:38.642852 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:15:38.940459 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:38.940378 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:15:39.176213 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:39.176176 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:15:39.372132 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:39.372099 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:15:39.835283 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:39.835236 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:15:39.933012 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:39.932979 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:15:40.033696 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:40.033659 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:15:40.127381 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:40.127282 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-d073f6-29722635-szzww"] Jul 06 17:15:40.127381 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:40.127352 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-d073f6-29722635-szzww"] Jul 06 17:15:40.132594 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:40.132556 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:15:41.302557 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:41.302516 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e21b345-44a1-4f4c-ac8b-453bbc39a129" path="/var/lib/kubelet/pods/2e21b345-44a1-4f4c-ac8b-453bbc39a129/volumes" Jul 06 17:15:45.678019 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:45.677981 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:15:45.865159 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:45.865086 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:15:45.968408 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:45.968310 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:15:46.191605 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:46.191568 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:15:51.999559 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:51.999528 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722605-db4d8_ea04b203-271a-42e3-9480-01bde1dbba79/cleanup/0.log" Jul 06 17:15:52.120820 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:52.120790 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722620-pd9dq_0b36f51d-42f8-421c-a47d-96c64cd5928e/cleanup/0.log" Jul 06 17:15:52.246361 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:52.246329 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722635-kd84x_6998820f-fd9f-417d-8e2d-1a3c25917da2/cleanup/0.log" Jul 06 17:15:52.394429 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:52.394396 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-75bdb5777f-6466d_db3cb52c-1ad0-481b-85b7-1a61ca7b24a4/manager/0.log" Jul 06 17:15:52.941434 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:52.941365 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb6889b66-wn5m5_178930b2-46c5-4565-ac97-946b2ea1b015/copy-manifests/0.log" Jul 06 17:15:52.963983 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:52.963928 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb6889b66-wn5m5_178930b2-46c5-4565-ac97-946b2ea1b015/manager/0.log" Jul 06 17:15:53.228252 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:53.228170 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-g7xdk_51315930-951d-4794-94c3-fea496f88aad/postgres/0.log" Jul 06 17:15:54.131329 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:54.131296 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5_3bc7247c-6828-4d27-97dd-ceb7fecc9377/util/0.log" Jul 06 17:15:54.139675 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:54.139639 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5_3bc7247c-6828-4d27-97dd-ceb7fecc9377/pull/0.log" Jul 06 17:15:54.146780 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:54.146678 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5_3bc7247c-6828-4d27-97dd-ceb7fecc9377/extract/0.log" Jul 06 17:15:54.262161 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:54.262128 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8_b66e74f7-5670-4edf-a020-f26f310b3d60/util/0.log" Jul 06 17:15:54.269008 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:54.268977 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8_b66e74f7-5670-4edf-a020-f26f310b3d60/pull/0.log" Jul 06 17:15:54.275987 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:54.275966 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8_b66e74f7-5670-4edf-a020-f26f310b3d60/extract/0.log" Jul 06 17:15:54.394231 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:54.394145 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf_2e40881b-0a53-4413-9dfa-51371af7dcf5/util/0.log" Jul 06 17:15:54.401232 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:54.401204 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf_2e40881b-0a53-4413-9dfa-51371af7dcf5/pull/0.log" Jul 06 17:15:54.409797 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:54.409774 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf_2e40881b-0a53-4413-9dfa-51371af7dcf5/extract/0.log" Jul 06 17:15:54.542933 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:54.542905 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd_6d3cc162-d1c5-4084-8137-a95baa651ca7/pull/0.log" Jul 06 17:15:54.550527 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:54.550502 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd_6d3cc162-d1c5-4084-8137-a95baa651ca7/extract/0.log" Jul 06 17:15:54.557729 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:54.557708 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd_6d3cc162-d1c5-4084-8137-a95baa651ca7/util/0.log" Jul 06 17:15:54.833369 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:54.833338 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-9mn9v_fdd650b4-fa3a-402f-9bb7-e72526f213c1/manager/0.log" Jul 06 17:15:55.209173 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:55.209097 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-t2sr9_6143e2b5-42c6-4511-ab11-f735cd42fff9/registry-server/0.log" Jul 06 17:15:55.347322 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:55.347287 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fgmbb_291667be-a8e9-44ed-8b03-c045ca927cf7/manager/0.log" Jul 06 17:15:56.082348 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:56.082283 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-p9d2z_386d2c59-227d-4f7d-9074-8ad1be90384a/discovery/0.log" Jul 06 17:15:56.196530 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:56.196497 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75577b88c-dvhj4_dc2383c3-10e9-4407-ba1d-fab1ac05c225/kube-auth-proxy/0.log" Jul 06 17:15:56.722252 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:56.722217 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-k7nxx_4628caff-24fd-4c97-b04e-17163a771267/payload-processing/0.log" Jul 06 17:15:56.847321 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:56.847289 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7d69cf4657-pdgx6_b3e38ae9-126b-4c58-ac65-3f00859768f4/router/0.log" Jul 06 17:15:57.358998 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:57.358967 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-9nch4_2e7a6615-e067-4ef7-a4ac-1ec27b9bbc90/main/0.log" Jul 06 17:15:57.508979 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:15:57.508932 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-qd8lz_79542ff8-0016-4d35-915b-a208c89b9195/main/0.log" Jul 06 17:16:02.493754 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:02.493718 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:16:02.593070 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:02.593037 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:16:05.424243 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:05.424211 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-k69gf_bc02cd8b-c9cd-4cd1-ae92-184380a1bec2/global-pull-secret-syncer/0.log" Jul 06 17:16:05.557602 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:05.557571 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" Jul 06 17:16:05.692099 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:05.692009 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-222.ec2.internal_ff5280726b858514ce49d9d3bdaeb9d2/haproxy/0.log" Jul 06 17:16:09.860627 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:09.860589 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5_3bc7247c-6828-4d27-97dd-ceb7fecc9377/extract/0.log" Jul 06 17:16:09.885069 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:09.885040 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5_3bc7247c-6828-4d27-97dd-ceb7fecc9377/util/0.log" Jul 06 17:16:09.916247 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:09.916217 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759684m5_3bc7247c-6828-4d27-97dd-ceb7fecc9377/pull/0.log" Jul 06 17:16:09.941309 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:09.941265 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8_b66e74f7-5670-4edf-a020-f26f310b3d60/extract/0.log" Jul 06 17:16:09.966549 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:09.966522 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8_b66e74f7-5670-4edf-a020-f26f310b3d60/util/0.log" Jul 06 17:16:09.998381 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:09.998353 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n9nm8_b66e74f7-5670-4edf-a020-f26f310b3d60/pull/0.log" Jul 06 17:16:10.041327 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:10.041299 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf_2e40881b-0a53-4413-9dfa-51371af7dcf5/extract/0.log" Jul 06 17:16:10.064717 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:10.064679 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf_2e40881b-0a53-4413-9dfa-51371af7dcf5/util/0.log" Jul 06 17:16:10.096982 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:10.096952 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hrwwf_2e40881b-0a53-4413-9dfa-51371af7dcf5/pull/0.log" Jul 06 17:16:10.129818 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:10.129728 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd_6d3cc162-d1c5-4084-8137-a95baa651ca7/extract/0.log" Jul 06 17:16:10.153850 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:10.153823 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd_6d3cc162-d1c5-4084-8137-a95baa651ca7/util/0.log" Jul 06 17:16:10.181769 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:10.181745 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h7wdd_6d3cc162-d1c5-4084-8137-a95baa651ca7/pull/0.log" Jul 06 17:16:10.227382 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:10.227349 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:16:10.326408 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:10.326368 2555 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-76qf5_629c3598-7a2a-42ee-9905-6cc9560b6c6d/konnectivity-agent/0.log" limit=1024 Jul 06 17:16:10.621207 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:10.621165 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-9mn9v_fdd650b4-fa3a-402f-9bb7-e72526f213c1/manager/0.log" Jul 06 17:16:10.742758 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:10.742729 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-t2sr9_6143e2b5-42c6-4511-ab11-f735cd42fff9/registry-server/0.log" Jul 06 17:16:10.950528 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:10.950441 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fgmbb_291667be-a8e9-44ed-8b03-c045ca927cf7/manager/0.log" Jul 06 17:16:12.742628 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:12.742560 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e12770d0-5fee-4b5e-9df3-db62ec655e3d/alertmanager/0.log" Jul 06 17:16:12.773977 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:12.773907 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e12770d0-5fee-4b5e-9df3-db62ec655e3d/config-reloader/0.log" Jul 06 17:16:12.801166 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:12.801135 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e12770d0-5fee-4b5e-9df3-db62ec655e3d/kube-rbac-proxy-web/0.log" Jul 06 17:16:12.824247 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:12.824218 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e12770d0-5fee-4b5e-9df3-db62ec655e3d/kube-rbac-proxy/0.log" Jul 06 17:16:12.854554 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:12.854526 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e12770d0-5fee-4b5e-9df3-db62ec655e3d/kube-rbac-proxy-metric/0.log" Jul 06 17:16:12.881956 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:12.881920 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e12770d0-5fee-4b5e-9df3-db62ec655e3d/prom-label-proxy/0.log" Jul 06 17:16:12.916188 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:12.916163 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e12770d0-5fee-4b5e-9df3-db62ec655e3d/init-config-reloader/0.log" Jul 06 17:16:12.969806 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:12.969780 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-z2jj5_c3bcfe9c-2960-4edd-99bb-078b967271f9/cluster-monitoring-operator/0.log" Jul 06 17:16:13.298307 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:13.298267 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-97d8m_643b4a71-d1b2-46fb-9230-e765d4b045f7/node-exporter/0.log" Jul 06 17:16:13.320121 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:13.320092 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-97d8m_643b4a71-d1b2-46fb-9230-e765d4b045f7/kube-rbac-proxy/0.log" Jul 06 17:16:13.350221 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:13.350198 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-97d8m_643b4a71-d1b2-46fb-9230-e765d4b045f7/init-textfile/0.log" Jul 06 17:16:13.796922 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:13.796895 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-j2qdt_e0521ef3-5c23-436b-b48f-80c894b48ff7/prometheus-operator-admission-webhook/0.log" Jul 06 17:16:13.847258 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:13.847226 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-97498c9d-lm82s_1497c949-e6ab-49ad-a4cf-d7548b9ad4c8/telemeter-client/0.log" Jul 06 17:16:13.905847 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:13.905825 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-97498c9d-lm82s_1497c949-e6ab-49ad-a4cf-d7548b9ad4c8/reload/0.log" Jul 06 17:16:13.956535 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:13.956508 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-97498c9d-lm82s_1497c949-e6ab-49ad-a4cf-d7548b9ad4c8/kube-rbac-proxy/0.log" Jul 06 17:16:13.989044 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:13.989013 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b5bcc8cc5-b8kdj_72bd5db7-ca8c-4b28-909b-19583ad7159e/thanos-query/0.log" Jul 06 17:16:14.013893 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:14.013822 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b5bcc8cc5-b8kdj_72bd5db7-ca8c-4b28-909b-19583ad7159e/kube-rbac-proxy-web/0.log" Jul 06 17:16:14.037479 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:14.037458 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b5bcc8cc5-b8kdj_72bd5db7-ca8c-4b28-909b-19583ad7159e/kube-rbac-proxy/0.log" Jul 06 17:16:14.060015 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:14.059997 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b5bcc8cc5-b8kdj_72bd5db7-ca8c-4b28-909b-19583ad7159e/prom-label-proxy/0.log" Jul 06 17:16:14.082567 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:14.082551 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b5bcc8cc5-b8kdj_72bd5db7-ca8c-4b28-909b-19583ad7159e/kube-rbac-proxy-rules/0.log" Jul 06 17:16:14.107709 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:14.107683 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b5bcc8cc5-b8kdj_72bd5db7-ca8c-4b28-909b-19583ad7159e/kube-rbac-proxy-metrics/0.log" Jul 06 17:16:15.654156 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:15.654111 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8rtpd/perf-node-gather-daemonset-fhhgm"] Jul 06 17:16:15.654587 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:15.654572 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e21b345-44a1-4f4c-ac8b-453bbc39a129" containerName="cleanup" Jul 06 17:16:15.654633 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:15.654590 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e21b345-44a1-4f4c-ac8b-453bbc39a129" containerName="cleanup" Jul 06 17:16:15.654633 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:15.654599 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6998820f-fd9f-417d-8e2d-1a3c25917da2" containerName="cleanup" Jul 06 17:16:15.654633 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:15.654605 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="6998820f-fd9f-417d-8e2d-1a3c25917da2" containerName="cleanup" Jul 06 17:16:15.654633 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:15.654614 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2125cf4-9172-48a1-9dba-f24e009066c9" containerName="cleanup" Jul 06 17:16:15.654633 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:15.654619 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2125cf4-9172-48a1-9dba-f24e009066c9" containerName="cleanup" Jul 06 17:16:15.654783 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:15.654700 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e21b345-44a1-4f4c-ac8b-453bbc39a129" containerName="cleanup" Jul 06 17:16:15.654783 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:15.654712 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2125cf4-9172-48a1-9dba-f24e009066c9" containerName="cleanup" Jul 06 17:16:15.654783 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:15.654717 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="6998820f-fd9f-417d-8e2d-1a3c25917da2" containerName="cleanup" Jul 06 17:16:15.658196 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:15.658181 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-fhhgm" Jul 06 17:16:15.660161 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:15.660138 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8rtpd\"/\"openshift-service-ca.crt\"" Jul 06 17:16:15.660700 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:15.660684 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8rtpd\"/\"kube-root-ca.crt\"" Jul 06 17:16:15.660750 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:15.660684 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8rtpd\"/\"default-dockercfg-52s7j\"" Jul 06 17:16:15.668401 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:15.668380 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8rtpd/perf-node-gather-daemonset-fhhgm"] Jul 06 17:16:15.734842 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:15.734806 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46dhj\" (UniqueName: \"kubernetes.io/projected/e4e98fb8-c1a5-4c00-a0a8-84ca71aafbf9-kube-api-access-46dhj\") pod \"perf-node-gather-daemonset-fhhgm\" (UID: \"e4e98fb8-c1a5-4c00-a0a8-84ca71aafbf9\") " pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-fhhgm" Jul 06 17:16:15.735057 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:15.734846 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e4e98fb8-c1a5-4c00-a0a8-84ca71aafbf9-podres\") pod \"perf-node-gather-daemonset-fhhgm\" (UID: \"e4e98fb8-c1a5-4c00-a0a8-84ca71aafbf9\") " pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-fhhgm" Jul 06 17:16:15.735057 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:15.734995 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e4e98fb8-c1a5-4c00-a0a8-84ca71aafbf9-proc\") pod \"perf-node-gather-daemonset-fhhgm\" (UID: \"e4e98fb8-c1a5-4c00-a0a8-84ca71aafbf9\") " pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-fhhgm" Jul 06 17:16:15.735057 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:15.735016 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e4e98fb8-c1a5-4c00-a0a8-84ca71aafbf9-lib-modules\") pod \"perf-node-gather-daemonset-fhhgm\" (UID: \"e4e98fb8-c1a5-4c00-a0a8-84ca71aafbf9\") " pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-fhhgm" Jul 06 17:16:15.735057 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:15.735044 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4e98fb8-c1a5-4c00-a0a8-84ca71aafbf9-sys\") pod \"perf-node-gather-daemonset-fhhgm\" (UID: \"e4e98fb8-c1a5-4c00-a0a8-84ca71aafbf9\") " pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-fhhgm" Jul 06 17:16:15.836524 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:15.836491 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e4e98fb8-c1a5-4c00-a0a8-84ca71aafbf9-proc\") pod \"perf-node-gather-daemonset-fhhgm\" (UID: \"e4e98fb8-c1a5-4c00-a0a8-84ca71aafbf9\") " pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-fhhgm" Jul 06 17:16:15.836524 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:15.836523 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e4e98fb8-c1a5-4c00-a0a8-84ca71aafbf9-lib-modules\") pod \"perf-node-gather-daemonset-fhhgm\" (UID: \"e4e98fb8-c1a5-4c00-a0a8-84ca71aafbf9\") " pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-fhhgm" Jul 06 17:16:15.836763 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:15.836547 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4e98fb8-c1a5-4c00-a0a8-84ca71aafbf9-sys\") pod \"perf-node-gather-daemonset-fhhgm\" (UID: \"e4e98fb8-c1a5-4c00-a0a8-84ca71aafbf9\") " pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-fhhgm" Jul 06 17:16:15.836763 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:15.836611 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46dhj\" (UniqueName: \"kubernetes.io/projected/e4e98fb8-c1a5-4c00-a0a8-84ca71aafbf9-kube-api-access-46dhj\") pod \"perf-node-gather-daemonset-fhhgm\" (UID: \"e4e98fb8-c1a5-4c00-a0a8-84ca71aafbf9\") " pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-fhhgm" Jul 06 17:16:15.836763 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:15.836621 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e4e98fb8-c1a5-4c00-a0a8-84ca71aafbf9-proc\") pod \"perf-node-gather-daemonset-fhhgm\" (UID: \"e4e98fb8-c1a5-4c00-a0a8-84ca71aafbf9\") " pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-fhhgm" Jul 06 17:16:15.836763 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:15.836636 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e4e98fb8-c1a5-4c00-a0a8-84ca71aafbf9-podres\") pod \"perf-node-gather-daemonset-fhhgm\" (UID: \"e4e98fb8-c1a5-4c00-a0a8-84ca71aafbf9\") " pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-fhhgm" Jul 06 17:16:15.836763 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:15.836702 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e4e98fb8-c1a5-4c00-a0a8-84ca71aafbf9-sys\") pod \"perf-node-gather-daemonset-fhhgm\" (UID: \"e4e98fb8-c1a5-4c00-a0a8-84ca71aafbf9\") " pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-fhhgm" Jul 06 17:16:15.836763 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:15.836702 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e4e98fb8-c1a5-4c00-a0a8-84ca71aafbf9-lib-modules\") pod \"perf-node-gather-daemonset-fhhgm\" (UID: \"e4e98fb8-c1a5-4c00-a0a8-84ca71aafbf9\") " pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-fhhgm" Jul 06 17:16:15.836763 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:15.836706 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e4e98fb8-c1a5-4c00-a0a8-84ca71aafbf9-podres\") pod \"perf-node-gather-daemonset-fhhgm\" (UID: \"e4e98fb8-c1a5-4c00-a0a8-84ca71aafbf9\") " pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-fhhgm" Jul 06 17:16:15.843480 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:15.843454 2555 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46dhj\" (UniqueName: \"kubernetes.io/projected/e4e98fb8-c1a5-4c00-a0a8-84ca71aafbf9-kube-api-access-46dhj\") pod \"perf-node-gather-daemonset-fhhgm\" (UID: \"e4e98fb8-c1a5-4c00-a0a8-84ca71aafbf9\") " pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-fhhgm" Jul 06 17:16:15.969051 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:15.968977 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-fhhgm" Jul 06 17:16:16.109625 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:16.109594 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8rtpd/perf-node-gather-daemonset-fhhgm"] Jul 06 17:16:16.111329 ip-10-0-140-222 kubenswrapper[2555]: W0706 17:16:16.111280 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode4e98fb8_c1a5_4c00_a0a8_84ca71aafbf9.slice/crio-37a1df04ed8f1dd533db775ba47789bc049afc4144d492ec356760cc722c0e1c WatchSource:0}: Error finding container 37a1df04ed8f1dd533db775ba47789bc049afc4144d492ec356760cc722c0e1c: Status 404 returned error can't find the container with id 37a1df04ed8f1dd533db775ba47789bc049afc4144d492ec356760cc722c0e1c Jul 06 17:16:16.511111 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:16.511011 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-fhhgm" event={"ID":"e4e98fb8-c1a5-4c00-a0a8-84ca71aafbf9","Type":"ContainerStarted","Data":"f84bb973bb0e4490c8f36e3c58685855098222518bea0c33826bac2a45ae5cc5"} Jul 06 17:16:16.511111 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:16.511073 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-fhhgm" event={"ID":"e4e98fb8-c1a5-4c00-a0a8-84ca71aafbf9","Type":"ContainerStarted","Data":"37a1df04ed8f1dd533db775ba47789bc049afc4144d492ec356760cc722c0e1c"} Jul 06 17:16:16.511111 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:16.511096 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-fhhgm" Jul 06 17:16:16.526416 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:16.526367 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-fhhgm" podStartSLOduration=1.5263524240000002 podStartE2EDuration="1.526352424s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 17:16:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 17:16:16.523814022 +0000 UTC m=+2857.792885059" watchObservedRunningTime="2026-07-06 17:16:16.526352424 +0000 UTC m=+2857.795423461" Jul 06 17:16:16.580600 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:16.580571 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7cdcb85c55-nwh89_96f95c5b-bf9c-44ee-ab8f-92a0b3f6ad14/console/0.log" Jul 06 17:16:16.621682 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:16.621644 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-mf8hj_a4b49e16-f55c-42e6-971d-cad8ebfde1fe/download-server/0.log" Jul 06 17:16:17.226603 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:17.226571 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-847cq_24f30770-a9ab-418a-bca1-e867f0f905b0/volume-data-source-validator/0.log" Jul 06 17:16:18.367512 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:18.367477 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hbxj8_9f53e144-c856-4edf-92a9-bacbe1b5d03e/dns/0.log" Jul 06 17:16:18.389537 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:18.389505 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hbxj8_9f53e144-c856-4edf-92a9-bacbe1b5d03e/kube-rbac-proxy/0.log" Jul 06 17:16:18.466364 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:18.466338 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qq68r_3ceed420-7d00-4dc3-85fd-0fe2db980e33/dns-node-resolver/0.log" Jul 06 17:16:19.063827 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:19.063767 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4r7fj_e2070c7e-34d0-42d4-a85a-aea1b7d4e08c/node-ca/0.log" Jul 06 17:16:20.261162 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:20.261107 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-p9d2z_386d2c59-227d-4f7d-9074-8ad1be90384a/discovery/0.log" Jul 06 17:16:20.284331 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:20.284304 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75577b88c-dvhj4_dc2383c3-10e9-4407-ba1d-fab1ac05c225/kube-auth-proxy/0.log" Jul 06 17:16:20.512360 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:20.512270 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-k7nxx_4628caff-24fd-4c97-b04e-17163a771267/payload-processing/0.log" Jul 06 17:16:20.537915 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:20.537869 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7d69cf4657-pdgx6_b3e38ae9-126b-4c58-ac65-3f00859768f4/router/0.log" Jul 06 17:16:21.238921 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:21.238888 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6zmcw_7d109c3a-bd70-4cce-bb25-73238bd1f2af/serve-healthcheck-canary/0.log" Jul 06 17:16:21.929285 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:21.929256 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t6vgq_ee4780a2-31fd-47ce-a3d5-e44d3016ef5d/kube-rbac-proxy/0.log" Jul 06 17:16:21.951773 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:21.951739 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t6vgq_ee4780a2-31fd-47ce-a3d5-e44d3016ef5d/exporter/0.log" Jul 06 17:16:21.974775 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:21.974748 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t6vgq_ee4780a2-31fd-47ce-a3d5-e44d3016ef5d/extractor/0.log" Jul 06 17:16:22.527416 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:22.527384 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8rtpd/perf-node-gather-daemonset-fhhgm" Jul 06 17:16:24.384064 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:24.384033 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722605-db4d8_ea04b203-271a-42e3-9480-01bde1dbba79/cleanup/0.log" Jul 06 17:16:24.408215 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:24.408184 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722620-pd9dq_0b36f51d-42f8-421c-a47d-96c64cd5928e/cleanup/0.log" Jul 06 17:16:24.433949 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:24.433922 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722635-kd84x_6998820f-fd9f-417d-8e2d-1a3c25917da2/cleanup/0.log" Jul 06 17:16:24.599818 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:24.599788 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-75bdb5777f-6466d_db3cb52c-1ad0-481b-85b7-1a61ca7b24a4/manager/0.log" Jul 06 17:16:24.865711 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:24.865672 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb6889b66-wn5m5_178930b2-46c5-4565-ac97-946b2ea1b015/manager/0.log" Jul 06 17:16:24.886393 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:24.886369 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb6889b66-wn5m5_178930b2-46c5-4565-ac97-946b2ea1b015/copy-manifests/0.log" Jul 06 17:16:24.971512 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:24.971486 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-g7xdk_51315930-951d-4794-94c3-fea496f88aad/postgres/0.log" Jul 06 17:16:26.324495 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:26.324461 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-p9d2z_386d2c59-227d-4f7d-9074-8ad1be90384a/discovery/0.log" Jul 06 17:16:26.335226 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:26.335203 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75577b88c-dvhj4_dc2383c3-10e9-4407-ba1d-fab1ac05c225/kube-auth-proxy/0.log" Jul 06 17:16:26.522267 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:26.522242 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-k7nxx_4628caff-24fd-4c97-b04e-17163a771267/payload-processing/0.log" Jul 06 17:16:26.540531 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:26.540499 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7d69cf4657-pdgx6_b3e38ae9-126b-4c58-ac65-3f00859768f4/router/0.log" Jul 06 17:16:27.998167 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:27.998123 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-p9d2z_386d2c59-227d-4f7d-9074-8ad1be90384a/discovery/0.log" Jul 06 17:16:28.017441 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:28.017420 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75577b88c-dvhj4_dc2383c3-10e9-4407-ba1d-fab1ac05c225/kube-auth-proxy/0.log" Jul 06 17:16:28.215546 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:28.215517 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-k7nxx_4628caff-24fd-4c97-b04e-17163a771267/payload-processing/0.log" Jul 06 17:16:28.238094 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:28.238071 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7d69cf4657-pdgx6_b3e38ae9-126b-4c58-ac65-3f00859768f4/router/0.log" Jul 06 17:16:32.028780 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:32.028685 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-z9bg9_a96ad9ee-55e2-46e8-96a1-381dd5af2a2e/kube-storage-version-migrator-operator/1.log" Jul 06 17:16:32.030384 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:32.030362 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-z9bg9_a96ad9ee-55e2-46e8-96a1-381dd5af2a2e/kube-storage-version-migrator-operator/0.log" Jul 06 17:16:33.073130 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:33.073099 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4h5nh_195c23ea-51e7-41ab-ad83-265bb8bdd209/kube-multus-additional-cni-plugins/0.log" Jul 06 17:16:33.097741 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:33.097714 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4h5nh_195c23ea-51e7-41ab-ad83-265bb8bdd209/egress-router-binary-copy/0.log" Jul 06 17:16:33.121433 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:33.121410 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4h5nh_195c23ea-51e7-41ab-ad83-265bb8bdd209/cni-plugins/0.log" Jul 06 17:16:33.143841 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:33.143814 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4h5nh_195c23ea-51e7-41ab-ad83-265bb8bdd209/bond-cni-plugin/0.log" Jul 06 17:16:33.166799 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:33.166733 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4h5nh_195c23ea-51e7-41ab-ad83-265bb8bdd209/routeoverride-cni/0.log" Jul 06 17:16:33.190058 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:33.190034 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4h5nh_195c23ea-51e7-41ab-ad83-265bb8bdd209/whereabouts-cni-bincopy/0.log" Jul 06 17:16:33.213789 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:33.213774 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4h5nh_195c23ea-51e7-41ab-ad83-265bb8bdd209/whereabouts-cni/0.log" Jul 06 17:16:33.654691 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:33.654659 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-szz2c_0739ad82-cf16-49a1-acf8-3dd957b76036/kube-multus/0.log" Jul 06 17:16:33.775116 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:33.775084 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rj9l8_0948aaf4-b68e-4587-9a7c-a71b5fb43dda/network-metrics-daemon/0.log" Jul 06 17:16:33.795467 ip-10-0-140-222 kubenswrapper[2555]: I0706 17:16:33.795444 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rj9l8_0948aaf4-b68e-4587-9a7c-a71b5fb43dda/kube-rbac-proxy/0.log"