Jul 06 00:59:18.321101 ip-10-0-135-61 systemd[1]: Starting Kubernetes Kubelet... Jul 06 00:59:18.709861 ip-10-0-135-61 kubenswrapper[2553]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 00:59:18.709861 ip-10-0-135-61 kubenswrapper[2553]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 00:59:18.709861 ip-10-0-135-61 kubenswrapper[2553]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 00:59:18.709861 ip-10-0-135-61 kubenswrapper[2553]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 00:59:18.709861 ip-10-0-135-61 kubenswrapper[2553]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 00:59:18.710520 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.709855 2553 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 00:59:18.713366 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713351 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 00:59:18.713366 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713365 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 00:59:18.713434 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713369 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 00:59:18.713434 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713372 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 00:59:18.713434 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713375 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 00:59:18.713434 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713378 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 00:59:18.713434 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713380 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 00:59:18.713434 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713384 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 00:59:18.713434 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713386 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 00:59:18.713434 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713389 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 00:59:18.713434 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713392 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 00:59:18.713434 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713394 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 00:59:18.713434 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713397 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 00:59:18.713434 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713399 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 00:59:18.713434 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713402 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 00:59:18.713434 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713405 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 00:59:18.713434 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713416 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 00:59:18.713434 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713419 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 00:59:18.713434 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713421 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 00:59:18.713434 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713424 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 00:59:18.713434 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713427 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 00:59:18.713434 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713429 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 00:59:18.713920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713432 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 00:59:18.713920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713434 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 00:59:18.713920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713438 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 00:59:18.713920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713440 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 00:59:18.713920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713444 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 00:59:18.713920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713447 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 00:59:18.713920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713450 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 00:59:18.713920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713452 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 00:59:18.713920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713455 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 00:59:18.713920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713458 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 00:59:18.713920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713460 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 00:59:18.713920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713464 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 00:59:18.713920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713468 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 00:59:18.713920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713472 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 00:59:18.713920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713475 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 00:59:18.713920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713477 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 00:59:18.713920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713480 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 00:59:18.713920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713483 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 00:59:18.713920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713485 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 00:59:18.713920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713488 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 00:59:18.714385 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713490 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 00:59:18.714385 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713493 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 00:59:18.714385 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713495 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 00:59:18.714385 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713498 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 00:59:18.714385 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713501 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 00:59:18.714385 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713503 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 00:59:18.714385 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713506 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 00:59:18.714385 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713508 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 00:59:18.714385 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713510 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 00:59:18.714385 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713513 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 00:59:18.714385 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713516 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 00:59:18.714385 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713518 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 00:59:18.714385 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713520 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 00:59:18.714385 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713524 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 06 00:59:18.714385 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713527 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 00:59:18.714385 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713529 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 00:59:18.714385 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713532 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 00:59:18.714385 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713535 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 00:59:18.714385 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713537 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 00:59:18.714385 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713539 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 00:59:18.714868 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713542 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 00:59:18.714868 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713545 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 00:59:18.714868 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713547 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 00:59:18.714868 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713550 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 00:59:18.714868 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713552 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 00:59:18.714868 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713555 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 00:59:18.714868 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713557 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 00:59:18.714868 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713559 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 00:59:18.714868 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713562 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 00:59:18.714868 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713565 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 00:59:18.714868 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713568 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 00:59:18.714868 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713570 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 00:59:18.714868 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713573 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 00:59:18.714868 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713576 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 00:59:18.714868 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713580 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 00:59:18.714868 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713583 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 00:59:18.714868 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713586 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 00:59:18.714868 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713589 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 00:59:18.714868 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713592 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 00:59:18.715320 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713594 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 00:59:18.715320 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713597 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 00:59:18.715320 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713599 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 00:59:18.715320 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713602 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 00:59:18.715320 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713605 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 00:59:18.715320 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713607 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 00:59:18.715320 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713610 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 00:59:18.715320 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713615 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 00:59:18.715320 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713618 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 00:59:18.715320 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713621 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 00:59:18.715320 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713624 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 00:59:18.715320 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713627 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 00:59:18.715320 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713630 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 00:59:18.715320 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713632 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 00:59:18.715320 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713635 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 00:59:18.715320 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713637 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 00:59:18.715320 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713640 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 00:59:18.715320 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.713642 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 00:59:18.715320 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714331 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 00:59:18.715785 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714338 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 00:59:18.715785 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714341 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 00:59:18.715785 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714344 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 00:59:18.715785 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714347 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 00:59:18.715785 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714350 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 00:59:18.715785 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714355 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 00:59:18.715785 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714360 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 00:59:18.715785 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714363 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 06 00:59:18.715785 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714366 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 00:59:18.715785 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714369 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 00:59:18.715785 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714371 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 00:59:18.715785 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714374 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 00:59:18.715785 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714377 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 00:59:18.715785 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714379 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 00:59:18.715785 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714382 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 00:59:18.715785 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714385 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 00:59:18.715785 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714388 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 00:59:18.715785 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714391 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 00:59:18.715785 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714394 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 00:59:18.715785 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714398 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 00:59:18.716286 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714400 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 00:59:18.716286 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714403 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 00:59:18.716286 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714406 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 00:59:18.716286 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714409 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 00:59:18.716286 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714412 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 00:59:18.716286 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714415 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 00:59:18.716286 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714417 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 00:59:18.716286 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714420 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 00:59:18.716286 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714422 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 00:59:18.716286 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714425 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 00:59:18.716286 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714428 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 00:59:18.716286 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714430 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 00:59:18.716286 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714432 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 00:59:18.716286 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714435 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 00:59:18.716286 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714437 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 00:59:18.716286 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714440 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 00:59:18.716286 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714443 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 00:59:18.716286 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714446 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 00:59:18.716286 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714450 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 00:59:18.716286 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714454 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 00:59:18.716760 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714456 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 00:59:18.716760 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714459 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 00:59:18.716760 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714461 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 00:59:18.716760 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714464 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 00:59:18.716760 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714466 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 00:59:18.716760 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714469 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 00:59:18.716760 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714472 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 00:59:18.716760 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714474 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 00:59:18.716760 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714477 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 00:59:18.716760 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714480 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 00:59:18.716760 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714482 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 00:59:18.716760 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714485 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 00:59:18.716760 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714488 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 00:59:18.716760 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714490 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 00:59:18.716760 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714493 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 00:59:18.716760 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714495 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 00:59:18.716760 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714499 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 00:59:18.716760 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714501 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 00:59:18.716760 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714504 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 00:59:18.716760 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714506 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 00:59:18.717337 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714509 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 00:59:18.717337 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714511 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 00:59:18.717337 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714514 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 00:59:18.717337 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714516 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 00:59:18.717337 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714519 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 00:59:18.717337 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714521 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 00:59:18.717337 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714524 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 00:59:18.717337 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714527 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 00:59:18.717337 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714529 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 00:59:18.717337 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714532 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 00:59:18.717337 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714535 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 00:59:18.717337 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714538 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 00:59:18.717337 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714540 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 00:59:18.717337 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714543 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 00:59:18.717337 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714545 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 00:59:18.717337 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714548 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 00:59:18.717337 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714550 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 00:59:18.717337 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714553 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 00:59:18.717337 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714555 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 00:59:18.717337 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714558 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 00:59:18.717815 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714560 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 00:59:18.717815 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714564 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 00:59:18.717815 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714567 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 00:59:18.717815 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714569 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 00:59:18.717815 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714572 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 00:59:18.717815 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714574 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 00:59:18.717815 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714577 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 00:59:18.717815 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714580 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 00:59:18.717815 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714582 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 00:59:18.717815 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714585 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 00:59:18.717815 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714587 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 00:59:18.717815 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714591 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 00:59:18.717815 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714595 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 00:59:18.717815 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714597 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 00:59:18.717815 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714600 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 00:59:18.717815 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714602 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 00:59:18.717815 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714605 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 00:59:18.717815 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.714607 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 00:59:18.717815 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715012 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 00:59:18.718299 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715019 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 00:59:18.718299 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715023 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 00:59:18.718299 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715025 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 00:59:18.718299 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715029 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 00:59:18.718299 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715032 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 00:59:18.718299 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715034 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 00:59:18.718299 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715037 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 00:59:18.718299 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715041 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 00:59:18.718299 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715043 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 00:59:18.718299 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715046 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 00:59:18.718299 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715048 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 00:59:18.718299 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715051 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 00:59:18.718299 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715053 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 00:59:18.718299 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715056 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 00:59:18.718299 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715059 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 00:59:18.718299 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715062 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 00:59:18.718299 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715065 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 00:59:18.718299 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715067 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 00:59:18.718299 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715070 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 06 00:59:18.718299 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715073 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 00:59:18.718791 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715075 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 00:59:18.718791 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715078 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 00:59:18.718791 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715082 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 00:59:18.718791 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715085 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 00:59:18.718791 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715087 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 00:59:18.718791 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715090 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 00:59:18.718791 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715092 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 00:59:18.718791 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715095 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 00:59:18.718791 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715097 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 00:59:18.718791 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715100 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 00:59:18.718791 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715106 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 00:59:18.718791 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715109 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 00:59:18.718791 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715111 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 00:59:18.718791 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715113 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 00:59:18.718791 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715116 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 00:59:18.718791 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715119 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 00:59:18.718791 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715122 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 00:59:18.718791 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715124 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 00:59:18.718791 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715126 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 00:59:18.719243 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715129 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 00:59:18.719243 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715132 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 00:59:18.719243 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715135 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 00:59:18.719243 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715137 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 00:59:18.719243 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715140 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 00:59:18.719243 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715142 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 00:59:18.719243 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715145 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 00:59:18.719243 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715147 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 00:59:18.719243 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715150 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 00:59:18.719243 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715152 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 00:59:18.719243 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715154 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 00:59:18.719243 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715157 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 00:59:18.719243 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715159 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 00:59:18.719243 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715162 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 00:59:18.719243 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715164 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 00:59:18.719243 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715167 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 00:59:18.719243 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715169 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 00:59:18.719243 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715172 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 00:59:18.719243 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715175 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 00:59:18.719243 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715177 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 00:59:18.719728 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715181 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 00:59:18.719728 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715185 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 00:59:18.719728 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715188 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 00:59:18.719728 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715192 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 00:59:18.719728 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715194 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 00:59:18.719728 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715197 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 00:59:18.719728 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715200 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 00:59:18.719728 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715202 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 00:59:18.719728 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715205 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 00:59:18.719728 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715209 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 00:59:18.719728 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715213 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 00:59:18.719728 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715216 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 00:59:18.719728 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715219 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 00:59:18.719728 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715222 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 00:59:18.719728 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715225 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 00:59:18.719728 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715228 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 00:59:18.719728 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715231 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 00:59:18.719728 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715233 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 00:59:18.719728 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715236 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 00:59:18.720242 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715238 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 00:59:18.720242 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715242 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 00:59:18.720242 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715245 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 00:59:18.720242 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715247 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 00:59:18.720242 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715250 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 00:59:18.720242 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715252 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 00:59:18.720242 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715255 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 00:59:18.720242 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715257 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 00:59:18.720242 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715259 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 00:59:18.720242 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715262 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 00:59:18.720242 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715265 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 00:59:18.720242 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715267 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 00:59:18.720242 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715269 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 00:59:18.720242 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715272 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 00:59:18.720242 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715274 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 00:59:18.720242 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715277 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 00:59:18.720242 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715280 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 00:59:18.720242 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715283 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 00:59:18.720242 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715286 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 00:59:18.720242 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715288 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 00:59:18.720714 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715358 2553 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 00:59:18.720714 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715365 2553 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 00:59:18.720714 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715371 2553 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 00:59:18.720714 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715375 2553 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 00:59:18.720714 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715380 2553 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 00:59:18.720714 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715383 2553 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 00:59:18.720714 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715387 2553 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 00:59:18.720714 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715391 2553 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 00:59:18.720714 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715395 2553 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 00:59:18.720714 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715397 2553 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 00:59:18.720714 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715401 2553 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 00:59:18.720714 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715404 2553 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 00:59:18.720714 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715407 2553 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 00:59:18.720714 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715410 2553 flags.go:64] FLAG: --cgroup-root="" Jul 06 00:59:18.720714 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715413 2553 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 00:59:18.720714 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715416 2553 flags.go:64] FLAG: --client-ca-file="" Jul 06 00:59:18.720714 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715419 2553 flags.go:64] FLAG: --cloud-provider="external" Jul 06 00:59:18.720714 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715422 2553 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 00:59:18.720714 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715426 2553 flags.go:64] FLAG: --cluster-domain="" Jul 06 00:59:18.720714 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715429 2553 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 00:59:18.720714 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715432 2553 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 00:59:18.720714 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715435 2553 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 00:59:18.720714 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715438 2553 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 00:59:18.720714 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715442 2553 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 00:59:18.721348 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715445 2553 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 00:59:18.721348 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715448 2553 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 00:59:18.721348 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715451 2553 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 00:59:18.721348 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715454 2553 flags.go:64] FLAG: --contention-profiling="false" Jul 06 00:59:18.721348 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715459 2553 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 00:59:18.721348 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715462 2553 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 00:59:18.721348 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715465 2553 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 00:59:18.721348 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715468 2553 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 00:59:18.721348 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715472 2553 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 00:59:18.721348 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715475 2553 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 00:59:18.721348 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715478 2553 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 00:59:18.721348 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715481 2553 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 00:59:18.721348 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715484 2553 flags.go:64] FLAG: --enable-server="true" Jul 06 00:59:18.721348 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715487 2553 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 00:59:18.721348 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715491 2553 flags.go:64] FLAG: --event-burst="100" Jul 06 00:59:18.721348 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715494 2553 flags.go:64] FLAG: --event-qps="50" Jul 06 00:59:18.721348 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715497 2553 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 00:59:18.721348 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715500 2553 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 00:59:18.721348 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715503 2553 flags.go:64] FLAG: --eviction-hard="" Jul 06 00:59:18.721348 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715506 2553 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 00:59:18.721348 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715509 2553 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 00:59:18.721348 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715512 2553 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 00:59:18.721348 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715515 2553 flags.go:64] FLAG: --eviction-soft="" Jul 06 00:59:18.721348 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715518 2553 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 00:59:18.721348 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715520 2553 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 00:59:18.722093 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715523 2553 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 00:59:18.722093 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715526 2553 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 00:59:18.722093 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715529 2553 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 00:59:18.722093 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715532 2553 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 00:59:18.722093 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715534 2553 flags.go:64] FLAG: --feature-gates="" Jul 06 00:59:18.722093 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715538 2553 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 00:59:18.722093 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715541 2553 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 00:59:18.722093 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715544 2553 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 00:59:18.722093 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715548 2553 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 00:59:18.722093 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715554 2553 flags.go:64] FLAG: --healthz-port="10248" Jul 06 00:59:18.722093 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715557 2553 flags.go:64] FLAG: --help="false" Jul 06 00:59:18.722093 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715561 2553 flags.go:64] FLAG: --hostname-override="ip-10-0-135-61.ec2.internal" Jul 06 00:59:18.722093 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715564 2553 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 00:59:18.722093 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715567 2553 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 00:59:18.722093 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715570 2553 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 00:59:18.722093 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715573 2553 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 00:59:18.722093 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715576 2553 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 00:59:18.722093 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715579 2553 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 00:59:18.722093 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715582 2553 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 00:59:18.722093 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715585 2553 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 00:59:18.722093 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715588 2553 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 00:59:18.722093 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715592 2553 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 00:59:18.722093 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715595 2553 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 00:59:18.722093 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715597 2553 flags.go:64] FLAG: --kube-reserved="" Jul 06 00:59:18.722753 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715601 2553 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 00:59:18.722753 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715603 2553 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 00:59:18.722753 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715606 2553 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 00:59:18.722753 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715609 2553 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 00:59:18.722753 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715612 2553 flags.go:64] FLAG: --lock-file="" Jul 06 00:59:18.722753 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715615 2553 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 00:59:18.722753 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715618 2553 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 00:59:18.722753 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715621 2553 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 00:59:18.722753 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715626 2553 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 00:59:18.722753 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715629 2553 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 00:59:18.722753 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715632 2553 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 00:59:18.722753 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715634 2553 flags.go:64] FLAG: --logging-format="text" Jul 06 00:59:18.722753 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715637 2553 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 00:59:18.722753 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715641 2553 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 00:59:18.722753 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715643 2553 flags.go:64] FLAG: --manifest-url="" Jul 06 00:59:18.722753 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715646 2553 flags.go:64] FLAG: --manifest-url-header="" Jul 06 00:59:18.722753 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715650 2553 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 00:59:18.722753 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715654 2553 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 00:59:18.722753 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715658 2553 flags.go:64] FLAG: --max-pods="110" Jul 06 00:59:18.722753 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715663 2553 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 00:59:18.722753 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715665 2553 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 00:59:18.722753 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715668 2553 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 00:59:18.722753 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715671 2553 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 00:59:18.722753 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715674 2553 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 00:59:18.722753 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715677 2553 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 00:59:18.723443 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715679 2553 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 00:59:18.723443 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715686 2553 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 00:59:18.723443 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715689 2553 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 00:59:18.723443 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715692 2553 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 00:59:18.723443 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715695 2553 flags.go:64] FLAG: --pod-cidr="" Jul 06 00:59:18.723443 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715709 2553 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 00:59:18.723443 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715715 2553 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 00:59:18.723443 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715717 2553 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 00:59:18.723443 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715721 2553 flags.go:64] FLAG: --pods-per-core="0" Jul 06 00:59:18.723443 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715723 2553 flags.go:64] FLAG: --port="10250" Jul 06 00:59:18.723443 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715726 2553 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 00:59:18.723443 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715729 2553 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06586cfbf85bb5bfb" Jul 06 00:59:18.723443 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715732 2553 flags.go:64] FLAG: --qos-reserved="" Jul 06 00:59:18.723443 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715735 2553 flags.go:64] FLAG: --read-only-port="10255" Jul 06 00:59:18.723443 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715738 2553 flags.go:64] FLAG: --register-node="true" Jul 06 00:59:18.723443 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715741 2553 flags.go:64] FLAG: --register-with-taints="" Jul 06 00:59:18.723443 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715748 2553 flags.go:64] FLAG: --registry-burst="10" Jul 06 00:59:18.723443 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715751 2553 flags.go:64] FLAG: --registry-qps="5" Jul 06 00:59:18.723443 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715754 2553 flags.go:64] FLAG: --reserved-cpus="" Jul 06 00:59:18.723443 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715757 2553 flags.go:64] FLAG: --reserved-memory="" Jul 06 00:59:18.723443 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715760 2553 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 00:59:18.723443 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715763 2553 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 00:59:18.723443 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715766 2553 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 00:59:18.723443 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715769 2553 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 00:59:18.723443 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715772 2553 flags.go:64] FLAG: --runonce="false" Jul 06 00:59:18.724213 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715776 2553 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 00:59:18.724213 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715781 2553 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 00:59:18.724213 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715784 2553 flags.go:64] FLAG: --seccomp-default="false" Jul 06 00:59:18.724213 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715787 2553 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 00:59:18.724213 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715790 2553 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 00:59:18.724213 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715793 2553 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 00:59:18.724213 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715796 2553 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 00:59:18.724213 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715799 2553 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 00:59:18.724213 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715803 2553 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 00:59:18.724213 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715805 2553 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 00:59:18.724213 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715808 2553 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 00:59:18.724213 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715811 2553 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 00:59:18.724213 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715814 2553 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 00:59:18.724213 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715818 2553 flags.go:64] FLAG: --system-cgroups="" Jul 06 00:59:18.724213 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715821 2553 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 00:59:18.724213 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715838 2553 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 00:59:18.724213 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715841 2553 flags.go:64] FLAG: --tls-cert-file="" Jul 06 00:59:18.724213 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715843 2553 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 00:59:18.724213 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715848 2553 flags.go:64] FLAG: --tls-min-version="" Jul 06 00:59:18.724213 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715850 2553 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 00:59:18.724213 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715853 2553 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 00:59:18.724213 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715856 2553 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 00:59:18.724213 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715859 2553 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 00:59:18.724213 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715862 2553 flags.go:64] FLAG: --v="2" Jul 06 00:59:18.724213 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715866 2553 flags.go:64] FLAG: --version="false" Jul 06 00:59:18.724920 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715870 2553 flags.go:64] FLAG: --vmodule="" Jul 06 00:59:18.724920 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715873 2553 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 00:59:18.724920 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.715876 2553 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 00:59:18.724920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715986 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 00:59:18.724920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715990 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 00:59:18.724920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715993 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 00:59:18.724920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.715996 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 00:59:18.724920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716000 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 00:59:18.724920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716003 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 00:59:18.724920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716006 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 00:59:18.724920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716008 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 00:59:18.724920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716011 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 00:59:18.724920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716013 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 00:59:18.724920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716016 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 00:59:18.724920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716019 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 00:59:18.724920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716021 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 00:59:18.724920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716024 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 00:59:18.724920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716026 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 00:59:18.724920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716029 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 00:59:18.724920 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716031 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 00:59:18.725440 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716034 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 00:59:18.725440 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716037 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 00:59:18.725440 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716040 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 00:59:18.725440 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716042 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 00:59:18.725440 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716045 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 00:59:18.725440 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716048 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 00:59:18.725440 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716050 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 00:59:18.725440 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716052 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 00:59:18.725440 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716055 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 00:59:18.725440 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716058 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 00:59:18.725440 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716060 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 00:59:18.725440 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716063 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 00:59:18.725440 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716067 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 00:59:18.725440 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716071 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 00:59:18.725440 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716074 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 00:59:18.725440 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716077 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 00:59:18.725440 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716080 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 00:59:18.725440 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716083 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 00:59:18.725440 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716086 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 00:59:18.725440 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716090 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 00:59:18.725988 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716093 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 00:59:18.725988 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716095 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 00:59:18.725988 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716098 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 00:59:18.725988 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716101 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 00:59:18.725988 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716103 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 00:59:18.725988 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716106 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 00:59:18.725988 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716108 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 00:59:18.725988 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716112 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 00:59:18.725988 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716115 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 00:59:18.725988 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716118 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 00:59:18.725988 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716121 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 06 00:59:18.725988 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716124 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 00:59:18.725988 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716127 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 00:59:18.725988 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716129 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 00:59:18.725988 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716132 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 00:59:18.725988 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716135 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 00:59:18.725988 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716138 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 00:59:18.725988 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716140 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 00:59:18.725988 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716143 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 00:59:18.726449 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716145 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 00:59:18.726449 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716148 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 00:59:18.726449 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716150 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 00:59:18.726449 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716153 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 00:59:18.726449 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716156 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 00:59:18.726449 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716158 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 00:59:18.726449 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716161 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 00:59:18.726449 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716164 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 00:59:18.726449 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716167 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 00:59:18.726449 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716171 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 00:59:18.726449 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716173 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 00:59:18.726449 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716176 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 00:59:18.726449 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716180 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 00:59:18.726449 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716183 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 00:59:18.726449 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716185 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 00:59:18.726449 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716188 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 00:59:18.726449 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716190 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 00:59:18.726449 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716193 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 00:59:18.726449 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716195 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 00:59:18.726449 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716198 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 00:59:18.726933 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716201 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 00:59:18.726933 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716203 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 00:59:18.726933 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716206 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 00:59:18.726933 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716208 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 00:59:18.726933 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716211 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 00:59:18.726933 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716213 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 00:59:18.726933 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716216 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 00:59:18.726933 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716218 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 00:59:18.726933 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716221 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 00:59:18.726933 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716224 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 00:59:18.726933 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716226 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 00:59:18.726933 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716229 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 00:59:18.726933 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716231 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 00:59:18.726933 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716234 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 00:59:18.726933 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716236 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 00:59:18.726933 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716239 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 00:59:18.726933 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716242 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 00:59:18.726933 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716244 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 00:59:18.726933 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716247 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 00:59:18.727400 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716250 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 00:59:18.727400 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716252 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 00:59:18.727400 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716254 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 00:59:18.727400 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.716257 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 00:59:18.727400 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.716263 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 00:59:18.727400 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.722744 2553 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 00:59:18.727400 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.722758 2553 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 00:59:18.727400 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.722774 2553 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 00:59:18.727400 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.722780 2553 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 00:59:18.727400 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722853 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 00:59:18.727400 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722858 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 00:59:18.727400 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722861 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 00:59:18.727400 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722864 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 00:59:18.727400 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722867 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 00:59:18.727400 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722870 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 00:59:18.727770 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722872 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 00:59:18.727770 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722877 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 00:59:18.727770 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722880 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 00:59:18.727770 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722883 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 00:59:18.727770 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722886 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 00:59:18.727770 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722888 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 00:59:18.727770 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722891 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 00:59:18.727770 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722894 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 00:59:18.727770 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722896 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 00:59:18.727770 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722899 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 00:59:18.727770 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722901 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 00:59:18.727770 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722905 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 00:59:18.727770 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722909 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 00:59:18.727770 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722912 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 00:59:18.727770 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722915 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 00:59:18.727770 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722917 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 00:59:18.727770 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722920 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 00:59:18.727770 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722923 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 00:59:18.727770 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722926 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 00:59:18.728360 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722929 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 00:59:18.728360 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722931 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 00:59:18.728360 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722934 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 00:59:18.728360 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722937 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 00:59:18.728360 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722941 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 00:59:18.728360 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722944 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 00:59:18.728360 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722947 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 00:59:18.728360 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722949 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 00:59:18.728360 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722952 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 00:59:18.728360 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722955 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 00:59:18.728360 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722957 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 00:59:18.728360 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722959 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 00:59:18.728360 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722962 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 00:59:18.728360 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722965 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 00:59:18.728360 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722967 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 00:59:18.728360 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722970 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 00:59:18.728360 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722972 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 00:59:18.728360 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722975 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 00:59:18.728360 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722977 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 00:59:18.728360 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722980 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 00:59:18.728846 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722982 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 00:59:18.728846 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722985 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 00:59:18.728846 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722988 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 00:59:18.728846 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722991 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 00:59:18.728846 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722993 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 00:59:18.728846 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722996 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 00:59:18.728846 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.722998 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 00:59:18.728846 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723001 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 00:59:18.728846 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723003 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 00:59:18.728846 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723006 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 06 00:59:18.728846 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723008 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 00:59:18.728846 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723011 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 00:59:18.728846 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723013 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 00:59:18.728846 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723016 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 00:59:18.728846 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723018 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 00:59:18.728846 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723021 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 00:59:18.728846 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723024 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 00:59:18.728846 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723027 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 00:59:18.728846 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723030 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 00:59:18.728846 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723033 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 00:59:18.729327 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723035 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 00:59:18.729327 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723038 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 00:59:18.729327 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723040 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 00:59:18.729327 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723043 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 00:59:18.729327 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723045 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 00:59:18.729327 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723048 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 00:59:18.729327 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723050 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 00:59:18.729327 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723053 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 00:59:18.729327 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723055 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 00:59:18.729327 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723058 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 00:59:18.729327 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723060 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 00:59:18.729327 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723063 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 00:59:18.729327 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723067 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 00:59:18.729327 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723070 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 00:59:18.729327 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723073 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 00:59:18.729327 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723076 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 00:59:18.729327 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723078 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 00:59:18.729327 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723081 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 00:59:18.729327 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723084 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 00:59:18.729327 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723086 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 00:59:18.729791 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723089 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 00:59:18.729791 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723092 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 00:59:18.729791 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723095 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 00:59:18.729791 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723098 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 00:59:18.729791 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723100 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 00:59:18.729791 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723103 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 00:59:18.729791 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723106 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 00:59:18.729791 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723108 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 00:59:18.729791 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723110 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 00:59:18.729791 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723113 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 00:59:18.729791 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723117 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 00:59:18.729791 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723119 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 00:59:18.729791 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723122 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 00:59:18.729791 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723125 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 00:59:18.729791 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.723129 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 00:59:18.730180 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723239 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 00:59:18.730180 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723244 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 00:59:18.730180 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723247 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 00:59:18.730180 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723255 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 00:59:18.730180 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723258 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 00:59:18.730180 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723260 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 00:59:18.730180 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723263 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 00:59:18.730180 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723266 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 00:59:18.730180 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723268 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 00:59:18.730180 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723271 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 00:59:18.730180 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723274 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 00:59:18.730180 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723276 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 00:59:18.730180 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723279 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 00:59:18.730180 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723281 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 00:59:18.730180 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723284 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 00:59:18.730180 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723286 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 00:59:18.730180 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723289 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 00:59:18.730180 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723293 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 00:59:18.730180 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723297 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 00:59:18.730630 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723300 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 00:59:18.730630 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723302 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 00:59:18.730630 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723305 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 00:59:18.730630 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723308 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 00:59:18.730630 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723311 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 00:59:18.730630 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723314 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 00:59:18.730630 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723316 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 00:59:18.730630 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723319 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 00:59:18.730630 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723321 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 00:59:18.730630 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723324 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 00:59:18.730630 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723327 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 00:59:18.730630 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723330 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 00:59:18.730630 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723332 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 00:59:18.730630 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723335 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 00:59:18.730630 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723337 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 00:59:18.730630 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723339 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 00:59:18.730630 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723342 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 00:59:18.730630 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723344 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 00:59:18.730630 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723347 2553 feature_gate.go:328] unrecognized feature gate: Example Jul 06 00:59:18.730630 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723349 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 00:59:18.731152 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723352 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 00:59:18.731152 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723355 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 00:59:18.731152 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723357 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 00:59:18.731152 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723359 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 00:59:18.731152 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723362 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 00:59:18.731152 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723364 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 00:59:18.731152 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723367 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 00:59:18.731152 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723369 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 00:59:18.731152 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723372 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 00:59:18.731152 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723374 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 00:59:18.731152 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723377 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 00:59:18.731152 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723379 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 00:59:18.731152 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723382 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 00:59:18.731152 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723384 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 00:59:18.731152 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723387 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 00:59:18.731152 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723389 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 00:59:18.731152 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723392 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 00:59:18.731152 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723395 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 00:59:18.731152 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723397 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 00:59:18.731599 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723400 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 00:59:18.731599 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723403 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 00:59:18.731599 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723406 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 00:59:18.731599 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723446 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 00:59:18.731599 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723476 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 00:59:18.731599 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723482 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 00:59:18.731599 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723486 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 00:59:18.731599 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723492 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 00:59:18.731599 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723496 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 00:59:18.731599 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723499 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 00:59:18.731599 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723503 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 00:59:18.731599 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723506 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 00:59:18.731599 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723509 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 00:59:18.731599 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723514 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 00:59:18.731599 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723517 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 00:59:18.731599 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723519 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 00:59:18.731599 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723525 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 00:59:18.731599 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723528 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 00:59:18.731599 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723531 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 00:59:18.731599 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723535 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 00:59:18.732096 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723551 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 00:59:18.732096 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723555 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 00:59:18.732096 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.723559 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 00:59:18.732096 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.725118 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 00:59:18.732096 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.725129 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 00:59:18.732096 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.725135 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 00:59:18.732096 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.725139 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 00:59:18.732096 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.725145 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 00:59:18.732096 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.725150 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 00:59:18.732096 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.725155 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 00:59:18.732096 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.725160 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 00:59:18.732096 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.725165 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 00:59:18.732096 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.725170 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 00:59:18.732096 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.725175 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 00:59:18.732096 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.725180 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 00:59:18.732096 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.725184 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 00:59:18.732096 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.725204 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 00:59:18.732096 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.725208 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 00:59:18.732096 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.725212 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 00:59:18.732096 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.725215 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 00:59:18.732569 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:18.725218 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 00:59:18.732569 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.725224 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 00:59:18.732569 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.725534 2553 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 00:59:18.732569 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.727645 2553 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 00:59:18.732569 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.730669 2553 server.go:1019] "Starting client certificate rotation" Jul 06 00:59:18.732569 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.730764 2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 00:59:18.732569 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.730790 2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 00:59:18.733328 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.733315 2553 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 00:59:18.735478 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.735462 2553 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 00:59:18.747271 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.747254 2553 log.go:25] "Validated CRI v1 runtime API" Jul 06 00:59:18.749291 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.749277 2553 log.go:25] "Validated CRI v1 image API" Jul 06 00:59:18.750081 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.750069 2553 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 00:59:18.753975 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.753958 2553 fs.go:135] Filesystem UUIDs: map[4b282e18-13d5-4389-8855-7692c3ab0acf:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c2d091c6-be37-4154-b218-d481acc95595:/dev/nvme0n1p3] Jul 06 00:59:18.754021 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.753976 2553 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 00:59:18.759725 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.759621 2553 manager.go:216] Machine: {Timestamp:2026-07-06 00:59:18.758279573 +0000 UTC m=+0.325489956 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101747 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2202eb5de76d1ed673587d166b3411 SystemUUID:ec2202eb-5de7-6d1e-d673-587d166b3411 BootID:03415637-64b1-4461-a9e9-cd9acf0d2872 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8e:66:58:42:d7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8e:66:58:42:d7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:4b:60:b9:9c:e7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 00:59:18.759725 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.759715 2553 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 00:59:18.759872 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.759788 2553 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 00:59:18.760792 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.760777 2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 00:59:18.762840 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.762805 2553 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 00:59:18.763024 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.762849 2553 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-61.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 00:59:18.763694 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.763681 2553 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 00:59:18.763746 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.763700 2553 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 00:59:18.763746 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.763711 2553 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 00:59:18.764331 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.764319 2553 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 00:59:18.765474 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.765462 2553 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 00:59:18.768105 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.768091 2553 state_mem.go:36] "Initialized new in-memory state store" Jul 06 00:59:18.768234 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.768223 2553 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 00:59:18.768294 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.768261 2553 kubelet.go:486] "Attempting to sync node with API server" Jul 06 00:59:18.768294 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.768277 2553 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 00:59:18.768376 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.768295 2553 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 00:59:18.768376 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.768310 2553 kubelet.go:398] "Adding apiserver pod source" Jul 06 00:59:18.768376 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.768323 2553 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 00:59:18.768672 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.768658 2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 00:59:18.768740 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.768682 2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 00:59:18.771885 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.771854 2553 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 00:59:18.773860 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.773821 2553 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 00:59:18.773938 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.773878 2553 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 00:59:18.774928 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.774915 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 00:59:18.774982 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.774934 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 00:59:18.774982 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.774940 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 00:59:18.774982 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.774946 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 00:59:18.774982 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.774959 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 00:59:18.774982 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.774966 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 00:59:18.774982 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.774974 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 00:59:18.774982 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.774979 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 00:59:18.775154 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.774986 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 00:59:18.775154 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.774992 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 00:59:18.775154 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.775000 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 00:59:18.775154 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.775005 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 00:59:18.775799 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.775789 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 00:59:18.775842 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.775800 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 00:59:18.779074 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.779059 2553 server.go:1268] "Started kubelet" Jul 06 00:59:18.779176 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.779147 2553 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 00:59:18.779336 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.779273 2553 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 00:59:18.779430 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.779352 2553 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 00:59:18.779430 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.779405 2553 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-61.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 00:59:18.779532 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:18.779479 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-61.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 00:59:18.779532 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:18.779516 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 00:59:18.779898 ip-10-0-135-61 systemd[1]: Started Kubernetes Kubelet. Jul 06 00:59:18.780593 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.780499 2553 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 00:59:18.781570 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.781555 2553 server.go:310] "Adding debug handlers to kubelet server" Jul 06 00:59:18.787207 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:18.787183 2553 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 00:59:18.787523 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.787502 2553 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 00:59:18.787523 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.787511 2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 00:59:18.787658 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:18.786158 2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-61.ec2.internal.18bf8d80192297c5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-61.ec2.internal,UID:ip-10-0-135-61.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-61.ec2.internal,},FirstTimestamp:2026-07-06 00:59:18.779033541 +0000 UTC m=+0.346243927,LastTimestamp:2026-07-06 00:59:18.779033541 +0000 UTC m=+0.346243927,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-61.ec2.internal,}" Jul 06 00:59:18.787658 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:18.787643 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-61.ec2.internal\" not found" Jul 06 00:59:18.788627 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.788354 2553 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 00:59:18.788627 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.788436 2553 factory.go:55] Registering systemd factory Jul 06 00:59:18.788627 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.788469 2553 factory.go:223] Registration of the systemd container factory successfully Jul 06 00:59:18.788627 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.788516 2553 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 00:59:18.788627 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.788526 2553 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 00:59:18.788886 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.788638 2553 reconstruct.go:97] "Volume reconstruction finished" Jul 06 00:59:18.788886 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.788645 2553 reconciler.go:29] "Reconciler: start to sync state" Jul 06 00:59:18.788886 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.788705 2553 factory.go:153] Registering CRI-O factory Jul 06 00:59:18.788886 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.788716 2553 factory.go:223] Registration of the crio container factory successfully Jul 06 00:59:18.788886 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.788761 2553 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 00:59:18.788886 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.788784 2553 factory.go:103] Registering Raw factory Jul 06 00:59:18.788886 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.788801 2553 manager.go:1196] Started watching for new ooms in manager Jul 06 00:59:18.789410 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.789390 2553 manager.go:349] Starting recovery of all containers Jul 06 00:59:18.792960 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:18.792934 2553 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-61.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 00:59:18.793050 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:18.793027 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 00:59:18.800717 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.800694 2553 manager.go:354] Recovery completed Jul 06 00:59:18.805747 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.805734 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 00:59:18.807391 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.807370 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-61.ec2.internal" event="NodeHasSufficientMemory" Jul 06 00:59:18.807465 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.807404 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-61.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 00:59:18.807465 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.807418 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-61.ec2.internal" event="NodeHasSufficientPID" Jul 06 00:59:18.807889 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.807877 2553 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 00:59:18.807944 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.807890 2553 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 00:59:18.807944 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.807907 2553 state_mem.go:36] "Initialized new in-memory state store" Jul 06 00:59:18.807944 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.807882 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 00:59:18.808599 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.808582 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-61.ec2.internal" event="NodeHasSufficientMemory" Jul 06 00:59:18.808648 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.808612 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-61.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 00:59:18.808648 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.808622 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-61.ec2.internal" event="NodeHasSufficientPID" Jul 06 00:59:18.809021 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.809004 2553 policy_none.go:49] "None policy: Start" Jul 06 00:59:18.809021 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.809023 2553 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 00:59:18.809148 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.809040 2553 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 00:59:18.809255 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:18.809189 2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-61.ec2.internal.18bf8d801ad33ff8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-61.ec2.internal,UID:ip-10-0-135-61.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-61.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-61.ec2.internal,},FirstTimestamp:2026-07-06 00:59:18.807388152 +0000 UTC m=+0.374598538,LastTimestamp:2026-07-06 00:59:18.807388152 +0000 UTC m=+0.374598538,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-61.ec2.internal,}" Jul 06 00:59:18.810016 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.810005 2553 policy_none.go:47] "Start" Jul 06 00:59:18.810334 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.810321 2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zmsmc" Jul 06 00:59:18.818027 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.817914 2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zmsmc" Jul 06 00:59:18.818400 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:18.818338 2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-61.ec2.internal.18bf8d801ad39d14 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-61.ec2.internal,UID:ip-10-0-135-61.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-61.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-61.ec2.internal,},FirstTimestamp:2026-07-06 00:59:18.807411988 +0000 UTC m=+0.374622374,LastTimestamp:2026-07-06 00:59:18.807411988 +0000 UTC m=+0.374622374,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-61.ec2.internal,}" Jul 06 00:59:18.838618 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.838600 2553 manager.go:337] "Starting Device Plugin manager" Jul 06 00:59:18.838708 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:18.838643 2553 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 00:59:18.838708 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.838657 2553 server.go:87] "Starting device plugin registration server" Jul 06 00:59:18.839114 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.839092 2553 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 00:59:18.839216 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.839120 2553 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 00:59:18.839274 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.839214 2553 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 00:59:18.839324 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.839295 2553 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 00:59:18.839324 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.839305 2553 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 00:59:18.839783 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:18.839752 2553 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 00:59:18.839859 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:18.839817 2553 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-61.ec2.internal\" not found" Jul 06 00:59:18.932168 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.932131 2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 00:59:18.933303 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.933288 2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 00:59:18.933368 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.933326 2553 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 00:59:18.933368 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.933347 2553 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 00:59:18.933446 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:18.933383 2553 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 00:59:18.935764 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.935742 2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 00:59:18.939597 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.939582 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 00:59:18.940369 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.940355 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-61.ec2.internal" event="NodeHasSufficientMemory" Jul 06 00:59:18.940458 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.940383 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-61.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 00:59:18.940458 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.940397 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-61.ec2.internal" event="NodeHasSufficientPID" Jul 06 00:59:18.940458 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.940418 2553 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-61.ec2.internal" Jul 06 00:59:18.949026 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:18.949006 2553 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-61.ec2.internal" Jul 06 00:59:18.949026 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:18.949027 2553 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-61.ec2.internal\": node \"ip-10-0-135-61.ec2.internal\" not found" Jul 06 00:59:18.969573 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:18.969519 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-61.ec2.internal\" not found" Jul 06 00:59:19.034164 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:19.034119 2553 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-61.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-61.ec2.internal"] Jul 06 00:59:19.034320 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:19.034224 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 00:59:19.035651 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:19.035633 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-61.ec2.internal" event="NodeHasSufficientMemory" Jul 06 00:59:19.035736 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:19.035664 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-61.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 00:59:19.035736 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:19.035673 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-61.ec2.internal" event="NodeHasSufficientPID" Jul 06 00:59:19.036849 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:19.036819 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 00:59:19.036968 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:19.036943 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-61.ec2.internal" Jul 06 00:59:19.037029 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:19.036990 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 00:59:19.037512 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:19.037496 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-61.ec2.internal" event="NodeHasSufficientMemory" Jul 06 00:59:19.037583 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:19.037517 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-61.ec2.internal" event="NodeHasSufficientMemory" Jul 06 00:59:19.037583 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:19.037522 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-61.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 00:59:19.037583 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:19.037540 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-61.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 00:59:19.037583 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:19.037554 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-61.ec2.internal" event="NodeHasSufficientPID" Jul 06 00:59:19.037583 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:19.037559 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-61.ec2.internal" event="NodeHasSufficientPID" Jul 06 00:59:19.038639 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:19.038624 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-61.ec2.internal" Jul 06 00:59:19.038719 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:19.038652 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 00:59:19.039312 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:19.039295 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-61.ec2.internal" event="NodeHasSufficientMemory" Jul 06 00:59:19.039374 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:19.039322 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-61.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 00:59:19.039374 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:19.039337 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-61.ec2.internal" event="NodeHasSufficientPID" Jul 06 00:59:19.062367 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:19.062346 2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-61.ec2.internal\" not found" node="ip-10-0-135-61.ec2.internal" Jul 06 00:59:20.619679 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:20.619655 2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-61.ec2.internal\" not found" node="ip-10-0-135-61.ec2.internal" Jul 06 00:59:20.622713 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:20.622699 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-61.ec2.internal\" not found" Jul 06 00:59:20.643379 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:20.643360 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cb82acd52a7ee3f92342ad96761e1bd7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-61.ec2.internal\" (UID: \"cb82acd52a7ee3f92342ad96761e1bd7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-61.ec2.internal" Jul 06 00:59:20.643444 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:20.643382 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb82acd52a7ee3f92342ad96761e1bd7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-61.ec2.internal\" (UID: \"cb82acd52a7ee3f92342ad96761e1bd7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-61.ec2.internal" Jul 06 00:59:20.643444 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:20.643399 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fa4fbd7fe1f0fd86fc4d5f8945ab75a3-config\") pod \"kube-apiserver-proxy-ip-10-0-135-61.ec2.internal\" (UID: \"fa4fbd7fe1f0fd86fc4d5f8945ab75a3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-61.ec2.internal" Jul 06 00:59:20.722825 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:20.722796 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-61.ec2.internal\" not found" Jul 06 00:59:20.744209 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:20.744189 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cb82acd52a7ee3f92342ad96761e1bd7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-61.ec2.internal\" (UID: \"cb82acd52a7ee3f92342ad96761e1bd7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-61.ec2.internal" Jul 06 00:59:20.744286 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:20.744214 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb82acd52a7ee3f92342ad96761e1bd7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-61.ec2.internal\" (UID: \"cb82acd52a7ee3f92342ad96761e1bd7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-61.ec2.internal" Jul 06 00:59:20.744286 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:20.744231 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fa4fbd7fe1f0fd86fc4d5f8945ab75a3-config\") pod \"kube-apiserver-proxy-ip-10-0-135-61.ec2.internal\" (UID: \"fa4fbd7fe1f0fd86fc4d5f8945ab75a3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-61.ec2.internal" Jul 06 00:59:20.744286 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:20.744277 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fa4fbd7fe1f0fd86fc4d5f8945ab75a3-config\") pod \"kube-apiserver-proxy-ip-10-0-135-61.ec2.internal\" (UID: \"fa4fbd7fe1f0fd86fc4d5f8945ab75a3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-61.ec2.internal" Jul 06 00:59:20.744400 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:20.744290 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cb82acd52a7ee3f92342ad96761e1bd7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-61.ec2.internal\" (UID: \"cb82acd52a7ee3f92342ad96761e1bd7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-61.ec2.internal" Jul 06 00:59:20.744400 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:20.744301 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb82acd52a7ee3f92342ad96761e1bd7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-61.ec2.internal\" (UID: \"cb82acd52a7ee3f92342ad96761e1bd7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-61.ec2.internal" Jul 06 00:59:20.823625 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:20.823560 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-61.ec2.internal\" not found" Jul 06 00:59:20.918151 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:20.918115 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-61.ec2.internal" Jul 06 00:59:20.922832 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:20.922816 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-61.ec2.internal" Jul 06 00:59:20.923889 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:20.923873 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-61.ec2.internal\" not found" Jul 06 00:59:21.024197 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:21.024165 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-61.ec2.internal\" not found" Jul 06 00:59:21.124720 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:21.124628 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-61.ec2.internal\" not found" Jul 06 00:59:21.225308 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:21.225276 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-61.ec2.internal\" not found" Jul 06 00:59:21.282744 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:21.282719 2553 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 00:59:21.283189 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:21.282877 2553 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 00:59:21.326170 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:21.326147 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-61.ec2.internal\" not found" Jul 06 00:59:21.373728 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:21.373698 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 00:54:20 +0000 UTC" deadline="2028-01-25 19:08:23.398721602 +0000 UTC" Jul 06 00:59:21.373728 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:21.373722 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13650h9m2.025002388s" Jul 06 00:59:21.427034 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:21.426983 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-61.ec2.internal\" not found" Jul 06 00:59:21.430130 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:21.430116 2553 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 00:59:21.453947 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:21.453923 2553 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 00:59:21.505692 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:21.505655 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 00:59:21.507218 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:21.507202 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-61.ec2.internal" event="NodeHasSufficientMemory" Jul 06 00:59:21.507321 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:21.507234 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-61.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 00:59:21.507321 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:21.507246 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-61.ec2.internal" event="NodeHasSufficientPID" Jul 06 00:59:21.527291 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:21.527269 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-61.ec2.internal\" not found" Jul 06 00:59:21.599990 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:21.599969 2553 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 00:59:21.600566 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:21.600543 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa4fbd7fe1f0fd86fc4d5f8945ab75a3.slice/crio-c5925161f5562bb21d680c7bd01d82b0424433b2d2a33ab1f885e2ebc14bb838 WatchSource:0}: Error finding container c5925161f5562bb21d680c7bd01d82b0424433b2d2a33ab1f885e2ebc14bb838: Status 404 returned error can't find the container with id c5925161f5562bb21d680c7bd01d82b0424433b2d2a33ab1f885e2ebc14bb838 Jul 06 00:59:21.600949 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:21.600932 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb82acd52a7ee3f92342ad96761e1bd7.slice/crio-d3c7d653ebf35e4ca4a6be3511dc5b0a204e58d3bf9b2e3b5748d6001c4af826 WatchSource:0}: Error finding container d3c7d653ebf35e4ca4a6be3511dc5b0a204e58d3bf9b2e3b5748d6001c4af826: Status 404 returned error can't find the container with id d3c7d653ebf35e4ca4a6be3511dc5b0a204e58d3bf9b2e3b5748d6001c4af826 Jul 06 00:59:21.605466 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:21.605450 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 00:59:21.640837 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:21.640820 2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-61.ec2.internal" Jul 06 00:59:21.652084 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:21.652066 2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 00:59:21.652941 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:21.652928 2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-61.ec2.internal" Jul 06 00:59:21.663221 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:21.663202 2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 00:59:22.323024 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.322995 2553 apiserver.go:52] "Watching apiserver" Jul 06 00:59:22.333042 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.332859 2553 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 00:59:22.333443 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.333343 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-5bpwj","kube-system/global-pull-secret-syncer-29jzf","kube-system/konnectivity-agent-qs4nj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvn4v","openshift-image-registry/node-ca-4zt7s","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-61.ec2.internal","openshift-multus/multus-additional-cni-plugins-fd9gs","openshift-network-diagnostics/network-check-target-nhbq2","kube-system/kube-apiserver-proxy-ip-10-0-135-61.ec2.internal","openshift-cluster-node-tuning-operator/tuned-9gpql","openshift-dns/node-resolver-fc8xr","openshift-multus/multus-2l8g9","openshift-multus/network-metrics-daemon-gn92r","openshift-network-operator/iptables-alerter-g4sx7"] Jul 06 00:59:22.334948 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.334908 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fd9gs" Jul 06 00:59:22.336352 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.336304 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn92r" Jul 06 00:59:22.336486 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:22.336368 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn92r" podUID="4ae44021-3eed-4a62-9e80-47242e594a85" Jul 06 00:59:22.337996 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.337484 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 00:59:22.337996 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.337541 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 00:59:22.337996 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.337633 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 00:59:22.337996 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.337698 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 00:59:22.337996 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.337792 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-v6fmb\"" Jul 06 00:59:22.337996 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.337892 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 00:59:22.337996 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.337908 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qs4nj" Jul 06 00:59:22.339256 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.339238 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvn4v" Jul 06 00:59:22.340338 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.340319 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4zt7s" Jul 06 00:59:22.340424 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.340376 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 00:59:22.340424 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.340328 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 00:59:22.340424 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.340395 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5hjt8\"" Jul 06 00:59:22.342051 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.342025 2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 00:59:22.342427 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.342407 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g4sx7" Jul 06 00:59:22.342965 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.342945 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhbq2" Jul 06 00:59:22.343054 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:22.343010 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhbq2" podUID="b8c268c7-44e5-467f-a64e-cf7aa8ed1af1" Jul 06 00:59:22.344122 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.344101 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 00:59:22.344359 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.344319 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 00:59:22.344523 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.344504 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 00:59:22.344588 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.344559 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.345174 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.345152 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-64dmr\"" Jul 06 00:59:22.346152 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.345913 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-657nb\"" Jul 06 00:59:22.346152 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.345977 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 00:59:22.346152 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.346022 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 00:59:22.346152 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.346117 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29jzf" Jul 06 00:59:22.346381 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:22.346172 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29jzf" podUID="a0c517c0-a190-4429-84f8-1b1cae3a15d3" Jul 06 00:59:22.346973 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.346611 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 00:59:22.346973 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.346654 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 00:59:22.346973 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.346818 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 00:59:22.346973 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.346874 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nxg75\"" Jul 06 00:59:22.346973 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.346904 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 00:59:22.347244 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.347155 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.347244 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.347163 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 00:59:22.347416 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.347398 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 00:59:22.347623 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.347606 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 00:59:22.348343 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.348326 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 00:59:22.348594 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.348577 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 00:59:22.348862 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.348842 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-z85xt\"" Jul 06 00:59:22.348977 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.348958 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 00:59:22.349189 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.349174 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fc8xr" Jul 06 00:59:22.351918 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.351894 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.352693 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.352660 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-r8z5x\"" Jul 06 00:59:22.352785 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.352763 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 00:59:22.353076 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.352658 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 00:59:22.353426 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.353406 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b06e2389-f65c-472b-96e1-a90b509a285f-os-release\") pod \"multus-additional-cni-plugins-fd9gs\" (UID: \"b06e2389-f65c-472b-96e1-a90b509a285f\") " pod="openshift-multus/multus-additional-cni-plugins-fd9gs" Jul 06 00:59:22.353515 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.353457 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b06e2389-f65c-472b-96e1-a90b509a285f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fd9gs\" (UID: \"b06e2389-f65c-472b-96e1-a90b509a285f\") " pod="openshift-multus/multus-additional-cni-plugins-fd9gs" Jul 06 00:59:22.353515 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.353489 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wskv7\" (UniqueName: \"kubernetes.io/projected/b06e2389-f65c-472b-96e1-a90b509a285f-kube-api-access-wskv7\") pod \"multus-additional-cni-plugins-fd9gs\" (UID: \"b06e2389-f65c-472b-96e1-a90b509a285f\") " pod="openshift-multus/multus-additional-cni-plugins-fd9gs" Jul 06 00:59:22.353622 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.353519 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ab933df1-be97-411c-9012-1eca2b14c318-agent-certs\") pod \"konnectivity-agent-qs4nj\" (UID: \"ab933df1-be97-411c-9012-1eca2b14c318\") " pod="kube-system/konnectivity-agent-qs4nj" Jul 06 00:59:22.353622 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.353566 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1683b4f2-b243-4601-ade5-88419c3343a2-device-dir\") pod \"aws-ebs-csi-driver-node-gvn4v\" (UID: \"1683b4f2-b243-4601-ade5-88419c3343a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvn4v" Jul 06 00:59:22.353744 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.353629 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttnlr\" (UniqueName: \"kubernetes.io/projected/b8c268c7-44e5-467f-a64e-cf7aa8ed1af1-kube-api-access-ttnlr\") pod \"network-check-target-nhbq2\" (UID: \"b8c268c7-44e5-467f-a64e-cf7aa8ed1af1\") " pod="openshift-network-diagnostics/network-check-target-nhbq2" Jul 06 00:59:22.353744 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.353692 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ae44021-3eed-4a62-9e80-47242e594a85-metrics-certs\") pod \"network-metrics-daemon-gn92r\" (UID: \"4ae44021-3eed-4a62-9e80-47242e594a85\") " pod="openshift-multus/network-metrics-daemon-gn92r" Jul 06 00:59:22.353744 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.353732 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cb1b89be-8278-4871-99e2-d5710f5da0cc-serviceca\") pod \"node-ca-4zt7s\" (UID: \"cb1b89be-8278-4871-99e2-d5710f5da0cc\") " pod="openshift-image-registry/node-ca-4zt7s" Jul 06 00:59:22.353886 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.353766 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b06e2389-f65c-472b-96e1-a90b509a285f-cni-binary-copy\") pod \"multus-additional-cni-plugins-fd9gs\" (UID: \"b06e2389-f65c-472b-96e1-a90b509a285f\") " pod="openshift-multus/multus-additional-cni-plugins-fd9gs" Jul 06 00:59:22.353886 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.353877 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlxkr\" (UniqueName: \"kubernetes.io/projected/4ae44021-3eed-4a62-9e80-47242e594a85-kube-api-access-rlxkr\") pod \"network-metrics-daemon-gn92r\" (UID: \"4ae44021-3eed-4a62-9e80-47242e594a85\") " pod="openshift-multus/network-metrics-daemon-gn92r" Jul 06 00:59:22.353979 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.353906 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1683b4f2-b243-4601-ade5-88419c3343a2-registration-dir\") pod \"aws-ebs-csi-driver-node-gvn4v\" (UID: \"1683b4f2-b243-4601-ade5-88419c3343a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvn4v" Jul 06 00:59:22.353979 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.353934 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1683b4f2-b243-4601-ade5-88419c3343a2-sys-fs\") pod \"aws-ebs-csi-driver-node-gvn4v\" (UID: \"1683b4f2-b243-4601-ade5-88419c3343a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvn4v" Jul 06 00:59:22.353979 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.353972 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cb1b89be-8278-4871-99e2-d5710f5da0cc-host\") pod \"node-ca-4zt7s\" (UID: \"cb1b89be-8278-4871-99e2-d5710f5da0cc\") " pod="openshift-image-registry/node-ca-4zt7s" Jul 06 00:59:22.354112 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.354002 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b06e2389-f65c-472b-96e1-a90b509a285f-system-cni-dir\") pod \"multus-additional-cni-plugins-fd9gs\" (UID: \"b06e2389-f65c-472b-96e1-a90b509a285f\") " pod="openshift-multus/multus-additional-cni-plugins-fd9gs" Jul 06 00:59:22.354112 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.354097 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b06e2389-f65c-472b-96e1-a90b509a285f-cnibin\") pod \"multus-additional-cni-plugins-fd9gs\" (UID: \"b06e2389-f65c-472b-96e1-a90b509a285f\") " pod="openshift-multus/multus-additional-cni-plugins-fd9gs" Jul 06 00:59:22.354210 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.354148 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b06e2389-f65c-472b-96e1-a90b509a285f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fd9gs\" (UID: \"b06e2389-f65c-472b-96e1-a90b509a285f\") " pod="openshift-multus/multus-additional-cni-plugins-fd9gs" Jul 06 00:59:22.354262 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.354236 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1683b4f2-b243-4601-ade5-88419c3343a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-gvn4v\" (UID: \"1683b4f2-b243-4601-ade5-88419c3343a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvn4v" Jul 06 00:59:22.354314 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.354265 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9rqg\" (UniqueName: \"kubernetes.io/projected/0592acc7-b10c-4497-9b99-7f0de0eb2b91-kube-api-access-g9rqg\") pod \"iptables-alerter-g4sx7\" (UID: \"0592acc7-b10c-4497-9b99-7f0de0eb2b91\") " pod="openshift-network-operator/iptables-alerter-g4sx7" Jul 06 00:59:22.354314 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.354276 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ns6hx\"" Jul 06 00:59:22.354314 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.354295 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1683b4f2-b243-4601-ade5-88419c3343a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gvn4v\" (UID: \"1683b4f2-b243-4601-ade5-88419c3343a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvn4v" Jul 06 00:59:22.354453 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.354327 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf64r\" (UniqueName: \"kubernetes.io/projected/cb1b89be-8278-4871-99e2-d5710f5da0cc-kube-api-access-zf64r\") pod \"node-ca-4zt7s\" (UID: \"cb1b89be-8278-4871-99e2-d5710f5da0cc\") " pod="openshift-image-registry/node-ca-4zt7s" Jul 06 00:59:22.354453 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.354378 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0592acc7-b10c-4497-9b99-7f0de0eb2b91-host-slash\") pod \"iptables-alerter-g4sx7\" (UID: \"0592acc7-b10c-4497-9b99-7f0de0eb2b91\") " pod="openshift-network-operator/iptables-alerter-g4sx7" Jul 06 00:59:22.354453 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.354388 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-z7kjd\"" Jul 06 00:59:22.354453 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.354406 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ab933df1-be97-411c-9012-1eca2b14c318-konnectivity-ca\") pod \"konnectivity-agent-qs4nj\" (UID: \"ab933df1-be97-411c-9012-1eca2b14c318\") " pod="kube-system/konnectivity-agent-qs4nj" Jul 06 00:59:22.354453 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.354434 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6xn9\" (UniqueName: \"kubernetes.io/projected/1683b4f2-b243-4601-ade5-88419c3343a2-kube-api-access-d6xn9\") pod \"aws-ebs-csi-driver-node-gvn4v\" (UID: \"1683b4f2-b243-4601-ade5-88419c3343a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvn4v" Jul 06 00:59:22.354706 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.354568 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1683b4f2-b243-4601-ade5-88419c3343a2-socket-dir\") pod \"aws-ebs-csi-driver-node-gvn4v\" (UID: \"1683b4f2-b243-4601-ade5-88419c3343a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvn4v" Jul 06 00:59:22.354764 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.354712 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0592acc7-b10c-4497-9b99-7f0de0eb2b91-iptables-alerter-script\") pod \"iptables-alerter-g4sx7\" (UID: \"0592acc7-b10c-4497-9b99-7f0de0eb2b91\") " pod="openshift-network-operator/iptables-alerter-g4sx7" Jul 06 00:59:22.354764 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.354755 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 00:59:22.354764 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.354756 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b06e2389-f65c-472b-96e1-a90b509a285f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fd9gs\" (UID: \"b06e2389-f65c-472b-96e1-a90b509a285f\") " pod="openshift-multus/multus-additional-cni-plugins-fd9gs" Jul 06 00:59:22.355035 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.355017 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 00:59:22.356279 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.356261 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 00:59:22.358329 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.358203 2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 00:59:22.371941 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.371345 2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5xprs" Jul 06 00:59:22.380397 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.380371 2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5xprs" Jul 06 00:59:22.390477 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.390457 2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 00:59:22.442601 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.442577 2553 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 00:59:22.455622 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.455596 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-multus-socket-dir-parent\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.455759 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.455639 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6xn9\" (UniqueName: \"kubernetes.io/projected/1683b4f2-b243-4601-ade5-88419c3343a2-kube-api-access-d6xn9\") pod \"aws-ebs-csi-driver-node-gvn4v\" (UID: \"1683b4f2-b243-4601-ade5-88419c3343a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvn4v" Jul 06 00:59:22.455759 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.455679 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-run-systemd\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.455759 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.455705 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/77af8bb2-87f4-4059-9dd0-15e7820325ed-ovnkube-config\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.455759 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.455728 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d98beaf2-36ca-43ac-87ae-38972aae9ad9-etc-sysconfig\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.455759 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.455751 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d98beaf2-36ca-43ac-87ae-38972aae9ad9-etc-tuned\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.455972 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.455777 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b06e2389-f65c-472b-96e1-a90b509a285f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fd9gs\" (UID: \"b06e2389-f65c-472b-96e1-a90b509a285f\") " pod="openshift-multus/multus-additional-cni-plugins-fd9gs" Jul 06 00:59:22.455972 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.455803 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-systemd-units\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.455972 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.455933 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-etc-openvswitch\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.455972 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.455955 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a0c517c0-a190-4429-84f8-1b1cae3a15d3-dbus\") pod \"global-pull-secret-syncer-29jzf\" (UID: \"a0c517c0-a190-4429-84f8-1b1cae3a15d3\") " pod="kube-system/global-pull-secret-syncer-29jzf" Jul 06 00:59:22.456114 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.455980 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-hostroot\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.456114 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.456072 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b06e2389-f65c-472b-96e1-a90b509a285f-os-release\") pod \"multus-additional-cni-plugins-fd9gs\" (UID: \"b06e2389-f65c-472b-96e1-a90b509a285f\") " pod="openshift-multus/multus-additional-cni-plugins-fd9gs" Jul 06 00:59:22.456114 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.456106 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b06e2389-f65c-472b-96e1-a90b509a285f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fd9gs\" (UID: \"b06e2389-f65c-472b-96e1-a90b509a285f\") " pod="openshift-multus/multus-additional-cni-plugins-fd9gs" Jul 06 00:59:22.456246 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.456135 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-host-var-lib-cni-multus\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.456246 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.456161 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d98beaf2-36ca-43ac-87ae-38972aae9ad9-etc-kubernetes\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.456246 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.456168 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b06e2389-f65c-472b-96e1-a90b509a285f-os-release\") pod \"multus-additional-cni-plugins-fd9gs\" (UID: \"b06e2389-f65c-472b-96e1-a90b509a285f\") " pod="openshift-multus/multus-additional-cni-plugins-fd9gs" Jul 06 00:59:22.456246 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.456191 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ab933df1-be97-411c-9012-1eca2b14c318-agent-certs\") pod \"konnectivity-agent-qs4nj\" (UID: \"ab933df1-be97-411c-9012-1eca2b14c318\") " pod="kube-system/konnectivity-agent-qs4nj" Jul 06 00:59:22.456246 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.456240 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1683b4f2-b243-4601-ade5-88419c3343a2-device-dir\") pod \"aws-ebs-csi-driver-node-gvn4v\" (UID: \"1683b4f2-b243-4601-ade5-88419c3343a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvn4v" Jul 06 00:59:22.456451 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.456266 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttnlr\" (UniqueName: \"kubernetes.io/projected/b8c268c7-44e5-467f-a64e-cf7aa8ed1af1-kube-api-access-ttnlr\") pod \"network-check-target-nhbq2\" (UID: \"b8c268c7-44e5-467f-a64e-cf7aa8ed1af1\") " pod="openshift-network-diagnostics/network-check-target-nhbq2" Jul 06 00:59:22.456451 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.456295 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/77af8bb2-87f4-4059-9dd0-15e7820325ed-env-overrides\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.456451 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.456318 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0c517c0-a190-4429-84f8-1b1cae3a15d3-original-pull-secret\") pod \"global-pull-secret-syncer-29jzf\" (UID: \"a0c517c0-a190-4429-84f8-1b1cae3a15d3\") " pod="kube-system/global-pull-secret-syncer-29jzf" Jul 06 00:59:22.456451 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.456314 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b06e2389-f65c-472b-96e1-a90b509a285f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fd9gs\" (UID: \"b06e2389-f65c-472b-96e1-a90b509a285f\") " pod="openshift-multus/multus-additional-cni-plugins-fd9gs" Jul 06 00:59:22.456451 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.456342 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d98beaf2-36ca-43ac-87ae-38972aae9ad9-etc-sysctl-conf\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.456451 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.456387 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1683b4f2-b243-4601-ade5-88419c3343a2-device-dir\") pod \"aws-ebs-csi-driver-node-gvn4v\" (UID: \"1683b4f2-b243-4601-ade5-88419c3343a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvn4v" Jul 06 00:59:22.456451 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.456421 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/74e85a91-ab9c-4c02-985f-48961dec5b3c-hosts-file\") pod \"node-resolver-fc8xr\" (UID: \"74e85a91-ab9c-4c02-985f-48961dec5b3c\") " pod="openshift-dns/node-resolver-fc8xr" Jul 06 00:59:22.456451 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.456449 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cb1b89be-8278-4871-99e2-d5710f5da0cc-serviceca\") pod \"node-ca-4zt7s\" (UID: \"cb1b89be-8278-4871-99e2-d5710f5da0cc\") " pod="openshift-image-registry/node-ca-4zt7s" Jul 06 00:59:22.456887 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.456475 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-host-slash\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.456887 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.456497 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-os-release\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.456887 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.456496 2553 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 00:59:22.456887 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.456542 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-host-run-k8s-cni-cncf-io\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.456887 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.456570 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b06e2389-f65c-472b-96e1-a90b509a285f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fd9gs\" (UID: \"b06e2389-f65c-472b-96e1-a90b509a285f\") " pod="openshift-multus/multus-additional-cni-plugins-fd9gs" Jul 06 00:59:22.456887 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.456581 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-host-var-lib-cni-bin\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.456887 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.456602 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e0506c24-d40f-474c-891d-7a3695d5c055-multus-daemon-config\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.456887 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.456627 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlxkr\" (UniqueName: \"kubernetes.io/projected/4ae44021-3eed-4a62-9e80-47242e594a85-kube-api-access-rlxkr\") pod \"network-metrics-daemon-gn92r\" (UID: \"4ae44021-3eed-4a62-9e80-47242e594a85\") " pod="openshift-multus/network-metrics-daemon-gn92r" Jul 06 00:59:22.456887 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.456694 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1683b4f2-b243-4601-ade5-88419c3343a2-registration-dir\") pod \"aws-ebs-csi-driver-node-gvn4v\" (UID: \"1683b4f2-b243-4601-ade5-88419c3343a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvn4v" Jul 06 00:59:22.456887 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.456725 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1683b4f2-b243-4601-ade5-88419c3343a2-sys-fs\") pod \"aws-ebs-csi-driver-node-gvn4v\" (UID: \"1683b4f2-b243-4601-ade5-88419c3343a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvn4v" Jul 06 00:59:22.456887 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.456833 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cb1b89be-8278-4871-99e2-d5710f5da0cc-host\") pod \"node-ca-4zt7s\" (UID: \"cb1b89be-8278-4871-99e2-d5710f5da0cc\") " pod="openshift-image-registry/node-ca-4zt7s" Jul 06 00:59:22.456887 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.456874 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b06e2389-f65c-472b-96e1-a90b509a285f-cnibin\") pod \"multus-additional-cni-plugins-fd9gs\" (UID: \"b06e2389-f65c-472b-96e1-a90b509a285f\") " pod="openshift-multus/multus-additional-cni-plugins-fd9gs" Jul 06 00:59:22.457475 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.456900 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-node-log\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.457475 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.456922 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d98beaf2-36ca-43ac-87ae-38972aae9ad9-tmp\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.457475 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.456986 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74e85a91-ab9c-4c02-985f-48961dec5b3c-tmp-dir\") pod \"node-resolver-fc8xr\" (UID: \"74e85a91-ab9c-4c02-985f-48961dec5b3c\") " pod="openshift-dns/node-resolver-fc8xr" Jul 06 00:59:22.457475 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.457015 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9rqg\" (UniqueName: \"kubernetes.io/projected/0592acc7-b10c-4497-9b99-7f0de0eb2b91-kube-api-access-g9rqg\") pod \"iptables-alerter-g4sx7\" (UID: \"0592acc7-b10c-4497-9b99-7f0de0eb2b91\") " pod="openshift-network-operator/iptables-alerter-g4sx7" Jul 06 00:59:22.457475 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.457040 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cb1b89be-8278-4871-99e2-d5710f5da0cc-serviceca\") pod \"node-ca-4zt7s\" (UID: \"cb1b89be-8278-4871-99e2-d5710f5da0cc\") " pod="openshift-image-registry/node-ca-4zt7s" Jul 06 00:59:22.457475 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.457043 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d98beaf2-36ca-43ac-87ae-38972aae9ad9-etc-sysctl-d\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.457475 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.457082 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pz74\" (UniqueName: \"kubernetes.io/projected/e0506c24-d40f-474c-891d-7a3695d5c055-kube-api-access-8pz74\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.457475 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.457101 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1683b4f2-b243-4601-ade5-88419c3343a2-sys-fs\") pod \"aws-ebs-csi-driver-node-gvn4v\" (UID: \"1683b4f2-b243-4601-ade5-88419c3343a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvn4v" Jul 06 00:59:22.457475 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.457113 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1683b4f2-b243-4601-ade5-88419c3343a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gvn4v\" (UID: \"1683b4f2-b243-4601-ade5-88419c3343a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvn4v" Jul 06 00:59:22.457475 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.457170 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1683b4f2-b243-4601-ade5-88419c3343a2-registration-dir\") pod \"aws-ebs-csi-driver-node-gvn4v\" (UID: \"1683b4f2-b243-4601-ade5-88419c3343a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvn4v" Jul 06 00:59:22.457475 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.457202 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf64r\" (UniqueName: \"kubernetes.io/projected/cb1b89be-8278-4871-99e2-d5710f5da0cc-kube-api-access-zf64r\") pod \"node-ca-4zt7s\" (UID: \"cb1b89be-8278-4871-99e2-d5710f5da0cc\") " pod="openshift-image-registry/node-ca-4zt7s" Jul 06 00:59:22.457475 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.457213 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cb1b89be-8278-4871-99e2-d5710f5da0cc-host\") pod \"node-ca-4zt7s\" (UID: \"cb1b89be-8278-4871-99e2-d5710f5da0cc\") " pod="openshift-image-registry/node-ca-4zt7s" Jul 06 00:59:22.457475 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.457228 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0592acc7-b10c-4497-9b99-7f0de0eb2b91-host-slash\") pod \"iptables-alerter-g4sx7\" (UID: \"0592acc7-b10c-4497-9b99-7f0de0eb2b91\") " pod="openshift-network-operator/iptables-alerter-g4sx7" Jul 06 00:59:22.457475 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.457259 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b06e2389-f65c-472b-96e1-a90b509a285f-cnibin\") pod \"multus-additional-cni-plugins-fd9gs\" (UID: \"b06e2389-f65c-472b-96e1-a90b509a285f\") " pod="openshift-multus/multus-additional-cni-plugins-fd9gs" Jul 06 00:59:22.457475 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.457254 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-host-run-netns\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.457475 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.457395 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-host-run-ovn-kubernetes\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.457475 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.457425 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d98beaf2-36ca-43ac-87ae-38972aae9ad9-etc-modprobe-d\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.458278 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.457459 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-host-var-lib-kubelet\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.458278 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.457482 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1683b4f2-b243-4601-ade5-88419c3343a2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gvn4v\" (UID: \"1683b4f2-b243-4601-ade5-88419c3343a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvn4v" Jul 06 00:59:22.458278 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.457507 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ab933df1-be97-411c-9012-1eca2b14c318-konnectivity-ca\") pod \"konnectivity-agent-qs4nj\" (UID: \"ab933df1-be97-411c-9012-1eca2b14c318\") " pod="kube-system/konnectivity-agent-qs4nj" Jul 06 00:59:22.458278 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.457542 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0592acc7-b10c-4497-9b99-7f0de0eb2b91-host-slash\") pod \"iptables-alerter-g4sx7\" (UID: \"0592acc7-b10c-4497-9b99-7f0de0eb2b91\") " pod="openshift-network-operator/iptables-alerter-g4sx7" Jul 06 00:59:22.458278 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.457578 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-run-openvswitch\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.458278 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.457603 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a0c517c0-a190-4429-84f8-1b1cae3a15d3-kubelet-config\") pod \"global-pull-secret-syncer-29jzf\" (UID: \"a0c517c0-a190-4429-84f8-1b1cae3a15d3\") " pod="kube-system/global-pull-secret-syncer-29jzf" Jul 06 00:59:22.458278 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.457706 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d98beaf2-36ca-43ac-87ae-38972aae9ad9-sys\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.458278 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.457737 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-system-cni-dir\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.458278 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.457772 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1683b4f2-b243-4601-ade5-88419c3343a2-socket-dir\") pod \"aws-ebs-csi-driver-node-gvn4v\" (UID: \"1683b4f2-b243-4601-ade5-88419c3343a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvn4v" Jul 06 00:59:22.458278 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.457805 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0592acc7-b10c-4497-9b99-7f0de0eb2b91-iptables-alerter-script\") pod \"iptables-alerter-g4sx7\" (UID: \"0592acc7-b10c-4497-9b99-7f0de0eb2b91\") " pod="openshift-network-operator/iptables-alerter-g4sx7" Jul 06 00:59:22.458278 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.457851 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d98beaf2-36ca-43ac-87ae-38972aae9ad9-etc-systemd\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.458278 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.457876 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d98beaf2-36ca-43ac-87ae-38972aae9ad9-run\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.458278 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.457882 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1683b4f2-b243-4601-ade5-88419c3343a2-socket-dir\") pod \"aws-ebs-csi-driver-node-gvn4v\" (UID: \"1683b4f2-b243-4601-ade5-88419c3343a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvn4v" Jul 06 00:59:22.458278 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.457952 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wskv7\" (UniqueName: \"kubernetes.io/projected/b06e2389-f65c-472b-96e1-a90b509a285f-kube-api-access-wskv7\") pod \"multus-additional-cni-plugins-fd9gs\" (UID: \"b06e2389-f65c-472b-96e1-a90b509a285f\") " pod="openshift-multus/multus-additional-cni-plugins-fd9gs" Jul 06 00:59:22.458278 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.458014 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d98beaf2-36ca-43ac-87ae-38972aae9ad9-var-lib-kubelet\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.458278 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.458061 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d98beaf2-36ca-43ac-87ae-38972aae9ad9-host\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.458278 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.458131 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0506c24-d40f-474c-891d-7a3695d5c055-cni-binary-copy\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.459101 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.458136 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ab933df1-be97-411c-9012-1eca2b14c318-konnectivity-ca\") pod \"konnectivity-agent-qs4nj\" (UID: \"ab933df1-be97-411c-9012-1eca2b14c318\") " pod="kube-system/konnectivity-agent-qs4nj" Jul 06 00:59:22.459101 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.458178 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-host-run-netns\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.459101 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.458208 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-multus-conf-dir\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.459101 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.458249 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-run-ovn\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.459101 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.458303 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-host-cni-bin\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.459101 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.458332 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-host-cni-netd\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.459101 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.458360 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-host-run-multus-certs\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.459101 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.458370 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0592acc7-b10c-4497-9b99-7f0de0eb2b91-iptables-alerter-script\") pod \"iptables-alerter-g4sx7\" (UID: \"0592acc7-b10c-4497-9b99-7f0de0eb2b91\") " pod="openshift-network-operator/iptables-alerter-g4sx7" Jul 06 00:59:22.459101 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.458391 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgghs\" (UniqueName: \"kubernetes.io/projected/77af8bb2-87f4-4059-9dd0-15e7820325ed-kube-api-access-mgghs\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.459101 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.458424 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ae44021-3eed-4a62-9e80-47242e594a85-metrics-certs\") pod \"network-metrics-daemon-gn92r\" (UID: \"4ae44021-3eed-4a62-9e80-47242e594a85\") " pod="openshift-multus/network-metrics-daemon-gn92r" Jul 06 00:59:22.459101 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.458467 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b06e2389-f65c-472b-96e1-a90b509a285f-cni-binary-copy\") pod \"multus-additional-cni-plugins-fd9gs\" (UID: \"b06e2389-f65c-472b-96e1-a90b509a285f\") " pod="openshift-multus/multus-additional-cni-plugins-fd9gs" Jul 06 00:59:22.459101 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:22.458546 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 00:59:22.459101 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.458577 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-var-lib-openvswitch\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.459101 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:22.458624 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ae44021-3eed-4a62-9e80-47242e594a85-metrics-certs podName:4ae44021-3eed-4a62-9e80-47242e594a85 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:22.958590289 +0000 UTC m=+2.972963316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ae44021-3eed-4a62-9e80-47242e594a85-metrics-certs") pod "network-metrics-daemon-gn92r" (UID: "4ae44021-3eed-4a62-9e80-47242e594a85") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 00:59:22.459101 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.458644 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-log-socket\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.459101 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.458861 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjznq\" (UniqueName: \"kubernetes.io/projected/d98beaf2-36ca-43ac-87ae-38972aae9ad9-kube-api-access-zjznq\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.459863 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.458894 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6vnn\" (UniqueName: \"kubernetes.io/projected/74e85a91-ab9c-4c02-985f-48961dec5b3c-kube-api-access-j6vnn\") pod \"node-resolver-fc8xr\" (UID: \"74e85a91-ab9c-4c02-985f-48961dec5b3c\") " pod="openshift-dns/node-resolver-fc8xr" Jul 06 00:59:22.459863 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.458955 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b06e2389-f65c-472b-96e1-a90b509a285f-system-cni-dir\") pod \"multus-additional-cni-plugins-fd9gs\" (UID: \"b06e2389-f65c-472b-96e1-a90b509a285f\") " pod="openshift-multus/multus-additional-cni-plugins-fd9gs" Jul 06 00:59:22.459863 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.458996 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b06e2389-f65c-472b-96e1-a90b509a285f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fd9gs\" (UID: \"b06e2389-f65c-472b-96e1-a90b509a285f\") " pod="openshift-multus/multus-additional-cni-plugins-fd9gs" Jul 06 00:59:22.459863 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.459023 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/77af8bb2-87f4-4059-9dd0-15e7820325ed-ovn-node-metrics-cert\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.459863 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.459070 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-multus-cni-dir\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.459863 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.459096 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-etc-kubernetes\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.459863 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.459124 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1683b4f2-b243-4601-ade5-88419c3343a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-gvn4v\" (UID: \"1683b4f2-b243-4601-ade5-88419c3343a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvn4v" Jul 06 00:59:22.459863 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.459139 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b06e2389-f65c-472b-96e1-a90b509a285f-cni-binary-copy\") pod \"multus-additional-cni-plugins-fd9gs\" (UID: \"b06e2389-f65c-472b-96e1-a90b509a285f\") " pod="openshift-multus/multus-additional-cni-plugins-fd9gs" Jul 06 00:59:22.459863 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.459151 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-host-kubelet\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.459863 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.459201 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.459863 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.459208 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b06e2389-f65c-472b-96e1-a90b509a285f-system-cni-dir\") pod \"multus-additional-cni-plugins-fd9gs\" (UID: \"b06e2389-f65c-472b-96e1-a90b509a285f\") " pod="openshift-multus/multus-additional-cni-plugins-fd9gs" Jul 06 00:59:22.459863 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.459230 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/77af8bb2-87f4-4059-9dd0-15e7820325ed-ovnkube-script-lib\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.459863 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.459255 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d98beaf2-36ca-43ac-87ae-38972aae9ad9-lib-modules\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.459863 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.459319 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-cnibin\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.459863 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.459341 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1683b4f2-b243-4601-ade5-88419c3343a2-etc-selinux\") pod \"aws-ebs-csi-driver-node-gvn4v\" (UID: \"1683b4f2-b243-4601-ade5-88419c3343a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvn4v" Jul 06 00:59:22.459863 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.459590 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b06e2389-f65c-472b-96e1-a90b509a285f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fd9gs\" (UID: \"b06e2389-f65c-472b-96e1-a90b509a285f\") " pod="openshift-multus/multus-additional-cni-plugins-fd9gs" Jul 06 00:59:22.460595 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.460161 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ab933df1-be97-411c-9012-1eca2b14c318-agent-certs\") pod \"konnectivity-agent-qs4nj\" (UID: \"ab933df1-be97-411c-9012-1eca2b14c318\") " pod="kube-system/konnectivity-agent-qs4nj" Jul 06 00:59:22.461847 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:22.461830 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 00:59:22.461942 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:22.461853 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 00:59:22.461942 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:22.461868 2553 projected.go:196] Error preparing data for projected volume kube-api-access-ttnlr for pod openshift-network-diagnostics/network-check-target-nhbq2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 00:59:22.461942 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:22.461917 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8c268c7-44e5-467f-a64e-cf7aa8ed1af1-kube-api-access-ttnlr podName:b8c268c7-44e5-467f-a64e-cf7aa8ed1af1 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:22.961902468 +0000 UTC m=+2.976275489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ttnlr" (UniqueName: "kubernetes.io/projected/b8c268c7-44e5-467f-a64e-cf7aa8ed1af1-kube-api-access-ttnlr") pod "network-check-target-nhbq2" (UID: "b8c268c7-44e5-467f-a64e-cf7aa8ed1af1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 00:59:22.465175 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.464973 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf64r\" (UniqueName: \"kubernetes.io/projected/cb1b89be-8278-4871-99e2-d5710f5da0cc-kube-api-access-zf64r\") pod \"node-ca-4zt7s\" (UID: \"cb1b89be-8278-4871-99e2-d5710f5da0cc\") " pod="openshift-image-registry/node-ca-4zt7s" Jul 06 00:59:22.465925 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.465782 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9rqg\" (UniqueName: \"kubernetes.io/projected/0592acc7-b10c-4497-9b99-7f0de0eb2b91-kube-api-access-g9rqg\") pod \"iptables-alerter-g4sx7\" (UID: \"0592acc7-b10c-4497-9b99-7f0de0eb2b91\") " pod="openshift-network-operator/iptables-alerter-g4sx7" Jul 06 00:59:22.466213 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.466193 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6xn9\" (UniqueName: \"kubernetes.io/projected/1683b4f2-b243-4601-ade5-88419c3343a2-kube-api-access-d6xn9\") pod \"aws-ebs-csi-driver-node-gvn4v\" (UID: \"1683b4f2-b243-4601-ade5-88419c3343a2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvn4v" Jul 06 00:59:22.467012 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.466994 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlxkr\" (UniqueName: \"kubernetes.io/projected/4ae44021-3eed-4a62-9e80-47242e594a85-kube-api-access-rlxkr\") pod \"network-metrics-daemon-gn92r\" (UID: \"4ae44021-3eed-4a62-9e80-47242e594a85\") " pod="openshift-multus/network-metrics-daemon-gn92r" Jul 06 00:59:22.468930 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.468908 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wskv7\" (UniqueName: \"kubernetes.io/projected/b06e2389-f65c-472b-96e1-a90b509a285f-kube-api-access-wskv7\") pod \"multus-additional-cni-plugins-fd9gs\" (UID: \"b06e2389-f65c-472b-96e1-a90b509a285f\") " pod="openshift-multus/multus-additional-cni-plugins-fd9gs" Jul 06 00:59:22.492161 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.492115 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-61.ec2.internal" event={"ID":"fa4fbd7fe1f0fd86fc4d5f8945ab75a3","Type":"ContainerStarted","Data":"c5925161f5562bb21d680c7bd01d82b0424433b2d2a33ab1f885e2ebc14bb838"} Jul 06 00:59:22.494823 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.494765 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-61.ec2.internal" event={"ID":"cb82acd52a7ee3f92342ad96761e1bd7","Type":"ContainerStarted","Data":"d3c7d653ebf35e4ca4a6be3511dc5b0a204e58d3bf9b2e3b5748d6001c4af826"} Jul 06 00:59:22.560268 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.560232 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-var-lib-openvswitch\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.560435 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.560273 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-log-socket\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.560435 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.560298 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjznq\" (UniqueName: \"kubernetes.io/projected/d98beaf2-36ca-43ac-87ae-38972aae9ad9-kube-api-access-zjznq\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.560435 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.560321 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6vnn\" (UniqueName: \"kubernetes.io/projected/74e85a91-ab9c-4c02-985f-48961dec5b3c-kube-api-access-j6vnn\") pod \"node-resolver-fc8xr\" (UID: \"74e85a91-ab9c-4c02-985f-48961dec5b3c\") " pod="openshift-dns/node-resolver-fc8xr" Jul 06 00:59:22.560435 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.560349 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/77af8bb2-87f4-4059-9dd0-15e7820325ed-ovn-node-metrics-cert\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.560435 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.560365 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-log-socket\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.560435 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.560361 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-var-lib-openvswitch\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.562463 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.560372 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-multus-cni-dir\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.562463 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.560593 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-etc-kubernetes\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.562463 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.560613 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-host-kubelet\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.562463 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.560636 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.562463 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.560682 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/77af8bb2-87f4-4059-9dd0-15e7820325ed-ovnkube-script-lib\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.562463 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.560704 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-host-kubelet\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.562463 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.560708 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d98beaf2-36ca-43ac-87ae-38972aae9ad9-lib-modules\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.562463 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.560739 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-etc-kubernetes\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.562463 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.560759 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-cnibin\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.562463 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.560637 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-multus-cni-dir\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.562463 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.560785 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-multus-socket-dir-parent\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.562463 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.560810 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-run-systemd\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.562463 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.560814 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.562463 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.560830 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d98beaf2-36ca-43ac-87ae-38972aae9ad9-lib-modules\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.562463 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.560832 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/77af8bb2-87f4-4059-9dd0-15e7820325ed-ovnkube-config\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.562463 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.560867 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d98beaf2-36ca-43ac-87ae-38972aae9ad9-etc-sysconfig\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.562463 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.560891 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d98beaf2-36ca-43ac-87ae-38972aae9ad9-etc-tuned\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.562463 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.560911 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-cnibin\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.563379 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.560916 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-systemd-units\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.563379 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.560959 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d98beaf2-36ca-43ac-87ae-38972aae9ad9-etc-sysconfig\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.563379 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.560963 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-systemd-units\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.563379 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.560867 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-multus-socket-dir-parent\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.563379 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.560985 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-etc-openvswitch\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.563379 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561011 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a0c517c0-a190-4429-84f8-1b1cae3a15d3-dbus\") pod \"global-pull-secret-syncer-29jzf\" (UID: \"a0c517c0-a190-4429-84f8-1b1cae3a15d3\") " pod="kube-system/global-pull-secret-syncer-29jzf" Jul 06 00:59:22.563379 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561034 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-hostroot\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.563379 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561061 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-host-var-lib-cni-multus\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.563379 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561084 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d98beaf2-36ca-43ac-87ae-38972aae9ad9-etc-kubernetes\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.563379 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561142 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-host-var-lib-cni-multus\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.563379 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561142 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/77af8bb2-87f4-4059-9dd0-15e7820325ed-env-overrides\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.563379 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561157 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-etc-openvswitch\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.563379 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561180 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0c517c0-a190-4429-84f8-1b1cae3a15d3-original-pull-secret\") pod \"global-pull-secret-syncer-29jzf\" (UID: \"a0c517c0-a190-4429-84f8-1b1cae3a15d3\") " pod="kube-system/global-pull-secret-syncer-29jzf" Jul 06 00:59:22.563379 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561191 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a0c517c0-a190-4429-84f8-1b1cae3a15d3-dbus\") pod \"global-pull-secret-syncer-29jzf\" (UID: \"a0c517c0-a190-4429-84f8-1b1cae3a15d3\") " pod="kube-system/global-pull-secret-syncer-29jzf" Jul 06 00:59:22.563379 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561207 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d98beaf2-36ca-43ac-87ae-38972aae9ad9-etc-sysctl-conf\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.563379 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561224 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-hostroot\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.563379 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561231 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/74e85a91-ab9c-4c02-985f-48961dec5b3c-hosts-file\") pod \"node-resolver-fc8xr\" (UID: \"74e85a91-ab9c-4c02-985f-48961dec5b3c\") " pod="openshift-dns/node-resolver-fc8xr" Jul 06 00:59:22.563379 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561262 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-host-slash\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.564226 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561286 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-os-release\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.564226 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561310 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-host-run-k8s-cni-cncf-io\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.564226 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561334 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-host-var-lib-cni-bin\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.564226 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561346 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d98beaf2-36ca-43ac-87ae-38972aae9ad9-etc-sysctl-conf\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.564226 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:22.561353 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 00:59:22.564226 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561357 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e0506c24-d40f-474c-891d-7a3695d5c055-multus-daemon-config\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.564226 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561385 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-host-slash\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.564226 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561386 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-node-log\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.564226 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561206 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-run-systemd\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.564226 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:22.561420 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0c517c0-a190-4429-84f8-1b1cae3a15d3-original-pull-secret podName:a0c517c0-a190-4429-84f8-1b1cae3a15d3 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:23.061400937 +0000 UTC m=+3.075773968 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0c517c0-a190-4429-84f8-1b1cae3a15d3-original-pull-secret") pod "global-pull-secret-syncer-29jzf" (UID: "a0c517c0-a190-4429-84f8-1b1cae3a15d3") : object "kube-system"/"original-pull-secret" not registered Jul 06 00:59:22.564226 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561428 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/74e85a91-ab9c-4c02-985f-48961dec5b3c-hosts-file\") pod \"node-resolver-fc8xr\" (UID: \"74e85a91-ab9c-4c02-985f-48961dec5b3c\") " pod="openshift-dns/node-resolver-fc8xr" Jul 06 00:59:22.564226 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561463 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-os-release\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.564226 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561469 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-host-var-lib-cni-bin\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.564226 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561507 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-host-run-k8s-cni-cncf-io\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.564226 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561638 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d98beaf2-36ca-43ac-87ae-38972aae9ad9-tmp\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.564226 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561703 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74e85a91-ab9c-4c02-985f-48961dec5b3c-tmp-dir\") pod \"node-resolver-fc8xr\" (UID: \"74e85a91-ab9c-4c02-985f-48961dec5b3c\") " pod="openshift-dns/node-resolver-fc8xr" Jul 06 00:59:22.564226 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561732 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d98beaf2-36ca-43ac-87ae-38972aae9ad9-etc-sysctl-d\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.564226 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561756 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pz74\" (UniqueName: \"kubernetes.io/projected/e0506c24-d40f-474c-891d-7a3695d5c055-kube-api-access-8pz74\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.564961 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561786 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-host-run-netns\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.564961 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561810 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-host-run-ovn-kubernetes\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.564961 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561833 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d98beaf2-36ca-43ac-87ae-38972aae9ad9-etc-modprobe-d\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.564961 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561860 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-host-var-lib-kubelet\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.564961 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561885 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-run-openvswitch\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.564961 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561894 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/77af8bb2-87f4-4059-9dd0-15e7820325ed-ovnkube-config\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.564961 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561908 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a0c517c0-a190-4429-84f8-1b1cae3a15d3-kubelet-config\") pod \"global-pull-secret-syncer-29jzf\" (UID: \"a0c517c0-a190-4429-84f8-1b1cae3a15d3\") " pod="kube-system/global-pull-secret-syncer-29jzf" Jul 06 00:59:22.564961 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.561965 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a0c517c0-a190-4429-84f8-1b1cae3a15d3-kubelet-config\") pod \"global-pull-secret-syncer-29jzf\" (UID: \"a0c517c0-a190-4429-84f8-1b1cae3a15d3\") " pod="kube-system/global-pull-secret-syncer-29jzf" Jul 06 00:59:22.564961 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562004 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-host-run-netns\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.564961 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562020 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e0506c24-d40f-474c-891d-7a3695d5c055-multus-daemon-config\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.564961 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562040 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-host-run-ovn-kubernetes\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.564961 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562079 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-node-log\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.564961 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562152 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d98beaf2-36ca-43ac-87ae-38972aae9ad9-etc-modprobe-d\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.564961 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562187 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d98beaf2-36ca-43ac-87ae-38972aae9ad9-etc-sysctl-d\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.564961 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562200 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-host-var-lib-kubelet\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.564961 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562241 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-run-openvswitch\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.564961 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562271 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d98beaf2-36ca-43ac-87ae-38972aae9ad9-sys\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.564961 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562296 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-system-cni-dir\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.565792 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562320 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d98beaf2-36ca-43ac-87ae-38972aae9ad9-etc-systemd\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.565792 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562342 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d98beaf2-36ca-43ac-87ae-38972aae9ad9-run\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.565792 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562367 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d98beaf2-36ca-43ac-87ae-38972aae9ad9-var-lib-kubelet\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.565792 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562390 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d98beaf2-36ca-43ac-87ae-38972aae9ad9-host\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.565792 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562409 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0506c24-d40f-474c-891d-7a3695d5c055-cni-binary-copy\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.565792 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562433 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-host-run-netns\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.565792 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562435 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74e85a91-ab9c-4c02-985f-48961dec5b3c-tmp-dir\") pod \"node-resolver-fc8xr\" (UID: \"74e85a91-ab9c-4c02-985f-48961dec5b3c\") " pod="openshift-dns/node-resolver-fc8xr" Jul 06 00:59:22.565792 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562486 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-multus-conf-dir\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.565792 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562519 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-run-ovn\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.565792 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562525 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d98beaf2-36ca-43ac-87ae-38972aae9ad9-var-lib-kubelet\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.565792 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562544 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-host-cni-bin\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.565792 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562571 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-host-cni-netd\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.565792 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562599 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-host-run-multus-certs\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.565792 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562625 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgghs\" (UniqueName: \"kubernetes.io/projected/77af8bb2-87f4-4059-9dd0-15e7820325ed-kube-api-access-mgghs\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.565792 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562645 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d98beaf2-36ca-43ac-87ae-38972aae9ad9-sys\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.565792 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562715 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d98beaf2-36ca-43ac-87ae-38972aae9ad9-run\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.565792 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562753 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-host-run-multus-certs\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.565792 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562761 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d98beaf2-36ca-43ac-87ae-38972aae9ad9-etc-systemd\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.566651 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562490 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d98beaf2-36ca-43ac-87ae-38972aae9ad9-host\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.566651 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562600 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-host-run-netns\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.566651 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562804 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-run-ovn\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.566651 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562835 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-multus-conf-dir\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.566651 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562875 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-host-cni-netd\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.566651 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562920 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0506c24-d40f-474c-891d-7a3695d5c055-system-cni-dir\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.566651 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562947 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0506c24-d40f-474c-891d-7a3695d5c055-cni-binary-copy\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.566651 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.562958 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77af8bb2-87f4-4059-9dd0-15e7820325ed-host-cni-bin\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.566651 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.563024 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d98beaf2-36ca-43ac-87ae-38972aae9ad9-etc-kubernetes\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.566651 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.563344 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/77af8bb2-87f4-4059-9dd0-15e7820325ed-env-overrides\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.566651 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.563711 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/77af8bb2-87f4-4059-9dd0-15e7820325ed-ovnkube-script-lib\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.566651 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.563894 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d98beaf2-36ca-43ac-87ae-38972aae9ad9-etc-tuned\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.566651 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.563966 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/77af8bb2-87f4-4059-9dd0-15e7820325ed-ovn-node-metrics-cert\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.566651 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.565596 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d98beaf2-36ca-43ac-87ae-38972aae9ad9-tmp\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.567974 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.567951 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjznq\" (UniqueName: \"kubernetes.io/projected/d98beaf2-36ca-43ac-87ae-38972aae9ad9-kube-api-access-zjznq\") pod \"tuned-9gpql\" (UID: \"d98beaf2-36ca-43ac-87ae-38972aae9ad9\") " pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.568783 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.568758 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6vnn\" (UniqueName: \"kubernetes.io/projected/74e85a91-ab9c-4c02-985f-48961dec5b3c-kube-api-access-j6vnn\") pod \"node-resolver-fc8xr\" (UID: \"74e85a91-ab9c-4c02-985f-48961dec5b3c\") " pod="openshift-dns/node-resolver-fc8xr" Jul 06 00:59:22.570051 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.570026 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pz74\" (UniqueName: \"kubernetes.io/projected/e0506c24-d40f-474c-891d-7a3695d5c055-kube-api-access-8pz74\") pod \"multus-2l8g9\" (UID: \"e0506c24-d40f-474c-891d-7a3695d5c055\") " pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.570434 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.570417 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgghs\" (UniqueName: \"kubernetes.io/projected/77af8bb2-87f4-4059-9dd0-15e7820325ed-kube-api-access-mgghs\") pod \"ovnkube-node-5bpwj\" (UID: \"77af8bb2-87f4-4059-9dd0-15e7820325ed\") " pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.649548 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.649481 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fd9gs" Jul 06 00:59:22.658222 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:22.658195 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb06e2389_f65c_472b_96e1_a90b509a285f.slice/crio-2067eef0ee129ac1649363abdb55f0f201f15edde1e6334281b84bb899079c9f WatchSource:0}: Error finding container 2067eef0ee129ac1649363abdb55f0f201f15edde1e6334281b84bb899079c9f: Status 404 returned error can't find the container with id 2067eef0ee129ac1649363abdb55f0f201f15edde1e6334281b84bb899079c9f Jul 06 00:59:22.660151 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.660134 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qs4nj" Jul 06 00:59:22.668810 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:22.668784 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab933df1_be97_411c_9012_1eca2b14c318.slice/crio-808532699ef9adf85d7f8da31c1731a8707e016849ab69f204260b031cce8672 WatchSource:0}: Error finding container 808532699ef9adf85d7f8da31c1731a8707e016849ab69f204260b031cce8672: Status 404 returned error can't find the container with id 808532699ef9adf85d7f8da31c1731a8707e016849ab69f204260b031cce8672 Jul 06 00:59:22.669657 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.669640 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvn4v" Jul 06 00:59:22.674477 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.674462 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4zt7s" Jul 06 00:59:22.676611 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:22.676592 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1683b4f2_b243_4601_ade5_88419c3343a2.slice/crio-54fbd89b30f4ea0f5b442e1ff261f6e9fca02e3a6ea977952156640884e69961 WatchSource:0}: Error finding container 54fbd89b30f4ea0f5b442e1ff261f6e9fca02e3a6ea977952156640884e69961: Status 404 returned error can't find the container with id 54fbd89b30f4ea0f5b442e1ff261f6e9fca02e3a6ea977952156640884e69961 Jul 06 00:59:22.684188 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.684171 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g4sx7" Jul 06 00:59:22.692872 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.692854 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:22.700156 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.700139 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9gpql" Jul 06 00:59:22.708818 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.708794 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fc8xr" Jul 06 00:59:22.715615 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.715594 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2l8g9" Jul 06 00:59:22.965503 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.965414 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ae44021-3eed-4a62-9e80-47242e594a85-metrics-certs\") pod \"network-metrics-daemon-gn92r\" (UID: \"4ae44021-3eed-4a62-9e80-47242e594a85\") " pod="openshift-multus/network-metrics-daemon-gn92r" Jul 06 00:59:22.965503 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:22.965482 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttnlr\" (UniqueName: \"kubernetes.io/projected/b8c268c7-44e5-467f-a64e-cf7aa8ed1af1-kube-api-access-ttnlr\") pod \"network-check-target-nhbq2\" (UID: \"b8c268c7-44e5-467f-a64e-cf7aa8ed1af1\") " pod="openshift-network-diagnostics/network-check-target-nhbq2" Jul 06 00:59:22.965741 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:22.965573 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 00:59:22.965741 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:22.965583 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 00:59:22.965741 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:22.965598 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 00:59:22.965741 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:22.965612 2553 projected.go:196] Error preparing data for projected volume kube-api-access-ttnlr for pod openshift-network-diagnostics/network-check-target-nhbq2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 00:59:22.965741 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:22.965638 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ae44021-3eed-4a62-9e80-47242e594a85-metrics-certs podName:4ae44021-3eed-4a62-9e80-47242e594a85 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:23.965620492 +0000 UTC m=+3.979993518 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ae44021-3eed-4a62-9e80-47242e594a85-metrics-certs") pod "network-metrics-daemon-gn92r" (UID: "4ae44021-3eed-4a62-9e80-47242e594a85") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 00:59:22.965741 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:22.965717 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8c268c7-44e5-467f-a64e-cf7aa8ed1af1-kube-api-access-ttnlr podName:b8c268c7-44e5-467f-a64e-cf7aa8ed1af1 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:23.965689777 +0000 UTC m=+3.980062804 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ttnlr" (UniqueName: "kubernetes.io/projected/b8c268c7-44e5-467f-a64e-cf7aa8ed1af1-kube-api-access-ttnlr") pod "network-check-target-nhbq2" (UID: "b8c268c7-44e5-467f-a64e-cf7aa8ed1af1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 00:59:23.066834 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:23.066798 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0c517c0-a190-4429-84f8-1b1cae3a15d3-original-pull-secret\") pod \"global-pull-secret-syncer-29jzf\" (UID: \"a0c517c0-a190-4429-84f8-1b1cae3a15d3\") " pod="kube-system/global-pull-secret-syncer-29jzf" Jul 06 00:59:23.067023 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:23.066950 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 00:59:23.067023 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:23.067011 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0c517c0-a190-4429-84f8-1b1cae3a15d3-original-pull-secret podName:a0c517c0-a190-4429-84f8-1b1cae3a15d3 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:24.066993787 +0000 UTC m=+4.081366801 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0c517c0-a190-4429-84f8-1b1cae3a15d3-original-pull-secret") pod "global-pull-secret-syncer-29jzf" (UID: "a0c517c0-a190-4429-84f8-1b1cae3a15d3") : object "kube-system"/"original-pull-secret" not registered Jul 06 00:59:23.382369 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:23.382284 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 00:54:22 +0000 UTC" deadline="2028-01-07 07:09:12.240300506 +0000 UTC" Jul 06 00:59:23.382369 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:23.382315 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13206h9m48.857988316s" Jul 06 00:59:23.486590 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:23.486560 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhbq2" Jul 06 00:59:23.486764 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:23.486658 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhbq2" podUID="b8c268c7-44e5-467f-a64e-cf7aa8ed1af1" Jul 06 00:59:23.497248 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:23.497158 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvn4v" event={"ID":"1683b4f2-b243-4601-ade5-88419c3343a2","Type":"ContainerStarted","Data":"54fbd89b30f4ea0f5b442e1ff261f6e9fca02e3a6ea977952156640884e69961"} Jul 06 00:59:23.498686 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:23.498645 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qs4nj" event={"ID":"ab933df1-be97-411c-9012-1eca2b14c318","Type":"ContainerStarted","Data":"808532699ef9adf85d7f8da31c1731a8707e016849ab69f204260b031cce8672"} Jul 06 00:59:23.499956 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:23.499933 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fd9gs" event={"ID":"b06e2389-f65c-472b-96e1-a90b509a285f","Type":"ContainerStarted","Data":"2067eef0ee129ac1649363abdb55f0f201f15edde1e6334281b84bb899079c9f"} Jul 06 00:59:23.775879 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:23.775756 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd98beaf2_36ca_43ac_87ae_38972aae9ad9.slice/crio-00e5d03c155fcda15bfc14737db53d3a701a68bb15e4ce6d51bd7e714771853e WatchSource:0}: Error finding container 00e5d03c155fcda15bfc14737db53d3a701a68bb15e4ce6d51bd7e714771853e: Status 404 returned error can't find the container with id 00e5d03c155fcda15bfc14737db53d3a701a68bb15e4ce6d51bd7e714771853e Jul 06 00:59:23.777915 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:23.777894 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb1b89be_8278_4871_99e2_d5710f5da0cc.slice/crio-d2c13ffd0685fcdec638d27aeb551d775994e7eda685877f7b577ea449af0244 WatchSource:0}: Error finding container d2c13ffd0685fcdec638d27aeb551d775994e7eda685877f7b577ea449af0244: Status 404 returned error can't find the container with id d2c13ffd0685fcdec638d27aeb551d775994e7eda685877f7b577ea449af0244 Jul 06 00:59:23.786163 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:23.786069 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74e85a91_ab9c_4c02_985f_48961dec5b3c.slice/crio-811ff5179ed953cb3d14c3695359f8340368318fb2d680e4cdfe8b83d05855b1 WatchSource:0}: Error finding container 811ff5179ed953cb3d14c3695359f8340368318fb2d680e4cdfe8b83d05855b1: Status 404 returned error can't find the container with id 811ff5179ed953cb3d14c3695359f8340368318fb2d680e4cdfe8b83d05855b1 Jul 06 00:59:23.977920 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:23.977698 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ae44021-3eed-4a62-9e80-47242e594a85-metrics-certs\") pod \"network-metrics-daemon-gn92r\" (UID: \"4ae44021-3eed-4a62-9e80-47242e594a85\") " pod="openshift-multus/network-metrics-daemon-gn92r" Jul 06 00:59:23.978086 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:23.977960 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttnlr\" (UniqueName: \"kubernetes.io/projected/b8c268c7-44e5-467f-a64e-cf7aa8ed1af1-kube-api-access-ttnlr\") pod \"network-check-target-nhbq2\" (UID: \"b8c268c7-44e5-467f-a64e-cf7aa8ed1af1\") " pod="openshift-network-diagnostics/network-check-target-nhbq2" Jul 06 00:59:23.978154 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:23.978143 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 00:59:23.978209 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:23.978168 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 00:59:23.978209 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:23.978181 2553 projected.go:196] Error preparing data for projected volume kube-api-access-ttnlr for pod openshift-network-diagnostics/network-check-target-nhbq2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 00:59:23.978305 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:23.978238 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8c268c7-44e5-467f-a64e-cf7aa8ed1af1-kube-api-access-ttnlr podName:b8c268c7-44e5-467f-a64e-cf7aa8ed1af1 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:25.978217966 +0000 UTC m=+5.992590986 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ttnlr" (UniqueName: "kubernetes.io/projected/b8c268c7-44e5-467f-a64e-cf7aa8ed1af1-kube-api-access-ttnlr") pod "network-check-target-nhbq2" (UID: "b8c268c7-44e5-467f-a64e-cf7aa8ed1af1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 00:59:23.978726 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:23.978644 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 00:59:23.978726 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:23.978724 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ae44021-3eed-4a62-9e80-47242e594a85-metrics-certs podName:4ae44021-3eed-4a62-9e80-47242e594a85 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:25.978708585 +0000 UTC m=+5.993081622 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ae44021-3eed-4a62-9e80-47242e594a85-metrics-certs") pod "network-metrics-daemon-gn92r" (UID: "4ae44021-3eed-4a62-9e80-47242e594a85") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 00:59:24.079032 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:24.078909 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0c517c0-a190-4429-84f8-1b1cae3a15d3-original-pull-secret\") pod \"global-pull-secret-syncer-29jzf\" (UID: \"a0c517c0-a190-4429-84f8-1b1cae3a15d3\") " pod="kube-system/global-pull-secret-syncer-29jzf" Jul 06 00:59:24.079125 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:24.079058 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 00:59:24.079125 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:24.079114 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0c517c0-a190-4429-84f8-1b1cae3a15d3-original-pull-secret podName:a0c517c0-a190-4429-84f8-1b1cae3a15d3 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:26.079096687 +0000 UTC m=+6.093469708 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0c517c0-a190-4429-84f8-1b1cae3a15d3-original-pull-secret") pod "global-pull-secret-syncer-29jzf" (UID: "a0c517c0-a190-4429-84f8-1b1cae3a15d3") : object "kube-system"/"original-pull-secret" not registered Jul 06 00:59:24.382864 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:24.382743 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 00:54:22 +0000 UTC" deadline="2028-01-26 23:15:48.263539752 +0000 UTC" Jul 06 00:59:24.382864 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:24.382803 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13678h16m23.880741121s" Jul 06 00:59:24.488571 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:24.488017 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29jzf" Jul 06 00:59:24.488571 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:24.488138 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29jzf" podUID="a0c517c0-a190-4429-84f8-1b1cae3a15d3" Jul 06 00:59:24.489473 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:24.489330 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn92r" Jul 06 00:59:24.489473 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:24.489436 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn92r" podUID="4ae44021-3eed-4a62-9e80-47242e594a85" Jul 06 00:59:24.507492 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:24.507452 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2l8g9" event={"ID":"e0506c24-d40f-474c-891d-7a3695d5c055","Type":"ContainerStarted","Data":"c65597c77ced2bcee1f199b97264c102e10822d9b7ed60efc488f2d2168fabbd"} Jul 06 00:59:24.522487 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:24.522447 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fc8xr" event={"ID":"74e85a91-ab9c-4c02-985f-48961dec5b3c","Type":"ContainerStarted","Data":"811ff5179ed953cb3d14c3695359f8340368318fb2d680e4cdfe8b83d05855b1"} Jul 06 00:59:24.529004 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:24.528908 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g4sx7" event={"ID":"0592acc7-b10c-4497-9b99-7f0de0eb2b91","Type":"ContainerStarted","Data":"f0e0ef04460a30cb40517de38811e3c22daffb2f2f88183fe290accc86bb512b"} Jul 06 00:59:24.531885 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:24.531805 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4zt7s" event={"ID":"cb1b89be-8278-4871-99e2-d5710f5da0cc","Type":"ContainerStarted","Data":"d2c13ffd0685fcdec638d27aeb551d775994e7eda685877f7b577ea449af0244"} Jul 06 00:59:24.542800 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:24.542746 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-61.ec2.internal" event={"ID":"fa4fbd7fe1f0fd86fc4d5f8945ab75a3","Type":"ContainerStarted","Data":"c75f0927b1f0b872fecf410451f9fb2e470e3804ab0d440fa7b9fb377e1e3bac"} Jul 06 00:59:24.552208 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:24.551639 2553 generic.go:356] "Generic (PLEG): container finished" podID="cb82acd52a7ee3f92342ad96761e1bd7" containerID="bf3d987b1db0e25b3052e638e9e0674815a926751a3d5cd73ac8bfa0bd48a8c1" exitCode=0 Jul 06 00:59:24.552208 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:24.551709 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-61.ec2.internal" event={"ID":"cb82acd52a7ee3f92342ad96761e1bd7","Type":"ContainerDied","Data":"bf3d987b1db0e25b3052e638e9e0674815a926751a3d5cd73ac8bfa0bd48a8c1"} Jul 06 00:59:24.555055 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:24.555022 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" event={"ID":"77af8bb2-87f4-4059-9dd0-15e7820325ed","Type":"ContainerStarted","Data":"64b91be5cce32fbf1de940d03bcf081e02a499898fdf3c6b9c58d5ed94623ea6"} Jul 06 00:59:24.556955 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:24.556903 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9gpql" event={"ID":"d98beaf2-36ca-43ac-87ae-38972aae9ad9","Type":"ContainerStarted","Data":"00e5d03c155fcda15bfc14737db53d3a701a68bb15e4ce6d51bd7e714771853e"} Jul 06 00:59:24.580158 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:24.579906 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-61.ec2.internal" podStartSLOduration=3.5798840419999998 podStartE2EDuration="3.579884042s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 00:59:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 00:59:24.565210777 +0000 UTC m=+4.579583814" watchObservedRunningTime="2026-07-06 00:59:24.579884042 +0000 UTC m=+4.594257081" Jul 06 00:59:25.487312 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:25.487278 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhbq2" Jul 06 00:59:25.487888 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:25.487407 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhbq2" podUID="b8c268c7-44e5-467f-a64e-cf7aa8ed1af1" Jul 06 00:59:25.994383 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:25.994344 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttnlr\" (UniqueName: \"kubernetes.io/projected/b8c268c7-44e5-467f-a64e-cf7aa8ed1af1-kube-api-access-ttnlr\") pod \"network-check-target-nhbq2\" (UID: \"b8c268c7-44e5-467f-a64e-cf7aa8ed1af1\") " pod="openshift-network-diagnostics/network-check-target-nhbq2" Jul 06 00:59:25.994577 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:25.994435 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ae44021-3eed-4a62-9e80-47242e594a85-metrics-certs\") pod \"network-metrics-daemon-gn92r\" (UID: \"4ae44021-3eed-4a62-9e80-47242e594a85\") " pod="openshift-multus/network-metrics-daemon-gn92r" Jul 06 00:59:25.994640 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:25.994576 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 00:59:25.994640 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:25.994637 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ae44021-3eed-4a62-9e80-47242e594a85-metrics-certs podName:4ae44021-3eed-4a62-9e80-47242e594a85 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:29.994619017 +0000 UTC m=+10.008992038 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ae44021-3eed-4a62-9e80-47242e594a85-metrics-certs") pod "network-metrics-daemon-gn92r" (UID: "4ae44021-3eed-4a62-9e80-47242e594a85") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 00:59:25.995206 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:25.995049 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 00:59:25.995206 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:25.995074 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 00:59:25.995206 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:25.995089 2553 projected.go:196] Error preparing data for projected volume kube-api-access-ttnlr for pod openshift-network-diagnostics/network-check-target-nhbq2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 00:59:25.995206 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:25.995135 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8c268c7-44e5-467f-a64e-cf7aa8ed1af1-kube-api-access-ttnlr podName:b8c268c7-44e5-467f-a64e-cf7aa8ed1af1 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:29.995119875 +0000 UTC m=+10.009492893 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ttnlr" (UniqueName: "kubernetes.io/projected/b8c268c7-44e5-467f-a64e-cf7aa8ed1af1-kube-api-access-ttnlr") pod "network-check-target-nhbq2" (UID: "b8c268c7-44e5-467f-a64e-cf7aa8ed1af1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 00:59:26.095150 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:26.095107 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0c517c0-a190-4429-84f8-1b1cae3a15d3-original-pull-secret\") pod \"global-pull-secret-syncer-29jzf\" (UID: \"a0c517c0-a190-4429-84f8-1b1cae3a15d3\") " pod="kube-system/global-pull-secret-syncer-29jzf" Jul 06 00:59:26.095344 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:26.095321 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 00:59:26.095407 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:26.095386 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0c517c0-a190-4429-84f8-1b1cae3a15d3-original-pull-secret podName:a0c517c0-a190-4429-84f8-1b1cae3a15d3 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:30.095367565 +0000 UTC m=+10.109740582 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0c517c0-a190-4429-84f8-1b1cae3a15d3-original-pull-secret") pod "global-pull-secret-syncer-29jzf" (UID: "a0c517c0-a190-4429-84f8-1b1cae3a15d3") : object "kube-system"/"original-pull-secret" not registered Jul 06 00:59:26.487706 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:26.487460 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn92r" Jul 06 00:59:26.487706 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:26.487595 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn92r" podUID="4ae44021-3eed-4a62-9e80-47242e594a85" Jul 06 00:59:26.487706 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:26.487635 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29jzf" Jul 06 00:59:26.488250 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:26.487758 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29jzf" podUID="a0c517c0-a190-4429-84f8-1b1cae3a15d3" Jul 06 00:59:27.486829 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:27.486797 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhbq2" Jul 06 00:59:27.487011 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:27.486936 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhbq2" podUID="b8c268c7-44e5-467f-a64e-cf7aa8ed1af1" Jul 06 00:59:28.490489 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:28.490459 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29jzf" Jul 06 00:59:28.490942 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:28.490577 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29jzf" podUID="a0c517c0-a190-4429-84f8-1b1cae3a15d3" Jul 06 00:59:28.490942 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:28.490933 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn92r" Jul 06 00:59:28.491049 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:28.491024 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn92r" podUID="4ae44021-3eed-4a62-9e80-47242e594a85" Jul 06 00:59:29.486855 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:29.486822 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhbq2" Jul 06 00:59:29.487014 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:29.486956 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhbq2" podUID="b8c268c7-44e5-467f-a64e-cf7aa8ed1af1" Jul 06 00:59:30.029339 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:30.029303 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttnlr\" (UniqueName: \"kubernetes.io/projected/b8c268c7-44e5-467f-a64e-cf7aa8ed1af1-kube-api-access-ttnlr\") pod \"network-check-target-nhbq2\" (UID: \"b8c268c7-44e5-467f-a64e-cf7aa8ed1af1\") " pod="openshift-network-diagnostics/network-check-target-nhbq2" Jul 06 00:59:30.029824 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:30.029386 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ae44021-3eed-4a62-9e80-47242e594a85-metrics-certs\") pod \"network-metrics-daemon-gn92r\" (UID: \"4ae44021-3eed-4a62-9e80-47242e594a85\") " pod="openshift-multus/network-metrics-daemon-gn92r" Jul 06 00:59:30.029824 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:30.029479 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 00:59:30.029824 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:30.029502 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 00:59:30.029824 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:30.029509 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 00:59:30.029824 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:30.029515 2553 projected.go:196] Error preparing data for projected volume kube-api-access-ttnlr for pod openshift-network-diagnostics/network-check-target-nhbq2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 00:59:30.029824 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:30.029569 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ae44021-3eed-4a62-9e80-47242e594a85-metrics-certs podName:4ae44021-3eed-4a62-9e80-47242e594a85 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:38.02955079 +0000 UTC m=+18.043923807 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ae44021-3eed-4a62-9e80-47242e594a85-metrics-certs") pod "network-metrics-daemon-gn92r" (UID: "4ae44021-3eed-4a62-9e80-47242e594a85") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 00:59:30.029824 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:30.029589 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8c268c7-44e5-467f-a64e-cf7aa8ed1af1-kube-api-access-ttnlr podName:b8c268c7-44e5-467f-a64e-cf7aa8ed1af1 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:38.029579114 +0000 UTC m=+18.043952131 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ttnlr" (UniqueName: "kubernetes.io/projected/b8c268c7-44e5-467f-a64e-cf7aa8ed1af1-kube-api-access-ttnlr") pod "network-check-target-nhbq2" (UID: "b8c268c7-44e5-467f-a64e-cf7aa8ed1af1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 00:59:30.129912 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:30.129867 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0c517c0-a190-4429-84f8-1b1cae3a15d3-original-pull-secret\") pod \"global-pull-secret-syncer-29jzf\" (UID: \"a0c517c0-a190-4429-84f8-1b1cae3a15d3\") " pod="kube-system/global-pull-secret-syncer-29jzf" Jul 06 00:59:30.130059 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:30.130014 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 00:59:30.130105 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:30.130086 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0c517c0-a190-4429-84f8-1b1cae3a15d3-original-pull-secret podName:a0c517c0-a190-4429-84f8-1b1cae3a15d3 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:38.130066511 +0000 UTC m=+18.144439530 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0c517c0-a190-4429-84f8-1b1cae3a15d3-original-pull-secret") pod "global-pull-secret-syncer-29jzf" (UID: "a0c517c0-a190-4429-84f8-1b1cae3a15d3") : object "kube-system"/"original-pull-secret" not registered Jul 06 00:59:30.488168 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:30.487627 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn92r" Jul 06 00:59:30.488168 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:30.487777 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn92r" podUID="4ae44021-3eed-4a62-9e80-47242e594a85" Jul 06 00:59:30.488168 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:30.487825 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29jzf" Jul 06 00:59:30.488168 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:30.487932 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29jzf" podUID="a0c517c0-a190-4429-84f8-1b1cae3a15d3" Jul 06 00:59:31.487247 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:31.487214 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhbq2" Jul 06 00:59:31.487649 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:31.487311 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhbq2" podUID="b8c268c7-44e5-467f-a64e-cf7aa8ed1af1" Jul 06 00:59:32.487407 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:32.487370 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29jzf" Jul 06 00:59:32.487946 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:32.487506 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29jzf" podUID="a0c517c0-a190-4429-84f8-1b1cae3a15d3" Jul 06 00:59:32.487946 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:32.487378 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn92r" Jul 06 00:59:32.487946 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:32.487809 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn92r" podUID="4ae44021-3eed-4a62-9e80-47242e594a85" Jul 06 00:59:33.486522 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:33.486487 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhbq2" Jul 06 00:59:33.486710 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:33.486613 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhbq2" podUID="b8c268c7-44e5-467f-a64e-cf7aa8ed1af1" Jul 06 00:59:34.486916 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:34.486882 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29jzf" Jul 06 00:59:34.487374 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:34.487004 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29jzf" podUID="a0c517c0-a190-4429-84f8-1b1cae3a15d3" Jul 06 00:59:34.487374 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:34.487034 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn92r" Jul 06 00:59:34.487374 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:34.487114 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn92r" podUID="4ae44021-3eed-4a62-9e80-47242e594a85" Jul 06 00:59:35.486718 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:35.486680 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhbq2" Jul 06 00:59:35.486879 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:35.486816 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhbq2" podUID="b8c268c7-44e5-467f-a64e-cf7aa8ed1af1" Jul 06 00:59:36.486874 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:36.486838 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn92r" Jul 06 00:59:36.487309 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:36.486846 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29jzf" Jul 06 00:59:36.487309 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:36.486983 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn92r" podUID="4ae44021-3eed-4a62-9e80-47242e594a85" Jul 06 00:59:36.487309 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:36.487025 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29jzf" podUID="a0c517c0-a190-4429-84f8-1b1cae3a15d3" Jul 06 00:59:37.487350 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:37.487267 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhbq2" Jul 06 00:59:37.487826 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:37.487379 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhbq2" podUID="b8c268c7-44e5-467f-a64e-cf7aa8ed1af1" Jul 06 00:59:38.095024 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:38.094989 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ae44021-3eed-4a62-9e80-47242e594a85-metrics-certs\") pod \"network-metrics-daemon-gn92r\" (UID: \"4ae44021-3eed-4a62-9e80-47242e594a85\") " pod="openshift-multus/network-metrics-daemon-gn92r" Jul 06 00:59:38.095202 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:38.095043 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttnlr\" (UniqueName: \"kubernetes.io/projected/b8c268c7-44e5-467f-a64e-cf7aa8ed1af1-kube-api-access-ttnlr\") pod \"network-check-target-nhbq2\" (UID: \"b8c268c7-44e5-467f-a64e-cf7aa8ed1af1\") " pod="openshift-network-diagnostics/network-check-target-nhbq2" Jul 06 00:59:38.095202 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:38.095156 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 00:59:38.095306 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:38.095226 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 00:59:38.095306 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:38.095232 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ae44021-3eed-4a62-9e80-47242e594a85-metrics-certs podName:4ae44021-3eed-4a62-9e80-47242e594a85 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:54.095213318 +0000 UTC m=+34.109586337 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ae44021-3eed-4a62-9e80-47242e594a85-metrics-certs") pod "network-metrics-daemon-gn92r" (UID: "4ae44021-3eed-4a62-9e80-47242e594a85") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 00:59:38.095306 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:38.095242 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 00:59:38.095306 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:38.095254 2553 projected.go:196] Error preparing data for projected volume kube-api-access-ttnlr for pod openshift-network-diagnostics/network-check-target-nhbq2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 00:59:38.095306 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:38.095293 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8c268c7-44e5-467f-a64e-cf7aa8ed1af1-kube-api-access-ttnlr podName:b8c268c7-44e5-467f-a64e-cf7aa8ed1af1 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:54.095283603 +0000 UTC m=+34.109656617 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ttnlr" (UniqueName: "kubernetes.io/projected/b8c268c7-44e5-467f-a64e-cf7aa8ed1af1-kube-api-access-ttnlr") pod "network-check-target-nhbq2" (UID: "b8c268c7-44e5-467f-a64e-cf7aa8ed1af1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 00:59:38.195721 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:38.195678 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0c517c0-a190-4429-84f8-1b1cae3a15d3-original-pull-secret\") pod \"global-pull-secret-syncer-29jzf\" (UID: \"a0c517c0-a190-4429-84f8-1b1cae3a15d3\") " pod="kube-system/global-pull-secret-syncer-29jzf" Jul 06 00:59:38.195927 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:38.195796 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 00:59:38.195927 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:38.195871 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0c517c0-a190-4429-84f8-1b1cae3a15d3-original-pull-secret podName:a0c517c0-a190-4429-84f8-1b1cae3a15d3 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:54.195851241 +0000 UTC m=+34.210224259 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0c517c0-a190-4429-84f8-1b1cae3a15d3-original-pull-secret") pod "global-pull-secret-syncer-29jzf" (UID: "a0c517c0-a190-4429-84f8-1b1cae3a15d3") : object "kube-system"/"original-pull-secret" not registered Jul 06 00:59:38.486875 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:38.486794 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn92r" Jul 06 00:59:38.487036 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:38.486950 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn92r" podUID="4ae44021-3eed-4a62-9e80-47242e594a85" Jul 06 00:59:38.487036 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:38.486996 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29jzf" Jul 06 00:59:38.487149 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:38.487118 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29jzf" podUID="a0c517c0-a190-4429-84f8-1b1cae3a15d3" Jul 06 00:59:39.487418 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:39.487384 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhbq2" Jul 06 00:59:39.487825 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:39.487502 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhbq2" podUID="b8c268c7-44e5-467f-a64e-cf7aa8ed1af1" Jul 06 00:59:40.487931 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:40.487902 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn92r" Jul 06 00:59:40.488360 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:40.488016 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn92r" podUID="4ae44021-3eed-4a62-9e80-47242e594a85" Jul 06 00:59:40.488360 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:40.488094 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29jzf" Jul 06 00:59:40.488360 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:40.488180 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29jzf" podUID="a0c517c0-a190-4429-84f8-1b1cae3a15d3" Jul 06 00:59:41.487143 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:41.486977 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhbq2" Jul 06 00:59:41.487249 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:41.487231 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhbq2" podUID="b8c268c7-44e5-467f-a64e-cf7aa8ed1af1" Jul 06 00:59:41.590261 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:41.590235 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvn4v" event={"ID":"1683b4f2-b243-4601-ade5-88419c3343a2","Type":"ContainerStarted","Data":"b3fab5133592e7df62fba253d6281ace1be4bbf39d0b618aa5324da62b9ae98c"} Jul 06 00:59:41.591772 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:41.591744 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fd9gs" event={"ID":"b06e2389-f65c-472b-96e1-a90b509a285f","Type":"ContainerStarted","Data":"129526311f8c48d7a88b8e93d5df71421ea0d4eba6e1f3370f76df8b68c7eb75"} Jul 06 00:59:41.593484 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:41.593457 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fc8xr" event={"ID":"74e85a91-ab9c-4c02-985f-48961dec5b3c","Type":"ContainerStarted","Data":"c4785a231ab7add466a72166fc264c69f0687918c3a7772d91ca117633092505"} Jul 06 00:59:41.595171 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:41.595139 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4zt7s" event={"ID":"cb1b89be-8278-4871-99e2-d5710f5da0cc","Type":"ContainerStarted","Data":"40df45e475b226af0351b5070abf947ecd2068b9397511a21156f3821aac3ae4"} Jul 06 00:59:41.596519 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:41.596499 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-61.ec2.internal" event={"ID":"cb82acd52a7ee3f92342ad96761e1bd7","Type":"ContainerStarted","Data":"9f08d426ee79a441e25217eadae313b4ee3f43e267e020e1b9fedbd56f692ae1"} Jul 06 00:59:41.597876 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:41.597853 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qs4nj" event={"ID":"ab933df1-be97-411c-9012-1eca2b14c318","Type":"ContainerStarted","Data":"17e735c2ab4df665e0f4397d57268cf90e23631e8454b92b29c8ff3c111a9267"} Jul 06 00:59:41.598996 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:41.598979 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9gpql" event={"ID":"d98beaf2-36ca-43ac-87ae-38972aae9ad9","Type":"ContainerStarted","Data":"08f7571a4671dc7b4a90ff353e99342387e2b314bf722024a572658c12063b6d"} Jul 06 00:59:41.623184 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:41.623144 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qs4nj" podStartSLOduration=7.2754038340000005 podStartE2EDuration="21.62313241s" totalImagesPullingTime="14.347728576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 00:59:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 00:59:41.622477938 +0000 UTC m=+21.636850973" watchObservedRunningTime="2026-07-06 00:59:41.62313241 +0000 UTC m=+21.637505445" Jul 06 00:59:41.637039 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:41.637004 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9gpql" podStartSLOduration=4.236551471 podStartE2EDuration="21.636993271s" totalImagesPullingTime="17.4004418s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 00:59:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 00:59:41.636717793 +0000 UTC m=+21.651090830" watchObservedRunningTime="2026-07-06 00:59:41.636993271 +0000 UTC m=+21.651366304" Jul 06 00:59:41.650205 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:41.650171 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fc8xr" podStartSLOduration=4.256085951 podStartE2EDuration="21.650160223s" totalImagesPullingTime="17.394074272s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 00:59:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 00:59:41.650152069 +0000 UTC m=+21.664525104" watchObservedRunningTime="2026-07-06 00:59:41.650160223 +0000 UTC m=+21.664533259" Jul 06 00:59:41.682497 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:41.682445 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4zt7s" podStartSLOduration=4.283673297 podStartE2EDuration="21.682429656s" totalImagesPullingTime="17.398756359s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 00:59:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 00:59:41.681991724 +0000 UTC m=+21.696364761" watchObservedRunningTime="2026-07-06 00:59:41.682429656 +0000 UTC m=+21.696802695" Jul 06 00:59:41.682605 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:41.682538 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-61.ec2.internal" podStartSLOduration=20.682530351 podStartE2EDuration="20.682530351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 00:59:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 00:59:41.667758799 +0000 UTC m=+21.682131835" watchObservedRunningTime="2026-07-06 00:59:41.682530351 +0000 UTC m=+21.696903390" Jul 06 00:59:42.452746 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:42.452491 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qs4nj" Jul 06 00:59:42.489603 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:42.489574 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29jzf" Jul 06 00:59:42.489739 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:42.489688 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29jzf" podUID="a0c517c0-a190-4429-84f8-1b1cae3a15d3" Jul 06 00:59:42.489739 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:42.489724 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn92r" Jul 06 00:59:42.489832 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:42.489815 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn92r" podUID="4ae44021-3eed-4a62-9e80-47242e594a85" Jul 06 00:59:42.604443 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:42.603528 2553 generic.go:356] "Generic (PLEG): container finished" podID="b06e2389-f65c-472b-96e1-a90b509a285f" containerID="129526311f8c48d7a88b8e93d5df71421ea0d4eba6e1f3370f76df8b68c7eb75" exitCode=0 Jul 06 00:59:42.604443 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:42.603612 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fd9gs" event={"ID":"b06e2389-f65c-472b-96e1-a90b509a285f","Type":"ContainerDied","Data":"129526311f8c48d7a88b8e93d5df71421ea0d4eba6e1f3370f76df8b68c7eb75"} Jul 06 00:59:42.605392 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:42.605363 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2l8g9" event={"ID":"e0506c24-d40f-474c-891d-7a3695d5c055","Type":"ContainerStarted","Data":"73f010da4e28354f66b5e6830a471423f7ef500b63b3753a692b220f40d4bc82"} Jul 06 00:59:42.608577 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:42.608550 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" event={"ID":"77af8bb2-87f4-4059-9dd0-15e7820325ed","Type":"ContainerStarted","Data":"073e5da43feb3141cd1b6364e03be8eff9abc083d4a00d76079d12d5257818bc"} Jul 06 00:59:42.608762 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:42.608631 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" event={"ID":"77af8bb2-87f4-4059-9dd0-15e7820325ed","Type":"ContainerStarted","Data":"6ada99bd7c8d730d5fd2a740190bac0346b5a194bef5e983d14a2cc66d614e6c"} Jul 06 00:59:42.608762 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:42.608707 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" event={"ID":"77af8bb2-87f4-4059-9dd0-15e7820325ed","Type":"ContainerStarted","Data":"e261dff48ecc80476adcdf64b7080dec5ffd5891080aaf74f6fb321337ba09e7"} Jul 06 00:59:42.608762 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:42.608754 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" event={"ID":"77af8bb2-87f4-4059-9dd0-15e7820325ed","Type":"ContainerStarted","Data":"88d78ad62c3ae431d7bdc5899edebde994efe805d65655ee5d468db352819b74"} Jul 06 00:59:42.608876 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:42.608785 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" event={"ID":"77af8bb2-87f4-4059-9dd0-15e7820325ed","Type":"ContainerStarted","Data":"bd414fbf503c609867ace21f9f8361e75cd08a98708f29e22e3a886581f62faa"} Jul 06 00:59:42.608876 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:42.608821 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" event={"ID":"77af8bb2-87f4-4059-9dd0-15e7820325ed","Type":"ContainerStarted","Data":"13b7cf269d6c4be949263733f13e98e7974c21525c7d329405ee82180ab5b350"} Jul 06 00:59:42.973604 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:42.973583 2553 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 00:59:43.405465 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:43.405378 2553 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T00:59:42.973599645Z","UUID":"c026099e-9604-44ac-bae1-2851b193995f","Handler":null,"Name":"","Endpoint":""} Jul 06 00:59:43.406996 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:43.406961 2553 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 00:59:43.407148 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:43.407015 2553 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 00:59:43.486623 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:43.486590 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhbq2" Jul 06 00:59:43.486914 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:43.486722 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhbq2" podUID="b8c268c7-44e5-467f-a64e-cf7aa8ed1af1" Jul 06 00:59:43.613457 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:43.613409 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvn4v" event={"ID":"1683b4f2-b243-4601-ade5-88419c3343a2","Type":"ContainerStarted","Data":"663c3b79f40d3c98b673cb60c43bc15151c9b821dfb77753cd8a7e4277fdd33f"} Jul 06 00:59:43.615581 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:43.615540 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g4sx7" event={"ID":"0592acc7-b10c-4497-9b99-7f0de0eb2b91","Type":"ContainerStarted","Data":"6f8b7b2bedd6495527935cb4892b8eadd95fd5dcf29401df4f83689b0147b79a"} Jul 06 00:59:43.630421 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:43.630360 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2l8g9" podStartSLOduration=5.717938613 podStartE2EDuration="23.630339789s" totalImagesPullingTime="17.912401176s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 00:59:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 00:59:42.638372514 +0000 UTC m=+22.652745560" watchObservedRunningTime="2026-07-06 00:59:43.630339789 +0000 UTC m=+23.644712825" Jul 06 00:59:43.630587 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:43.630560 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-g4sx7" podStartSLOduration=6.243848903 podStartE2EDuration="23.630553354s" totalImagesPullingTime="17.386704451s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 00:59:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 00:59:43.629855031 +0000 UTC m=+23.644228060" watchObservedRunningTime="2026-07-06 00:59:43.630553354 +0000 UTC m=+23.644926392" Jul 06 00:59:44.487162 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:44.486985 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn92r" Jul 06 00:59:44.487289 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:44.487022 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29jzf" Jul 06 00:59:44.487289 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:44.487258 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn92r" podUID="4ae44021-3eed-4a62-9e80-47242e594a85" Jul 06 00:59:44.487357 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:44.487295 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29jzf" podUID="a0c517c0-a190-4429-84f8-1b1cae3a15d3" Jul 06 00:59:44.620205 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:44.620165 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvn4v" event={"ID":"1683b4f2-b243-4601-ade5-88419c3343a2","Type":"ContainerStarted","Data":"1daa5053a28335d24fbac0c9b5c07563a2ec251fadeac834619b1e1a1cb7b191"} Jul 06 00:59:44.624180 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:44.624149 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" event={"ID":"77af8bb2-87f4-4059-9dd0-15e7820325ed","Type":"ContainerStarted","Data":"4a65571100769feb9f991c5463f32dd1d854ecb098d60d6a002c359b6f7f0f96"} Jul 06 00:59:44.636573 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:44.636525 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gvn4v" podStartSLOduration=7.552536315 podStartE2EDuration="24.636512024s" totalImagesPullingTime="17.083975709s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 00:59:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 00:59:44.636285507 +0000 UTC m=+24.650658543" watchObservedRunningTime="2026-07-06 00:59:44.636512024 +0000 UTC m=+24.650885059" Jul 06 00:59:45.487320 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:45.487282 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhbq2" Jul 06 00:59:45.487486 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:45.487410 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhbq2" podUID="b8c268c7-44e5-467f-a64e-cf7aa8ed1af1" Jul 06 00:59:46.305987 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:46.305964 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qs4nj" Jul 06 00:59:46.306574 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:46.306496 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qs4nj" Jul 06 00:59:46.316337 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:46.316294 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qs4nj" Jul 06 00:59:46.486825 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:46.486632 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29jzf" Jul 06 00:59:46.486981 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:46.486723 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn92r" Jul 06 00:59:46.486981 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:46.486938 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29jzf" podUID="a0c517c0-a190-4429-84f8-1b1cae3a15d3" Jul 06 00:59:46.487072 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:46.487015 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn92r" podUID="4ae44021-3eed-4a62-9e80-47242e594a85" Jul 06 00:59:46.631496 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:46.631377 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" event={"ID":"77af8bb2-87f4-4059-9dd0-15e7820325ed","Type":"ContainerStarted","Data":"71ccd94a9b89a5866252e72ea91e074bf943f7110dea5db1e3461cc519627410"} Jul 06 00:59:46.656042 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:46.656000 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" podStartSLOduration=8.937930582 podStartE2EDuration="26.65598657s" totalImagesPullingTime="17.718055988s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 00:59:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 00:59:46.65591064 +0000 UTC m=+26.670283677" watchObservedRunningTime="2026-07-06 00:59:46.65598657 +0000 UTC m=+26.670359605" Jul 06 00:59:47.486762 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:47.486725 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhbq2" Jul 06 00:59:47.487198 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:47.486854 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhbq2" podUID="b8c268c7-44e5-467f-a64e-cf7aa8ed1af1" Jul 06 00:59:47.635113 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:47.634896 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:47.635113 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:47.634987 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:47.635113 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:47.635042 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:47.657556 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:47.657124 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:47.657556 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:47.657468 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 00:59:48.317187 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:48.317157 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gn92r"] Jul 06 00:59:48.317360 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:48.317282 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn92r" Jul 06 00:59:48.317428 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:48.317406 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn92r" podUID="4ae44021-3eed-4a62-9e80-47242e594a85" Jul 06 00:59:48.319969 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:48.319943 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nhbq2"] Jul 06 00:59:48.320100 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:48.320025 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhbq2" Jul 06 00:59:48.320166 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:48.320126 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhbq2" podUID="b8c268c7-44e5-467f-a64e-cf7aa8ed1af1" Jul 06 00:59:48.327632 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:48.327609 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-29jzf"] Jul 06 00:59:48.327763 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:48.327725 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29jzf" Jul 06 00:59:48.327835 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:48.327814 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29jzf" podUID="a0c517c0-a190-4429-84f8-1b1cae3a15d3" Jul 06 00:59:48.640614 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:48.640584 2553 generic.go:356] "Generic (PLEG): container finished" podID="b06e2389-f65c-472b-96e1-a90b509a285f" containerID="c983c0b31df6524633d35ba428a2c2be83ac3b850e004c44841d597e45a7217d" exitCode=0 Jul 06 00:59:48.641035 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:48.640660 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fd9gs" event={"ID":"b06e2389-f65c-472b-96e1-a90b509a285f","Type":"ContainerDied","Data":"c983c0b31df6524633d35ba428a2c2be83ac3b850e004c44841d597e45a7217d"} Jul 06 00:59:50.488072 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:50.487891 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn92r" Jul 06 00:59:50.488533 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:50.487952 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhbq2" Jul 06 00:59:50.488533 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:50.488135 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn92r" podUID="4ae44021-3eed-4a62-9e80-47242e594a85" Jul 06 00:59:50.488533 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:50.488251 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhbq2" podUID="b8c268c7-44e5-467f-a64e-cf7aa8ed1af1" Jul 06 00:59:50.488533 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:50.487976 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29jzf" Jul 06 00:59:50.488533 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:50.488314 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29jzf" podUID="a0c517c0-a190-4429-84f8-1b1cae3a15d3" Jul 06 00:59:50.646415 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:50.646333 2553 generic.go:356] "Generic (PLEG): container finished" podID="b06e2389-f65c-472b-96e1-a90b509a285f" containerID="045b650b206f7dcfbd5767703b8031931d87f80e1538ec5e3c2fbe0d7f730c20" exitCode=0 Jul 06 00:59:50.646415 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:50.646392 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fd9gs" event={"ID":"b06e2389-f65c-472b-96e1-a90b509a285f","Type":"ContainerDied","Data":"045b650b206f7dcfbd5767703b8031931d87f80e1538ec5e3c2fbe0d7f730c20"} Jul 06 00:59:52.487085 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:52.487058 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29jzf" Jul 06 00:59:52.487577 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:52.487151 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn92r" Jul 06 00:59:52.487577 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:52.487179 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhbq2" Jul 06 00:59:52.487577 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:52.487256 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gn92r" podUID="4ae44021-3eed-4a62-9e80-47242e594a85" Jul 06 00:59:52.487577 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:52.487154 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-29jzf" podUID="a0c517c0-a190-4429-84f8-1b1cae3a15d3" Jul 06 00:59:52.487577 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:52.487321 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nhbq2" podUID="b8c268c7-44e5-467f-a64e-cf7aa8ed1af1" Jul 06 00:59:52.652292 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:52.652262 2553 generic.go:356] "Generic (PLEG): container finished" podID="b06e2389-f65c-472b-96e1-a90b509a285f" containerID="30acd0d8252bdac97bb0ba21af8e69190a6463f122ac7e3cc475437318836954" exitCode=0 Jul 06 00:59:52.652463 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:52.652309 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fd9gs" event={"ID":"b06e2389-f65c-472b-96e1-a90b509a285f","Type":"ContainerDied","Data":"30acd0d8252bdac97bb0ba21af8e69190a6463f122ac7e3cc475437318836954"} Jul 06 00:59:54.122272 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.122236 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttnlr\" (UniqueName: \"kubernetes.io/projected/b8c268c7-44e5-467f-a64e-cf7aa8ed1af1-kube-api-access-ttnlr\") pod \"network-check-target-nhbq2\" (UID: \"b8c268c7-44e5-467f-a64e-cf7aa8ed1af1\") " pod="openshift-network-diagnostics/network-check-target-nhbq2" Jul 06 00:59:54.122801 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.122298 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ae44021-3eed-4a62-9e80-47242e594a85-metrics-certs\") pod \"network-metrics-daemon-gn92r\" (UID: \"4ae44021-3eed-4a62-9e80-47242e594a85\") " pod="openshift-multus/network-metrics-daemon-gn92r" Jul 06 00:59:54.122801 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:54.122388 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 00:59:54.122801 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:54.122410 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 00:59:54.122801 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:54.122431 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ae44021-3eed-4a62-9e80-47242e594a85-metrics-certs podName:4ae44021-3eed-4a62-9e80-47242e594a85 nodeName:}" failed. No retries permitted until 2026-07-06 01:00:26.122417252 +0000 UTC m=+66.136790266 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ae44021-3eed-4a62-9e80-47242e594a85-metrics-certs") pod "network-metrics-daemon-gn92r" (UID: "4ae44021-3eed-4a62-9e80-47242e594a85") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 00:59:54.122801 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:54.122433 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 00:59:54.122801 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:54.122447 2553 projected.go:196] Error preparing data for projected volume kube-api-access-ttnlr for pod openshift-network-diagnostics/network-check-target-nhbq2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 00:59:54.122801 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:54.122499 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8c268c7-44e5-467f-a64e-cf7aa8ed1af1-kube-api-access-ttnlr podName:b8c268c7-44e5-467f-a64e-cf7aa8ed1af1 nodeName:}" failed. No retries permitted until 2026-07-06 01:00:26.122482561 +0000 UTC m=+66.136855575 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ttnlr" (UniqueName: "kubernetes.io/projected/b8c268c7-44e5-467f-a64e-cf7aa8ed1af1-kube-api-access-ttnlr") pod "network-check-target-nhbq2" (UID: "b8c268c7-44e5-467f-a64e-cf7aa8ed1af1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 00:59:54.223420 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.223387 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0c517c0-a190-4429-84f8-1b1cae3a15d3-original-pull-secret\") pod \"global-pull-secret-syncer-29jzf\" (UID: \"a0c517c0-a190-4429-84f8-1b1cae3a15d3\") " pod="kube-system/global-pull-secret-syncer-29jzf" Jul 06 00:59:54.223576 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:54.223554 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 00:59:54.223634 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:54.223621 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0c517c0-a190-4429-84f8-1b1cae3a15d3-original-pull-secret podName:a0c517c0-a190-4429-84f8-1b1cae3a15d3 nodeName:}" failed. No retries permitted until 2026-07-06 01:00:26.223603584 +0000 UTC m=+66.237976602 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a0c517c0-a190-4429-84f8-1b1cae3a15d3-original-pull-secret") pod "global-pull-secret-syncer-29jzf" (UID: "a0c517c0-a190-4429-84f8-1b1cae3a15d3") : object "kube-system"/"original-pull-secret" not registered Jul 06 00:59:54.304678 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.304634 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-61.ec2.internal" event="NodeReady" Jul 06 00:59:54.304818 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.304778 2553 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 00:59:54.336780 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.336754 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-774f7dcb6c-6fcv4"] Jul 06 00:59:54.350859 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.350827 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2ftr2"] Jul 06 00:59:54.351069 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.350919 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 00:59:54.353506 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.353483 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 00:59:54.353617 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.353543 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 00:59:54.353974 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.353958 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s9mpr\"" Jul 06 00:59:54.354067 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.354016 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 00:59:54.359244 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.359226 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n59gl"] Jul 06 00:59:54.359387 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.359371 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2ftr2" Jul 06 00:59:54.359583 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.359379 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 00:59:54.362047 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.362026 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lh7x6\"" Jul 06 00:59:54.362861 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.362331 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 00:59:54.362861 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.362384 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 00:59:54.374011 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.373981 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-774f7dcb6c-6fcv4"] Jul 06 00:59:54.374011 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.374012 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2ftr2"] Jul 06 00:59:54.374155 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.374035 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n59gl"] Jul 06 00:59:54.374155 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.374096 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n59gl" Jul 06 00:59:54.376790 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.376766 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8lk2l\"" Jul 06 00:59:54.376790 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.376784 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 00:59:54.376976 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.376776 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 00:59:54.377170 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.377154 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 00:59:54.486722 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.486692 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn92r" Jul 06 00:59:54.486892 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.486692 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29jzf" Jul 06 00:59:54.486892 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.486692 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhbq2" Jul 06 00:59:54.489711 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.489684 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 00:59:54.489843 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.489781 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fwj5x\"" Jul 06 00:59:54.490028 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.490002 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 00:59:54.490113 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.490035 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-98z5h\"" Jul 06 00:59:54.490214 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.490198 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 00:59:54.490263 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.490250 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 00:59:54.525172 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.525147 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/261a7be8-29de-4ea5-9394-7cf8275dfd9c-config-volume\") pod \"dns-default-2ftr2\" (UID: \"261a7be8-29de-4ea5-9394-7cf8275dfd9c\") " pod="openshift-dns/dns-default-2ftr2" Jul 06 00:59:54.525300 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.525186 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-bound-sa-token\") pod \"image-registry-774f7dcb6c-6fcv4\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 00:59:54.525300 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.525214 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf64d\" (UniqueName: \"kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-kube-api-access-vf64d\") pod \"image-registry-774f7dcb6c-6fcv4\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 00:59:54.525300 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.525237 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb9sj\" (UniqueName: \"kubernetes.io/projected/bb979aaf-8966-44b2-a762-bbd3052753a4-kube-api-access-wb9sj\") pod \"ingress-canary-n59gl\" (UID: \"bb979aaf-8966-44b2-a762-bbd3052753a4\") " pod="openshift-ingress-canary/ingress-canary-n59gl" Jul 06 00:59:54.525466 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.525339 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk7nn\" (UniqueName: \"kubernetes.io/projected/261a7be8-29de-4ea5-9394-7cf8275dfd9c-kube-api-access-fk7nn\") pod \"dns-default-2ftr2\" (UID: \"261a7be8-29de-4ea5-9394-7cf8275dfd9c\") " pod="openshift-dns/dns-default-2ftr2" Jul 06 00:59:54.525466 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.525375 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-trusted-ca\") pod \"image-registry-774f7dcb6c-6fcv4\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 00:59:54.525466 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.525402 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-ca-trust-extracted\") pod \"image-registry-774f7dcb6c-6fcv4\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 00:59:54.525466 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.525429 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-certificates\") pod \"image-registry-774f7dcb6c-6fcv4\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 00:59:54.525466 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.525461 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb979aaf-8966-44b2-a762-bbd3052753a4-cert\") pod \"ingress-canary-n59gl\" (UID: \"bb979aaf-8966-44b2-a762-bbd3052753a4\") " pod="openshift-ingress-canary/ingress-canary-n59gl" Jul 06 00:59:54.525733 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.525517 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-image-registry-private-configuration\") pod \"image-registry-774f7dcb6c-6fcv4\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 00:59:54.525733 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.525543 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-installation-pull-secrets\") pod \"image-registry-774f7dcb6c-6fcv4\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 00:59:54.525733 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.525609 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/261a7be8-29de-4ea5-9394-7cf8275dfd9c-metrics-tls\") pod \"dns-default-2ftr2\" (UID: \"261a7be8-29de-4ea5-9394-7cf8275dfd9c\") " pod="openshift-dns/dns-default-2ftr2" Jul 06 00:59:54.525733 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.525633 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/261a7be8-29de-4ea5-9394-7cf8275dfd9c-tmp-dir\") pod \"dns-default-2ftr2\" (UID: \"261a7be8-29de-4ea5-9394-7cf8275dfd9c\") " pod="openshift-dns/dns-default-2ftr2" Jul 06 00:59:54.525733 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.525683 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-tls\") pod \"image-registry-774f7dcb6c-6fcv4\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 00:59:54.626745 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.626647 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-ca-trust-extracted\") pod \"image-registry-774f7dcb6c-6fcv4\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 00:59:54.626745 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.626707 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-certificates\") pod \"image-registry-774f7dcb6c-6fcv4\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 00:59:54.626745 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.626734 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb979aaf-8966-44b2-a762-bbd3052753a4-cert\") pod \"ingress-canary-n59gl\" (UID: \"bb979aaf-8966-44b2-a762-bbd3052753a4\") " pod="openshift-ingress-canary/ingress-canary-n59gl" Jul 06 00:59:54.627033 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.626756 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-image-registry-private-configuration\") pod \"image-registry-774f7dcb6c-6fcv4\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 00:59:54.627033 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.626980 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-installation-pull-secrets\") pod \"image-registry-774f7dcb6c-6fcv4\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 00:59:54.627141 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.627084 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/261a7be8-29de-4ea5-9394-7cf8275dfd9c-metrics-tls\") pod \"dns-default-2ftr2\" (UID: \"261a7be8-29de-4ea5-9394-7cf8275dfd9c\") " pod="openshift-dns/dns-default-2ftr2" Jul 06 00:59:54.627141 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.627125 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/261a7be8-29de-4ea5-9394-7cf8275dfd9c-tmp-dir\") pod \"dns-default-2ftr2\" (UID: \"261a7be8-29de-4ea5-9394-7cf8275dfd9c\") " pod="openshift-dns/dns-default-2ftr2" Jul 06 00:59:54.627241 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.627147 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-tls\") pod \"image-registry-774f7dcb6c-6fcv4\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 00:59:54.627241 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.627184 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/261a7be8-29de-4ea5-9394-7cf8275dfd9c-config-volume\") pod \"dns-default-2ftr2\" (UID: \"261a7be8-29de-4ea5-9394-7cf8275dfd9c\") " pod="openshift-dns/dns-default-2ftr2" Jul 06 00:59:54.627241 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.627209 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-bound-sa-token\") pod \"image-registry-774f7dcb6c-6fcv4\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 00:59:54.627241 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.627236 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf64d\" (UniqueName: \"kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-kube-api-access-vf64d\") pod \"image-registry-774f7dcb6c-6fcv4\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 00:59:54.627438 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.627259 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb9sj\" (UniqueName: \"kubernetes.io/projected/bb979aaf-8966-44b2-a762-bbd3052753a4-kube-api-access-wb9sj\") pod \"ingress-canary-n59gl\" (UID: \"bb979aaf-8966-44b2-a762-bbd3052753a4\") " pod="openshift-ingress-canary/ingress-canary-n59gl" Jul 06 00:59:54.627438 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.627315 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk7nn\" (UniqueName: \"kubernetes.io/projected/261a7be8-29de-4ea5-9394-7cf8275dfd9c-kube-api-access-fk7nn\") pod \"dns-default-2ftr2\" (UID: \"261a7be8-29de-4ea5-9394-7cf8275dfd9c\") " pod="openshift-dns/dns-default-2ftr2" Jul 06 00:59:54.627438 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.627347 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-trusted-ca\") pod \"image-registry-774f7dcb6c-6fcv4\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 00:59:54.627438 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.627411 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-certificates\") pod \"image-registry-774f7dcb6c-6fcv4\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 00:59:54.627640 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.627571 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/261a7be8-29de-4ea5-9394-7cf8275dfd9c-tmp-dir\") pod \"dns-default-2ftr2\" (UID: \"261a7be8-29de-4ea5-9394-7cf8275dfd9c\") " pod="openshift-dns/dns-default-2ftr2" Jul 06 00:59:54.627725 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:54.627653 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 00:59:54.627789 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:54.627739 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261a7be8-29de-4ea5-9394-7cf8275dfd9c-metrics-tls podName:261a7be8-29de-4ea5-9394-7cf8275dfd9c nodeName:}" failed. No retries permitted until 2026-07-06 00:59:55.127718763 +0000 UTC m=+35.142091790 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/261a7be8-29de-4ea5-9394-7cf8275dfd9c-metrics-tls") pod "dns-default-2ftr2" (UID: "261a7be8-29de-4ea5-9394-7cf8275dfd9c") : secret "dns-default-metrics-tls" not found Jul 06 00:59:54.628399 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.627098 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-ca-trust-extracted\") pod \"image-registry-774f7dcb6c-6fcv4\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 00:59:54.628399 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:54.628115 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 00:59:54.628399 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:54.628135 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-774f7dcb6c-6fcv4: secret "image-registry-tls" not found Jul 06 00:59:54.628399 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:54.628238 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-tls podName:4d049ebd-dbc6-49a4-9974-d7f2e911bb77 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:55.128163481 +0000 UTC m=+35.142536509 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-tls") pod "image-registry-774f7dcb6c-6fcv4" (UID: "4d049ebd-dbc6-49a4-9974-d7f2e911bb77") : secret "image-registry-tls" not found Jul 06 00:59:54.628399 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.628312 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-trusted-ca\") pod \"image-registry-774f7dcb6c-6fcv4\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 00:59:54.628804 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.628539 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/261a7be8-29de-4ea5-9394-7cf8275dfd9c-config-volume\") pod \"dns-default-2ftr2\" (UID: \"261a7be8-29de-4ea5-9394-7cf8275dfd9c\") " pod="openshift-dns/dns-default-2ftr2" Jul 06 00:59:54.631849 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.631817 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-installation-pull-secrets\") pod \"image-registry-774f7dcb6c-6fcv4\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 00:59:54.631941 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.631823 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb979aaf-8966-44b2-a762-bbd3052753a4-cert\") pod \"ingress-canary-n59gl\" (UID: \"bb979aaf-8966-44b2-a762-bbd3052753a4\") " pod="openshift-ingress-canary/ingress-canary-n59gl" Jul 06 00:59:54.631941 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.631870 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-image-registry-private-configuration\") pod \"image-registry-774f7dcb6c-6fcv4\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 00:59:54.636117 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.636093 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk7nn\" (UniqueName: \"kubernetes.io/projected/261a7be8-29de-4ea5-9394-7cf8275dfd9c-kube-api-access-fk7nn\") pod \"dns-default-2ftr2\" (UID: \"261a7be8-29de-4ea5-9394-7cf8275dfd9c\") " pod="openshift-dns/dns-default-2ftr2" Jul 06 00:59:54.636332 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.636314 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-bound-sa-token\") pod \"image-registry-774f7dcb6c-6fcv4\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 00:59:54.636607 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.636590 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb9sj\" (UniqueName: \"kubernetes.io/projected/bb979aaf-8966-44b2-a762-bbd3052753a4-kube-api-access-wb9sj\") pod \"ingress-canary-n59gl\" (UID: \"bb979aaf-8966-44b2-a762-bbd3052753a4\") " pod="openshift-ingress-canary/ingress-canary-n59gl" Jul 06 00:59:54.637895 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.637832 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf64d\" (UniqueName: \"kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-kube-api-access-vf64d\") pod \"image-registry-774f7dcb6c-6fcv4\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 00:59:54.683748 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.683717 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n59gl" Jul 06 00:59:54.868148 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:54.867988 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n59gl"] Jul 06 00:59:54.871756 ip-10-0-135-61 kubenswrapper[2553]: W0706 00:59:54.871732 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb979aaf_8966_44b2_a762_bbd3052753a4.slice/crio-f07af089bfa479a846285d53660ad896da2a0a77637ba511a1d2eb8a528102f6 WatchSource:0}: Error finding container f07af089bfa479a846285d53660ad896da2a0a77637ba511a1d2eb8a528102f6: Status 404 returned error can't find the container with id f07af089bfa479a846285d53660ad896da2a0a77637ba511a1d2eb8a528102f6 Jul 06 00:59:55.130883 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:55.130846 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/261a7be8-29de-4ea5-9394-7cf8275dfd9c-metrics-tls\") pod \"dns-default-2ftr2\" (UID: \"261a7be8-29de-4ea5-9394-7cf8275dfd9c\") " pod="openshift-dns/dns-default-2ftr2" Jul 06 00:59:55.130883 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:55.130886 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-tls\") pod \"image-registry-774f7dcb6c-6fcv4\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 00:59:55.131392 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:55.130988 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 00:59:55.131392 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:55.130990 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 00:59:55.131392 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:55.130999 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-774f7dcb6c-6fcv4: secret "image-registry-tls" not found Jul 06 00:59:55.131392 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:55.131057 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261a7be8-29de-4ea5-9394-7cf8275dfd9c-metrics-tls podName:261a7be8-29de-4ea5-9394-7cf8275dfd9c nodeName:}" failed. No retries permitted until 2026-07-06 00:59:56.13103916 +0000 UTC m=+36.145412177 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/261a7be8-29de-4ea5-9394-7cf8275dfd9c-metrics-tls") pod "dns-default-2ftr2" (UID: "261a7be8-29de-4ea5-9394-7cf8275dfd9c") : secret "dns-default-metrics-tls" not found Jul 06 00:59:55.131392 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:55.131090 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-tls podName:4d049ebd-dbc6-49a4-9974-d7f2e911bb77 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:56.131074917 +0000 UTC m=+36.145447932 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-tls") pod "image-registry-774f7dcb6c-6fcv4" (UID: "4d049ebd-dbc6-49a4-9974-d7f2e911bb77") : secret "image-registry-tls" not found Jul 06 00:59:55.660541 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:55.660498 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n59gl" event={"ID":"bb979aaf-8966-44b2-a762-bbd3052753a4","Type":"ContainerStarted","Data":"f07af089bfa479a846285d53660ad896da2a0a77637ba511a1d2eb8a528102f6"} Jul 06 00:59:56.139827 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:56.139794 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/261a7be8-29de-4ea5-9394-7cf8275dfd9c-metrics-tls\") pod \"dns-default-2ftr2\" (UID: \"261a7be8-29de-4ea5-9394-7cf8275dfd9c\") " pod="openshift-dns/dns-default-2ftr2" Jul 06 00:59:56.139827 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:56.139829 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-tls\") pod \"image-registry-774f7dcb6c-6fcv4\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 00:59:56.140255 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:56.139938 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 00:59:56.140255 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:56.139950 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-774f7dcb6c-6fcv4: secret "image-registry-tls" not found Jul 06 00:59:56.140255 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:56.139955 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 00:59:56.140255 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:56.140017 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-tls podName:4d049ebd-dbc6-49a4-9974-d7f2e911bb77 nodeName:}" failed. No retries permitted until 2026-07-06 00:59:58.140000431 +0000 UTC m=+38.154373452 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-tls") pod "image-registry-774f7dcb6c-6fcv4" (UID: "4d049ebd-dbc6-49a4-9974-d7f2e911bb77") : secret "image-registry-tls" not found Jul 06 00:59:56.140255 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:56.140035 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261a7be8-29de-4ea5-9394-7cf8275dfd9c-metrics-tls podName:261a7be8-29de-4ea5-9394-7cf8275dfd9c nodeName:}" failed. No retries permitted until 2026-07-06 00:59:58.140025907 +0000 UTC m=+38.154398922 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/261a7be8-29de-4ea5-9394-7cf8275dfd9c-metrics-tls") pod "dns-default-2ftr2" (UID: "261a7be8-29de-4ea5-9394-7cf8275dfd9c") : secret "dns-default-metrics-tls" not found Jul 06 00:59:58.154982 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:58.154903 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/261a7be8-29de-4ea5-9394-7cf8275dfd9c-metrics-tls\") pod \"dns-default-2ftr2\" (UID: \"261a7be8-29de-4ea5-9394-7cf8275dfd9c\") " pod="openshift-dns/dns-default-2ftr2" Jul 06 00:59:58.154982 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:58.154946 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-tls\") pod \"image-registry-774f7dcb6c-6fcv4\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 00:59:58.155433 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:58.155072 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 00:59:58.155433 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:58.155134 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261a7be8-29de-4ea5-9394-7cf8275dfd9c-metrics-tls podName:261a7be8-29de-4ea5-9394-7cf8275dfd9c nodeName:}" failed. No retries permitted until 2026-07-06 01:00:02.155113226 +0000 UTC m=+42.169486243 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/261a7be8-29de-4ea5-9394-7cf8275dfd9c-metrics-tls") pod "dns-default-2ftr2" (UID: "261a7be8-29de-4ea5-9394-7cf8275dfd9c") : secret "dns-default-metrics-tls" not found Jul 06 00:59:58.155433 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:58.155134 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 00:59:58.155433 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:58.155153 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-774f7dcb6c-6fcv4: secret "image-registry-tls" not found Jul 06 00:59:58.155433 ip-10-0-135-61 kubenswrapper[2553]: E0706 00:59:58.155186 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-tls podName:4d049ebd-dbc6-49a4-9974-d7f2e911bb77 nodeName:}" failed. No retries permitted until 2026-07-06 01:00:02.155176483 +0000 UTC m=+42.169549500 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-tls") pod "image-registry-774f7dcb6c-6fcv4" (UID: "4d049ebd-dbc6-49a4-9974-d7f2e911bb77") : secret "image-registry-tls" not found Jul 06 00:59:59.671439 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:59.671242 2553 generic.go:356] "Generic (PLEG): container finished" podID="b06e2389-f65c-472b-96e1-a90b509a285f" containerID="993125c339c60ecddeefdf65322f7069bc274ef673b8c5ed79c2e90bde46d5b2" exitCode=0 Jul 06 00:59:59.671895 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:59.671328 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fd9gs" event={"ID":"b06e2389-f65c-472b-96e1-a90b509a285f","Type":"ContainerDied","Data":"993125c339c60ecddeefdf65322f7069bc274ef673b8c5ed79c2e90bde46d5b2"} Jul 06 00:59:59.672881 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:59.672859 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n59gl" event={"ID":"bb979aaf-8966-44b2-a762-bbd3052753a4","Type":"ContainerStarted","Data":"15993c15d694ee01887d41e64ba23310e66878e2596c155936c95992be1fb10a"} Jul 06 00:59:59.704410 ip-10-0-135-61 kubenswrapper[2553]: I0706 00:59:59.704367 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n59gl" podStartSLOduration=1.6313483149999999 podStartE2EDuration="5.704351378s" totalImagesPullingTime="4.073003063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 00:59:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 00:59:59.704100421 +0000 UTC m=+39.718473458" watchObservedRunningTime="2026-07-06 00:59:59.704351378 +0000 UTC m=+39.718724414" Jul 06 01:00:00.677525 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:00.677495 2553 generic.go:356] "Generic (PLEG): container finished" podID="b06e2389-f65c-472b-96e1-a90b509a285f" containerID="c7480310c1ef4bf1a1a6317c09d843d35bd7529f5850d0924229306b2c2739b1" exitCode=0 Jul 06 01:00:00.678000 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:00.677577 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fd9gs" event={"ID":"b06e2389-f65c-472b-96e1-a90b509a285f","Type":"ContainerDied","Data":"c7480310c1ef4bf1a1a6317c09d843d35bd7529f5850d0924229306b2c2739b1"} Jul 06 01:00:01.683584 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:01.683547 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fd9gs" event={"ID":"b06e2389-f65c-472b-96e1-a90b509a285f","Type":"ContainerStarted","Data":"4b19077ab696186a23be96d030dd0dfc64b4a264c1f51a34b60e614dd98efc8b"} Jul 06 01:00:01.703763 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:01.703720 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fd9gs" podStartSLOduration=8.722840318 podStartE2EDuration="41.703706956s" totalImagesPullingTime="32.980866638s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 00:59:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:00:01.703352488 +0000 UTC m=+41.717725526" watchObservedRunningTime="2026-07-06 01:00:01.703706956 +0000 UTC m=+41.718079991" Jul 06 01:00:02.184200 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:02.184155 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/261a7be8-29de-4ea5-9394-7cf8275dfd9c-metrics-tls\") pod \"dns-default-2ftr2\" (UID: \"261a7be8-29de-4ea5-9394-7cf8275dfd9c\") " pod="openshift-dns/dns-default-2ftr2" Jul 06 01:00:02.184200 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:02.184198 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-tls\") pod \"image-registry-774f7dcb6c-6fcv4\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 01:00:02.184457 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:00:02.184315 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 01:00:02.184457 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:00:02.184316 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 01:00:02.184457 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:00:02.184394 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261a7be8-29de-4ea5-9394-7cf8275dfd9c-metrics-tls podName:261a7be8-29de-4ea5-9394-7cf8275dfd9c nodeName:}" failed. No retries permitted until 2026-07-06 01:00:10.18437195 +0000 UTC m=+50.198744972 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/261a7be8-29de-4ea5-9394-7cf8275dfd9c-metrics-tls") pod "dns-default-2ftr2" (UID: "261a7be8-29de-4ea5-9394-7cf8275dfd9c") : secret "dns-default-metrics-tls" not found Jul 06 01:00:02.184457 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:00:02.184327 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-774f7dcb6c-6fcv4: secret "image-registry-tls" not found Jul 06 01:00:02.184457 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:00:02.184454 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-tls podName:4d049ebd-dbc6-49a4-9974-d7f2e911bb77 nodeName:}" failed. No retries permitted until 2026-07-06 01:00:10.184443427 +0000 UTC m=+50.198816442 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-tls") pod "image-registry-774f7dcb6c-6fcv4" (UID: "4d049ebd-dbc6-49a4-9974-d7f2e911bb77") : secret "image-registry-tls" not found Jul 06 01:00:10.240837 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:10.240800 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/261a7be8-29de-4ea5-9394-7cf8275dfd9c-metrics-tls\") pod \"dns-default-2ftr2\" (UID: \"261a7be8-29de-4ea5-9394-7cf8275dfd9c\") " pod="openshift-dns/dns-default-2ftr2" Jul 06 01:00:10.240837 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:10.240839 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-tls\") pod \"image-registry-774f7dcb6c-6fcv4\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 01:00:10.241261 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:00:10.240950 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 01:00:10.241261 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:00:10.241000 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 01:00:10.241261 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:00:10.241011 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-774f7dcb6c-6fcv4: secret "image-registry-tls" not found Jul 06 01:00:10.241261 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:00:10.241019 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261a7be8-29de-4ea5-9394-7cf8275dfd9c-metrics-tls podName:261a7be8-29de-4ea5-9394-7cf8275dfd9c nodeName:}" failed. No retries permitted until 2026-07-06 01:00:26.241002643 +0000 UTC m=+66.255375659 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/261a7be8-29de-4ea5-9394-7cf8275dfd9c-metrics-tls") pod "dns-default-2ftr2" (UID: "261a7be8-29de-4ea5-9394-7cf8275dfd9c") : secret "dns-default-metrics-tls" not found Jul 06 01:00:10.241261 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:00:10.241046 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-tls podName:4d049ebd-dbc6-49a4-9974-d7f2e911bb77 nodeName:}" failed. No retries permitted until 2026-07-06 01:00:26.241036004 +0000 UTC m=+66.255409019 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-tls") pod "image-registry-774f7dcb6c-6fcv4" (UID: "4d049ebd-dbc6-49a4-9974-d7f2e911bb77") : secret "image-registry-tls" not found Jul 06 01:00:19.660725 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:19.660696 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5bpwj" Jul 06 01:00:26.149765 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:26.149717 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttnlr\" (UniqueName: \"kubernetes.io/projected/b8c268c7-44e5-467f-a64e-cf7aa8ed1af1-kube-api-access-ttnlr\") pod \"network-check-target-nhbq2\" (UID: \"b8c268c7-44e5-467f-a64e-cf7aa8ed1af1\") " pod="openshift-network-diagnostics/network-check-target-nhbq2" Jul 06 01:00:26.150199 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:26.149819 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ae44021-3eed-4a62-9e80-47242e594a85-metrics-certs\") pod \"network-metrics-daemon-gn92r\" (UID: \"4ae44021-3eed-4a62-9e80-47242e594a85\") " pod="openshift-multus/network-metrics-daemon-gn92r" Jul 06 01:00:26.152387 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:26.152367 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 01:00:26.152474 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:26.152393 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 01:00:26.160496 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:00:26.160478 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 01:00:26.160551 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:00:26.160544 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ae44021-3eed-4a62-9e80-47242e594a85-metrics-certs podName:4ae44021-3eed-4a62-9e80-47242e594a85 nodeName:}" failed. No retries permitted until 2026-07-06 01:01:30.160527491 +0000 UTC m=+130.174900508 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ae44021-3eed-4a62-9e80-47242e594a85-metrics-certs") pod "network-metrics-daemon-gn92r" (UID: "4ae44021-3eed-4a62-9e80-47242e594a85") : secret "metrics-daemon-secret" not found Jul 06 01:00:26.162292 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:26.162278 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 01:00:26.174255 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:26.174229 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttnlr\" (UniqueName: \"kubernetes.io/projected/b8c268c7-44e5-467f-a64e-cf7aa8ed1af1-kube-api-access-ttnlr\") pod \"network-check-target-nhbq2\" (UID: \"b8c268c7-44e5-467f-a64e-cf7aa8ed1af1\") " pod="openshift-network-diagnostics/network-check-target-nhbq2" Jul 06 01:00:26.251036 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:26.251004 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0c517c0-a190-4429-84f8-1b1cae3a15d3-original-pull-secret\") pod \"global-pull-secret-syncer-29jzf\" (UID: \"a0c517c0-a190-4429-84f8-1b1cae3a15d3\") " pod="kube-system/global-pull-secret-syncer-29jzf" Jul 06 01:00:26.251176 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:26.251041 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/261a7be8-29de-4ea5-9394-7cf8275dfd9c-metrics-tls\") pod \"dns-default-2ftr2\" (UID: \"261a7be8-29de-4ea5-9394-7cf8275dfd9c\") " pod="openshift-dns/dns-default-2ftr2" Jul 06 01:00:26.251176 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:26.251061 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-tls\") pod \"image-registry-774f7dcb6c-6fcv4\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 01:00:26.251176 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:00:26.251150 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 01:00:26.251176 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:00:26.251161 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-774f7dcb6c-6fcv4: secret "image-registry-tls" not found Jul 06 01:00:26.251343 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:00:26.251209 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-tls podName:4d049ebd-dbc6-49a4-9974-d7f2e911bb77 nodeName:}" failed. No retries permitted until 2026-07-06 01:00:58.25119532 +0000 UTC m=+98.265568334 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-tls") pod "image-registry-774f7dcb6c-6fcv4" (UID: "4d049ebd-dbc6-49a4-9974-d7f2e911bb77") : secret "image-registry-tls" not found Jul 06 01:00:26.251343 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:00:26.251148 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 01:00:26.251343 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:00:26.251299 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261a7be8-29de-4ea5-9394-7cf8275dfd9c-metrics-tls podName:261a7be8-29de-4ea5-9394-7cf8275dfd9c nodeName:}" failed. No retries permitted until 2026-07-06 01:00:58.251279942 +0000 UTC m=+98.265652960 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/261a7be8-29de-4ea5-9394-7cf8275dfd9c-metrics-tls") pod "dns-default-2ftr2" (UID: "261a7be8-29de-4ea5-9394-7cf8275dfd9c") : secret "dns-default-metrics-tls" not found Jul 06 01:00:26.253674 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:26.253650 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 01:00:26.264135 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:26.264116 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a0c517c0-a190-4429-84f8-1b1cae3a15d3-original-pull-secret\") pod \"global-pull-secret-syncer-29jzf\" (UID: \"a0c517c0-a190-4429-84f8-1b1cae3a15d3\") " pod="kube-system/global-pull-secret-syncer-29jzf" Jul 06 01:00:26.302412 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:26.302378 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-29jzf" Jul 06 01:00:26.309521 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:26.309500 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-98z5h\"" Jul 06 01:00:26.317362 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:26.317345 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nhbq2" Jul 06 01:00:26.426508 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:26.426478 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-29jzf"] Jul 06 01:00:26.429534 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:00:26.429500 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0c517c0_a190_4429_84f8_1b1cae3a15d3.slice/crio-40e4971c0f63fbb8ef44d058aca079b5e2835ed169de83edc000ef66ab32f5dc WatchSource:0}: Error finding container 40e4971c0f63fbb8ef44d058aca079b5e2835ed169de83edc000ef66ab32f5dc: Status 404 returned error can't find the container with id 40e4971c0f63fbb8ef44d058aca079b5e2835ed169de83edc000ef66ab32f5dc Jul 06 01:00:26.442005 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:26.441981 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nhbq2"] Jul 06 01:00:26.444786 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:00:26.444763 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8c268c7_44e5_467f_a64e_cf7aa8ed1af1.slice/crio-14dcc9918f5f1cf07eea4b7b6b665b9c7b3ae1c2dd9e8d371014695de7f4c326 WatchSource:0}: Error finding container 14dcc9918f5f1cf07eea4b7b6b665b9c7b3ae1c2dd9e8d371014695de7f4c326: Status 404 returned error can't find the container with id 14dcc9918f5f1cf07eea4b7b6b665b9c7b3ae1c2dd9e8d371014695de7f4c326 Jul 06 01:00:26.743254 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:26.743217 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nhbq2" event={"ID":"b8c268c7-44e5-467f-a64e-cf7aa8ed1af1","Type":"ContainerStarted","Data":"14dcc9918f5f1cf07eea4b7b6b665b9c7b3ae1c2dd9e8d371014695de7f4c326"} Jul 06 01:00:26.744164 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:26.744140 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-29jzf" event={"ID":"a0c517c0-a190-4429-84f8-1b1cae3a15d3","Type":"ContainerStarted","Data":"40e4971c0f63fbb8ef44d058aca079b5e2835ed169de83edc000ef66ab32f5dc"} Jul 06 01:00:30.401942 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:30.401907 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5897499cfd-mmzvp"] Jul 06 01:00:30.404303 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:30.404275 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5897499cfd-mmzvp" Jul 06 01:00:30.408005 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:30.407719 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 06 01:00:30.408005 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:30.407746 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-tmksz\"" Jul 06 01:00:30.408005 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:30.407770 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 06 01:00:30.408005 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:30.407724 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 06 01:00:30.408005 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:30.407720 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 06 01:00:30.414920 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:30.414898 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5897499cfd-mmzvp"] Jul 06 01:00:30.485909 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:30.485877 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/94eabe70-0156-4774-8cc0-a040383784d7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5897499cfd-mmzvp\" (UID: \"94eabe70-0156-4774-8cc0-a040383784d7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5897499cfd-mmzvp" Jul 06 01:00:30.486086 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:30.485946 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnf2b\" (UniqueName: \"kubernetes.io/projected/94eabe70-0156-4774-8cc0-a040383784d7-kube-api-access-xnf2b\") pod \"managed-serviceaccount-addon-agent-5897499cfd-mmzvp\" (UID: \"94eabe70-0156-4774-8cc0-a040383784d7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5897499cfd-mmzvp" Jul 06 01:00:30.587293 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:30.587255 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnf2b\" (UniqueName: \"kubernetes.io/projected/94eabe70-0156-4774-8cc0-a040383784d7-kube-api-access-xnf2b\") pod \"managed-serviceaccount-addon-agent-5897499cfd-mmzvp\" (UID: \"94eabe70-0156-4774-8cc0-a040383784d7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5897499cfd-mmzvp" Jul 06 01:00:30.587439 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:30.587311 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/94eabe70-0156-4774-8cc0-a040383784d7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5897499cfd-mmzvp\" (UID: \"94eabe70-0156-4774-8cc0-a040383784d7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5897499cfd-mmzvp" Jul 06 01:00:30.590022 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:30.589992 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/94eabe70-0156-4774-8cc0-a040383784d7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5897499cfd-mmzvp\" (UID: \"94eabe70-0156-4774-8cc0-a040383784d7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5897499cfd-mmzvp" Jul 06 01:00:30.594717 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:30.594660 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnf2b\" (UniqueName: \"kubernetes.io/projected/94eabe70-0156-4774-8cc0-a040383784d7-kube-api-access-xnf2b\") pod \"managed-serviceaccount-addon-agent-5897499cfd-mmzvp\" (UID: \"94eabe70-0156-4774-8cc0-a040383784d7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5897499cfd-mmzvp" Jul 06 01:00:30.722558 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:30.722526 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5897499cfd-mmzvp" Jul 06 01:00:31.590626 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:31.589701 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5897499cfd-mmzvp"] Jul 06 01:00:31.594123 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:00:31.594094 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94eabe70_0156_4774_8cc0_a040383784d7.slice/crio-3e738cceeeb903095cf0c553f2a425c93a0359908db0d197a0497500a325f5cd WatchSource:0}: Error finding container 3e738cceeeb903095cf0c553f2a425c93a0359908db0d197a0497500a325f5cd: Status 404 returned error can't find the container with id 3e738cceeeb903095cf0c553f2a425c93a0359908db0d197a0497500a325f5cd Jul 06 01:00:31.759095 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:31.759056 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-29jzf" event={"ID":"a0c517c0-a190-4429-84f8-1b1cae3a15d3","Type":"ContainerStarted","Data":"e362bf0d5b6c272ffe146b0f1b4175590cf656517c66722cc3b51dfc27747503"} Jul 06 01:00:31.760256 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:31.760225 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5897499cfd-mmzvp" event={"ID":"94eabe70-0156-4774-8cc0-a040383784d7","Type":"ContainerStarted","Data":"3e738cceeeb903095cf0c553f2a425c93a0359908db0d197a0497500a325f5cd"} Jul 06 01:00:31.761576 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:31.761543 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nhbq2" event={"ID":"b8c268c7-44e5-467f-a64e-cf7aa8ed1af1","Type":"ContainerStarted","Data":"9ffeca4347d6e9ccb257cbc57317fef4dca6b3f1824aa8162d767d9b405b8ff9"} Jul 06 01:00:31.761706 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:31.761690 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nhbq2" Jul 06 01:00:31.773707 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:31.773644 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-29jzf" podStartSLOduration=66.724965304 podStartE2EDuration="1m11.773627814s" totalImagesPullingTime="5.04866251s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 00:59:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:00:31.772921602 +0000 UTC m=+71.787294637" watchObservedRunningTime="2026-07-06 01:00:31.773627814 +0000 UTC m=+71.788000851" Jul 06 01:00:31.785730 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:31.785692 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nhbq2" podStartSLOduration=66.765815706 podStartE2EDuration="1m11.785680341s" totalImagesPullingTime="5.019864635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 00:59:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:00:31.784828818 +0000 UTC m=+71.799201854" watchObservedRunningTime="2026-07-06 01:00:31.785680341 +0000 UTC m=+71.800053370" Jul 06 01:00:35.773329 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:35.773296 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5897499cfd-mmzvp" event={"ID":"94eabe70-0156-4774-8cc0-a040383784d7","Type":"ContainerStarted","Data":"2061d7f5f1cde3d48add965cf6b7c059d831931ddc78e28955bf4a92bd06f285"} Jul 06 01:00:35.787233 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:35.787190 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5897499cfd-mmzvp" podStartSLOduration=2.4680482919999998 podStartE2EDuration="5.787174026s" totalImagesPullingTime="3.319125734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:00:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:00:35.786514891 +0000 UTC m=+75.800887924" watchObservedRunningTime="2026-07-06 01:00:35.787174026 +0000 UTC m=+75.801547062" Jul 06 01:00:58.270956 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:58.270918 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/261a7be8-29de-4ea5-9394-7cf8275dfd9c-metrics-tls\") pod \"dns-default-2ftr2\" (UID: \"261a7be8-29de-4ea5-9394-7cf8275dfd9c\") " pod="openshift-dns/dns-default-2ftr2" Jul 06 01:00:58.271313 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:00:58.271053 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 01:00:58.271313 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:00:58.271123 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 01:00:58.271313 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:00:58.271144 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-774f7dcb6c-6fcv4: secret "image-registry-tls" not found Jul 06 01:00:58.271313 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:00:58.271057 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-tls\") pod \"image-registry-774f7dcb6c-6fcv4\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 01:00:58.271313 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:00:58.271175 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261a7be8-29de-4ea5-9394-7cf8275dfd9c-metrics-tls podName:261a7be8-29de-4ea5-9394-7cf8275dfd9c nodeName:}" failed. No retries permitted until 2026-07-06 01:02:02.271153875 +0000 UTC m=+162.285526891 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/261a7be8-29de-4ea5-9394-7cf8275dfd9c-metrics-tls") pod "dns-default-2ftr2" (UID: "261a7be8-29de-4ea5-9394-7cf8275dfd9c") : secret "dns-default-metrics-tls" not found Jul 06 01:00:58.271313 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:00:58.271259 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-tls podName:4d049ebd-dbc6-49a4-9974-d7f2e911bb77 nodeName:}" failed. No retries permitted until 2026-07-06 01:02:02.271238416 +0000 UTC m=+162.285611431 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-tls") pod "image-registry-774f7dcb6c-6fcv4" (UID: "4d049ebd-dbc6-49a4-9974-d7f2e911bb77") : secret "image-registry-tls" not found Jul 06 01:01:02.766901 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:01:02.766869 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nhbq2" Jul 06 01:01:30.190273 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:01:30.190233 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ae44021-3eed-4a62-9e80-47242e594a85-metrics-certs\") pod \"network-metrics-daemon-gn92r\" (UID: \"4ae44021-3eed-4a62-9e80-47242e594a85\") " pod="openshift-multus/network-metrics-daemon-gn92r" Jul 06 01:01:30.190775 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:01:30.190343 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 01:01:30.190775 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:01:30.190403 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ae44021-3eed-4a62-9e80-47242e594a85-metrics-certs podName:4ae44021-3eed-4a62-9e80-47242e594a85 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:32.190388656 +0000 UTC m=+252.204761670 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ae44021-3eed-4a62-9e80-47242e594a85-metrics-certs") pod "network-metrics-daemon-gn92r" (UID: "4ae44021-3eed-4a62-9e80-47242e594a85") : secret "metrics-daemon-secret" not found Jul 06 01:01:57.364889 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:01:57.364847 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" podUID="4d049ebd-dbc6-49a4-9974-d7f2e911bb77" Jul 06 01:01:57.371979 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:01:57.371954 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2ftr2" podUID="261a7be8-29de-4ea5-9394-7cf8275dfd9c" Jul 06 01:01:57.496989 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:01:57.496951 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-gn92r" podUID="4ae44021-3eed-4a62-9e80-47242e594a85" Jul 06 01:01:57.957606 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:01:57.957579 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 01:01:57.957606 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:01:57.957613 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2ftr2" Jul 06 01:02:02.314503 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:02:02.314465 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/261a7be8-29de-4ea5-9394-7cf8275dfd9c-metrics-tls\") pod \"dns-default-2ftr2\" (UID: \"261a7be8-29de-4ea5-9394-7cf8275dfd9c\") " pod="openshift-dns/dns-default-2ftr2" Jul 06 01:02:02.314503 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:02:02.314503 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-tls\") pod \"image-registry-774f7dcb6c-6fcv4\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 01:02:02.315206 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:02:02.314634 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 01:02:02.315206 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:02:02.314697 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 01:02:02.315206 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:02:02.314713 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-774f7dcb6c-6fcv4: secret "image-registry-tls" not found Jul 06 01:02:02.315206 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:02:02.314772 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/261a7be8-29de-4ea5-9394-7cf8275dfd9c-metrics-tls podName:261a7be8-29de-4ea5-9394-7cf8275dfd9c nodeName:}" failed. No retries permitted until 2026-07-06 01:04:04.31474311 +0000 UTC m=+284.329116134 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/261a7be8-29de-4ea5-9394-7cf8275dfd9c-metrics-tls") pod "dns-default-2ftr2" (UID: "261a7be8-29de-4ea5-9394-7cf8275dfd9c") : secret "dns-default-metrics-tls" not found Jul 06 01:02:02.315206 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:02:02.314793 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-tls podName:4d049ebd-dbc6-49a4-9974-d7f2e911bb77 nodeName:}" failed. No retries permitted until 2026-07-06 01:04:04.314783449 +0000 UTC m=+284.329156476 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-tls") pod "image-registry-774f7dcb6c-6fcv4" (UID: "4d049ebd-dbc6-49a4-9974-d7f2e911bb77") : secret "image-registry-tls" not found Jul 06 01:02:11.486374 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:02:11.486341 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn92r" Jul 06 01:02:35.044477 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:02:35.044450 2553 generic.go:356] "Generic (PLEG): container finished" podID="94eabe70-0156-4774-8cc0-a040383784d7" containerID="2061d7f5f1cde3d48add965cf6b7c059d831931ddc78e28955bf4a92bd06f285" exitCode=255 Jul 06 01:02:35.044851 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:02:35.044506 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5897499cfd-mmzvp" event={"ID":"94eabe70-0156-4774-8cc0-a040383784d7","Type":"ContainerDied","Data":"2061d7f5f1cde3d48add965cf6b7c059d831931ddc78e28955bf4a92bd06f285"} Jul 06 01:02:35.044851 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:02:35.044788 2553 scope.go:117] "RemoveContainer" containerID="2061d7f5f1cde3d48add965cf6b7c059d831931ddc78e28955bf4a92bd06f285" Jul 06 01:02:36.048566 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:02:36.048533 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5897499cfd-mmzvp" event={"ID":"94eabe70-0156-4774-8cc0-a040383784d7","Type":"ContainerStarted","Data":"11b1232f82007fb26dd20d6ee71be4b52d523d89d01cfbce457a9e8ae82fc8f4"} Jul 06 01:03:10.086602 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.086563 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-rrw4g"] Jul 06 01:03:10.089406 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.089390 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-q27c6"] Jul 06 01:03:10.089528 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.089508 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-rrw4g" Jul 06 01:03:10.091944 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.091922 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 06 01:03:10.092053 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.091992 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-ng8gh\"" Jul 06 01:03:10.092136 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.092121 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-znllg"] Jul 06 01:03:10.092255 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.092233 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-q27c6" Jul 06 01:03:10.092358 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.092260 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 06 01:03:10.092358 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.092262 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 01:03:10.092519 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.092498 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 01:03:10.095205 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.095050 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-znllg" Jul 06 01:03:10.095362 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.095340 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 06 01:03:10.095422 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.095357 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-5n5z6\"" Jul 06 01:03:10.095515 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.095481 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 06 01:03:10.095636 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.095532 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 06 01:03:10.095636 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.095531 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 06 01:03:10.098114 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.098096 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 06 01:03:10.098219 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.098154 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 06 01:03:10.098219 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.098173 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 06 01:03:10.098219 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.098188 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-s5ldc\"" Jul 06 01:03:10.098363 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.098232 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 06 01:03:10.099496 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.099481 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 06 01:03:10.102466 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.102445 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-q27c6"] Jul 06 01:03:10.104906 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.104881 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-rrw4g"] Jul 06 01:03:10.106759 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.106715 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 06 01:03:10.108579 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.108562 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-znllg"] Jul 06 01:03:10.173589 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.173554 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2n5x\" (UniqueName: \"kubernetes.io/projected/287d98a2-bc12-44af-87f9-c59dfbee9c0c-kube-api-access-m2n5x\") pod \"kube-storage-version-migrator-operator-846bf668f7-q27c6\" (UID: \"287d98a2-bc12-44af-87f9-c59dfbee9c0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-q27c6" Jul 06 01:03:10.173589 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.173590 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/289da140-83a3-40ae-9470-bd4c6e476df6-serving-cert\") pod \"insights-operator-5c847dcfc4-rrw4g\" (UID: \"289da140-83a3-40ae-9470-bd4c6e476df6\") " pod="openshift-insights/insights-operator-5c847dcfc4-rrw4g" Jul 06 01:03:10.173868 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.173652 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfknp\" (UniqueName: \"kubernetes.io/projected/289da140-83a3-40ae-9470-bd4c6e476df6-kube-api-access-sfknp\") pod \"insights-operator-5c847dcfc4-rrw4g\" (UID: \"289da140-83a3-40ae-9470-bd4c6e476df6\") " pod="openshift-insights/insights-operator-5c847dcfc4-rrw4g" Jul 06 01:03:10.173868 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.173707 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/287d98a2-bc12-44af-87f9-c59dfbee9c0c-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-q27c6\" (UID: \"287d98a2-bc12-44af-87f9-c59dfbee9c0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-q27c6" Jul 06 01:03:10.173868 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.173808 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/289da140-83a3-40ae-9470-bd4c6e476df6-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-rrw4g\" (UID: \"289da140-83a3-40ae-9470-bd4c6e476df6\") " pod="openshift-insights/insights-operator-5c847dcfc4-rrw4g" Jul 06 01:03:10.173868 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.173843 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/289da140-83a3-40ae-9470-bd4c6e476df6-snapshots\") pod \"insights-operator-5c847dcfc4-rrw4g\" (UID: \"289da140-83a3-40ae-9470-bd4c6e476df6\") " pod="openshift-insights/insights-operator-5c847dcfc4-rrw4g" Jul 06 01:03:10.173868 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.173866 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/789b12fb-c3d0-428d-838c-f29718e69e2c-serving-cert\") pod \"console-operator-68b757fb67-znllg\" (UID: \"789b12fb-c3d0-428d-838c-f29718e69e2c\") " pod="openshift-console-operator/console-operator-68b757fb67-znllg" Jul 06 01:03:10.174168 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.173891 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/789b12fb-c3d0-428d-838c-f29718e69e2c-trusted-ca\") pod \"console-operator-68b757fb67-znllg\" (UID: \"789b12fb-c3d0-428d-838c-f29718e69e2c\") " pod="openshift-console-operator/console-operator-68b757fb67-znllg" Jul 06 01:03:10.174168 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.173917 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/789b12fb-c3d0-428d-838c-f29718e69e2c-config\") pod \"console-operator-68b757fb67-znllg\" (UID: \"789b12fb-c3d0-428d-838c-f29718e69e2c\") " pod="openshift-console-operator/console-operator-68b757fb67-znllg" Jul 06 01:03:10.174168 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.173969 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/289da140-83a3-40ae-9470-bd4c6e476df6-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-rrw4g\" (UID: \"289da140-83a3-40ae-9470-bd4c6e476df6\") " pod="openshift-insights/insights-operator-5c847dcfc4-rrw4g" Jul 06 01:03:10.174168 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.174009 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/287d98a2-bc12-44af-87f9-c59dfbee9c0c-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-q27c6\" (UID: \"287d98a2-bc12-44af-87f9-c59dfbee9c0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-q27c6" Jul 06 01:03:10.174168 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.174035 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/289da140-83a3-40ae-9470-bd4c6e476df6-tmp\") pod \"insights-operator-5c847dcfc4-rrw4g\" (UID: \"289da140-83a3-40ae-9470-bd4c6e476df6\") " pod="openshift-insights/insights-operator-5c847dcfc4-rrw4g" Jul 06 01:03:10.174168 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.174068 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b4fm\" (UniqueName: \"kubernetes.io/projected/789b12fb-c3d0-428d-838c-f29718e69e2c-kube-api-access-8b4fm\") pod \"console-operator-68b757fb67-znllg\" (UID: \"789b12fb-c3d0-428d-838c-f29718e69e2c\") " pod="openshift-console-operator/console-operator-68b757fb67-znllg" Jul 06 01:03:10.184222 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.184195 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-khdjc"] Jul 06 01:03:10.187021 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.187004 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-55758cd8ff-8lgbp"] Jul 06 01:03:10.187130 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.187115 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-khdjc" Jul 06 01:03:10.189608 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.189589 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 01:03:10.189857 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.189839 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-55758cd8ff-8lgbp" Jul 06 01:03:10.190094 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.190073 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-sl76v\"" Jul 06 01:03:10.190268 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.190200 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 06 01:03:10.191193 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.191176 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 06 01:03:10.191286 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.191218 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 01:03:10.192102 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.192082 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 01:03:10.192169 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.192135 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 06 01:03:10.192169 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.192137 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 06 01:03:10.192262 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.192244 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-bvsjm\"" Jul 06 01:03:10.192348 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.192336 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 01:03:10.192416 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.192400 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 06 01:03:10.192475 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.192421 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 06 01:03:10.196308 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.196287 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-khdjc"] Jul 06 01:03:10.203873 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.203710 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-55758cd8ff-8lgbp"] Jul 06 01:03:10.275307 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.275277 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/287d98a2-bc12-44af-87f9-c59dfbee9c0c-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-q27c6\" (UID: \"287d98a2-bc12-44af-87f9-c59dfbee9c0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-q27c6" Jul 06 01:03:10.275307 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.275309 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c6f894e-5149-4c29-84ff-468f3cae5d80-service-ca-bundle\") pod \"router-default-55758cd8ff-8lgbp\" (UID: \"8c6f894e-5149-4c29-84ff-468f3cae5d80\") " pod="openshift-ingress/router-default-55758cd8ff-8lgbp" Jul 06 01:03:10.275487 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.275327 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d863b393-e7eb-42f0-afe7-371c3e9996c9-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-khdjc\" (UID: \"d863b393-e7eb-42f0-afe7-371c3e9996c9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-khdjc" Jul 06 01:03:10.275487 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.275347 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/289da140-83a3-40ae-9470-bd4c6e476df6-tmp\") pod \"insights-operator-5c847dcfc4-rrw4g\" (UID: \"289da140-83a3-40ae-9470-bd4c6e476df6\") " pod="openshift-insights/insights-operator-5c847dcfc4-rrw4g" Jul 06 01:03:10.275487 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.275367 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b4fm\" (UniqueName: \"kubernetes.io/projected/789b12fb-c3d0-428d-838c-f29718e69e2c-kube-api-access-8b4fm\") pod \"console-operator-68b757fb67-znllg\" (UID: \"789b12fb-c3d0-428d-838c-f29718e69e2c\") " pod="openshift-console-operator/console-operator-68b757fb67-znllg" Jul 06 01:03:10.275487 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.275435 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2n5x\" (UniqueName: \"kubernetes.io/projected/287d98a2-bc12-44af-87f9-c59dfbee9c0c-kube-api-access-m2n5x\") pod \"kube-storage-version-migrator-operator-846bf668f7-q27c6\" (UID: \"287d98a2-bc12-44af-87f9-c59dfbee9c0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-q27c6" Jul 06 01:03:10.275487 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.275475 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22bs4\" (UniqueName: \"kubernetes.io/projected/8c6f894e-5149-4c29-84ff-468f3cae5d80-kube-api-access-22bs4\") pod \"router-default-55758cd8ff-8lgbp\" (UID: \"8c6f894e-5149-4c29-84ff-468f3cae5d80\") " pod="openshift-ingress/router-default-55758cd8ff-8lgbp" Jul 06 01:03:10.275698 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.275500 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/289da140-83a3-40ae-9470-bd4c6e476df6-serving-cert\") pod \"insights-operator-5c847dcfc4-rrw4g\" (UID: \"289da140-83a3-40ae-9470-bd4c6e476df6\") " pod="openshift-insights/insights-operator-5c847dcfc4-rrw4g" Jul 06 01:03:10.275698 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.275567 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfknp\" (UniqueName: \"kubernetes.io/projected/289da140-83a3-40ae-9470-bd4c6e476df6-kube-api-access-sfknp\") pod \"insights-operator-5c847dcfc4-rrw4g\" (UID: \"289da140-83a3-40ae-9470-bd4c6e476df6\") " pod="openshift-insights/insights-operator-5c847dcfc4-rrw4g" Jul 06 01:03:10.275698 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.275612 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/287d98a2-bc12-44af-87f9-c59dfbee9c0c-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-q27c6\" (UID: \"287d98a2-bc12-44af-87f9-c59dfbee9c0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-q27c6" Jul 06 01:03:10.275857 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.275696 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8c6f894e-5149-4c29-84ff-468f3cae5d80-stats-auth\") pod \"router-default-55758cd8ff-8lgbp\" (UID: \"8c6f894e-5149-4c29-84ff-468f3cae5d80\") " pod="openshift-ingress/router-default-55758cd8ff-8lgbp" Jul 06 01:03:10.275857 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.275737 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/289da140-83a3-40ae-9470-bd4c6e476df6-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-rrw4g\" (UID: \"289da140-83a3-40ae-9470-bd4c6e476df6\") " pod="openshift-insights/insights-operator-5c847dcfc4-rrw4g" Jul 06 01:03:10.275857 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.275760 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c6f894e-5149-4c29-84ff-468f3cae5d80-metrics-certs\") pod \"router-default-55758cd8ff-8lgbp\" (UID: \"8c6f894e-5149-4c29-84ff-468f3cae5d80\") " pod="openshift-ingress/router-default-55758cd8ff-8lgbp" Jul 06 01:03:10.275857 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.275781 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7wg5\" (UniqueName: \"kubernetes.io/projected/d863b393-e7eb-42f0-afe7-371c3e9996c9-kube-api-access-j7wg5\") pod \"cluster-monitoring-operator-64786d9cbb-khdjc\" (UID: \"d863b393-e7eb-42f0-afe7-371c3e9996c9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-khdjc" Jul 06 01:03:10.275857 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.275802 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/289da140-83a3-40ae-9470-bd4c6e476df6-snapshots\") pod \"insights-operator-5c847dcfc4-rrw4g\" (UID: \"289da140-83a3-40ae-9470-bd4c6e476df6\") " pod="openshift-insights/insights-operator-5c847dcfc4-rrw4g" Jul 06 01:03:10.275857 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.275818 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/789b12fb-c3d0-428d-838c-f29718e69e2c-serving-cert\") pod \"console-operator-68b757fb67-znllg\" (UID: \"789b12fb-c3d0-428d-838c-f29718e69e2c\") " pod="openshift-console-operator/console-operator-68b757fb67-znllg" Jul 06 01:03:10.275857 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.275838 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8c6f894e-5149-4c29-84ff-468f3cae5d80-default-certificate\") pod \"router-default-55758cd8ff-8lgbp\" (UID: \"8c6f894e-5149-4c29-84ff-468f3cae5d80\") " pod="openshift-ingress/router-default-55758cd8ff-8lgbp" Jul 06 01:03:10.276243 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.275862 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d863b393-e7eb-42f0-afe7-371c3e9996c9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-khdjc\" (UID: \"d863b393-e7eb-42f0-afe7-371c3e9996c9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-khdjc" Jul 06 01:03:10.276243 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.275891 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/789b12fb-c3d0-428d-838c-f29718e69e2c-trusted-ca\") pod \"console-operator-68b757fb67-znllg\" (UID: \"789b12fb-c3d0-428d-838c-f29718e69e2c\") " pod="openshift-console-operator/console-operator-68b757fb67-znllg" Jul 06 01:03:10.276243 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.275919 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/789b12fb-c3d0-428d-838c-f29718e69e2c-config\") pod \"console-operator-68b757fb67-znllg\" (UID: \"789b12fb-c3d0-428d-838c-f29718e69e2c\") " pod="openshift-console-operator/console-operator-68b757fb67-znllg" Jul 06 01:03:10.276243 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.275946 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/289da140-83a3-40ae-9470-bd4c6e476df6-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-rrw4g\" (UID: \"289da140-83a3-40ae-9470-bd4c6e476df6\") " pod="openshift-insights/insights-operator-5c847dcfc4-rrw4g" Jul 06 01:03:10.276243 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.276191 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/289da140-83a3-40ae-9470-bd4c6e476df6-tmp\") pod \"insights-operator-5c847dcfc4-rrw4g\" (UID: \"289da140-83a3-40ae-9470-bd4c6e476df6\") " pod="openshift-insights/insights-operator-5c847dcfc4-rrw4g" Jul 06 01:03:10.276481 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.276293 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/287d98a2-bc12-44af-87f9-c59dfbee9c0c-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-q27c6\" (UID: \"287d98a2-bc12-44af-87f9-c59dfbee9c0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-q27c6" Jul 06 01:03:10.276481 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.276377 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/289da140-83a3-40ae-9470-bd4c6e476df6-snapshots\") pod \"insights-operator-5c847dcfc4-rrw4g\" (UID: \"289da140-83a3-40ae-9470-bd4c6e476df6\") " pod="openshift-insights/insights-operator-5c847dcfc4-rrw4g" Jul 06 01:03:10.276588 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.276481 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/289da140-83a3-40ae-9470-bd4c6e476df6-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-rrw4g\" (UID: \"289da140-83a3-40ae-9470-bd4c6e476df6\") " pod="openshift-insights/insights-operator-5c847dcfc4-rrw4g" Jul 06 01:03:10.276646 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.276626 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/289da140-83a3-40ae-9470-bd4c6e476df6-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-rrw4g\" (UID: \"289da140-83a3-40ae-9470-bd4c6e476df6\") " pod="openshift-insights/insights-operator-5c847dcfc4-rrw4g" Jul 06 01:03:10.276969 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.276947 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/789b12fb-c3d0-428d-838c-f29718e69e2c-config\") pod \"console-operator-68b757fb67-znllg\" (UID: \"789b12fb-c3d0-428d-838c-f29718e69e2c\") " pod="openshift-console-operator/console-operator-68b757fb67-znllg" Jul 06 01:03:10.277247 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.277225 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/789b12fb-c3d0-428d-838c-f29718e69e2c-trusted-ca\") pod \"console-operator-68b757fb67-znllg\" (UID: \"789b12fb-c3d0-428d-838c-f29718e69e2c\") " pod="openshift-console-operator/console-operator-68b757fb67-znllg" Jul 06 01:03:10.277848 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.277818 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/287d98a2-bc12-44af-87f9-c59dfbee9c0c-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-q27c6\" (UID: \"287d98a2-bc12-44af-87f9-c59dfbee9c0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-q27c6" Jul 06 01:03:10.277953 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.277937 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/289da140-83a3-40ae-9470-bd4c6e476df6-serving-cert\") pod \"insights-operator-5c847dcfc4-rrw4g\" (UID: \"289da140-83a3-40ae-9470-bd4c6e476df6\") " pod="openshift-insights/insights-operator-5c847dcfc4-rrw4g" Jul 06 01:03:10.278155 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.278139 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/789b12fb-c3d0-428d-838c-f29718e69e2c-serving-cert\") pod \"console-operator-68b757fb67-znllg\" (UID: \"789b12fb-c3d0-428d-838c-f29718e69e2c\") " pod="openshift-console-operator/console-operator-68b757fb67-znllg" Jul 06 01:03:10.288107 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.288079 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2n5x\" (UniqueName: \"kubernetes.io/projected/287d98a2-bc12-44af-87f9-c59dfbee9c0c-kube-api-access-m2n5x\") pod \"kube-storage-version-migrator-operator-846bf668f7-q27c6\" (UID: \"287d98a2-bc12-44af-87f9-c59dfbee9c0c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-q27c6" Jul 06 01:03:10.288346 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.288326 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfknp\" (UniqueName: \"kubernetes.io/projected/289da140-83a3-40ae-9470-bd4c6e476df6-kube-api-access-sfknp\") pod \"insights-operator-5c847dcfc4-rrw4g\" (UID: \"289da140-83a3-40ae-9470-bd4c6e476df6\") " pod="openshift-insights/insights-operator-5c847dcfc4-rrw4g" Jul 06 01:03:10.288648 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.288632 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b4fm\" (UniqueName: \"kubernetes.io/projected/789b12fb-c3d0-428d-838c-f29718e69e2c-kube-api-access-8b4fm\") pod \"console-operator-68b757fb67-znllg\" (UID: \"789b12fb-c3d0-428d-838c-f29718e69e2c\") " pod="openshift-console-operator/console-operator-68b757fb67-znllg" Jul 06 01:03:10.376688 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.376582 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c6f894e-5149-4c29-84ff-468f3cae5d80-service-ca-bundle\") pod \"router-default-55758cd8ff-8lgbp\" (UID: \"8c6f894e-5149-4c29-84ff-468f3cae5d80\") " pod="openshift-ingress/router-default-55758cd8ff-8lgbp" Jul 06 01:03:10.376688 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.376617 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d863b393-e7eb-42f0-afe7-371c3e9996c9-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-khdjc\" (UID: \"d863b393-e7eb-42f0-afe7-371c3e9996c9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-khdjc" Jul 06 01:03:10.376688 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.376645 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22bs4\" (UniqueName: \"kubernetes.io/projected/8c6f894e-5149-4c29-84ff-468f3cae5d80-kube-api-access-22bs4\") pod \"router-default-55758cd8ff-8lgbp\" (UID: \"8c6f894e-5149-4c29-84ff-468f3cae5d80\") " pod="openshift-ingress/router-default-55758cd8ff-8lgbp" Jul 06 01:03:10.376941 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:10.376776 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8c6f894e-5149-4c29-84ff-468f3cae5d80-service-ca-bundle podName:8c6f894e-5149-4c29-84ff-468f3cae5d80 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:10.876758787 +0000 UTC m=+230.891131801 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8c6f894e-5149-4c29-84ff-468f3cae5d80-service-ca-bundle") pod "router-default-55758cd8ff-8lgbp" (UID: "8c6f894e-5149-4c29-84ff-468f3cae5d80") : configmap references non-existent config key: service-ca.crt Jul 06 01:03:10.376941 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.376865 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8c6f894e-5149-4c29-84ff-468f3cae5d80-stats-auth\") pod \"router-default-55758cd8ff-8lgbp\" (UID: \"8c6f894e-5149-4c29-84ff-468f3cae5d80\") " pod="openshift-ingress/router-default-55758cd8ff-8lgbp" Jul 06 01:03:10.376941 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.376924 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c6f894e-5149-4c29-84ff-468f3cae5d80-metrics-certs\") pod \"router-default-55758cd8ff-8lgbp\" (UID: \"8c6f894e-5149-4c29-84ff-468f3cae5d80\") " pod="openshift-ingress/router-default-55758cd8ff-8lgbp" Jul 06 01:03:10.377103 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.376954 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7wg5\" (UniqueName: \"kubernetes.io/projected/d863b393-e7eb-42f0-afe7-371c3e9996c9-kube-api-access-j7wg5\") pod \"cluster-monitoring-operator-64786d9cbb-khdjc\" (UID: \"d863b393-e7eb-42f0-afe7-371c3e9996c9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-khdjc" Jul 06 01:03:10.377103 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.376999 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8c6f894e-5149-4c29-84ff-468f3cae5d80-default-certificate\") pod \"router-default-55758cd8ff-8lgbp\" (UID: \"8c6f894e-5149-4c29-84ff-468f3cae5d80\") " pod="openshift-ingress/router-default-55758cd8ff-8lgbp" Jul 06 01:03:10.377103 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:10.377024 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 01:03:10.377103 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:10.377085 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c6f894e-5149-4c29-84ff-468f3cae5d80-metrics-certs podName:8c6f894e-5149-4c29-84ff-468f3cae5d80 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:10.877068882 +0000 UTC m=+230.891441922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c6f894e-5149-4c29-84ff-468f3cae5d80-metrics-certs") pod "router-default-55758cd8ff-8lgbp" (UID: "8c6f894e-5149-4c29-84ff-468f3cae5d80") : secret "router-metrics-certs-default" not found Jul 06 01:03:10.377312 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.377109 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d863b393-e7eb-42f0-afe7-371c3e9996c9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-khdjc\" (UID: \"d863b393-e7eb-42f0-afe7-371c3e9996c9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-khdjc" Jul 06 01:03:10.377312 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:10.377219 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 01:03:10.377312 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.377244 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d863b393-e7eb-42f0-afe7-371c3e9996c9-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-khdjc\" (UID: \"d863b393-e7eb-42f0-afe7-371c3e9996c9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-khdjc" Jul 06 01:03:10.377312 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:10.377270 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d863b393-e7eb-42f0-afe7-371c3e9996c9-cluster-monitoring-operator-tls podName:d863b393-e7eb-42f0-afe7-371c3e9996c9 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:10.877257323 +0000 UTC m=+230.891630337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d863b393-e7eb-42f0-afe7-371c3e9996c9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-khdjc" (UID: "d863b393-e7eb-42f0-afe7-371c3e9996c9") : secret "cluster-monitoring-operator-tls" not found Jul 06 01:03:10.379241 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.379221 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8c6f894e-5149-4c29-84ff-468f3cae5d80-default-certificate\") pod \"router-default-55758cd8ff-8lgbp\" (UID: \"8c6f894e-5149-4c29-84ff-468f3cae5d80\") " pod="openshift-ingress/router-default-55758cd8ff-8lgbp" Jul 06 01:03:10.379443 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.379422 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8c6f894e-5149-4c29-84ff-468f3cae5d80-stats-auth\") pod \"router-default-55758cd8ff-8lgbp\" (UID: \"8c6f894e-5149-4c29-84ff-468f3cae5d80\") " pod="openshift-ingress/router-default-55758cd8ff-8lgbp" Jul 06 01:03:10.385039 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.385011 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7wg5\" (UniqueName: \"kubernetes.io/projected/d863b393-e7eb-42f0-afe7-371c3e9996c9-kube-api-access-j7wg5\") pod \"cluster-monitoring-operator-64786d9cbb-khdjc\" (UID: \"d863b393-e7eb-42f0-afe7-371c3e9996c9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-khdjc" Jul 06 01:03:10.385239 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.385225 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22bs4\" (UniqueName: \"kubernetes.io/projected/8c6f894e-5149-4c29-84ff-468f3cae5d80-kube-api-access-22bs4\") pod \"router-default-55758cd8ff-8lgbp\" (UID: \"8c6f894e-5149-4c29-84ff-468f3cae5d80\") " pod="openshift-ingress/router-default-55758cd8ff-8lgbp" Jul 06 01:03:10.400039 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.400022 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-rrw4g" Jul 06 01:03:10.407067 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.407053 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-q27c6" Jul 06 01:03:10.413838 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.413818 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-znllg" Jul 06 01:03:10.543548 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.543515 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-rrw4g"] Jul 06 01:03:10.546381 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:03:10.546355 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod289da140_83a3_40ae_9470_bd4c6e476df6.slice/crio-f29dc606fe8b387361fb82dc7732a526d5008d8130864c5b0765d112f058c833 WatchSource:0}: Error finding container f29dc606fe8b387361fb82dc7732a526d5008d8130864c5b0765d112f058c833: Status 404 returned error can't find the container with id f29dc606fe8b387361fb82dc7732a526d5008d8130864c5b0765d112f058c833 Jul 06 01:03:10.765238 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.765204 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-znllg"] Jul 06 01:03:10.768010 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:03:10.767976 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod789b12fb_c3d0_428d_838c_f29718e69e2c.slice/crio-d2616ab36df4f0963bb9a744cf30c3391970c03dc5b43915bff55a5fda261b6d WatchSource:0}: Error finding container d2616ab36df4f0963bb9a744cf30c3391970c03dc5b43915bff55a5fda261b6d: Status 404 returned error can't find the container with id d2616ab36df4f0963bb9a744cf30c3391970c03dc5b43915bff55a5fda261b6d Jul 06 01:03:10.768163 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.768146 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-q27c6"] Jul 06 01:03:10.770960 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:03:10.770938 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod287d98a2_bc12_44af_87f9_c59dfbee9c0c.slice/crio-6fa8c0f65ec9db0b69a4da69deae05222edeba90defcd46d4e9ec991d06827a6 WatchSource:0}: Error finding container 6fa8c0f65ec9db0b69a4da69deae05222edeba90defcd46d4e9ec991d06827a6: Status 404 returned error can't find the container with id 6fa8c0f65ec9db0b69a4da69deae05222edeba90defcd46d4e9ec991d06827a6 Jul 06 01:03:10.881556 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.881523 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c6f894e-5149-4c29-84ff-468f3cae5d80-metrics-certs\") pod \"router-default-55758cd8ff-8lgbp\" (UID: \"8c6f894e-5149-4c29-84ff-468f3cae5d80\") " pod="openshift-ingress/router-default-55758cd8ff-8lgbp" Jul 06 01:03:10.881556 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.881560 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d863b393-e7eb-42f0-afe7-371c3e9996c9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-khdjc\" (UID: \"d863b393-e7eb-42f0-afe7-371c3e9996c9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-khdjc" Jul 06 01:03:10.881809 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:10.881593 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c6f894e-5149-4c29-84ff-468f3cae5d80-service-ca-bundle\") pod \"router-default-55758cd8ff-8lgbp\" (UID: \"8c6f894e-5149-4c29-84ff-468f3cae5d80\") " pod="openshift-ingress/router-default-55758cd8ff-8lgbp" Jul 06 01:03:10.881809 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:10.881707 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 01:03:10.881809 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:10.881708 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 01:03:10.881809 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:10.881754 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8c6f894e-5149-4c29-84ff-468f3cae5d80-service-ca-bundle podName:8c6f894e-5149-4c29-84ff-468f3cae5d80 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:11.881734991 +0000 UTC m=+231.896108010 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8c6f894e-5149-4c29-84ff-468f3cae5d80-service-ca-bundle") pod "router-default-55758cd8ff-8lgbp" (UID: "8c6f894e-5149-4c29-84ff-468f3cae5d80") : configmap references non-existent config key: service-ca.crt Jul 06 01:03:10.881809 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:10.881772 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c6f894e-5149-4c29-84ff-468f3cae5d80-metrics-certs podName:8c6f894e-5149-4c29-84ff-468f3cae5d80 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:11.881762555 +0000 UTC m=+231.896135574 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c6f894e-5149-4c29-84ff-468f3cae5d80-metrics-certs") pod "router-default-55758cd8ff-8lgbp" (UID: "8c6f894e-5149-4c29-84ff-468f3cae5d80") : secret "router-metrics-certs-default" not found Jul 06 01:03:10.881809 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:10.881786 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d863b393-e7eb-42f0-afe7-371c3e9996c9-cluster-monitoring-operator-tls podName:d863b393-e7eb-42f0-afe7-371c3e9996c9 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:11.881778885 +0000 UTC m=+231.896151901 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d863b393-e7eb-42f0-afe7-371c3e9996c9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-khdjc" (UID: "d863b393-e7eb-42f0-afe7-371c3e9996c9") : secret "cluster-monitoring-operator-tls" not found Jul 06 01:03:11.133855 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:11.133763 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-q27c6" event={"ID":"287d98a2-bc12-44af-87f9-c59dfbee9c0c","Type":"ContainerStarted","Data":"6fa8c0f65ec9db0b69a4da69deae05222edeba90defcd46d4e9ec991d06827a6"} Jul 06 01:03:11.134794 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:11.134768 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-rrw4g" event={"ID":"289da140-83a3-40ae-9470-bd4c6e476df6","Type":"ContainerStarted","Data":"f29dc606fe8b387361fb82dc7732a526d5008d8130864c5b0765d112f058c833"} Jul 06 01:03:11.135743 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:11.135721 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-znllg" event={"ID":"789b12fb-c3d0-428d-838c-f29718e69e2c","Type":"ContainerStarted","Data":"d2616ab36df4f0963bb9a744cf30c3391970c03dc5b43915bff55a5fda261b6d"} Jul 06 01:03:11.889120 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:11.889084 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c6f894e-5149-4c29-84ff-468f3cae5d80-metrics-certs\") pod \"router-default-55758cd8ff-8lgbp\" (UID: \"8c6f894e-5149-4c29-84ff-468f3cae5d80\") " pod="openshift-ingress/router-default-55758cd8ff-8lgbp" Jul 06 01:03:11.889315 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:11.889139 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d863b393-e7eb-42f0-afe7-371c3e9996c9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-khdjc\" (UID: \"d863b393-e7eb-42f0-afe7-371c3e9996c9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-khdjc" Jul 06 01:03:11.889315 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:11.889188 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c6f894e-5149-4c29-84ff-468f3cae5d80-service-ca-bundle\") pod \"router-default-55758cd8ff-8lgbp\" (UID: \"8c6f894e-5149-4c29-84ff-468f3cae5d80\") " pod="openshift-ingress/router-default-55758cd8ff-8lgbp" Jul 06 01:03:11.889315 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:11.889252 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 01:03:11.889315 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:11.889304 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 01:03:11.889484 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:11.889334 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c6f894e-5149-4c29-84ff-468f3cae5d80-metrics-certs podName:8c6f894e-5149-4c29-84ff-468f3cae5d80 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:13.889313858 +0000 UTC m=+233.903686878 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c6f894e-5149-4c29-84ff-468f3cae5d80-metrics-certs") pod "router-default-55758cd8ff-8lgbp" (UID: "8c6f894e-5149-4c29-84ff-468f3cae5d80") : secret "router-metrics-certs-default" not found Jul 06 01:03:11.889484 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:11.889355 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8c6f894e-5149-4c29-84ff-468f3cae5d80-service-ca-bundle podName:8c6f894e-5149-4c29-84ff-468f3cae5d80 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:13.889345574 +0000 UTC m=+233.903718595 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8c6f894e-5149-4c29-84ff-468f3cae5d80-service-ca-bundle") pod "router-default-55758cd8ff-8lgbp" (UID: "8c6f894e-5149-4c29-84ff-468f3cae5d80") : configmap references non-existent config key: service-ca.crt Jul 06 01:03:11.889484 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:11.889369 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d863b393-e7eb-42f0-afe7-371c3e9996c9-cluster-monitoring-operator-tls podName:d863b393-e7eb-42f0-afe7-371c3e9996c9 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:13.889361013 +0000 UTC m=+233.903734032 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d863b393-e7eb-42f0-afe7-371c3e9996c9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-khdjc" (UID: "d863b393-e7eb-42f0-afe7-371c3e9996c9") : secret "cluster-monitoring-operator-tls" not found Jul 06 01:03:13.908658 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:13.908623 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c6f894e-5149-4c29-84ff-468f3cae5d80-service-ca-bundle\") pod \"router-default-55758cd8ff-8lgbp\" (UID: \"8c6f894e-5149-4c29-84ff-468f3cae5d80\") " pod="openshift-ingress/router-default-55758cd8ff-8lgbp" Jul 06 01:03:13.909079 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:13.908744 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c6f894e-5149-4c29-84ff-468f3cae5d80-metrics-certs\") pod \"router-default-55758cd8ff-8lgbp\" (UID: \"8c6f894e-5149-4c29-84ff-468f3cae5d80\") " pod="openshift-ingress/router-default-55758cd8ff-8lgbp" Jul 06 01:03:13.909079 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:13.908780 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d863b393-e7eb-42f0-afe7-371c3e9996c9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-khdjc\" (UID: \"d863b393-e7eb-42f0-afe7-371c3e9996c9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-khdjc" Jul 06 01:03:13.909079 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:13.908796 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8c6f894e-5149-4c29-84ff-468f3cae5d80-service-ca-bundle podName:8c6f894e-5149-4c29-84ff-468f3cae5d80 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:17.908776271 +0000 UTC m=+237.923149298 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8c6f894e-5149-4c29-84ff-468f3cae5d80-service-ca-bundle") pod "router-default-55758cd8ff-8lgbp" (UID: "8c6f894e-5149-4c29-84ff-468f3cae5d80") : configmap references non-existent config key: service-ca.crt Jul 06 01:03:13.909079 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:13.908873 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 01:03:13.909079 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:13.908899 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 01:03:13.909079 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:13.908909 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d863b393-e7eb-42f0-afe7-371c3e9996c9-cluster-monitoring-operator-tls podName:d863b393-e7eb-42f0-afe7-371c3e9996c9 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:17.90890045 +0000 UTC m=+237.923273464 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d863b393-e7eb-42f0-afe7-371c3e9996c9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-khdjc" (UID: "d863b393-e7eb-42f0-afe7-371c3e9996c9") : secret "cluster-monitoring-operator-tls" not found Jul 06 01:03:13.909079 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:13.908972 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c6f894e-5149-4c29-84ff-468f3cae5d80-metrics-certs podName:8c6f894e-5149-4c29-84ff-468f3cae5d80 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:17.908954799 +0000 UTC m=+237.923327827 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c6f894e-5149-4c29-84ff-468f3cae5d80-metrics-certs") pod "router-default-55758cd8ff-8lgbp" (UID: "8c6f894e-5149-4c29-84ff-468f3cae5d80") : secret "router-metrics-certs-default" not found Jul 06 01:03:14.154169 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:14.154131 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-q27c6" event={"ID":"287d98a2-bc12-44af-87f9-c59dfbee9c0c","Type":"ContainerStarted","Data":"0e4958ab8fbf02443eb4b56fff399d75be07f5a9554e7ee8802f561940bd951a"} Jul 06 01:03:14.155681 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:14.155642 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-rrw4g" event={"ID":"289da140-83a3-40ae-9470-bd4c6e476df6","Type":"ContainerStarted","Data":"8eb683629df963eae3fb4a23d00561a86fdb06bd9fee052c36a5f21ef86971e6"} Jul 06 01:03:14.169295 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:14.169166 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-q27c6" podStartSLOduration=1.5262356879999999 podStartE2EDuration="4.169152249s" totalImagesPullingTime="2.642916561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:03:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:03:14.168390221 +0000 UTC m=+234.182763258" watchObservedRunningTime="2026-07-06 01:03:14.169152249 +0000 UTC m=+234.183525267" Jul 06 01:03:14.186826 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:14.186785 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-rrw4g" podStartSLOduration=1.321916873 podStartE2EDuration="4.186772043s" totalImagesPullingTime="2.86485517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:03:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:03:14.185834657 +0000 UTC m=+234.200207696" watchObservedRunningTime="2026-07-06 01:03:14.186772043 +0000 UTC m=+234.201145058" Jul 06 01:03:14.404618 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:14.404586 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wfsvc"] Jul 06 01:03:14.407913 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:14.407893 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wfsvc" Jul 06 01:03:14.411697 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:14.411628 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 01:03:14.412898 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:14.412877 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jv6lr\"" Jul 06 01:03:14.413237 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:14.413216 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 01:03:14.437357 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:14.437298 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wfsvc"] Jul 06 01:03:14.514016 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:14.513981 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-data-volume\") pod \"insights-runtime-extractor-wfsvc\" (UID: \"f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3\") " pod="openshift-insights/insights-runtime-extractor-wfsvc" Jul 06 01:03:14.514180 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:14.514044 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfsvc\" (UID: \"f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3\") " pod="openshift-insights/insights-runtime-extractor-wfsvc" Jul 06 01:03:14.514180 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:14.514100 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-crio-socket\") pod \"insights-runtime-extractor-wfsvc\" (UID: \"f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3\") " pod="openshift-insights/insights-runtime-extractor-wfsvc" Jul 06 01:03:14.514180 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:14.514142 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwc9g\" (UniqueName: \"kubernetes.io/projected/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-kube-api-access-gwc9g\") pod \"insights-runtime-extractor-wfsvc\" (UID: \"f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3\") " pod="openshift-insights/insights-runtime-extractor-wfsvc" Jul 06 01:03:14.514333 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:14.514259 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfsvc\" (UID: \"f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3\") " pod="openshift-insights/insights-runtime-extractor-wfsvc" Jul 06 01:03:14.615469 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:14.615438 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-crio-socket\") pod \"insights-runtime-extractor-wfsvc\" (UID: \"f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3\") " pod="openshift-insights/insights-runtime-extractor-wfsvc" Jul 06 01:03:14.615632 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:14.615490 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwc9g\" (UniqueName: \"kubernetes.io/projected/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-kube-api-access-gwc9g\") pod \"insights-runtime-extractor-wfsvc\" (UID: \"f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3\") " pod="openshift-insights/insights-runtime-extractor-wfsvc" Jul 06 01:03:14.615632 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:14.615574 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-crio-socket\") pod \"insights-runtime-extractor-wfsvc\" (UID: \"f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3\") " pod="openshift-insights/insights-runtime-extractor-wfsvc" Jul 06 01:03:14.615759 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:14.615720 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfsvc\" (UID: \"f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3\") " pod="openshift-insights/insights-runtime-extractor-wfsvc" Jul 06 01:03:14.615823 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:14.615779 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-data-volume\") pod \"insights-runtime-extractor-wfsvc\" (UID: \"f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3\") " pod="openshift-insights/insights-runtime-extractor-wfsvc" Jul 06 01:03:14.615924 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:14.615822 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfsvc\" (UID: \"f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3\") " pod="openshift-insights/insights-runtime-extractor-wfsvc" Jul 06 01:03:14.615924 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:14.615851 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 01:03:14.615924 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:14.615914 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-kube-rbac-proxy-cm podName:f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:15.115893717 +0000 UTC m=+235.130266746 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wfsvc" (UID: "f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3") : configmap "kube-rbac-proxy" not found Jul 06 01:03:14.616066 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:14.615950 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 01:03:14.616066 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:14.616005 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-insights-runtime-extractor-tls podName:f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:15.115990183 +0000 UTC m=+235.130363203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wfsvc" (UID: "f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3") : secret "insights-runtime-extractor-tls" not found Jul 06 01:03:14.616176 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:14.616137 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-data-volume\") pod \"insights-runtime-extractor-wfsvc\" (UID: \"f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3\") " pod="openshift-insights/insights-runtime-extractor-wfsvc" Jul 06 01:03:14.626028 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:14.626007 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwc9g\" (UniqueName: \"kubernetes.io/projected/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-kube-api-access-gwc9g\") pod \"insights-runtime-extractor-wfsvc\" (UID: \"f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3\") " pod="openshift-insights/insights-runtime-extractor-wfsvc" Jul 06 01:03:15.120527 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:15.120494 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfsvc\" (UID: \"f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3\") " pod="openshift-insights/insights-runtime-extractor-wfsvc" Jul 06 01:03:15.120923 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:15.120622 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfsvc\" (UID: \"f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3\") " pod="openshift-insights/insights-runtime-extractor-wfsvc" Jul 06 01:03:15.120923 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:15.120679 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 01:03:15.120923 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:15.120723 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 01:03:15.120923 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:15.120753 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-insights-runtime-extractor-tls podName:f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:16.120731875 +0000 UTC m=+236.135104895 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wfsvc" (UID: "f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3") : secret "insights-runtime-extractor-tls" not found Jul 06 01:03:15.120923 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:15.120779 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-kube-rbac-proxy-cm podName:f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:16.120761754 +0000 UTC m=+236.135134789 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wfsvc" (UID: "f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3") : configmap "kube-rbac-proxy" not found Jul 06 01:03:15.159744 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:15.159725 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-znllg_789b12fb-c3d0-428d-838c-f29718e69e2c/console-operator/0.log" Jul 06 01:03:15.159862 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:15.159762 2553 generic.go:356] "Generic (PLEG): container finished" podID="789b12fb-c3d0-428d-838c-f29718e69e2c" containerID="82fb6a8dce9d144f0bd993cb59a464d7352fb49aed144f3407b16f81dfacd086" exitCode=255 Jul 06 01:03:15.159862 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:15.159791 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-znllg" event={"ID":"789b12fb-c3d0-428d-838c-f29718e69e2c","Type":"ContainerDied","Data":"82fb6a8dce9d144f0bd993cb59a464d7352fb49aed144f3407b16f81dfacd086"} Jul 06 01:03:15.160087 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:15.160063 2553 scope.go:117] "RemoveContainer" containerID="82fb6a8dce9d144f0bd993cb59a464d7352fb49aed144f3407b16f81dfacd086" Jul 06 01:03:16.130208 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:16.130160 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfsvc\" (UID: \"f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3\") " pod="openshift-insights/insights-runtime-extractor-wfsvc" Jul 06 01:03:16.130725 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:16.130232 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfsvc\" (UID: \"f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3\") " pod="openshift-insights/insights-runtime-extractor-wfsvc" Jul 06 01:03:16.130725 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:16.130303 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 01:03:16.130725 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:16.130386 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-kube-rbac-proxy-cm podName:f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:18.130363444 +0000 UTC m=+238.144736462 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wfsvc" (UID: "f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3") : configmap "kube-rbac-proxy" not found Jul 06 01:03:16.130725 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:16.130390 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 01:03:16.130725 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:16.130445 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-insights-runtime-extractor-tls podName:f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:18.130427275 +0000 UTC m=+238.144800302 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wfsvc" (UID: "f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3") : secret "insights-runtime-extractor-tls" not found Jul 06 01:03:16.163886 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:16.163862 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-znllg_789b12fb-c3d0-428d-838c-f29718e69e2c/console-operator/1.log" Jul 06 01:03:16.164248 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:16.164235 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-znllg_789b12fb-c3d0-428d-838c-f29718e69e2c/console-operator/0.log" Jul 06 01:03:16.164301 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:16.164265 2553 generic.go:356] "Generic (PLEG): container finished" podID="789b12fb-c3d0-428d-838c-f29718e69e2c" containerID="8f5545cfcc45b30fb97e0535cff00eb1c2fc178fc169cc944e3c29c921dc2f3f" exitCode=255 Jul 06 01:03:16.164301 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:16.164291 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-znllg" event={"ID":"789b12fb-c3d0-428d-838c-f29718e69e2c","Type":"ContainerDied","Data":"8f5545cfcc45b30fb97e0535cff00eb1c2fc178fc169cc944e3c29c921dc2f3f"} Jul 06 01:03:16.164403 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:16.164344 2553 scope.go:117] "RemoveContainer" containerID="82fb6a8dce9d144f0bd993cb59a464d7352fb49aed144f3407b16f81dfacd086" Jul 06 01:03:16.164617 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:16.164586 2553 scope.go:117] "RemoveContainer" containerID="8f5545cfcc45b30fb97e0535cff00eb1c2fc178fc169cc944e3c29c921dc2f3f" Jul 06 01:03:16.164785 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:16.164767 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-znllg_openshift-console-operator(789b12fb-c3d0-428d-838c-f29718e69e2c)\"" pod="openshift-console-operator/console-operator-68b757fb67-znllg" podUID="789b12fb-c3d0-428d-838c-f29718e69e2c" Jul 06 01:03:16.595575 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:16.595545 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fc8xr_74e85a91-ab9c-4c02-985f-48961dec5b3c/dns-node-resolver/0.log" Jul 06 01:03:17.170905 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:17.170878 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-znllg_789b12fb-c3d0-428d-838c-f29718e69e2c/console-operator/1.log" Jul 06 01:03:17.171249 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:17.171215 2553 scope.go:117] "RemoveContainer" containerID="8f5545cfcc45b30fb97e0535cff00eb1c2fc178fc169cc944e3c29c921dc2f3f" Jul 06 01:03:17.171433 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:17.171396 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-znllg_openshift-console-operator(789b12fb-c3d0-428d-838c-f29718e69e2c)\"" pod="openshift-console-operator/console-operator-68b757fb67-znllg" podUID="789b12fb-c3d0-428d-838c-f29718e69e2c" Jul 06 01:03:17.195631 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:17.195609 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4zt7s_cb1b89be-8278-4871-99e2-d5710f5da0cc/node-ca/0.log" Jul 06 01:03:17.947656 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:17.947618 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c6f894e-5149-4c29-84ff-468f3cae5d80-service-ca-bundle\") pod \"router-default-55758cd8ff-8lgbp\" (UID: \"8c6f894e-5149-4c29-84ff-468f3cae5d80\") " pod="openshift-ingress/router-default-55758cd8ff-8lgbp" Jul 06 01:03:17.947849 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:17.947736 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c6f894e-5149-4c29-84ff-468f3cae5d80-metrics-certs\") pod \"router-default-55758cd8ff-8lgbp\" (UID: \"8c6f894e-5149-4c29-84ff-468f3cae5d80\") " pod="openshift-ingress/router-default-55758cd8ff-8lgbp" Jul 06 01:03:17.947849 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:17.947768 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d863b393-e7eb-42f0-afe7-371c3e9996c9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-khdjc\" (UID: \"d863b393-e7eb-42f0-afe7-371c3e9996c9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-khdjc" Jul 06 01:03:17.947849 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:17.947789 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8c6f894e-5149-4c29-84ff-468f3cae5d80-service-ca-bundle podName:8c6f894e-5149-4c29-84ff-468f3cae5d80 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:25.947770495 +0000 UTC m=+245.962143509 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8c6f894e-5149-4c29-84ff-468f3cae5d80-service-ca-bundle") pod "router-default-55758cd8ff-8lgbp" (UID: "8c6f894e-5149-4c29-84ff-468f3cae5d80") : configmap references non-existent config key: service-ca.crt Jul 06 01:03:17.947849 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:17.947825 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 01:03:17.948009 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:17.947888 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c6f894e-5149-4c29-84ff-468f3cae5d80-metrics-certs podName:8c6f894e-5149-4c29-84ff-468f3cae5d80 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:25.947872336 +0000 UTC m=+245.962245349 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c6f894e-5149-4c29-84ff-468f3cae5d80-metrics-certs") pod "router-default-55758cd8ff-8lgbp" (UID: "8c6f894e-5149-4c29-84ff-468f3cae5d80") : secret "router-metrics-certs-default" not found Jul 06 01:03:17.948009 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:17.947829 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 01:03:17.948009 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:17.947926 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d863b393-e7eb-42f0-afe7-371c3e9996c9-cluster-monitoring-operator-tls podName:d863b393-e7eb-42f0-afe7-371c3e9996c9 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:25.947918932 +0000 UTC m=+245.962291946 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d863b393-e7eb-42f0-afe7-371c3e9996c9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-khdjc" (UID: "d863b393-e7eb-42f0-afe7-371c3e9996c9") : secret "cluster-monitoring-operator-tls" not found Jul 06 01:03:17.995625 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:17.995601 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n59gl_bb979aaf-8966-44b2-a762-bbd3052753a4/serve-healthcheck-canary/0.log" Jul 06 01:03:18.148978 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:18.148938 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfsvc\" (UID: \"f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3\") " pod="openshift-insights/insights-runtime-extractor-wfsvc" Jul 06 01:03:18.149149 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:18.149000 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfsvc\" (UID: \"f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3\") " pod="openshift-insights/insights-runtime-extractor-wfsvc" Jul 06 01:03:18.149149 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:18.149067 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 01:03:18.149149 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:18.149085 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 01:03:18.149149 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:18.149140 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-insights-runtime-extractor-tls podName:f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:22.149126071 +0000 UTC m=+242.163499085 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wfsvc" (UID: "f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3") : secret "insights-runtime-extractor-tls" not found Jul 06 01:03:18.149279 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:18.149153 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-kube-rbac-proxy-cm podName:f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:22.149146429 +0000 UTC m=+242.163519443 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wfsvc" (UID: "f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3") : configmap "kube-rbac-proxy" not found Jul 06 01:03:20.414180 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:20.414117 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-znllg" Jul 06 01:03:20.414180 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:20.414159 2553 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-znllg" Jul 06 01:03:20.414621 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:20.414508 2553 scope.go:117] "RemoveContainer" containerID="8f5545cfcc45b30fb97e0535cff00eb1c2fc178fc169cc944e3c29c921dc2f3f" Jul 06 01:03:20.414720 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:20.414699 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-znllg_openshift-console-operator(789b12fb-c3d0-428d-838c-f29718e69e2c)\"" pod="openshift-console-operator/console-operator-68b757fb67-znllg" podUID="789b12fb-c3d0-428d-838c-f29718e69e2c" Jul 06 01:03:22.182111 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:22.182072 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfsvc\" (UID: \"f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3\") " pod="openshift-insights/insights-runtime-extractor-wfsvc" Jul 06 01:03:22.182490 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:22.182200 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfsvc\" (UID: \"f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3\") " pod="openshift-insights/insights-runtime-extractor-wfsvc" Jul 06 01:03:22.182490 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:22.182231 2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 01:03:22.182490 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:22.182293 2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 01:03:22.182490 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:22.182296 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-insights-runtime-extractor-tls podName:f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:30.182276901 +0000 UTC m=+250.196649925 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wfsvc" (UID: "f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3") : secret "insights-runtime-extractor-tls" not found Jul 06 01:03:22.182490 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:22.182336 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-kube-rbac-proxy-cm podName:f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:30.182325344 +0000 UTC m=+250.196698359 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wfsvc" (UID: "f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3") : configmap "kube-rbac-proxy" not found Jul 06 01:03:26.017332 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:26.017293 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c6f894e-5149-4c29-84ff-468f3cae5d80-metrics-certs\") pod \"router-default-55758cd8ff-8lgbp\" (UID: \"8c6f894e-5149-4c29-84ff-468f3cae5d80\") " pod="openshift-ingress/router-default-55758cd8ff-8lgbp" Jul 06 01:03:26.017722 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:26.017337 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d863b393-e7eb-42f0-afe7-371c3e9996c9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-khdjc\" (UID: \"d863b393-e7eb-42f0-afe7-371c3e9996c9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-khdjc" Jul 06 01:03:26.017722 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:26.017479 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c6f894e-5149-4c29-84ff-468f3cae5d80-service-ca-bundle\") pod \"router-default-55758cd8ff-8lgbp\" (UID: \"8c6f894e-5149-4c29-84ff-468f3cae5d80\") " pod="openshift-ingress/router-default-55758cd8ff-8lgbp" Jul 06 01:03:26.018129 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:26.018110 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c6f894e-5149-4c29-84ff-468f3cae5d80-service-ca-bundle\") pod \"router-default-55758cd8ff-8lgbp\" (UID: \"8c6f894e-5149-4c29-84ff-468f3cae5d80\") " pod="openshift-ingress/router-default-55758cd8ff-8lgbp" Jul 06 01:03:26.019739 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:26.019717 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d863b393-e7eb-42f0-afe7-371c3e9996c9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-khdjc\" (UID: \"d863b393-e7eb-42f0-afe7-371c3e9996c9\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-khdjc" Jul 06 01:03:26.019836 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:26.019759 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c6f894e-5149-4c29-84ff-468f3cae5d80-metrics-certs\") pod \"router-default-55758cd8ff-8lgbp\" (UID: \"8c6f894e-5149-4c29-84ff-468f3cae5d80\") " pod="openshift-ingress/router-default-55758cd8ff-8lgbp" Jul 06 01:03:26.100405 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:26.100375 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-sl76v\"" Jul 06 01:03:26.108244 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:26.108220 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-khdjc" Jul 06 01:03:26.108346 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:26.108332 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-bvsjm\"" Jul 06 01:03:26.117261 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:26.117244 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-55758cd8ff-8lgbp" Jul 06 01:03:26.243618 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:26.243589 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-khdjc"] Jul 06 01:03:26.246322 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:03:26.246296 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd863b393_e7eb_42f0_afe7_371c3e9996c9.slice/crio-9ed5e8d34ddfe943f3c41faac2a5014c092657770f2142c632af3adb35692a36 WatchSource:0}: Error finding container 9ed5e8d34ddfe943f3c41faac2a5014c092657770f2142c632af3adb35692a36: Status 404 returned error can't find the container with id 9ed5e8d34ddfe943f3c41faac2a5014c092657770f2142c632af3adb35692a36 Jul 06 01:03:26.260555 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:26.260532 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-55758cd8ff-8lgbp"] Jul 06 01:03:26.264022 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:03:26.264000 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c6f894e_5149_4c29_84ff_468f3cae5d80.slice/crio-d919e06c1184b9407b754d5461ecfaef801cb1e8f6542ccd5c8fc9b7480ce1f7 WatchSource:0}: Error finding container d919e06c1184b9407b754d5461ecfaef801cb1e8f6542ccd5c8fc9b7480ce1f7: Status 404 returned error can't find the container with id d919e06c1184b9407b754d5461ecfaef801cb1e8f6542ccd5c8fc9b7480ce1f7 Jul 06 01:03:27.202937 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:27.202897 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-khdjc" event={"ID":"d863b393-e7eb-42f0-afe7-371c3e9996c9","Type":"ContainerStarted","Data":"9ed5e8d34ddfe943f3c41faac2a5014c092657770f2142c632af3adb35692a36"} Jul 06 01:03:27.204311 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:27.204284 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-55758cd8ff-8lgbp" event={"ID":"8c6f894e-5149-4c29-84ff-468f3cae5d80","Type":"ContainerStarted","Data":"f54c6bc131a2c70eec4df0f19cddbb4502d4894cdf83387233e835330b166797"} Jul 06 01:03:27.204401 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:27.204326 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-55758cd8ff-8lgbp" event={"ID":"8c6f894e-5149-4c29-84ff-468f3cae5d80","Type":"ContainerStarted","Data":"d919e06c1184b9407b754d5461ecfaef801cb1e8f6542ccd5c8fc9b7480ce1f7"} Jul 06 01:03:27.223826 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:27.223770 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-55758cd8ff-8lgbp" podStartSLOduration=17.223753442 podStartE2EDuration="17.223753442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:03:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:03:27.222829411 +0000 UTC m=+247.237202448" watchObservedRunningTime="2026-07-06 01:03:27.223753442 +0000 UTC m=+247.238126525" Jul 06 01:03:28.117742 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:28.117704 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-55758cd8ff-8lgbp" Jul 06 01:03:28.120529 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:28.120507 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-55758cd8ff-8lgbp" Jul 06 01:03:28.207389 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:28.207360 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-55758cd8ff-8lgbp" Jul 06 01:03:28.208763 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:28.208733 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-55758cd8ff-8lgbp" Jul 06 01:03:29.211200 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:29.211163 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-khdjc" event={"ID":"d863b393-e7eb-42f0-afe7-371c3e9996c9","Type":"ContainerStarted","Data":"67df209456a3b6ca6d59fa8aa4c1d0d0d5d61e1e69dc194ff14e83007c7502e0"} Jul 06 01:03:29.231206 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:29.231157 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-khdjc" podStartSLOduration=17.148882282 podStartE2EDuration="19.231141855s" totalImagesPullingTime="2.082259573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:03:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:03:29.230360309 +0000 UTC m=+249.244733346" watchObservedRunningTime="2026-07-06 01:03:29.231141855 +0000 UTC m=+249.245514890" Jul 06 01:03:30.252953 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:30.252914 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfsvc\" (UID: \"f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3\") " pod="openshift-insights/insights-runtime-extractor-wfsvc" Jul 06 01:03:30.253378 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:30.253219 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfsvc\" (UID: \"f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3\") " pod="openshift-insights/insights-runtime-extractor-wfsvc" Jul 06 01:03:30.253714 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:30.253693 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfsvc\" (UID: \"f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3\") " pod="openshift-insights/insights-runtime-extractor-wfsvc" Jul 06 01:03:30.255287 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:30.255265 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfsvc\" (UID: \"f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3\") " pod="openshift-insights/insights-runtime-extractor-wfsvc" Jul 06 01:03:30.319982 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:30.319950 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jv6lr\"" Jul 06 01:03:30.327972 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:30.327950 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wfsvc" Jul 06 01:03:30.450527 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:30.450491 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wfsvc"] Jul 06 01:03:30.453757 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:03:30.453722 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4c7aa44_6ac7_49e1_8961_9ae41db2d2f3.slice/crio-06c6d7441c3f47f2d94f832b0b33e9cc985a66ba560b69a1117b13d2cbb91a07 WatchSource:0}: Error finding container 06c6d7441c3f47f2d94f832b0b33e9cc985a66ba560b69a1117b13d2cbb91a07: Status 404 returned error can't find the container with id 06c6d7441c3f47f2d94f832b0b33e9cc985a66ba560b69a1117b13d2cbb91a07 Jul 06 01:03:31.220217 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:31.220182 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wfsvc" event={"ID":"f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3","Type":"ContainerStarted","Data":"06c6d7441c3f47f2d94f832b0b33e9cc985a66ba560b69a1117b13d2cbb91a07"} Jul 06 01:03:32.271953 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:32.271913 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ae44021-3eed-4a62-9e80-47242e594a85-metrics-certs\") pod \"network-metrics-daemon-gn92r\" (UID: \"4ae44021-3eed-4a62-9e80-47242e594a85\") " pod="openshift-multus/network-metrics-daemon-gn92r" Jul 06 01:03:32.274347 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:32.274322 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ae44021-3eed-4a62-9e80-47242e594a85-metrics-certs\") pod \"network-metrics-daemon-gn92r\" (UID: \"4ae44021-3eed-4a62-9e80-47242e594a85\") " pod="openshift-multus/network-metrics-daemon-gn92r" Jul 06 01:03:32.487098 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:32.487068 2553 scope.go:117] "RemoveContainer" containerID="8f5545cfcc45b30fb97e0535cff00eb1c2fc178fc169cc944e3c29c921dc2f3f" Jul 06 01:03:32.489291 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:32.489265 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fwj5x\"" Jul 06 01:03:32.497241 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:32.497211 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gn92r" Jul 06 01:03:34.348861 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:34.348794 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gn92r"] Jul 06 01:03:34.351455 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:03:34.351426 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ae44021_3eed_4a62_9e80_47242e594a85.slice/crio-fe5da920c9146685b5403b739dedb186ff4425afa6177bef1473ceaaeaa27281 WatchSource:0}: Error finding container fe5da920c9146685b5403b739dedb186ff4425afa6177bef1473ceaaeaa27281: Status 404 returned error can't find the container with id fe5da920c9146685b5403b739dedb186ff4425afa6177bef1473ceaaeaa27281 Jul 06 01:03:35.235239 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:35.235198 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gn92r" event={"ID":"4ae44021-3eed-4a62-9e80-47242e594a85","Type":"ContainerStarted","Data":"fe5da920c9146685b5403b739dedb186ff4425afa6177bef1473ceaaeaa27281"} Jul 06 01:03:35.237280 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:35.237252 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-znllg_789b12fb-c3d0-428d-838c-f29718e69e2c/console-operator/1.log" Jul 06 01:03:35.237418 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:35.237326 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-znllg" event={"ID":"789b12fb-c3d0-428d-838c-f29718e69e2c","Type":"ContainerStarted","Data":"0e171a089244e40ce6d2e18727c9048c1fef3a7d15dac2608635bf56fb27afbb"} Jul 06 01:03:35.237977 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:35.237954 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-znllg" Jul 06 01:03:35.239179 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:35.239131 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wfsvc" event={"ID":"f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3","Type":"ContainerStarted","Data":"c85aae531c0019fbebf126efb54d3d7050a469a07536180ec8005962aafdddf3"} Jul 06 01:03:35.243899 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:35.243875 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-znllg" Jul 06 01:03:35.262915 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:35.262818 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-znllg" podStartSLOduration=21.046524195 podStartE2EDuration="25.262801906s" totalImagesPullingTime="4.216277711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:03:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:03:35.261418121 +0000 UTC m=+255.275791157" watchObservedRunningTime="2026-07-06 01:03:35.262801906 +0000 UTC m=+255.277174941" Jul 06 01:03:36.244641 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:36.244604 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wfsvc" event={"ID":"f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3","Type":"ContainerStarted","Data":"56ebadf498736771a7944c0c1ff3cfbadea9bdf24466897232ecb3ee1de5867d"} Jul 06 01:03:36.246507 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:36.246481 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gn92r" event={"ID":"4ae44021-3eed-4a62-9e80-47242e594a85","Type":"ContainerStarted","Data":"7018ef368a182b3d2227002abe020365ea6ffb1e5e6fdbb36ddb7ea2745b7eb9"} Jul 06 01:03:36.246621 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:36.246530 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gn92r" event={"ID":"4ae44021-3eed-4a62-9e80-47242e594a85","Type":"ContainerStarted","Data":"f767ee8994d385c934b318e2fd7a7dfe7b23a961bbfdd343c8d6ce703de5bc46"} Jul 06 01:03:36.265908 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:36.265853 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gn92r" podStartSLOduration=254.994663452 podStartE2EDuration="4m16.265837359s" totalImagesPullingTime="1.271173907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 00:59:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:03:36.263802436 +0000 UTC m=+256.278175471" watchObservedRunningTime="2026-07-06 01:03:36.265837359 +0000 UTC m=+256.280210395" Jul 06 01:03:38.254808 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:38.254770 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wfsvc" event={"ID":"f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3","Type":"ContainerStarted","Data":"96f46d0a4154471a0ec9d917a05571d412410595c08205a7cd74e18835b8d5c5"} Jul 06 01:03:38.275028 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:38.274978 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wfsvc" podStartSLOduration=17.033685023 podStartE2EDuration="24.274962429s" totalImagesPullingTime="7.241277406s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 01:03:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:03:38.274709986 +0000 UTC m=+258.289083023" watchObservedRunningTime="2026-07-06 01:03:38.274962429 +0000 UTC m=+258.289335464" Jul 06 01:03:41.938440 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:41.938392 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-4s62f"] Jul 06 01:03:41.941458 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:41.941441 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4s62f" Jul 06 01:03:41.954694 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:41.954656 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 06 01:03:41.954841 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:41.954749 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 06 01:03:41.955964 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:41.955951 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 01:03:41.956021 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:41.955982 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-nvrv4\"" Jul 06 01:03:41.961114 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:41.961095 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-4s62f"] Jul 06 01:03:42.058572 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:42.058527 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cfd645f-edf7-4ce4-a692-6d40e5d57d3e-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-4s62f\" (UID: \"0cfd645f-edf7-4ce4-a692-6d40e5d57d3e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4s62f" Jul 06 01:03:42.058841 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:42.058578 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwhlg\" (UniqueName: \"kubernetes.io/projected/0cfd645f-edf7-4ce4-a692-6d40e5d57d3e-kube-api-access-vwhlg\") pod \"prometheus-operator-567f7b8b7c-4s62f\" (UID: \"0cfd645f-edf7-4ce4-a692-6d40e5d57d3e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4s62f" Jul 06 01:03:42.058841 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:42.058634 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0cfd645f-edf7-4ce4-a692-6d40e5d57d3e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-4s62f\" (UID: \"0cfd645f-edf7-4ce4-a692-6d40e5d57d3e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4s62f" Jul 06 01:03:42.058841 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:42.058689 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cfd645f-edf7-4ce4-a692-6d40e5d57d3e-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-4s62f\" (UID: \"0cfd645f-edf7-4ce4-a692-6d40e5d57d3e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4s62f" Jul 06 01:03:42.159135 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:42.159099 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cfd645f-edf7-4ce4-a692-6d40e5d57d3e-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-4s62f\" (UID: \"0cfd645f-edf7-4ce4-a692-6d40e5d57d3e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4s62f" Jul 06 01:03:42.159319 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:42.159199 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cfd645f-edf7-4ce4-a692-6d40e5d57d3e-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-4s62f\" (UID: \"0cfd645f-edf7-4ce4-a692-6d40e5d57d3e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4s62f" Jul 06 01:03:42.159319 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:42.159235 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwhlg\" (UniqueName: \"kubernetes.io/projected/0cfd645f-edf7-4ce4-a692-6d40e5d57d3e-kube-api-access-vwhlg\") pod \"prometheus-operator-567f7b8b7c-4s62f\" (UID: \"0cfd645f-edf7-4ce4-a692-6d40e5d57d3e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4s62f" Jul 06 01:03:42.159319 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:42.159272 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0cfd645f-edf7-4ce4-a692-6d40e5d57d3e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-4s62f\" (UID: \"0cfd645f-edf7-4ce4-a692-6d40e5d57d3e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4s62f" Jul 06 01:03:42.160054 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:42.160029 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cfd645f-edf7-4ce4-a692-6d40e5d57d3e-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-4s62f\" (UID: \"0cfd645f-edf7-4ce4-a692-6d40e5d57d3e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4s62f" Jul 06 01:03:42.161590 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:42.161558 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0cfd645f-edf7-4ce4-a692-6d40e5d57d3e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-4s62f\" (UID: \"0cfd645f-edf7-4ce4-a692-6d40e5d57d3e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4s62f" Jul 06 01:03:42.161709 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:42.161645 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cfd645f-edf7-4ce4-a692-6d40e5d57d3e-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-4s62f\" (UID: \"0cfd645f-edf7-4ce4-a692-6d40e5d57d3e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4s62f" Jul 06 01:03:42.168064 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:42.168031 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwhlg\" (UniqueName: \"kubernetes.io/projected/0cfd645f-edf7-4ce4-a692-6d40e5d57d3e-kube-api-access-vwhlg\") pod \"prometheus-operator-567f7b8b7c-4s62f\" (UID: \"0cfd645f-edf7-4ce4-a692-6d40e5d57d3e\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4s62f" Jul 06 01:03:42.250051 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:42.250013 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4s62f" Jul 06 01:03:42.393244 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:42.393210 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-4s62f"] Jul 06 01:03:42.395589 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:03:42.395563 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cfd645f_edf7_4ce4_a692_6d40e5d57d3e.slice/crio-029b937c999e1870b1d0cf43b1a2270ce2d81643a7f9adb6f6a6a99b9d5a54c8 WatchSource:0}: Error finding container 029b937c999e1870b1d0cf43b1a2270ce2d81643a7f9adb6f6a6a99b9d5a54c8: Status 404 returned error can't find the container with id 029b937c999e1870b1d0cf43b1a2270ce2d81643a7f9adb6f6a6a99b9d5a54c8 Jul 06 01:03:43.292252 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:43.292217 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4s62f" event={"ID":"0cfd645f-edf7-4ce4-a692-6d40e5d57d3e","Type":"ContainerStarted","Data":"029b937c999e1870b1d0cf43b1a2270ce2d81643a7f9adb6f6a6a99b9d5a54c8"} Jul 06 01:03:44.297999 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:44.297957 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4s62f" event={"ID":"0cfd645f-edf7-4ce4-a692-6d40e5d57d3e","Type":"ContainerStarted","Data":"c2eee63f6f3f27167f44e47f458b80169b1e6a5702d29115b4cb6d6d8c85637a"} Jul 06 01:03:44.298438 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:44.298056 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4s62f" event={"ID":"0cfd645f-edf7-4ce4-a692-6d40e5d57d3e","Type":"ContainerStarted","Data":"5de66154bb59ba9bfe5efa54c7b2451ebc0966e160f1758289baa5001a96515b"} Jul 06 01:03:44.319803 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:44.319757 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4s62f" podStartSLOduration=1.8619299489999999 podStartE2EDuration="3.319742617s" totalImagesPullingTime="1.457812668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:03:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:03:44.318518113 +0000 UTC m=+264.332891148" watchObservedRunningTime="2026-07-06 01:03:44.319742617 +0000 UTC m=+264.334115653" Jul 06 01:03:46.236816 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.236778 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-m55nn"] Jul 06 01:03:46.240057 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.240024 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m55nn" Jul 06 01:03:46.243098 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.243078 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 06 01:03:46.243494 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.243475 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-rs769\"" Jul 06 01:03:46.244014 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.243998 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 06 01:03:46.253555 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.253534 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-m55nn"] Jul 06 01:03:46.304114 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.304086 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-q8fp2"] Jul 06 01:03:46.307153 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.307128 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q8fp2" Jul 06 01:03:46.310255 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.310235 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 01:03:46.310618 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.310599 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 01:03:46.310732 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.310623 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2dfmm\"" Jul 06 01:03:46.310956 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.310940 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 01:03:46.394462 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.394428 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksjvp\" (UniqueName: \"kubernetes.io/projected/4a8fea05-9512-4645-990e-2ce411026472-kube-api-access-ksjvp\") pod \"node-exporter-q8fp2\" (UID: \"4a8fea05-9512-4645-990e-2ce411026472\") " pod="openshift-monitoring/node-exporter-q8fp2" Jul 06 01:03:46.394631 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.394484 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79ae0875-ffd8-4438-8b0d-2bd328c43300-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-m55nn\" (UID: \"79ae0875-ffd8-4438-8b0d-2bd328c43300\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m55nn" Jul 06 01:03:46.394631 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.394542 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/79ae0875-ffd8-4438-8b0d-2bd328c43300-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-m55nn\" (UID: \"79ae0875-ffd8-4438-8b0d-2bd328c43300\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m55nn" Jul 06 01:03:46.394631 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.394575 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a8fea05-9512-4645-990e-2ce411026472-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q8fp2\" (UID: \"4a8fea05-9512-4645-990e-2ce411026472\") " pod="openshift-monitoring/node-exporter-q8fp2" Jul 06 01:03:46.394631 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.394617 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4a8fea05-9512-4645-990e-2ce411026472-node-exporter-tls\") pod \"node-exporter-q8fp2\" (UID: \"4a8fea05-9512-4645-990e-2ce411026472\") " pod="openshift-monitoring/node-exporter-q8fp2" Jul 06 01:03:46.394827 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.394639 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79ae0875-ffd8-4438-8b0d-2bd328c43300-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-m55nn\" (UID: \"79ae0875-ffd8-4438-8b0d-2bd328c43300\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m55nn" Jul 06 01:03:46.394827 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.394706 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4a8fea05-9512-4645-990e-2ce411026472-node-exporter-accelerators-collector-config\") pod \"node-exporter-q8fp2\" (UID: \"4a8fea05-9512-4645-990e-2ce411026472\") " pod="openshift-monitoring/node-exporter-q8fp2" Jul 06 01:03:46.394827 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.394733 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4a8fea05-9512-4645-990e-2ce411026472-node-exporter-wtmp\") pod \"node-exporter-q8fp2\" (UID: \"4a8fea05-9512-4645-990e-2ce411026472\") " pod="openshift-monitoring/node-exporter-q8fp2" Jul 06 01:03:46.394827 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.394755 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a8fea05-9512-4645-990e-2ce411026472-sys\") pod \"node-exporter-q8fp2\" (UID: \"4a8fea05-9512-4645-990e-2ce411026472\") " pod="openshift-monitoring/node-exporter-q8fp2" Jul 06 01:03:46.394827 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.394779 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a8fea05-9512-4645-990e-2ce411026472-metrics-client-ca\") pod \"node-exporter-q8fp2\" (UID: \"4a8fea05-9512-4645-990e-2ce411026472\") " pod="openshift-monitoring/node-exporter-q8fp2" Jul 06 01:03:46.394972 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.394837 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4a8fea05-9512-4645-990e-2ce411026472-root\") pod \"node-exporter-q8fp2\" (UID: \"4a8fea05-9512-4645-990e-2ce411026472\") " pod="openshift-monitoring/node-exporter-q8fp2" Jul 06 01:03:46.394972 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.394866 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcxmg\" (UniqueName: \"kubernetes.io/projected/79ae0875-ffd8-4438-8b0d-2bd328c43300-kube-api-access-tcxmg\") pod \"openshift-state-metrics-54cf96dfcf-m55nn\" (UID: \"79ae0875-ffd8-4438-8b0d-2bd328c43300\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m55nn" Jul 06 01:03:46.394972 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.394905 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4a8fea05-9512-4645-990e-2ce411026472-node-exporter-textfile\") pod \"node-exporter-q8fp2\" (UID: \"4a8fea05-9512-4645-990e-2ce411026472\") " pod="openshift-monitoring/node-exporter-q8fp2" Jul 06 01:03:46.495532 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.495453 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a8fea05-9512-4645-990e-2ce411026472-sys\") pod \"node-exporter-q8fp2\" (UID: \"4a8fea05-9512-4645-990e-2ce411026472\") " pod="openshift-monitoring/node-exporter-q8fp2" Jul 06 01:03:46.495532 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.495488 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a8fea05-9512-4645-990e-2ce411026472-metrics-client-ca\") pod \"node-exporter-q8fp2\" (UID: \"4a8fea05-9512-4645-990e-2ce411026472\") " pod="openshift-monitoring/node-exporter-q8fp2" Jul 06 01:03:46.495532 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.495508 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4a8fea05-9512-4645-990e-2ce411026472-root\") pod \"node-exporter-q8fp2\" (UID: \"4a8fea05-9512-4645-990e-2ce411026472\") " pod="openshift-monitoring/node-exporter-q8fp2" Jul 06 01:03:46.495815 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.495533 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcxmg\" (UniqueName: \"kubernetes.io/projected/79ae0875-ffd8-4438-8b0d-2bd328c43300-kube-api-access-tcxmg\") pod \"openshift-state-metrics-54cf96dfcf-m55nn\" (UID: \"79ae0875-ffd8-4438-8b0d-2bd328c43300\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m55nn" Jul 06 01:03:46.495815 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.495567 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a8fea05-9512-4645-990e-2ce411026472-sys\") pod \"node-exporter-q8fp2\" (UID: \"4a8fea05-9512-4645-990e-2ce411026472\") " pod="openshift-monitoring/node-exporter-q8fp2" Jul 06 01:03:46.495815 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.495580 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4a8fea05-9512-4645-990e-2ce411026472-root\") pod \"node-exporter-q8fp2\" (UID: \"4a8fea05-9512-4645-990e-2ce411026472\") " pod="openshift-monitoring/node-exporter-q8fp2" Jul 06 01:03:46.495815 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.495631 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4a8fea05-9512-4645-990e-2ce411026472-node-exporter-textfile\") pod \"node-exporter-q8fp2\" (UID: \"4a8fea05-9512-4645-990e-2ce411026472\") " pod="openshift-monitoring/node-exporter-q8fp2" Jul 06 01:03:46.495815 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.495649 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksjvp\" (UniqueName: \"kubernetes.io/projected/4a8fea05-9512-4645-990e-2ce411026472-kube-api-access-ksjvp\") pod \"node-exporter-q8fp2\" (UID: \"4a8fea05-9512-4645-990e-2ce411026472\") " pod="openshift-monitoring/node-exporter-q8fp2" Jul 06 01:03:46.495815 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.495715 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79ae0875-ffd8-4438-8b0d-2bd328c43300-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-m55nn\" (UID: \"79ae0875-ffd8-4438-8b0d-2bd328c43300\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m55nn" Jul 06 01:03:46.495815 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.495742 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/79ae0875-ffd8-4438-8b0d-2bd328c43300-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-m55nn\" (UID: \"79ae0875-ffd8-4438-8b0d-2bd328c43300\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m55nn" Jul 06 01:03:46.495815 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.495759 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a8fea05-9512-4645-990e-2ce411026472-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q8fp2\" (UID: \"4a8fea05-9512-4645-990e-2ce411026472\") " pod="openshift-monitoring/node-exporter-q8fp2" Jul 06 01:03:46.495815 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.495806 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4a8fea05-9512-4645-990e-2ce411026472-node-exporter-tls\") pod \"node-exporter-q8fp2\" (UID: \"4a8fea05-9512-4645-990e-2ce411026472\") " pod="openshift-monitoring/node-exporter-q8fp2" Jul 06 01:03:46.496240 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.495832 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79ae0875-ffd8-4438-8b0d-2bd328c43300-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-m55nn\" (UID: \"79ae0875-ffd8-4438-8b0d-2bd328c43300\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m55nn" Jul 06 01:03:46.496240 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:46.495879 2553 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 06 01:03:46.496240 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:46.495942 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79ae0875-ffd8-4438-8b0d-2bd328c43300-openshift-state-metrics-tls podName:79ae0875-ffd8-4438-8b0d-2bd328c43300 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:46.995922459 +0000 UTC m=+267.010295487 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/79ae0875-ffd8-4438-8b0d-2bd328c43300-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-m55nn" (UID: "79ae0875-ffd8-4438-8b0d-2bd328c43300") : secret "openshift-state-metrics-tls" not found Jul 06 01:03:46.496240 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.496041 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4a8fea05-9512-4645-990e-2ce411026472-node-exporter-textfile\") pod \"node-exporter-q8fp2\" (UID: \"4a8fea05-9512-4645-990e-2ce411026472\") " pod="openshift-monitoring/node-exporter-q8fp2" Jul 06 01:03:46.496240 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.495881 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4a8fea05-9512-4645-990e-2ce411026472-node-exporter-accelerators-collector-config\") pod \"node-exporter-q8fp2\" (UID: \"4a8fea05-9512-4645-990e-2ce411026472\") " pod="openshift-monitoring/node-exporter-q8fp2" Jul 06 01:03:46.496240 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.496109 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4a8fea05-9512-4645-990e-2ce411026472-node-exporter-wtmp\") pod \"node-exporter-q8fp2\" (UID: \"4a8fea05-9512-4645-990e-2ce411026472\") " pod="openshift-monitoring/node-exporter-q8fp2" Jul 06 01:03:46.496240 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:46.496116 2553 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 06 01:03:46.496240 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:46.496165 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a8fea05-9512-4645-990e-2ce411026472-node-exporter-tls podName:4a8fea05-9512-4645-990e-2ce411026472 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:46.99614928 +0000 UTC m=+267.010522296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4a8fea05-9512-4645-990e-2ce411026472-node-exporter-tls") pod "node-exporter-q8fp2" (UID: "4a8fea05-9512-4645-990e-2ce411026472") : secret "node-exporter-tls" not found Jul 06 01:03:46.496534 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.496266 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a8fea05-9512-4645-990e-2ce411026472-metrics-client-ca\") pod \"node-exporter-q8fp2\" (UID: \"4a8fea05-9512-4645-990e-2ce411026472\") " pod="openshift-monitoring/node-exporter-q8fp2" Jul 06 01:03:46.496534 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.496288 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4a8fea05-9512-4645-990e-2ce411026472-node-exporter-wtmp\") pod \"node-exporter-q8fp2\" (UID: \"4a8fea05-9512-4645-990e-2ce411026472\") " pod="openshift-monitoring/node-exporter-q8fp2" Jul 06 01:03:46.496534 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.496407 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4a8fea05-9512-4645-990e-2ce411026472-node-exporter-accelerators-collector-config\") pod \"node-exporter-q8fp2\" (UID: \"4a8fea05-9512-4645-990e-2ce411026472\") " pod="openshift-monitoring/node-exporter-q8fp2" Jul 06 01:03:46.496534 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.496466 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79ae0875-ffd8-4438-8b0d-2bd328c43300-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-m55nn\" (UID: \"79ae0875-ffd8-4438-8b0d-2bd328c43300\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m55nn" Jul 06 01:03:46.498103 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.498080 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a8fea05-9512-4645-990e-2ce411026472-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-q8fp2\" (UID: \"4a8fea05-9512-4645-990e-2ce411026472\") " pod="openshift-monitoring/node-exporter-q8fp2" Jul 06 01:03:46.498190 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.498164 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79ae0875-ffd8-4438-8b0d-2bd328c43300-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-m55nn\" (UID: \"79ae0875-ffd8-4438-8b0d-2bd328c43300\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m55nn" Jul 06 01:03:46.507278 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.507248 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksjvp\" (UniqueName: \"kubernetes.io/projected/4a8fea05-9512-4645-990e-2ce411026472-kube-api-access-ksjvp\") pod \"node-exporter-q8fp2\" (UID: \"4a8fea05-9512-4645-990e-2ce411026472\") " pod="openshift-monitoring/node-exporter-q8fp2" Jul 06 01:03:46.507406 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:46.507388 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcxmg\" (UniqueName: \"kubernetes.io/projected/79ae0875-ffd8-4438-8b0d-2bd328c43300-kube-api-access-tcxmg\") pod \"openshift-state-metrics-54cf96dfcf-m55nn\" (UID: \"79ae0875-ffd8-4438-8b0d-2bd328c43300\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m55nn" Jul 06 01:03:47.001910 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:47.001874 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/79ae0875-ffd8-4438-8b0d-2bd328c43300-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-m55nn\" (UID: \"79ae0875-ffd8-4438-8b0d-2bd328c43300\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m55nn" Jul 06 01:03:47.001910 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:47.001914 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4a8fea05-9512-4645-990e-2ce411026472-node-exporter-tls\") pod \"node-exporter-q8fp2\" (UID: \"4a8fea05-9512-4645-990e-2ce411026472\") " pod="openshift-monitoring/node-exporter-q8fp2" Jul 06 01:03:47.004380 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:47.004352 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4a8fea05-9512-4645-990e-2ce411026472-node-exporter-tls\") pod \"node-exporter-q8fp2\" (UID: \"4a8fea05-9512-4645-990e-2ce411026472\") " pod="openshift-monitoring/node-exporter-q8fp2" Jul 06 01:03:47.004609 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:47.004587 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/79ae0875-ffd8-4438-8b0d-2bd328c43300-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-m55nn\" (UID: \"79ae0875-ffd8-4438-8b0d-2bd328c43300\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m55nn" Jul 06 01:03:47.148916 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:47.148877 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m55nn" Jul 06 01:03:47.215855 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:47.215824 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-q8fp2" Jul 06 01:03:47.267360 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:03:47.267328 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a8fea05_9512_4645_990e_2ce411026472.slice/crio-8effa2e0ed921fa427534793a3094e4d195e65ffb700b6ba34d2875bc8d494ee WatchSource:0}: Error finding container 8effa2e0ed921fa427534793a3094e4d195e65ffb700b6ba34d2875bc8d494ee: Status 404 returned error can't find the container with id 8effa2e0ed921fa427534793a3094e4d195e65ffb700b6ba34d2875bc8d494ee Jul 06 01:03:47.312319 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:47.312283 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q8fp2" event={"ID":"4a8fea05-9512-4645-990e-2ce411026472","Type":"ContainerStarted","Data":"8effa2e0ed921fa427534793a3094e4d195e65ffb700b6ba34d2875bc8d494ee"} Jul 06 01:03:47.390645 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:47.390551 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-m55nn"] Jul 06 01:03:47.394895 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:03:47.394857 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79ae0875_ffd8_4438_8b0d_2bd328c43300.slice/crio-df3d992e756852ab938db8943a340c19e62a12088645a0c789becea3806e384f WatchSource:0}: Error finding container df3d992e756852ab938db8943a340c19e62a12088645a0c789becea3806e384f: Status 404 returned error can't find the container with id df3d992e756852ab938db8943a340c19e62a12088645a0c789becea3806e384f Jul 06 01:03:48.291796 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.291759 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f5b7cb989-xq5dv"] Jul 06 01:03:48.313964 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.313929 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f5b7cb989-xq5dv"] Jul 06 01:03:48.314234 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.314214 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5b7cb989-xq5dv" Jul 06 01:03:48.316873 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.316829 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 01:03:48.317044 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.316884 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 01:03:48.317044 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.316900 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 01:03:48.318040 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.318008 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 01:03:48.318205 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.318187 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 01:03:48.318285 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.318224 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 01:03:48.318285 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.318280 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 01:03:48.318386 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.318346 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5dwhp\"" Jul 06 01:03:48.319574 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.319548 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m55nn" event={"ID":"79ae0875-ffd8-4438-8b0d-2bd328c43300","Type":"ContainerStarted","Data":"d5b0306ef70d673760a9ecc0629a01c25e3193f7bbac15d00da610ac328692f6"} Jul 06 01:03:48.319650 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.319637 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m55nn" event={"ID":"79ae0875-ffd8-4438-8b0d-2bd328c43300","Type":"ContainerStarted","Data":"feb15c8b79a8daf4acacf5d77e8a2fa667958f76b03f7ed21b79bbf65491af76"} Jul 06 01:03:48.319721 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.319707 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m55nn" event={"ID":"79ae0875-ffd8-4438-8b0d-2bd328c43300","Type":"ContainerStarted","Data":"df3d992e756852ab938db8943a340c19e62a12088645a0c789becea3806e384f"} Jul 06 01:03:48.326890 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.326863 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 01:03:48.415403 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.415364 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f04d415d-f07c-4b4b-860a-c78b792cd419-trusted-ca-bundle\") pod \"console-7f5b7cb989-xq5dv\" (UID: \"f04d415d-f07c-4b4b-860a-c78b792cd419\") " pod="openshift-console/console-7f5b7cb989-xq5dv" Jul 06 01:03:48.415589 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.415450 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f04d415d-f07c-4b4b-860a-c78b792cd419-console-config\") pod \"console-7f5b7cb989-xq5dv\" (UID: \"f04d415d-f07c-4b4b-860a-c78b792cd419\") " pod="openshift-console/console-7f5b7cb989-xq5dv" Jul 06 01:03:48.415589 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.415490 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f04d415d-f07c-4b4b-860a-c78b792cd419-console-serving-cert\") pod \"console-7f5b7cb989-xq5dv\" (UID: \"f04d415d-f07c-4b4b-860a-c78b792cd419\") " pod="openshift-console/console-7f5b7cb989-xq5dv" Jul 06 01:03:48.415589 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.415521 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f04d415d-f07c-4b4b-860a-c78b792cd419-console-oauth-config\") pod \"console-7f5b7cb989-xq5dv\" (UID: \"f04d415d-f07c-4b4b-860a-c78b792cd419\") " pod="openshift-console/console-7f5b7cb989-xq5dv" Jul 06 01:03:48.415589 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.415566 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f04d415d-f07c-4b4b-860a-c78b792cd419-oauth-serving-cert\") pod \"console-7f5b7cb989-xq5dv\" (UID: \"f04d415d-f07c-4b4b-860a-c78b792cd419\") " pod="openshift-console/console-7f5b7cb989-xq5dv" Jul 06 01:03:48.415819 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.415592 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhpl8\" (UniqueName: \"kubernetes.io/projected/f04d415d-f07c-4b4b-860a-c78b792cd419-kube-api-access-rhpl8\") pod \"console-7f5b7cb989-xq5dv\" (UID: \"f04d415d-f07c-4b4b-860a-c78b792cd419\") " pod="openshift-console/console-7f5b7cb989-xq5dv" Jul 06 01:03:48.415819 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.415616 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f04d415d-f07c-4b4b-860a-c78b792cd419-service-ca\") pod \"console-7f5b7cb989-xq5dv\" (UID: \"f04d415d-f07c-4b4b-860a-c78b792cd419\") " pod="openshift-console/console-7f5b7cb989-xq5dv" Jul 06 01:03:48.516810 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.516777 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f04d415d-f07c-4b4b-860a-c78b792cd419-trusted-ca-bundle\") pod \"console-7f5b7cb989-xq5dv\" (UID: \"f04d415d-f07c-4b4b-860a-c78b792cd419\") " pod="openshift-console/console-7f5b7cb989-xq5dv" Jul 06 01:03:48.516992 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.516852 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f04d415d-f07c-4b4b-860a-c78b792cd419-console-config\") pod \"console-7f5b7cb989-xq5dv\" (UID: \"f04d415d-f07c-4b4b-860a-c78b792cd419\") " pod="openshift-console/console-7f5b7cb989-xq5dv" Jul 06 01:03:48.516992 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.516885 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f04d415d-f07c-4b4b-860a-c78b792cd419-console-serving-cert\") pod \"console-7f5b7cb989-xq5dv\" (UID: \"f04d415d-f07c-4b4b-860a-c78b792cd419\") " pod="openshift-console/console-7f5b7cb989-xq5dv" Jul 06 01:03:48.516992 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.516905 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f04d415d-f07c-4b4b-860a-c78b792cd419-console-oauth-config\") pod \"console-7f5b7cb989-xq5dv\" (UID: \"f04d415d-f07c-4b4b-860a-c78b792cd419\") " pod="openshift-console/console-7f5b7cb989-xq5dv" Jul 06 01:03:48.516992 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.516931 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f04d415d-f07c-4b4b-860a-c78b792cd419-oauth-serving-cert\") pod \"console-7f5b7cb989-xq5dv\" (UID: \"f04d415d-f07c-4b4b-860a-c78b792cd419\") " pod="openshift-console/console-7f5b7cb989-xq5dv" Jul 06 01:03:48.517211 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.517071 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhpl8\" (UniqueName: \"kubernetes.io/projected/f04d415d-f07c-4b4b-860a-c78b792cd419-kube-api-access-rhpl8\") pod \"console-7f5b7cb989-xq5dv\" (UID: \"f04d415d-f07c-4b4b-860a-c78b792cd419\") " pod="openshift-console/console-7f5b7cb989-xq5dv" Jul 06 01:03:48.517211 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.517133 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f04d415d-f07c-4b4b-860a-c78b792cd419-service-ca\") pod \"console-7f5b7cb989-xq5dv\" (UID: \"f04d415d-f07c-4b4b-860a-c78b792cd419\") " pod="openshift-console/console-7f5b7cb989-xq5dv" Jul 06 01:03:48.517747 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.517719 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f04d415d-f07c-4b4b-860a-c78b792cd419-service-ca\") pod \"console-7f5b7cb989-xq5dv\" (UID: \"f04d415d-f07c-4b4b-860a-c78b792cd419\") " pod="openshift-console/console-7f5b7cb989-xq5dv" Jul 06 01:03:48.517747 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.517719 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f04d415d-f07c-4b4b-860a-c78b792cd419-console-config\") pod \"console-7f5b7cb989-xq5dv\" (UID: \"f04d415d-f07c-4b4b-860a-c78b792cd419\") " pod="openshift-console/console-7f5b7cb989-xq5dv" Jul 06 01:03:48.517952 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.517747 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f04d415d-f07c-4b4b-860a-c78b792cd419-oauth-serving-cert\") pod \"console-7f5b7cb989-xq5dv\" (UID: \"f04d415d-f07c-4b4b-860a-c78b792cd419\") " pod="openshift-console/console-7f5b7cb989-xq5dv" Jul 06 01:03:48.518011 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.517999 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f04d415d-f07c-4b4b-860a-c78b792cd419-trusted-ca-bundle\") pod \"console-7f5b7cb989-xq5dv\" (UID: \"f04d415d-f07c-4b4b-860a-c78b792cd419\") " pod="openshift-console/console-7f5b7cb989-xq5dv" Jul 06 01:03:48.519471 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.519446 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f04d415d-f07c-4b4b-860a-c78b792cd419-console-serving-cert\") pod \"console-7f5b7cb989-xq5dv\" (UID: \"f04d415d-f07c-4b4b-860a-c78b792cd419\") " pod="openshift-console/console-7f5b7cb989-xq5dv" Jul 06 01:03:48.519588 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.519567 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f04d415d-f07c-4b4b-860a-c78b792cd419-console-oauth-config\") pod \"console-7f5b7cb989-xq5dv\" (UID: \"f04d415d-f07c-4b4b-860a-c78b792cd419\") " pod="openshift-console/console-7f5b7cb989-xq5dv" Jul 06 01:03:48.524887 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.524863 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhpl8\" (UniqueName: \"kubernetes.io/projected/f04d415d-f07c-4b4b-860a-c78b792cd419-kube-api-access-rhpl8\") pod \"console-7f5b7cb989-xq5dv\" (UID: \"f04d415d-f07c-4b4b-860a-c78b792cd419\") " pod="openshift-console/console-7f5b7cb989-xq5dv" Jul 06 01:03:48.628274 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.628250 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5b7cb989-xq5dv" Jul 06 01:03:48.784315 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:48.784280 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f5b7cb989-xq5dv"] Jul 06 01:03:48.787744 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:03:48.787704 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf04d415d_f07c_4b4b_860a_c78b792cd419.slice/crio-880dff02e7d6cfcbd98a2903bfc8e9a0c57704ca96f01f472f77800338c355d7 WatchSource:0}: Error finding container 880dff02e7d6cfcbd98a2903bfc8e9a0c57704ca96f01f472f77800338c355d7: Status 404 returned error can't find the container with id 880dff02e7d6cfcbd98a2903bfc8e9a0c57704ca96f01f472f77800338c355d7 Jul 06 01:03:49.257909 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.257870 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-ff5f56fcf-2sktx"] Jul 06 01:03:49.275059 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.275017 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" Jul 06 01:03:49.275834 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.275743 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-ff5f56fcf-2sktx"] Jul 06 01:03:49.278431 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.278408 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-gvg4l\"" Jul 06 01:03:49.278804 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.278782 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 06 01:03:49.278926 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.278867 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 06 01:03:49.278926 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.278865 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 06 01:03:49.279049 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.279025 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 06 01:03:49.279346 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.279326 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 06 01:03:49.279571 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.279555 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ajg3132mkuanm\"" Jul 06 01:03:49.325458 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.325427 2553 generic.go:356] "Generic (PLEG): container finished" podID="4a8fea05-9512-4645-990e-2ce411026472" containerID="552f71fc183b542aa2fdcfaef5d66fda70cbeb257f1c3335e1ce71e91432809f" exitCode=0 Jul 06 01:03:49.325927 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.325526 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q8fp2" event={"ID":"4a8fea05-9512-4645-990e-2ce411026472","Type":"ContainerDied","Data":"552f71fc183b542aa2fdcfaef5d66fda70cbeb257f1c3335e1ce71e91432809f"} Jul 06 01:03:49.326947 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.326923 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5b7cb989-xq5dv" event={"ID":"f04d415d-f07c-4b4b-860a-c78b792cd419","Type":"ContainerStarted","Data":"880dff02e7d6cfcbd98a2903bfc8e9a0c57704ca96f01f472f77800338c355d7"} Jul 06 01:03:49.424830 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.424803 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5-secret-thanos-querier-tls\") pod \"thanos-querier-ff5f56fcf-2sktx\" (UID: \"c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5\") " pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" Jul 06 01:03:49.424830 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.424835 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-ff5f56fcf-2sktx\" (UID: \"c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5\") " pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" Jul 06 01:03:49.425039 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.424859 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5-metrics-client-ca\") pod \"thanos-querier-ff5f56fcf-2sktx\" (UID: \"c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5\") " pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" Jul 06 01:03:49.425076 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.425035 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-ff5f56fcf-2sktx\" (UID: \"c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5\") " pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" Jul 06 01:03:49.425123 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.425071 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2hwq\" (UniqueName: \"kubernetes.io/projected/c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5-kube-api-access-q2hwq\") pod \"thanos-querier-ff5f56fcf-2sktx\" (UID: \"c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5\") " pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" Jul 06 01:03:49.425180 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.425125 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5-secret-grpc-tls\") pod \"thanos-querier-ff5f56fcf-2sktx\" (UID: \"c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5\") " pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" Jul 06 01:03:49.425235 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.425206 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-ff5f56fcf-2sktx\" (UID: \"c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5\") " pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" Jul 06 01:03:49.425319 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.425281 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-ff5f56fcf-2sktx\" (UID: \"c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5\") " pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" Jul 06 01:03:49.526605 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.526576 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-ff5f56fcf-2sktx\" (UID: \"c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5\") " pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" Jul 06 01:03:49.526769 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.526624 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5-secret-thanos-querier-tls\") pod \"thanos-querier-ff5f56fcf-2sktx\" (UID: \"c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5\") " pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" Jul 06 01:03:49.526769 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.526699 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-ff5f56fcf-2sktx\" (UID: \"c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5\") " pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" Jul 06 01:03:49.526769 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.526735 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5-metrics-client-ca\") pod \"thanos-querier-ff5f56fcf-2sktx\" (UID: \"c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5\") " pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" Jul 06 01:03:49.526950 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.526930 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-ff5f56fcf-2sktx\" (UID: \"c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5\") " pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" Jul 06 01:03:49.527004 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.526971 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2hwq\" (UniqueName: \"kubernetes.io/projected/c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5-kube-api-access-q2hwq\") pod \"thanos-querier-ff5f56fcf-2sktx\" (UID: \"c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5\") " pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" Jul 06 01:03:49.527057 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.527007 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5-secret-grpc-tls\") pod \"thanos-querier-ff5f56fcf-2sktx\" (UID: \"c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5\") " pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" Jul 06 01:03:49.527135 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.527088 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-ff5f56fcf-2sktx\" (UID: \"c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5\") " pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" Jul 06 01:03:49.527589 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.527561 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5-metrics-client-ca\") pod \"thanos-querier-ff5f56fcf-2sktx\" (UID: \"c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5\") " pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" Jul 06 01:03:49.529404 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.529356 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-ff5f56fcf-2sktx\" (UID: \"c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5\") " pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" Jul 06 01:03:49.529633 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.529608 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5-secret-grpc-tls\") pod \"thanos-querier-ff5f56fcf-2sktx\" (UID: \"c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5\") " pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" Jul 06 01:03:49.529701 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.529648 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-ff5f56fcf-2sktx\" (UID: \"c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5\") " pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" Jul 06 01:03:49.529872 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.529850 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-ff5f56fcf-2sktx\" (UID: \"c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5\") " pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" Jul 06 01:03:49.529908 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.529894 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5-secret-thanos-querier-tls\") pod \"thanos-querier-ff5f56fcf-2sktx\" (UID: \"c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5\") " pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" Jul 06 01:03:49.529987 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.529971 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-ff5f56fcf-2sktx\" (UID: \"c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5\") " pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" Jul 06 01:03:49.536514 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.536491 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2hwq\" (UniqueName: \"kubernetes.io/projected/c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5-kube-api-access-q2hwq\") pod \"thanos-querier-ff5f56fcf-2sktx\" (UID: \"c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5\") " pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" Jul 06 01:03:49.586143 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.586054 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" Jul 06 01:03:49.827426 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:49.827377 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-ff5f56fcf-2sktx"] Jul 06 01:03:49.830407 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:03:49.830368 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc19e44e5_b8a6_49b0_96ff_56b8bd12b8c5.slice/crio-9bd009123f82885c88ac3c27039b94c01ca398e986f7f67aa64ba667af3ff376 WatchSource:0}: Error finding container 9bd009123f82885c88ac3c27039b94c01ca398e986f7f67aa64ba667af3ff376: Status 404 returned error can't find the container with id 9bd009123f82885c88ac3c27039b94c01ca398e986f7f67aa64ba667af3ff376 Jul 06 01:03:50.334584 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:50.334543 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q8fp2" event={"ID":"4a8fea05-9512-4645-990e-2ce411026472","Type":"ContainerStarted","Data":"e33fa36dc8d0a5e3984f631edae7245f515d3cac3a2be96b7fbd2ba10d635bbd"} Jul 06 01:03:50.335061 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:50.334618 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-q8fp2" event={"ID":"4a8fea05-9512-4645-990e-2ce411026472","Type":"ContainerStarted","Data":"d9f5969c27d0e38b40b53d47055cbc05e8af788a531c25ae3b5adf505a857ea9"} Jul 06 01:03:50.336997 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:50.336968 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m55nn" event={"ID":"79ae0875-ffd8-4438-8b0d-2bd328c43300","Type":"ContainerStarted","Data":"65ebb9aeceb91b66b0a2f98244917a2e9a634b44ba4fcd2c6da549bf04885cb3"} Jul 06 01:03:50.338305 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:50.338272 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" event={"ID":"c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5","Type":"ContainerStarted","Data":"9bd009123f82885c88ac3c27039b94c01ca398e986f7f67aa64ba667af3ff376"} Jul 06 01:03:50.363519 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:50.363462 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-q8fp2" podStartSLOduration=2.901392094 podStartE2EDuration="4.363439483s" totalImagesPullingTime="1.342529024s" totalInitContainerRuntime="119.518365ms" isStatefulPod=true podCreationTimestamp="2026-07-06 01:03:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:03:50.361763758 +0000 UTC m=+270.376136795" watchObservedRunningTime="2026-07-06 01:03:50.363439483 +0000 UTC m=+270.377812520" Jul 06 01:03:51.034708 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:51.034421 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-m55nn" podStartSLOduration=2.999804238 podStartE2EDuration="5.034396455s" totalImagesPullingTime="2.034592217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:03:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:03:50.396273348 +0000 UTC m=+270.410646385" watchObservedRunningTime="2026-07-06 01:03:51.034396455 +0000 UTC m=+271.048769492" Jul 06 01:03:51.035531 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:51.035506 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-f9fzj"] Jul 06 01:03:51.052791 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:51.052757 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-f9fzj"] Jul 06 01:03:51.052987 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:51.052877 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f9fzj" Jul 06 01:03:51.055542 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:51.055513 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-pkw9z\"" Jul 06 01:03:51.055847 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:51.055827 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 06 01:03:51.142163 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:51.142127 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdsjk\" (UniqueName: \"kubernetes.io/projected/b24e9883-3bc0-43a3-a669-17b49ae0ffb8-kube-api-access-xdsjk\") pod \"monitoring-plugin-d5dcff7cf-f9fzj\" (UID: \"b24e9883-3bc0-43a3-a669-17b49ae0ffb8\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f9fzj" Jul 06 01:03:51.142370 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:51.142341 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b24e9883-3bc0-43a3-a669-17b49ae0ffb8-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-f9fzj\" (UID: \"b24e9883-3bc0-43a3-a669-17b49ae0ffb8\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f9fzj" Jul 06 01:03:51.243178 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:51.243140 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdsjk\" (UniqueName: \"kubernetes.io/projected/b24e9883-3bc0-43a3-a669-17b49ae0ffb8-kube-api-access-xdsjk\") pod \"monitoring-plugin-d5dcff7cf-f9fzj\" (UID: \"b24e9883-3bc0-43a3-a669-17b49ae0ffb8\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f9fzj" Jul 06 01:03:51.243359 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:51.243275 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b24e9883-3bc0-43a3-a669-17b49ae0ffb8-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-f9fzj\" (UID: \"b24e9883-3bc0-43a3-a669-17b49ae0ffb8\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f9fzj" Jul 06 01:03:51.243464 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:51.243438 2553 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 06 01:03:51.243559 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:03:51.243522 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b24e9883-3bc0-43a3-a669-17b49ae0ffb8-monitoring-plugin-cert podName:b24e9883-3bc0-43a3-a669-17b49ae0ffb8 nodeName:}" failed. No retries permitted until 2026-07-06 01:03:51.743500775 +0000 UTC m=+271.757873802 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/b24e9883-3bc0-43a3-a669-17b49ae0ffb8-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-f9fzj" (UID: "b24e9883-3bc0-43a3-a669-17b49ae0ffb8") : secret "monitoring-plugin-cert" not found Jul 06 01:03:51.252875 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:51.252847 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdsjk\" (UniqueName: \"kubernetes.io/projected/b24e9883-3bc0-43a3-a669-17b49ae0ffb8-kube-api-access-xdsjk\") pod \"monitoring-plugin-d5dcff7cf-f9fzj\" (UID: \"b24e9883-3bc0-43a3-a669-17b49ae0ffb8\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f9fzj" Jul 06 01:03:51.748026 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:51.747979 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b24e9883-3bc0-43a3-a669-17b49ae0ffb8-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-f9fzj\" (UID: \"b24e9883-3bc0-43a3-a669-17b49ae0ffb8\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f9fzj" Jul 06 01:03:51.750789 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:51.750753 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b24e9883-3bc0-43a3-a669-17b49ae0ffb8-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-f9fzj\" (UID: \"b24e9883-3bc0-43a3-a669-17b49ae0ffb8\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f9fzj" Jul 06 01:03:51.966560 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:51.966522 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f9fzj" Jul 06 01:03:53.228188 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:53.228162 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-f9fzj"] Jul 06 01:03:53.232371 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:03:53.232344 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb24e9883_3bc0_43a3_a669_17b49ae0ffb8.slice/crio-dc31fd6b7fbce8e300a38a97751aa5a769fdbdd0ca364c675e16b376f5b0d4fe WatchSource:0}: Error finding container dc31fd6b7fbce8e300a38a97751aa5a769fdbdd0ca364c675e16b376f5b0d4fe: Status 404 returned error can't find the container with id dc31fd6b7fbce8e300a38a97751aa5a769fdbdd0ca364c675e16b376f5b0d4fe Jul 06 01:03:53.352540 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:53.352505 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" event={"ID":"c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5","Type":"ContainerStarted","Data":"5dca886255211ed80f62beeb2577650503e58a950d9c1e5c39145e02319b2d2c"} Jul 06 01:03:53.353955 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:53.353927 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5b7cb989-xq5dv" event={"ID":"f04d415d-f07c-4b4b-860a-c78b792cd419","Type":"ContainerStarted","Data":"c983d88a73642dccf951d49d044cbd801a0d020cc4cd6358f825bcacc51a57d4"} Jul 06 01:03:53.355132 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:53.355108 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f9fzj" event={"ID":"b24e9883-3bc0-43a3-a669-17b49ae0ffb8","Type":"ContainerStarted","Data":"dc31fd6b7fbce8e300a38a97751aa5a769fdbdd0ca364c675e16b376f5b0d4fe"} Jul 06 01:03:53.373200 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:53.373151 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f5b7cb989-xq5dv" podStartSLOduration=1.062394903 podStartE2EDuration="5.373132969s" totalImagesPullingTime="4.310738066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:03:53.372197296 +0000 UTC m=+273.386570330" watchObservedRunningTime="2026-07-06 01:03:53.373132969 +0000 UTC m=+273.387506005" Jul 06 01:03:54.367105 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:54.364251 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" event={"ID":"c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5","Type":"ContainerStarted","Data":"6803aac1bd7e1aa1d4a9794c9e344743cb3462a762ff1aba7d1b50e534d3ecc8"} Jul 06 01:03:54.367105 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:54.364387 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" event={"ID":"c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5","Type":"ContainerStarted","Data":"bb903c2158573971d0e4e8b643ea91c8cd00bf68e27773b6ce956c3fdc7b5f5a"} Jul 06 01:03:55.372886 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:55.372845 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" event={"ID":"c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5","Type":"ContainerStarted","Data":"8088a93aeb988f92ca8a3c5a34798da03aa9399bab3671c2948281ace47248f2"} Jul 06 01:03:55.373327 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:55.372928 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" event={"ID":"c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5","Type":"ContainerStarted","Data":"22ae71fbbc2ec9e49b3074d54067fd2c9a964cedb5b271b06e03cd7bb5605409"} Jul 06 01:03:55.373327 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:55.372965 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" event={"ID":"c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5","Type":"ContainerStarted","Data":"d7d93ff9dc6db78838dd0879c8db9142ff62c6a3ffcad4163093ea27a53b9b61"} Jul 06 01:03:55.373327 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:55.373008 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" Jul 06 01:03:55.374169 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:55.374149 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f9fzj" event={"ID":"b24e9883-3bc0-43a3-a669-17b49ae0ffb8","Type":"ContainerStarted","Data":"8aef8576ada76876c82745c9123781b8380e361f14c787ca3dae884518ac7367"} Jul 06 01:03:55.374352 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:55.374337 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f9fzj" Jul 06 01:03:55.378979 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:55.378952 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f9fzj" Jul 06 01:03:55.396173 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:55.396125 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" podStartSLOduration=1.734742181 podStartE2EDuration="6.396111988s" totalImagesPullingTime="4.661369807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:03:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:03:55.394130341 +0000 UTC m=+275.408503396" watchObservedRunningTime="2026-07-06 01:03:55.396111988 +0000 UTC m=+275.410485023" Jul 06 01:03:55.412051 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:55.411998 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-f9fzj" podStartSLOduration=2.799556626 podStartE2EDuration="4.411984543s" totalImagesPullingTime="1.612427917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:03:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:03:55.410826391 +0000 UTC m=+275.425199428" watchObservedRunningTime="2026-07-06 01:03:55.411984543 +0000 UTC m=+275.426357579" Jul 06 01:03:58.628850 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:58.628803 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f5b7cb989-xq5dv" Jul 06 01:03:58.629353 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:58.628875 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f5b7cb989-xq5dv" Jul 06 01:03:58.630353 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:58.630330 2553 patch_prober.go:28] interesting pod/console-7f5b7cb989-xq5dv container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.18:8443/health\": dial tcp 10.132.0.18:8443: connect: connection refused" start-of-body= Jul 06 01:03:58.630411 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:03:58.630374 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7f5b7cb989-xq5dv" podUID="f04d415d-f07c-4b4b-860a-c78b792cd419" containerName="console" probeResult="failure" output="Get \"https://10.132.0.18:8443/health\": dial tcp 10.132.0.18:8443: connect: connection refused" Jul 06 01:04:00.958527 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:04:00.958470 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" podUID="4d049ebd-dbc6-49a4-9974-d7f2e911bb77" Jul 06 01:04:00.958527 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:04:00.958470 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2ftr2" podUID="261a7be8-29de-4ea5-9394-7cf8275dfd9c" Jul 06 01:04:01.383881 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:01.383851 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-ff5f56fcf-2sktx" Jul 06 01:04:01.396392 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:01.396358 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2ftr2" Jul 06 01:04:01.396546 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:01.396358 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 01:04:04.361635 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:04.361598 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/261a7be8-29de-4ea5-9394-7cf8275dfd9c-metrics-tls\") pod \"dns-default-2ftr2\" (UID: \"261a7be8-29de-4ea5-9394-7cf8275dfd9c\") " pod="openshift-dns/dns-default-2ftr2" Jul 06 01:04:04.361635 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:04.361644 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-tls\") pod \"image-registry-774f7dcb6c-6fcv4\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 01:04:04.364112 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:04.364083 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/261a7be8-29de-4ea5-9394-7cf8275dfd9c-metrics-tls\") pod \"dns-default-2ftr2\" (UID: \"261a7be8-29de-4ea5-9394-7cf8275dfd9c\") " pod="openshift-dns/dns-default-2ftr2" Jul 06 01:04:04.364191 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:04.364140 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-tls\") pod \"image-registry-774f7dcb6c-6fcv4\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 01:04:04.400805 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:04.400771 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lh7x6\"" Jul 06 01:04:04.400805 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:04.400771 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s9mpr\"" Jul 06 01:04:04.407092 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:04.407068 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2ftr2" Jul 06 01:04:04.407232 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:04.407106 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 01:04:04.547291 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:04.547241 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2ftr2"] Jul 06 01:04:04.550301 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:04:04.550267 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod261a7be8_29de_4ea5_9394_7cf8275dfd9c.slice/crio-e8d1f3177be69375db6506128d05f92a9a5bd4eabcdc1651985d5d114574a71d WatchSource:0}: Error finding container e8d1f3177be69375db6506128d05f92a9a5bd4eabcdc1651985d5d114574a71d: Status 404 returned error can't find the container with id e8d1f3177be69375db6506128d05f92a9a5bd4eabcdc1651985d5d114574a71d Jul 06 01:04:04.565714 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:04.565684 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-774f7dcb6c-6fcv4"] Jul 06 01:04:04.568994 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:04:04.568965 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d049ebd_dbc6_49a4_9974_d7f2e911bb77.slice/crio-58c4d9b07b75e2b965b7465cbda2c38112b8b584063d3c93393fec682e91ab74 WatchSource:0}: Error finding container 58c4d9b07b75e2b965b7465cbda2c38112b8b584063d3c93393fec682e91ab74: Status 404 returned error can't find the container with id 58c4d9b07b75e2b965b7465cbda2c38112b8b584063d3c93393fec682e91ab74 Jul 06 01:04:05.414214 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:05.414184 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" event={"ID":"4d049ebd-dbc6-49a4-9974-d7f2e911bb77","Type":"ContainerStarted","Data":"27a8aebfb2c720c3bc8110c51ee74455fa8d8237b693cd4c59a73676bd0b2303"} Jul 06 01:04:05.414630 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:05.414231 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" event={"ID":"4d049ebd-dbc6-49a4-9974-d7f2e911bb77","Type":"ContainerStarted","Data":"58c4d9b07b75e2b965b7465cbda2c38112b8b584063d3c93393fec682e91ab74"} Jul 06 01:04:05.414630 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:05.414279 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 01:04:05.415346 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:05.415326 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2ftr2" event={"ID":"261a7be8-29de-4ea5-9394-7cf8275dfd9c","Type":"ContainerStarted","Data":"e8d1f3177be69375db6506128d05f92a9a5bd4eabcdc1651985d5d114574a71d"} Jul 06 01:04:05.437525 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:05.437470 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" podStartSLOduration=285.437456433 podStartE2EDuration="4m45.437456433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 00:59:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:04:05.43611187 +0000 UTC m=+285.450484907" watchObservedRunningTime="2026-07-06 01:04:05.437456433 +0000 UTC m=+285.451829469" Jul 06 01:04:07.426240 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:07.426200 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2ftr2" event={"ID":"261a7be8-29de-4ea5-9394-7cf8275dfd9c","Type":"ContainerStarted","Data":"b16635d9ffea89b4a0db2aa68d3928e3b7181dc1c1bca8f91c8e5fb6423521c1"} Jul 06 01:04:07.426623 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:07.426267 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2ftr2" event={"ID":"261a7be8-29de-4ea5-9394-7cf8275dfd9c","Type":"ContainerStarted","Data":"ae38ceae554330a1e9da57972a1c6f20066e0ad15cc242a0dc281ae183fc2c20"} Jul 06 01:04:07.426623 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:07.426342 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2ftr2" Jul 06 01:04:07.446760 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:07.446699 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2ftr2" podStartSLOduration=251.069658266 podStartE2EDuration="4m13.44665646s" totalImagesPullingTime="2.376998194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 00:59:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:04:07.445185909 +0000 UTC m=+287.459558946" watchObservedRunningTime="2026-07-06 01:04:07.44665646 +0000 UTC m=+287.461029496" Jul 06 01:04:08.629685 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:08.629638 2553 patch_prober.go:28] interesting pod/console-7f5b7cb989-xq5dv container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.18:8443/health\": dial tcp 10.132.0.18:8443: connect: connection refused" start-of-body= Jul 06 01:04:08.630069 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:08.629705 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7f5b7cb989-xq5dv" podUID="f04d415d-f07c-4b4b-860a-c78b792cd419" containerName="console" probeResult="failure" output="Get \"https://10.132.0.18:8443/health\": dial tcp 10.132.0.18:8443: connect: connection refused" Jul 06 01:04:17.432144 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:17.432113 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2ftr2" Jul 06 01:04:18.633698 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:18.633626 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f5b7cb989-xq5dv" Jul 06 01:04:18.637490 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:18.637463 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f5b7cb989-xq5dv" Jul 06 01:04:20.369565 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:20.369485 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-znllg_789b12fb-c3d0-428d-838c-f29718e69e2c/console-operator/1.log" Jul 06 01:04:20.369985 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:20.369717 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-znllg_789b12fb-c3d0-428d-838c-f29718e69e2c/console-operator/1.log" Jul 06 01:04:20.380586 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:20.380563 2553 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 01:04:24.411860 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:24.411815 2553 patch_prober.go:28] interesting pod/image-registry-774f7dcb6c-6fcv4 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 01:04:24.414310 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:24.411902 2553 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" podUID="4d049ebd-dbc6-49a4-9974-d7f2e911bb77" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 01:04:26.425031 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:26.425002 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 01:04:29.196595 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:29.196503 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-774f7dcb6c-6fcv4"] Jul 06 01:04:29.512411 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:29.512373 2553 generic.go:356] "Generic (PLEG): container finished" podID="289da140-83a3-40ae-9470-bd4c6e476df6" containerID="8eb683629df963eae3fb4a23d00561a86fdb06bd9fee052c36a5f21ef86971e6" exitCode=0 Jul 06 01:04:29.512587 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:29.512426 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-rrw4g" event={"ID":"289da140-83a3-40ae-9470-bd4c6e476df6","Type":"ContainerDied","Data":"8eb683629df963eae3fb4a23d00561a86fdb06bd9fee052c36a5f21ef86971e6"} Jul 06 01:04:29.512820 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:29.512806 2553 scope.go:117] "RemoveContainer" containerID="8eb683629df963eae3fb4a23d00561a86fdb06bd9fee052c36a5f21ef86971e6" Jul 06 01:04:30.356683 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:30.356635 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2ftr2_261a7be8-29de-4ea5-9394-7cf8275dfd9c/dns/0.log" Jul 06 01:04:30.518331 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:30.518297 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-rrw4g" event={"ID":"289da140-83a3-40ae-9470-bd4c6e476df6","Type":"ContainerStarted","Data":"b0202e834b3ac58e617ec0e0939762618e4d600916652d1afcd09bdaa4275c00"} Jul 06 01:04:30.558104 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:30.558074 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2ftr2_261a7be8-29de-4ea5-9394-7cf8275dfd9c/kube-rbac-proxy/0.log" Jul 06 01:04:31.488593 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:31.488557 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f5b7cb989-xq5dv"] Jul 06 01:04:31.955612 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:31.955534 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fc8xr_74e85a91-ab9c-4c02-985f-48961dec5b3c/dns-node-resolver/0.log" Jul 06 01:04:32.156680 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:32.156641 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55758cd8ff-8lgbp_8c6f894e-5149-4c29-84ff-468f3cae5d80/router/0.log" Jul 06 01:04:32.355924 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:32.355896 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n59gl_bb979aaf-8966-44b2-a762-bbd3052753a4/serve-healthcheck-canary/0.log" Jul 06 01:04:40.559419 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:40.559379 2553 generic.go:356] "Generic (PLEG): container finished" podID="287d98a2-bc12-44af-87f9-c59dfbee9c0c" containerID="0e4958ab8fbf02443eb4b56fff399d75be07f5a9554e7ee8802f561940bd951a" exitCode=0 Jul 06 01:04:40.559867 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:40.559454 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-q27c6" event={"ID":"287d98a2-bc12-44af-87f9-c59dfbee9c0c","Type":"ContainerDied","Data":"0e4958ab8fbf02443eb4b56fff399d75be07f5a9554e7ee8802f561940bd951a"} Jul 06 01:04:40.559867 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:40.559833 2553 scope.go:117] "RemoveContainer" containerID="0e4958ab8fbf02443eb4b56fff399d75be07f5a9554e7ee8802f561940bd951a" Jul 06 01:04:41.566106 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:41.566065 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-q27c6" event={"ID":"287d98a2-bc12-44af-87f9-c59dfbee9c0c","Type":"ContainerStarted","Data":"a3987f45c186447c5426c341bdf9fc00ade06d602cc69305dcb8406a28696a72"} Jul 06 01:04:54.218685 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:54.218624 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" podUID="4d049ebd-dbc6-49a4-9974-d7f2e911bb77" containerName="registry" containerID="cri-o://27a8aebfb2c720c3bc8110c51ee74455fa8d8237b693cd4c59a73676bd0b2303" gracePeriod=30 Jul 06 01:04:55.472074 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:55.472048 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 01:04:55.489880 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:55.489816 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-ca-trust-extracted\") pod \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " Jul 06 01:04:55.489880 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:55.489878 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-certificates\") pod \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " Jul 06 01:04:55.490089 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:55.489923 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-tls\") pod \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " Jul 06 01:04:55.490089 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:55.489946 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vf64d\" (UniqueName: \"kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-kube-api-access-vf64d\") pod \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " Jul 06 01:04:55.490089 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:55.489963 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-image-registry-private-configuration\") pod \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " Jul 06 01:04:55.490089 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:55.490030 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-bound-sa-token\") pod \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " Jul 06 01:04:55.490293 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:55.490255 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4d049ebd-dbc6-49a4-9974-d7f2e911bb77" (UID: "4d049ebd-dbc6-49a4-9974-d7f2e911bb77"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:04:55.490350 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:55.490328 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-trusted-ca\") pod \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " Jul 06 01:04:55.490413 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:55.490394 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-installation-pull-secrets\") pod \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\" (UID: \"4d049ebd-dbc6-49a4-9974-d7f2e911bb77\") " Jul 06 01:04:55.490931 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:55.490641 2553 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-certificates\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:04:55.490931 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:55.490878 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4d049ebd-dbc6-49a4-9974-d7f2e911bb77" (UID: "4d049ebd-dbc6-49a4-9974-d7f2e911bb77"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:04:55.493025 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:55.492993 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4d049ebd-dbc6-49a4-9974-d7f2e911bb77" (UID: "4d049ebd-dbc6-49a4-9974-d7f2e911bb77"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:04:55.493550 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:55.493509 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4d049ebd-dbc6-49a4-9974-d7f2e911bb77" (UID: "4d049ebd-dbc6-49a4-9974-d7f2e911bb77"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 01:04:55.494061 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:55.494033 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4d049ebd-dbc6-49a4-9974-d7f2e911bb77" (UID: "4d049ebd-dbc6-49a4-9974-d7f2e911bb77"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 01:04:55.494492 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:55.494449 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-kube-api-access-vf64d" (OuterVolumeSpecName: "kube-api-access-vf64d") pod "4d049ebd-dbc6-49a4-9974-d7f2e911bb77" (UID: "4d049ebd-dbc6-49a4-9974-d7f2e911bb77"). InnerVolumeSpecName "kube-api-access-vf64d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:04:55.494492 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:55.494464 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4d049ebd-dbc6-49a4-9974-d7f2e911bb77" (UID: "4d049ebd-dbc6-49a4-9974-d7f2e911bb77"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:04:55.503126 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:55.503088 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4d049ebd-dbc6-49a4-9974-d7f2e911bb77" (UID: "4d049ebd-dbc6-49a4-9974-d7f2e911bb77"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:04:55.591359 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:55.591264 2553 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-ca-trust-extracted\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:04:55.591359 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:55.591294 2553 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-registry-tls\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:04:55.591359 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:55.591304 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vf64d\" (UniqueName: \"kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-kube-api-access-vf64d\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:04:55.591359 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:55.591313 2553 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-image-registry-private-configuration\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:04:55.591359 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:55.591325 2553 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-bound-sa-token\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:04:55.591359 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:55.591334 2553 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-trusted-ca\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:04:55.591359 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:55.591342 2553 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4d049ebd-dbc6-49a4-9974-d7f2e911bb77-installation-pull-secrets\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:04:55.628638 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:55.628605 2553 generic.go:356] "Generic (PLEG): container finished" podID="4d049ebd-dbc6-49a4-9974-d7f2e911bb77" containerID="27a8aebfb2c720c3bc8110c51ee74455fa8d8237b693cd4c59a73676bd0b2303" exitCode=0 Jul 06 01:04:55.628813 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:55.628654 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" Jul 06 01:04:55.628813 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:55.628658 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" event={"ID":"4d049ebd-dbc6-49a4-9974-d7f2e911bb77","Type":"ContainerDied","Data":"27a8aebfb2c720c3bc8110c51ee74455fa8d8237b693cd4c59a73676bd0b2303"} Jul 06 01:04:55.628813 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:55.628724 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-774f7dcb6c-6fcv4" event={"ID":"4d049ebd-dbc6-49a4-9974-d7f2e911bb77","Type":"ContainerDied","Data":"58c4d9b07b75e2b965b7465cbda2c38112b8b584063d3c93393fec682e91ab74"} Jul 06 01:04:55.628813 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:55.628745 2553 scope.go:117] "RemoveContainer" containerID="27a8aebfb2c720c3bc8110c51ee74455fa8d8237b693cd4c59a73676bd0b2303" Jul 06 01:04:55.637494 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:55.637477 2553 scope.go:117] "RemoveContainer" containerID="27a8aebfb2c720c3bc8110c51ee74455fa8d8237b693cd4c59a73676bd0b2303" Jul 06 01:04:55.637794 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:04:55.637774 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27a8aebfb2c720c3bc8110c51ee74455fa8d8237b693cd4c59a73676bd0b2303\": container with ID starting with 27a8aebfb2c720c3bc8110c51ee74455fa8d8237b693cd4c59a73676bd0b2303 not found: ID does not exist" containerID="27a8aebfb2c720c3bc8110c51ee74455fa8d8237b693cd4c59a73676bd0b2303" Jul 06 01:04:55.637865 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:55.637802 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27a8aebfb2c720c3bc8110c51ee74455fa8d8237b693cd4c59a73676bd0b2303"} err="failed to get container status \"27a8aebfb2c720c3bc8110c51ee74455fa8d8237b693cd4c59a73676bd0b2303\": rpc error: code = NotFound desc = could not find container \"27a8aebfb2c720c3bc8110c51ee74455fa8d8237b693cd4c59a73676bd0b2303\": container with ID starting with 27a8aebfb2c720c3bc8110c51ee74455fa8d8237b693cd4c59a73676bd0b2303 not found: ID does not exist" Jul 06 01:04:55.649284 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:55.649251 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-774f7dcb6c-6fcv4"] Jul 06 01:04:55.652487 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:55.652460 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-774f7dcb6c-6fcv4"] Jul 06 01:04:56.492852 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:56.492808 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d049ebd-dbc6-49a4-9974-d7f2e911bb77" path="/var/lib/kubelet/pods/4d049ebd-dbc6-49a4-9974-d7f2e911bb77/volumes" Jul 06 01:04:56.516884 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:56.516828 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7f5b7cb989-xq5dv" podUID="f04d415d-f07c-4b4b-860a-c78b792cd419" containerName="console" containerID="cri-o://c983d88a73642dccf951d49d044cbd801a0d020cc4cd6358f825bcacc51a57d4" gracePeriod=15 Jul 06 01:04:56.634988 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:56.634959 2553 generic.go:356] "Generic (PLEG): container finished" podID="f04d415d-f07c-4b4b-860a-c78b792cd419" containerID="c983d88a73642dccf951d49d044cbd801a0d020cc4cd6358f825bcacc51a57d4" exitCode=0 Jul 06 01:04:56.635086 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:56.635054 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5b7cb989-xq5dv" event={"ID":"f04d415d-f07c-4b4b-860a-c78b792cd419","Type":"ContainerDied","Data":"c983d88a73642dccf951d49d044cbd801a0d020cc4cd6358f825bcacc51a57d4"} Jul 06 01:04:56.767951 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:56.767926 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5b7cb989-xq5dv" Jul 06 01:04:56.801964 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:56.801920 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f04d415d-f07c-4b4b-860a-c78b792cd419-console-config\") pod \"f04d415d-f07c-4b4b-860a-c78b792cd419\" (UID: \"f04d415d-f07c-4b4b-860a-c78b792cd419\") " Jul 06 01:04:56.801964 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:56.801963 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f04d415d-f07c-4b4b-860a-c78b792cd419-console-oauth-config\") pod \"f04d415d-f07c-4b4b-860a-c78b792cd419\" (UID: \"f04d415d-f07c-4b4b-860a-c78b792cd419\") " Jul 06 01:04:56.802214 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:56.801994 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f04d415d-f07c-4b4b-860a-c78b792cd419-trusted-ca-bundle\") pod \"f04d415d-f07c-4b4b-860a-c78b792cd419\" (UID: \"f04d415d-f07c-4b4b-860a-c78b792cd419\") " Jul 06 01:04:56.802214 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:56.802028 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f04d415d-f07c-4b4b-860a-c78b792cd419-oauth-serving-cert\") pod \"f04d415d-f07c-4b4b-860a-c78b792cd419\" (UID: \"f04d415d-f07c-4b4b-860a-c78b792cd419\") " Jul 06 01:04:56.802214 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:56.802085 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f04d415d-f07c-4b4b-860a-c78b792cd419-service-ca\") pod \"f04d415d-f07c-4b4b-860a-c78b792cd419\" (UID: \"f04d415d-f07c-4b4b-860a-c78b792cd419\") " Jul 06 01:04:56.802214 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:56.802126 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhpl8\" (UniqueName: \"kubernetes.io/projected/f04d415d-f07c-4b4b-860a-c78b792cd419-kube-api-access-rhpl8\") pod \"f04d415d-f07c-4b4b-860a-c78b792cd419\" (UID: \"f04d415d-f07c-4b4b-860a-c78b792cd419\") " Jul 06 01:04:56.802214 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:56.802164 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f04d415d-f07c-4b4b-860a-c78b792cd419-console-serving-cert\") pod \"f04d415d-f07c-4b4b-860a-c78b792cd419\" (UID: \"f04d415d-f07c-4b4b-860a-c78b792cd419\") " Jul 06 01:04:56.802546 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:56.802451 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f04d415d-f07c-4b4b-860a-c78b792cd419-console-config" (OuterVolumeSpecName: "console-config") pod "f04d415d-f07c-4b4b-860a-c78b792cd419" (UID: "f04d415d-f07c-4b4b-860a-c78b792cd419"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:04:56.802695 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:56.802539 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f04d415d-f07c-4b4b-860a-c78b792cd419-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f04d415d-f07c-4b4b-860a-c78b792cd419" (UID: "f04d415d-f07c-4b4b-860a-c78b792cd419"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:04:56.802761 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:56.802590 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f04d415d-f07c-4b4b-860a-c78b792cd419-service-ca" (OuterVolumeSpecName: "service-ca") pod "f04d415d-f07c-4b4b-860a-c78b792cd419" (UID: "f04d415d-f07c-4b4b-860a-c78b792cd419"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:04:56.802846 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:56.802820 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f04d415d-f07c-4b4b-860a-c78b792cd419-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f04d415d-f07c-4b4b-860a-c78b792cd419" (UID: "f04d415d-f07c-4b4b-860a-c78b792cd419"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:04:56.804660 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:56.804626 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f04d415d-f07c-4b4b-860a-c78b792cd419-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f04d415d-f07c-4b4b-860a-c78b792cd419" (UID: "f04d415d-f07c-4b4b-860a-c78b792cd419"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 01:04:56.804765 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:56.804656 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f04d415d-f07c-4b4b-860a-c78b792cd419-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f04d415d-f07c-4b4b-860a-c78b792cd419" (UID: "f04d415d-f07c-4b4b-860a-c78b792cd419"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 01:04:56.804765 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:56.804705 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f04d415d-f07c-4b4b-860a-c78b792cd419-kube-api-access-rhpl8" (OuterVolumeSpecName: "kube-api-access-rhpl8") pod "f04d415d-f07c-4b4b-860a-c78b792cd419" (UID: "f04d415d-f07c-4b4b-860a-c78b792cd419"). InnerVolumeSpecName "kube-api-access-rhpl8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:04:56.903324 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:56.903282 2553 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f04d415d-f07c-4b4b-860a-c78b792cd419-service-ca\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:04:56.903324 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:56.903314 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhpl8\" (UniqueName: \"kubernetes.io/projected/f04d415d-f07c-4b4b-860a-c78b792cd419-kube-api-access-rhpl8\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:04:56.903324 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:56.903324 2553 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f04d415d-f07c-4b4b-860a-c78b792cd419-console-serving-cert\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:04:56.903324 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:56.903333 2553 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f04d415d-f07c-4b4b-860a-c78b792cd419-console-config\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:04:56.903578 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:56.903341 2553 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f04d415d-f07c-4b4b-860a-c78b792cd419-console-oauth-config\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:04:56.903578 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:56.903351 2553 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f04d415d-f07c-4b4b-860a-c78b792cd419-trusted-ca-bundle\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:04:56.903578 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:56.903360 2553 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f04d415d-f07c-4b4b-860a-c78b792cd419-oauth-serving-cert\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:04:57.639981 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:57.639950 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f5b7cb989-xq5dv" Jul 06 01:04:57.640407 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:57.639951 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f5b7cb989-xq5dv" event={"ID":"f04d415d-f07c-4b4b-860a-c78b792cd419","Type":"ContainerDied","Data":"880dff02e7d6cfcbd98a2903bfc8e9a0c57704ca96f01f472f77800338c355d7"} Jul 06 01:04:57.640407 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:57.640085 2553 scope.go:117] "RemoveContainer" containerID="c983d88a73642dccf951d49d044cbd801a0d020cc4cd6358f825bcacc51a57d4" Jul 06 01:04:57.663533 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:57.663508 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f5b7cb989-xq5dv"] Jul 06 01:04:57.666381 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:57.666359 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f5b7cb989-xq5dv"] Jul 06 01:04:58.491235 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:04:58.491199 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f04d415d-f07c-4b4b-860a-c78b792cd419" path="/var/lib/kubelet/pods/f04d415d-f07c-4b4b-860a-c78b792cd419/volumes" Jul 06 01:05:14.973622 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:14.973518 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-798585b779-c9rfw"] Jul 06 01:05:14.974844 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:14.974814 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d049ebd-dbc6-49a4-9974-d7f2e911bb77" containerName="registry" Jul 06 01:05:14.975110 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:14.975095 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d049ebd-dbc6-49a4-9974-d7f2e911bb77" containerName="registry" Jul 06 01:05:14.975223 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:14.975213 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f04d415d-f07c-4b4b-860a-c78b792cd419" containerName="console" Jul 06 01:05:14.975291 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:14.975283 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="f04d415d-f07c-4b4b-860a-c78b792cd419" containerName="console" Jul 06 01:05:14.975448 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:14.975438 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="f04d415d-f07c-4b4b-860a-c78b792cd419" containerName="console" Jul 06 01:05:14.975572 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:14.975561 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d049ebd-dbc6-49a4-9974-d7f2e911bb77" containerName="registry" Jul 06 01:05:14.977894 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:14.977870 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-798585b779-c9rfw" Jul 06 01:05:14.981954 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:14.981924 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5dwhp\"" Jul 06 01:05:14.982380 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:14.982249 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 01:05:14.982504 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:14.982482 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 01:05:14.982572 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:14.982505 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 01:05:14.982647 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:14.982629 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 01:05:14.982734 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:14.982716 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 01:05:14.983126 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:14.983017 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 01:05:14.983232 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:14.983141 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 01:05:14.987144 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:14.987124 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-798585b779-c9rfw"] Jul 06 01:05:14.987937 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:14.987915 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 01:05:15.040770 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:15.040722 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8963926e-4a99-4f57-a327-aba356da48f9-service-ca\") pod \"console-798585b779-c9rfw\" (UID: \"8963926e-4a99-4f57-a327-aba356da48f9\") " pod="openshift-console/console-798585b779-c9rfw" Jul 06 01:05:15.040770 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:15.040775 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8963926e-4a99-4f57-a327-aba356da48f9-console-serving-cert\") pod \"console-798585b779-c9rfw\" (UID: \"8963926e-4a99-4f57-a327-aba356da48f9\") " pod="openshift-console/console-798585b779-c9rfw" Jul 06 01:05:15.041038 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:15.040799 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8963926e-4a99-4f57-a327-aba356da48f9-oauth-serving-cert\") pod \"console-798585b779-c9rfw\" (UID: \"8963926e-4a99-4f57-a327-aba356da48f9\") " pod="openshift-console/console-798585b779-c9rfw" Jul 06 01:05:15.041038 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:15.040846 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8963926e-4a99-4f57-a327-aba356da48f9-trusted-ca-bundle\") pod \"console-798585b779-c9rfw\" (UID: \"8963926e-4a99-4f57-a327-aba356da48f9\") " pod="openshift-console/console-798585b779-c9rfw" Jul 06 01:05:15.041038 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:15.040918 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8963926e-4a99-4f57-a327-aba356da48f9-console-oauth-config\") pod \"console-798585b779-c9rfw\" (UID: \"8963926e-4a99-4f57-a327-aba356da48f9\") " pod="openshift-console/console-798585b779-c9rfw" Jul 06 01:05:15.041038 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:15.040959 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js5pv\" (UniqueName: \"kubernetes.io/projected/8963926e-4a99-4f57-a327-aba356da48f9-kube-api-access-js5pv\") pod \"console-798585b779-c9rfw\" (UID: \"8963926e-4a99-4f57-a327-aba356da48f9\") " pod="openshift-console/console-798585b779-c9rfw" Jul 06 01:05:15.041038 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:15.041016 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8963926e-4a99-4f57-a327-aba356da48f9-console-config\") pod \"console-798585b779-c9rfw\" (UID: \"8963926e-4a99-4f57-a327-aba356da48f9\") " pod="openshift-console/console-798585b779-c9rfw" Jul 06 01:05:15.141801 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:15.141766 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8963926e-4a99-4f57-a327-aba356da48f9-console-serving-cert\") pod \"console-798585b779-c9rfw\" (UID: \"8963926e-4a99-4f57-a327-aba356da48f9\") " pod="openshift-console/console-798585b779-c9rfw" Jul 06 01:05:15.141801 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:15.141800 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8963926e-4a99-4f57-a327-aba356da48f9-oauth-serving-cert\") pod \"console-798585b779-c9rfw\" (UID: \"8963926e-4a99-4f57-a327-aba356da48f9\") " pod="openshift-console/console-798585b779-c9rfw" Jul 06 01:05:15.142070 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:15.141825 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8963926e-4a99-4f57-a327-aba356da48f9-trusted-ca-bundle\") pod \"console-798585b779-c9rfw\" (UID: \"8963926e-4a99-4f57-a327-aba356da48f9\") " pod="openshift-console/console-798585b779-c9rfw" Jul 06 01:05:15.142070 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:15.141842 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8963926e-4a99-4f57-a327-aba356da48f9-console-oauth-config\") pod \"console-798585b779-c9rfw\" (UID: \"8963926e-4a99-4f57-a327-aba356da48f9\") " pod="openshift-console/console-798585b779-c9rfw" Jul 06 01:05:15.142070 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:15.141858 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js5pv\" (UniqueName: \"kubernetes.io/projected/8963926e-4a99-4f57-a327-aba356da48f9-kube-api-access-js5pv\") pod \"console-798585b779-c9rfw\" (UID: \"8963926e-4a99-4f57-a327-aba356da48f9\") " pod="openshift-console/console-798585b779-c9rfw" Jul 06 01:05:15.142070 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:15.141892 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8963926e-4a99-4f57-a327-aba356da48f9-console-config\") pod \"console-798585b779-c9rfw\" (UID: \"8963926e-4a99-4f57-a327-aba356da48f9\") " pod="openshift-console/console-798585b779-c9rfw" Jul 06 01:05:15.142070 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:15.141955 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8963926e-4a99-4f57-a327-aba356da48f9-service-ca\") pod \"console-798585b779-c9rfw\" (UID: \"8963926e-4a99-4f57-a327-aba356da48f9\") " pod="openshift-console/console-798585b779-c9rfw" Jul 06 01:05:15.142802 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:15.142766 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8963926e-4a99-4f57-a327-aba356da48f9-service-ca\") pod \"console-798585b779-c9rfw\" (UID: \"8963926e-4a99-4f57-a327-aba356da48f9\") " pod="openshift-console/console-798585b779-c9rfw" Jul 06 01:05:15.142802 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:15.142778 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8963926e-4a99-4f57-a327-aba356da48f9-oauth-serving-cert\") pod \"console-798585b779-c9rfw\" (UID: \"8963926e-4a99-4f57-a327-aba356da48f9\") " pod="openshift-console/console-798585b779-c9rfw" Jul 06 01:05:15.142950 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:15.142801 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8963926e-4a99-4f57-a327-aba356da48f9-trusted-ca-bundle\") pod \"console-798585b779-c9rfw\" (UID: \"8963926e-4a99-4f57-a327-aba356da48f9\") " pod="openshift-console/console-798585b779-c9rfw" Jul 06 01:05:15.142950 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:15.142888 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8963926e-4a99-4f57-a327-aba356da48f9-console-config\") pod \"console-798585b779-c9rfw\" (UID: \"8963926e-4a99-4f57-a327-aba356da48f9\") " pod="openshift-console/console-798585b779-c9rfw" Jul 06 01:05:15.144316 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:15.144290 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8963926e-4a99-4f57-a327-aba356da48f9-console-serving-cert\") pod \"console-798585b779-c9rfw\" (UID: \"8963926e-4a99-4f57-a327-aba356da48f9\") " pod="openshift-console/console-798585b779-c9rfw" Jul 06 01:05:15.144406 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:15.144341 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8963926e-4a99-4f57-a327-aba356da48f9-console-oauth-config\") pod \"console-798585b779-c9rfw\" (UID: \"8963926e-4a99-4f57-a327-aba356da48f9\") " pod="openshift-console/console-798585b779-c9rfw" Jul 06 01:05:15.150615 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:15.150596 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-js5pv\" (UniqueName: \"kubernetes.io/projected/8963926e-4a99-4f57-a327-aba356da48f9-kube-api-access-js5pv\") pod \"console-798585b779-c9rfw\" (UID: \"8963926e-4a99-4f57-a327-aba356da48f9\") " pod="openshift-console/console-798585b779-c9rfw" Jul 06 01:05:15.293260 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:15.293171 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-798585b779-c9rfw" Jul 06 01:05:15.425181 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:15.425146 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-798585b779-c9rfw"] Jul 06 01:05:15.428604 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:05:15.428576 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8963926e_4a99_4f57_a327_aba356da48f9.slice/crio-8d7018bcec5aa685fd78eeb86f6bf21e883d4a79160e0cbfaedbefbcbcb56b94 WatchSource:0}: Error finding container 8d7018bcec5aa685fd78eeb86f6bf21e883d4a79160e0cbfaedbefbcbcb56b94: Status 404 returned error can't find the container with id 8d7018bcec5aa685fd78eeb86f6bf21e883d4a79160e0cbfaedbefbcbcb56b94 Jul 06 01:05:15.711107 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:15.711075 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-798585b779-c9rfw" event={"ID":"8963926e-4a99-4f57-a327-aba356da48f9","Type":"ContainerStarted","Data":"e32ba108f62a7a5eb7a14b55a1ba62a066f7a8b3c061b9058263550639ef5277"} Jul 06 01:05:15.711273 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:15.711122 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-798585b779-c9rfw" event={"ID":"8963926e-4a99-4f57-a327-aba356da48f9","Type":"ContainerStarted","Data":"8d7018bcec5aa685fd78eeb86f6bf21e883d4a79160e0cbfaedbefbcbcb56b94"} Jul 06 01:05:15.727803 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:15.727740 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-798585b779-c9rfw" podStartSLOduration=1.7277232329999999 podStartE2EDuration="1.727723233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:05:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:05:15.727075554 +0000 UTC m=+355.741448591" watchObservedRunningTime="2026-07-06 01:05:15.727723233 +0000 UTC m=+355.742096268" Jul 06 01:05:25.294165 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:25.294125 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-798585b779-c9rfw" Jul 06 01:05:25.294598 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:25.294193 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-798585b779-c9rfw" Jul 06 01:05:25.299244 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:25.299217 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-798585b779-c9rfw" Jul 06 01:05:25.751956 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:05:25.751926 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-798585b779-c9rfw" Jul 06 01:06:40.405023 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:06:40.404980 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-798585b779-c9rfw"] Jul 06 01:07:05.428065 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:05.428012 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-798585b779-c9rfw" podUID="8963926e-4a99-4f57-a327-aba356da48f9" containerName="console" containerID="cri-o://e32ba108f62a7a5eb7a14b55a1ba62a066f7a8b3c061b9058263550639ef5277" gracePeriod=15 Jul 06 01:07:05.666537 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:05.666513 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-798585b779-c9rfw" Jul 06 01:07:05.750541 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:05.750504 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8963926e-4a99-4f57-a327-aba356da48f9-console-oauth-config\") pod \"8963926e-4a99-4f57-a327-aba356da48f9\" (UID: \"8963926e-4a99-4f57-a327-aba356da48f9\") " Jul 06 01:07:05.750773 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:05.750548 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8963926e-4a99-4f57-a327-aba356da48f9-trusted-ca-bundle\") pod \"8963926e-4a99-4f57-a327-aba356da48f9\" (UID: \"8963926e-4a99-4f57-a327-aba356da48f9\") " Jul 06 01:07:05.750773 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:05.750577 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8963926e-4a99-4f57-a327-aba356da48f9-console-serving-cert\") pod \"8963926e-4a99-4f57-a327-aba356da48f9\" (UID: \"8963926e-4a99-4f57-a327-aba356da48f9\") " Jul 06 01:07:05.750773 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:05.750596 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8963926e-4a99-4f57-a327-aba356da48f9-console-config\") pod \"8963926e-4a99-4f57-a327-aba356da48f9\" (UID: \"8963926e-4a99-4f57-a327-aba356da48f9\") " Jul 06 01:07:05.750773 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:05.750643 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8963926e-4a99-4f57-a327-aba356da48f9-oauth-serving-cert\") pod \"8963926e-4a99-4f57-a327-aba356da48f9\" (UID: \"8963926e-4a99-4f57-a327-aba356da48f9\") " Jul 06 01:07:05.750773 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:05.750689 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8963926e-4a99-4f57-a327-aba356da48f9-service-ca\") pod \"8963926e-4a99-4f57-a327-aba356da48f9\" (UID: \"8963926e-4a99-4f57-a327-aba356da48f9\") " Jul 06 01:07:05.750773 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:05.750719 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-js5pv\" (UniqueName: \"kubernetes.io/projected/8963926e-4a99-4f57-a327-aba356da48f9-kube-api-access-js5pv\") pod \"8963926e-4a99-4f57-a327-aba356da48f9\" (UID: \"8963926e-4a99-4f57-a327-aba356da48f9\") " Jul 06 01:07:05.751147 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:05.751100 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8963926e-4a99-4f57-a327-aba356da48f9-service-ca" (OuterVolumeSpecName: "service-ca") pod "8963926e-4a99-4f57-a327-aba356da48f9" (UID: "8963926e-4a99-4f57-a327-aba356da48f9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:07:05.751204 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:05.751155 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8963926e-4a99-4f57-a327-aba356da48f9-console-config" (OuterVolumeSpecName: "console-config") pod "8963926e-4a99-4f57-a327-aba356da48f9" (UID: "8963926e-4a99-4f57-a327-aba356da48f9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:07:05.751204 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:05.751166 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8963926e-4a99-4f57-a327-aba356da48f9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8963926e-4a99-4f57-a327-aba356da48f9" (UID: "8963926e-4a99-4f57-a327-aba356da48f9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:07:05.751280 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:05.751230 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8963926e-4a99-4f57-a327-aba356da48f9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8963926e-4a99-4f57-a327-aba356da48f9" (UID: "8963926e-4a99-4f57-a327-aba356da48f9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:07:05.752994 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:05.752970 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8963926e-4a99-4f57-a327-aba356da48f9-kube-api-access-js5pv" (OuterVolumeSpecName: "kube-api-access-js5pv") pod "8963926e-4a99-4f57-a327-aba356da48f9" (UID: "8963926e-4a99-4f57-a327-aba356da48f9"). InnerVolumeSpecName "kube-api-access-js5pv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:07:05.753208 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:05.753187 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8963926e-4a99-4f57-a327-aba356da48f9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8963926e-4a99-4f57-a327-aba356da48f9" (UID: "8963926e-4a99-4f57-a327-aba356da48f9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 01:07:05.753265 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:05.753207 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8963926e-4a99-4f57-a327-aba356da48f9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8963926e-4a99-4f57-a327-aba356da48f9" (UID: "8963926e-4a99-4f57-a327-aba356da48f9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 01:07:05.851762 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:05.851728 2553 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8963926e-4a99-4f57-a327-aba356da48f9-console-serving-cert\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:07:05.851762 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:05.851758 2553 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8963926e-4a99-4f57-a327-aba356da48f9-console-config\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:07:05.851762 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:05.851768 2553 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8963926e-4a99-4f57-a327-aba356da48f9-oauth-serving-cert\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:07:05.851988 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:05.851777 2553 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8963926e-4a99-4f57-a327-aba356da48f9-service-ca\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:07:05.851988 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:05.851786 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-js5pv\" (UniqueName: \"kubernetes.io/projected/8963926e-4a99-4f57-a327-aba356da48f9-kube-api-access-js5pv\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:07:05.851988 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:05.851794 2553 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8963926e-4a99-4f57-a327-aba356da48f9-console-oauth-config\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:07:05.851988 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:05.851803 2553 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8963926e-4a99-4f57-a327-aba356da48f9-trusted-ca-bundle\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:07:06.125401 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:06.125311 2553 generic.go:356] "Generic (PLEG): container finished" podID="8963926e-4a99-4f57-a327-aba356da48f9" containerID="e32ba108f62a7a5eb7a14b55a1ba62a066f7a8b3c061b9058263550639ef5277" exitCode=0 Jul 06 01:07:06.125401 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:06.125354 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-798585b779-c9rfw" Jul 06 01:07:06.125629 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:06.125392 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-798585b779-c9rfw" event={"ID":"8963926e-4a99-4f57-a327-aba356da48f9","Type":"ContainerDied","Data":"e32ba108f62a7a5eb7a14b55a1ba62a066f7a8b3c061b9058263550639ef5277"} Jul 06 01:07:06.125629 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:06.125448 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-798585b779-c9rfw" event={"ID":"8963926e-4a99-4f57-a327-aba356da48f9","Type":"ContainerDied","Data":"8d7018bcec5aa685fd78eeb86f6bf21e883d4a79160e0cbfaedbefbcbcb56b94"} Jul 06 01:07:06.125629 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:06.125478 2553 scope.go:117] "RemoveContainer" containerID="e32ba108f62a7a5eb7a14b55a1ba62a066f7a8b3c061b9058263550639ef5277" Jul 06 01:07:06.134480 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:06.134465 2553 scope.go:117] "RemoveContainer" containerID="e32ba108f62a7a5eb7a14b55a1ba62a066f7a8b3c061b9058263550639ef5277" Jul 06 01:07:06.134724 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:07:06.134697 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e32ba108f62a7a5eb7a14b55a1ba62a066f7a8b3c061b9058263550639ef5277\": container with ID starting with e32ba108f62a7a5eb7a14b55a1ba62a066f7a8b3c061b9058263550639ef5277 not found: ID does not exist" containerID="e32ba108f62a7a5eb7a14b55a1ba62a066f7a8b3c061b9058263550639ef5277" Jul 06 01:07:06.134785 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:06.134731 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e32ba108f62a7a5eb7a14b55a1ba62a066f7a8b3c061b9058263550639ef5277"} err="failed to get container status \"e32ba108f62a7a5eb7a14b55a1ba62a066f7a8b3c061b9058263550639ef5277\": rpc error: code = NotFound desc = could not find container \"e32ba108f62a7a5eb7a14b55a1ba62a066f7a8b3c061b9058263550639ef5277\": container with ID starting with e32ba108f62a7a5eb7a14b55a1ba62a066f7a8b3c061b9058263550639ef5277 not found: ID does not exist" Jul 06 01:07:06.145852 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:06.145829 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-798585b779-c9rfw"] Jul 06 01:07:06.147855 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:06.147834 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-798585b779-c9rfw"] Jul 06 01:07:06.492029 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:06.491997 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8963926e-4a99-4f57-a327-aba356da48f9" path="/var/lib/kubelet/pods/8963926e-4a99-4f57-a327-aba356da48f9/volumes" Jul 06 01:07:23.492244 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:23.492212 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gwg6r"] Jul 06 01:07:23.492643 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:23.492517 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8963926e-4a99-4f57-a327-aba356da48f9" containerName="console" Jul 06 01:07:23.492643 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:23.492528 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8963926e-4a99-4f57-a327-aba356da48f9" containerName="console" Jul 06 01:07:23.492643 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:23.492581 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="8963926e-4a99-4f57-a327-aba356da48f9" containerName="console" Jul 06 01:07:23.495207 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:23.495189 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gwg6r" Jul 06 01:07:23.497471 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:23.497448 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 01:07:23.498477 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:23.498456 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tqlrw\"" Jul 06 01:07:23.498593 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:23.498488 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 01:07:23.502883 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:23.502857 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gwg6r"] Jul 06 01:07:23.591362 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:23.591328 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08945732-252d-4aa3-bf4d-56d361ac6f6a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gwg6r\" (UID: \"08945732-252d-4aa3-bf4d-56d361ac6f6a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gwg6r" Jul 06 01:07:23.591526 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:23.591380 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08945732-252d-4aa3-bf4d-56d361ac6f6a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gwg6r\" (UID: \"08945732-252d-4aa3-bf4d-56d361ac6f6a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gwg6r" Jul 06 01:07:23.591526 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:23.591401 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmsn9\" (UniqueName: \"kubernetes.io/projected/08945732-252d-4aa3-bf4d-56d361ac6f6a-kube-api-access-hmsn9\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gwg6r\" (UID: \"08945732-252d-4aa3-bf4d-56d361ac6f6a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gwg6r" Jul 06 01:07:23.692812 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:23.692774 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08945732-252d-4aa3-bf4d-56d361ac6f6a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gwg6r\" (UID: \"08945732-252d-4aa3-bf4d-56d361ac6f6a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gwg6r" Jul 06 01:07:23.693019 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:23.692828 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08945732-252d-4aa3-bf4d-56d361ac6f6a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gwg6r\" (UID: \"08945732-252d-4aa3-bf4d-56d361ac6f6a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gwg6r" Jul 06 01:07:23.693019 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:23.692848 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmsn9\" (UniqueName: \"kubernetes.io/projected/08945732-252d-4aa3-bf4d-56d361ac6f6a-kube-api-access-hmsn9\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gwg6r\" (UID: \"08945732-252d-4aa3-bf4d-56d361ac6f6a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gwg6r" Jul 06 01:07:23.693174 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:23.693153 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08945732-252d-4aa3-bf4d-56d361ac6f6a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gwg6r\" (UID: \"08945732-252d-4aa3-bf4d-56d361ac6f6a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gwg6r" Jul 06 01:07:23.693236 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:23.693217 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08945732-252d-4aa3-bf4d-56d361ac6f6a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gwg6r\" (UID: \"08945732-252d-4aa3-bf4d-56d361ac6f6a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gwg6r" Jul 06 01:07:23.700783 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:23.700754 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmsn9\" (UniqueName: \"kubernetes.io/projected/08945732-252d-4aa3-bf4d-56d361ac6f6a-kube-api-access-hmsn9\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gwg6r\" (UID: \"08945732-252d-4aa3-bf4d-56d361ac6f6a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gwg6r" Jul 06 01:07:23.804886 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:23.804807 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gwg6r" Jul 06 01:07:23.932266 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:23.932235 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gwg6r"] Jul 06 01:07:23.935798 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:07:23.935763 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08945732_252d_4aa3_bf4d_56d361ac6f6a.slice/crio-2735ae5c0f961121942877e4b414761ba61d3c4cdd5ca2daa8e5909c24e57fd2 WatchSource:0}: Error finding container 2735ae5c0f961121942877e4b414761ba61d3c4cdd5ca2daa8e5909c24e57fd2: Status 404 returned error can't find the container with id 2735ae5c0f961121942877e4b414761ba61d3c4cdd5ca2daa8e5909c24e57fd2 Jul 06 01:07:23.937733 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:23.937715 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 01:07:24.191768 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:24.191644 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gwg6r" event={"ID":"08945732-252d-4aa3-bf4d-56d361ac6f6a","Type":"ContainerStarted","Data":"2735ae5c0f961121942877e4b414761ba61d3c4cdd5ca2daa8e5909c24e57fd2"} Jul 06 01:07:32.225336 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:32.225294 2553 generic.go:356] "Generic (PLEG): container finished" podID="08945732-252d-4aa3-bf4d-56d361ac6f6a" containerID="49a7d25e7e9a4cba286c3b34e0653fde6419cf0ae944e7eb8bccb6eb5430f080" exitCode=0 Jul 06 01:07:32.225769 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:32.225343 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gwg6r" event={"ID":"08945732-252d-4aa3-bf4d-56d361ac6f6a","Type":"ContainerDied","Data":"49a7d25e7e9a4cba286c3b34e0653fde6419cf0ae944e7eb8bccb6eb5430f080"} Jul 06 01:07:35.239725 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:35.239690 2553 generic.go:356] "Generic (PLEG): container finished" podID="08945732-252d-4aa3-bf4d-56d361ac6f6a" containerID="d2e7a7f34f536a89a33f0e1ee3919b48eb6324042426598e62bb9b2433d53752" exitCode=0 Jul 06 01:07:35.240103 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:35.239731 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gwg6r" event={"ID":"08945732-252d-4aa3-bf4d-56d361ac6f6a","Type":"ContainerDied","Data":"d2e7a7f34f536a89a33f0e1ee3919b48eb6324042426598e62bb9b2433d53752"} Jul 06 01:07:43.275377 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:43.275338 2553 generic.go:356] "Generic (PLEG): container finished" podID="08945732-252d-4aa3-bf4d-56d361ac6f6a" containerID="10c45081db1228643077c567f4016161ea91230c6a4680065cf677b4c8f34fce" exitCode=0 Jul 06 01:07:43.275799 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:43.275402 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gwg6r" event={"ID":"08945732-252d-4aa3-bf4d-56d361ac6f6a","Type":"ContainerDied","Data":"10c45081db1228643077c567f4016161ea91230c6a4680065cf677b4c8f34fce"} Jul 06 01:07:44.399357 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:44.399328 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gwg6r" Jul 06 01:07:44.576892 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:44.576785 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08945732-252d-4aa3-bf4d-56d361ac6f6a-bundle\") pod \"08945732-252d-4aa3-bf4d-56d361ac6f6a\" (UID: \"08945732-252d-4aa3-bf4d-56d361ac6f6a\") " Jul 06 01:07:44.576892 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:44.576837 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08945732-252d-4aa3-bf4d-56d361ac6f6a-util\") pod \"08945732-252d-4aa3-bf4d-56d361ac6f6a\" (UID: \"08945732-252d-4aa3-bf4d-56d361ac6f6a\") " Jul 06 01:07:44.576892 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:44.576903 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmsn9\" (UniqueName: \"kubernetes.io/projected/08945732-252d-4aa3-bf4d-56d361ac6f6a-kube-api-access-hmsn9\") pod \"08945732-252d-4aa3-bf4d-56d361ac6f6a\" (UID: \"08945732-252d-4aa3-bf4d-56d361ac6f6a\") " Jul 06 01:07:44.577498 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:44.577467 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08945732-252d-4aa3-bf4d-56d361ac6f6a-bundle" (OuterVolumeSpecName: "bundle") pod "08945732-252d-4aa3-bf4d-56d361ac6f6a" (UID: "08945732-252d-4aa3-bf4d-56d361ac6f6a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:07:44.579143 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:44.579120 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08945732-252d-4aa3-bf4d-56d361ac6f6a-kube-api-access-hmsn9" (OuterVolumeSpecName: "kube-api-access-hmsn9") pod "08945732-252d-4aa3-bf4d-56d361ac6f6a" (UID: "08945732-252d-4aa3-bf4d-56d361ac6f6a"). InnerVolumeSpecName "kube-api-access-hmsn9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:07:44.580858 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:44.580838 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08945732-252d-4aa3-bf4d-56d361ac6f6a-util" (OuterVolumeSpecName: "util") pod "08945732-252d-4aa3-bf4d-56d361ac6f6a" (UID: "08945732-252d-4aa3-bf4d-56d361ac6f6a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:07:44.677918 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:44.677881 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08945732-252d-4aa3-bf4d-56d361ac6f6a-bundle\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:07:44.677918 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:44.677911 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08945732-252d-4aa3-bf4d-56d361ac6f6a-util\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:07:44.677918 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:44.677920 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmsn9\" (UniqueName: \"kubernetes.io/projected/08945732-252d-4aa3-bf4d-56d361ac6f6a-kube-api-access-hmsn9\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:07:45.283769 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:45.283735 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gwg6r" event={"ID":"08945732-252d-4aa3-bf4d-56d361ac6f6a","Type":"ContainerDied","Data":"2735ae5c0f961121942877e4b414761ba61d3c4cdd5ca2daa8e5909c24e57fd2"} Jul 06 01:07:45.283769 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:45.283760 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gwg6r" Jul 06 01:07:45.283970 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:45.283780 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2735ae5c0f961121942877e4b414761ba61d3c4cdd5ca2daa8e5909c24e57fd2" Jul 06 01:07:51.611523 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:51.611486 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f5g4k"] Jul 06 01:07:51.611925 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:51.611787 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08945732-252d-4aa3-bf4d-56d361ac6f6a" containerName="pull" Jul 06 01:07:51.611925 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:51.611799 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="08945732-252d-4aa3-bf4d-56d361ac6f6a" containerName="pull" Jul 06 01:07:51.611925 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:51.611815 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08945732-252d-4aa3-bf4d-56d361ac6f6a" containerName="extract" Jul 06 01:07:51.611925 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:51.611820 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="08945732-252d-4aa3-bf4d-56d361ac6f6a" containerName="extract" Jul 06 01:07:51.611925 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:51.611827 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08945732-252d-4aa3-bf4d-56d361ac6f6a" containerName="util" Jul 06 01:07:51.611925 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:51.611831 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="08945732-252d-4aa3-bf4d-56d361ac6f6a" containerName="util" Jul 06 01:07:51.611925 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:51.611877 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="08945732-252d-4aa3-bf4d-56d361ac6f6a" containerName="extract" Jul 06 01:07:51.640216 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:51.640178 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f5g4k"] Jul 06 01:07:51.640363 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:51.640273 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f5g4k" Jul 06 01:07:51.642996 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:51.642969 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 06 01:07:51.643114 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:51.642969 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-pr5nl\"" Jul 06 01:07:51.643114 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:51.643031 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 06 01:07:51.734019 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:51.733982 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a19948f4-cb20-4cd4-be54-b217bbdc2ca6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-f5g4k\" (UID: \"a19948f4-cb20-4cd4-be54-b217bbdc2ca6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f5g4k" Jul 06 01:07:51.734191 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:51.734035 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6w7w\" (UniqueName: \"kubernetes.io/projected/a19948f4-cb20-4cd4-be54-b217bbdc2ca6-kube-api-access-q6w7w\") pod \"cert-manager-operator-controller-manager-55c444bf86-f5g4k\" (UID: \"a19948f4-cb20-4cd4-be54-b217bbdc2ca6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f5g4k" Jul 06 01:07:51.834607 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:51.834565 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a19948f4-cb20-4cd4-be54-b217bbdc2ca6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-f5g4k\" (UID: \"a19948f4-cb20-4cd4-be54-b217bbdc2ca6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f5g4k" Jul 06 01:07:51.834763 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:51.834623 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6w7w\" (UniqueName: \"kubernetes.io/projected/a19948f4-cb20-4cd4-be54-b217bbdc2ca6-kube-api-access-q6w7w\") pod \"cert-manager-operator-controller-manager-55c444bf86-f5g4k\" (UID: \"a19948f4-cb20-4cd4-be54-b217bbdc2ca6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f5g4k" Jul 06 01:07:51.834989 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:51.834965 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a19948f4-cb20-4cd4-be54-b217bbdc2ca6-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-f5g4k\" (UID: \"a19948f4-cb20-4cd4-be54-b217bbdc2ca6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f5g4k" Jul 06 01:07:51.842151 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:51.842124 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6w7w\" (UniqueName: \"kubernetes.io/projected/a19948f4-cb20-4cd4-be54-b217bbdc2ca6-kube-api-access-q6w7w\") pod \"cert-manager-operator-controller-manager-55c444bf86-f5g4k\" (UID: \"a19948f4-cb20-4cd4-be54-b217bbdc2ca6\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f5g4k" Jul 06 01:07:51.949091 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:51.948997 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f5g4k" Jul 06 01:07:52.081558 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:52.081484 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f5g4k"] Jul 06 01:07:52.085499 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:07:52.085474 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda19948f4_cb20_4cd4_be54_b217bbdc2ca6.slice/crio-25db8998ea768a41411e2825b18a04e109c7802308bceec441a5ff62e5ae97a6 WatchSource:0}: Error finding container 25db8998ea768a41411e2825b18a04e109c7802308bceec441a5ff62e5ae97a6: Status 404 returned error can't find the container with id 25db8998ea768a41411e2825b18a04e109c7802308bceec441a5ff62e5ae97a6 Jul 06 01:07:52.311613 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:52.311577 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f5g4k" event={"ID":"a19948f4-cb20-4cd4-be54-b217bbdc2ca6","Type":"ContainerStarted","Data":"25db8998ea768a41411e2825b18a04e109c7802308bceec441a5ff62e5ae97a6"} Jul 06 01:07:54.321484 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:54.321447 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f5g4k" event={"ID":"a19948f4-cb20-4cd4-be54-b217bbdc2ca6","Type":"ContainerStarted","Data":"18f43e70d50bdd95fad662e347454324a0d2b3e75aad1a6ad98b282093b62086"} Jul 06 01:07:54.342302 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:54.342254 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-f5g4k" podStartSLOduration=1.247238573 podStartE2EDuration="3.342233716s" totalImagesPullingTime="2.094995143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:07:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:07:54.339636874 +0000 UTC m=+514.354009912" watchObservedRunningTime="2026-07-06 01:07:54.342233716 +0000 UTC m=+514.356606752" Jul 06 01:07:55.663475 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:55.663439 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggvl7"] Jul 06 01:07:55.666223 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:55.666207 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggvl7" Jul 06 01:07:55.668587 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:55.668560 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 01:07:55.669550 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:55.669533 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tqlrw\"" Jul 06 01:07:55.669633 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:55.669535 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 01:07:55.672616 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:55.672591 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5996175c-e63c-49f7-9731-fccc3b716b8e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggvl7\" (UID: \"5996175c-e63c-49f7-9731-fccc3b716b8e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggvl7" Jul 06 01:07:55.673014 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:55.672723 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5996175c-e63c-49f7-9731-fccc3b716b8e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggvl7\" (UID: \"5996175c-e63c-49f7-9731-fccc3b716b8e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggvl7" Jul 06 01:07:55.673014 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:55.672805 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22ggf\" (UniqueName: \"kubernetes.io/projected/5996175c-e63c-49f7-9731-fccc3b716b8e-kube-api-access-22ggf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggvl7\" (UID: \"5996175c-e63c-49f7-9731-fccc3b716b8e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggvl7" Jul 06 01:07:55.674295 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:55.674275 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggvl7"] Jul 06 01:07:55.773903 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:55.773866 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5996175c-e63c-49f7-9731-fccc3b716b8e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggvl7\" (UID: \"5996175c-e63c-49f7-9731-fccc3b716b8e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggvl7" Jul 06 01:07:55.773903 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:55.773907 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5996175c-e63c-49f7-9731-fccc3b716b8e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggvl7\" (UID: \"5996175c-e63c-49f7-9731-fccc3b716b8e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggvl7" Jul 06 01:07:55.774115 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:55.773950 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22ggf\" (UniqueName: \"kubernetes.io/projected/5996175c-e63c-49f7-9731-fccc3b716b8e-kube-api-access-22ggf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggvl7\" (UID: \"5996175c-e63c-49f7-9731-fccc3b716b8e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggvl7" Jul 06 01:07:55.774314 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:55.774294 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5996175c-e63c-49f7-9731-fccc3b716b8e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggvl7\" (UID: \"5996175c-e63c-49f7-9731-fccc3b716b8e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggvl7" Jul 06 01:07:55.774358 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:55.774331 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5996175c-e63c-49f7-9731-fccc3b716b8e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggvl7\" (UID: \"5996175c-e63c-49f7-9731-fccc3b716b8e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggvl7" Jul 06 01:07:55.787132 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:55.787104 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22ggf\" (UniqueName: \"kubernetes.io/projected/5996175c-e63c-49f7-9731-fccc3b716b8e-kube-api-access-22ggf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggvl7\" (UID: \"5996175c-e63c-49f7-9731-fccc3b716b8e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggvl7" Jul 06 01:07:55.975493 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:55.975459 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggvl7" Jul 06 01:07:56.103841 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:56.103810 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggvl7"] Jul 06 01:07:56.105864 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:07:56.105836 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5996175c_e63c_49f7_9731_fccc3b716b8e.slice/crio-0f55850089969bf2c68b3d3e601a59672ab7eb56ce009f037faca111a2becc51 WatchSource:0}: Error finding container 0f55850089969bf2c68b3d3e601a59672ab7eb56ce009f037faca111a2becc51: Status 404 returned error can't find the container with id 0f55850089969bf2c68b3d3e601a59672ab7eb56ce009f037faca111a2becc51 Jul 06 01:07:56.115892 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:56.115869 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tz5t7"] Jul 06 01:07:56.118548 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:56.118527 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-tz5t7" Jul 06 01:07:56.121308 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:56.121123 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 06 01:07:56.121308 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:56.121176 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 06 01:07:56.121308 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:56.121241 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-qcvv5\"" Jul 06 01:07:56.127914 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:56.127893 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tz5t7"] Jul 06 01:07:56.176501 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:56.176466 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/399def60-5c0b-4f07-854b-27f1909ec2a2-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tz5t7\" (UID: \"399def60-5c0b-4f07-854b-27f1909ec2a2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tz5t7" Jul 06 01:07:56.176706 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:56.176555 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjldj\" (UniqueName: \"kubernetes.io/projected/399def60-5c0b-4f07-854b-27f1909ec2a2-kube-api-access-kjldj\") pod \"cert-manager-webhook-6486ffd997-tz5t7\" (UID: \"399def60-5c0b-4f07-854b-27f1909ec2a2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tz5t7" Jul 06 01:07:56.277386 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:56.277356 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjldj\" (UniqueName: \"kubernetes.io/projected/399def60-5c0b-4f07-854b-27f1909ec2a2-kube-api-access-kjldj\") pod \"cert-manager-webhook-6486ffd997-tz5t7\" (UID: \"399def60-5c0b-4f07-854b-27f1909ec2a2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tz5t7" Jul 06 01:07:56.277511 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:56.277401 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/399def60-5c0b-4f07-854b-27f1909ec2a2-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tz5t7\" (UID: \"399def60-5c0b-4f07-854b-27f1909ec2a2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tz5t7" Jul 06 01:07:56.285265 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:56.285237 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/399def60-5c0b-4f07-854b-27f1909ec2a2-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tz5t7\" (UID: \"399def60-5c0b-4f07-854b-27f1909ec2a2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tz5t7" Jul 06 01:07:56.285371 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:56.285343 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjldj\" (UniqueName: \"kubernetes.io/projected/399def60-5c0b-4f07-854b-27f1909ec2a2-kube-api-access-kjldj\") pod \"cert-manager-webhook-6486ffd997-tz5t7\" (UID: \"399def60-5c0b-4f07-854b-27f1909ec2a2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tz5t7" Jul 06 01:07:56.330616 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:56.330583 2553 generic.go:356] "Generic (PLEG): container finished" podID="5996175c-e63c-49f7-9731-fccc3b716b8e" containerID="48e1aa98d605e4c902d7385773b24c7b6d18f8d6bc36d5af91a74188ce551d33" exitCode=0 Jul 06 01:07:56.330812 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:56.330686 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggvl7" event={"ID":"5996175c-e63c-49f7-9731-fccc3b716b8e","Type":"ContainerDied","Data":"48e1aa98d605e4c902d7385773b24c7b6d18f8d6bc36d5af91a74188ce551d33"} Jul 06 01:07:56.330812 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:56.330736 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggvl7" event={"ID":"5996175c-e63c-49f7-9731-fccc3b716b8e","Type":"ContainerStarted","Data":"0f55850089969bf2c68b3d3e601a59672ab7eb56ce009f037faca111a2becc51"} Jul 06 01:07:56.497689 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:56.497636 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-tz5t7" Jul 06 01:07:56.625862 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:56.625836 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tz5t7"] Jul 06 01:07:56.628322 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:07:56.628292 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod399def60_5c0b_4f07_854b_27f1909ec2a2.slice/crio-2084a22243cf4bd531adef4e8387e0330ef6fff74be841b6f0fd1ba2af9679a0 WatchSource:0}: Error finding container 2084a22243cf4bd531adef4e8387e0330ef6fff74be841b6f0fd1ba2af9679a0: Status 404 returned error can't find the container with id 2084a22243cf4bd531adef4e8387e0330ef6fff74be841b6f0fd1ba2af9679a0 Jul 06 01:07:57.336922 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:07:57.336878 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-tz5t7" event={"ID":"399def60-5c0b-4f07-854b-27f1909ec2a2","Type":"ContainerStarted","Data":"2084a22243cf4bd531adef4e8387e0330ef6fff74be841b6f0fd1ba2af9679a0"} Jul 06 01:08:01.360494 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:01.360459 2553 generic.go:356] "Generic (PLEG): container finished" podID="5996175c-e63c-49f7-9731-fccc3b716b8e" containerID="f36d8817f6ccc3819b04c4397d113e87786c951017e3081102edc9d141eb91e2" exitCode=0 Jul 06 01:08:01.360959 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:01.360548 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggvl7" event={"ID":"5996175c-e63c-49f7-9731-fccc3b716b8e","Type":"ContainerDied","Data":"f36d8817f6ccc3819b04c4397d113e87786c951017e3081102edc9d141eb91e2"} Jul 06 01:08:01.362098 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:01.362069 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-tz5t7" event={"ID":"399def60-5c0b-4f07-854b-27f1909ec2a2","Type":"ContainerStarted","Data":"b1a8bff943f0e13c669311fdc769e60db43aae79ccf86aca9ea1f58fd1cd3b7b"} Jul 06 01:08:01.362211 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:01.362194 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-tz5t7" Jul 06 01:08:01.401690 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:01.401631 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-tz5t7" podStartSLOduration=1.572953067 podStartE2EDuration="5.401615133s" totalImagesPullingTime="3.828662066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:07:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:08:01.399892417 +0000 UTC m=+521.414265453" watchObservedRunningTime="2026-07-06 01:08:01.401615133 +0000 UTC m=+521.415988168" Jul 06 01:08:02.368841 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:02.368806 2553 generic.go:356] "Generic (PLEG): container finished" podID="5996175c-e63c-49f7-9731-fccc3b716b8e" containerID="8bf8c88584814297c13a674ef1e312270c7937b8663a0494f29dd48878ad7bd7" exitCode=0 Jul 06 01:08:02.369204 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:02.368889 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggvl7" event={"ID":"5996175c-e63c-49f7-9731-fccc3b716b8e","Type":"ContainerDied","Data":"8bf8c88584814297c13a674ef1e312270c7937b8663a0494f29dd48878ad7bd7"} Jul 06 01:08:03.497946 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:03.497914 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggvl7" Jul 06 01:08:03.523023 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:03.522990 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5996175c-e63c-49f7-9731-fccc3b716b8e-bundle\") pod \"5996175c-e63c-49f7-9731-fccc3b716b8e\" (UID: \"5996175c-e63c-49f7-9731-fccc3b716b8e\") " Jul 06 01:08:03.523193 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:03.523038 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22ggf\" (UniqueName: \"kubernetes.io/projected/5996175c-e63c-49f7-9731-fccc3b716b8e-kube-api-access-22ggf\") pod \"5996175c-e63c-49f7-9731-fccc3b716b8e\" (UID: \"5996175c-e63c-49f7-9731-fccc3b716b8e\") " Jul 06 01:08:03.523408 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:03.523382 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5996175c-e63c-49f7-9731-fccc3b716b8e-bundle" (OuterVolumeSpecName: "bundle") pod "5996175c-e63c-49f7-9731-fccc3b716b8e" (UID: "5996175c-e63c-49f7-9731-fccc3b716b8e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:08:03.525205 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:03.525177 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5996175c-e63c-49f7-9731-fccc3b716b8e-kube-api-access-22ggf" (OuterVolumeSpecName: "kube-api-access-22ggf") pod "5996175c-e63c-49f7-9731-fccc3b716b8e" (UID: "5996175c-e63c-49f7-9731-fccc3b716b8e"). InnerVolumeSpecName "kube-api-access-22ggf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:08:03.624125 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:03.624040 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5996175c-e63c-49f7-9731-fccc3b716b8e-util\") pod \"5996175c-e63c-49f7-9731-fccc3b716b8e\" (UID: \"5996175c-e63c-49f7-9731-fccc3b716b8e\") " Jul 06 01:08:03.624264 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:03.624209 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5996175c-e63c-49f7-9731-fccc3b716b8e-bundle\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:08:03.624264 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:03.624227 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22ggf\" (UniqueName: \"kubernetes.io/projected/5996175c-e63c-49f7-9731-fccc3b716b8e-kube-api-access-22ggf\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:08:03.628497 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:03.628469 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5996175c-e63c-49f7-9731-fccc3b716b8e-util" (OuterVolumeSpecName: "util") pod "5996175c-e63c-49f7-9731-fccc3b716b8e" (UID: "5996175c-e63c-49f7-9731-fccc3b716b8e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:08:03.724944 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:03.724914 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5996175c-e63c-49f7-9731-fccc3b716b8e-util\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:08:04.378626 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:04.378589 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggvl7" event={"ID":"5996175c-e63c-49f7-9731-fccc3b716b8e","Type":"ContainerDied","Data":"0f55850089969bf2c68b3d3e601a59672ab7eb56ce009f037faca111a2becc51"} Jul 06 01:08:04.378626 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:04.378613 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggvl7" Jul 06 01:08:04.378859 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:04.378661 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f55850089969bf2c68b3d3e601a59672ab7eb56ce009f037faca111a2becc51" Jul 06 01:08:07.231149 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:07.231110 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9j6nl"] Jul 06 01:08:07.231595 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:07.231404 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5996175c-e63c-49f7-9731-fccc3b716b8e" containerName="extract" Jul 06 01:08:07.231595 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:07.231415 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="5996175c-e63c-49f7-9731-fccc3b716b8e" containerName="extract" Jul 06 01:08:07.231595 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:07.231431 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5996175c-e63c-49f7-9731-fccc3b716b8e" containerName="pull" Jul 06 01:08:07.231595 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:07.231437 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="5996175c-e63c-49f7-9731-fccc3b716b8e" containerName="pull" Jul 06 01:08:07.231595 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:07.231448 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5996175c-e63c-49f7-9731-fccc3b716b8e" containerName="util" Jul 06 01:08:07.231595 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:07.231454 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="5996175c-e63c-49f7-9731-fccc3b716b8e" containerName="util" Jul 06 01:08:07.231595 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:07.231498 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="5996175c-e63c-49f7-9731-fccc3b716b8e" containerName="extract" Jul 06 01:08:07.234517 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:07.234498 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9j6nl" Jul 06 01:08:07.236875 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:07.236857 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-llwj7\"" Jul 06 01:08:07.243999 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:07.243980 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9j6nl"] Jul 06 01:08:07.248285 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:07.248262 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/202ad3d0-a621-4716-ac8e-a5c70376a13d-bound-sa-token\") pod \"cert-manager-55b4d954d5-9j6nl\" (UID: \"202ad3d0-a621-4716-ac8e-a5c70376a13d\") " pod="cert-manager/cert-manager-55b4d954d5-9j6nl" Jul 06 01:08:07.248391 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:07.248289 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86rjs\" (UniqueName: \"kubernetes.io/projected/202ad3d0-a621-4716-ac8e-a5c70376a13d-kube-api-access-86rjs\") pod \"cert-manager-55b4d954d5-9j6nl\" (UID: \"202ad3d0-a621-4716-ac8e-a5c70376a13d\") " pod="cert-manager/cert-manager-55b4d954d5-9j6nl" Jul 06 01:08:07.349280 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:07.349237 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/202ad3d0-a621-4716-ac8e-a5c70376a13d-bound-sa-token\") pod \"cert-manager-55b4d954d5-9j6nl\" (UID: \"202ad3d0-a621-4716-ac8e-a5c70376a13d\") " pod="cert-manager/cert-manager-55b4d954d5-9j6nl" Jul 06 01:08:07.349280 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:07.349276 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86rjs\" (UniqueName: \"kubernetes.io/projected/202ad3d0-a621-4716-ac8e-a5c70376a13d-kube-api-access-86rjs\") pod \"cert-manager-55b4d954d5-9j6nl\" (UID: \"202ad3d0-a621-4716-ac8e-a5c70376a13d\") " pod="cert-manager/cert-manager-55b4d954d5-9j6nl" Jul 06 01:08:07.357129 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:07.357089 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/202ad3d0-a621-4716-ac8e-a5c70376a13d-bound-sa-token\") pod \"cert-manager-55b4d954d5-9j6nl\" (UID: \"202ad3d0-a621-4716-ac8e-a5c70376a13d\") " pod="cert-manager/cert-manager-55b4d954d5-9j6nl" Jul 06 01:08:07.357314 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:07.357292 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86rjs\" (UniqueName: \"kubernetes.io/projected/202ad3d0-a621-4716-ac8e-a5c70376a13d-kube-api-access-86rjs\") pod \"cert-manager-55b4d954d5-9j6nl\" (UID: \"202ad3d0-a621-4716-ac8e-a5c70376a13d\") " pod="cert-manager/cert-manager-55b4d954d5-9j6nl" Jul 06 01:08:07.371898 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:07.371875 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-tz5t7" Jul 06 01:08:07.544238 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:07.544157 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-9j6nl" Jul 06 01:08:07.679651 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:07.679625 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-9j6nl"] Jul 06 01:08:07.682025 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:08:07.681993 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod202ad3d0_a621_4716_ac8e_a5c70376a13d.slice/crio-5f8c5d9cd658ccc16beba14096b8fa4a2b967fcab10d384993c7e1b39ee1601e WatchSource:0}: Error finding container 5f8c5d9cd658ccc16beba14096b8fa4a2b967fcab10d384993c7e1b39ee1601e: Status 404 returned error can't find the container with id 5f8c5d9cd658ccc16beba14096b8fa4a2b967fcab10d384993c7e1b39ee1601e Jul 06 01:08:08.397382 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:08.397344 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9j6nl" event={"ID":"202ad3d0-a621-4716-ac8e-a5c70376a13d","Type":"ContainerStarted","Data":"e61d13ffd23e34f28dfdc2f7f86a92aa461bfb4949121cd59a29be94e7bdca74"} Jul 06 01:08:08.397784 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:08.397393 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-9j6nl" event={"ID":"202ad3d0-a621-4716-ac8e-a5c70376a13d","Type":"ContainerStarted","Data":"5f8c5d9cd658ccc16beba14096b8fa4a2b967fcab10d384993c7e1b39ee1601e"} Jul 06 01:08:08.412922 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:08.412875 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-9j6nl" podStartSLOduration=1.412858863 podStartE2EDuration="1.412858863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:08:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:08:08.410919208 +0000 UTC m=+528.425292244" watchObservedRunningTime="2026-07-06 01:08:08.412858863 +0000 UTC m=+528.427231900" Jul 06 01:08:20.519172 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:20.519139 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af57sxv"] Jul 06 01:08:20.521347 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:20.521332 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af57sxv" Jul 06 01:08:20.523917 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:20.523893 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 01:08:20.524042 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:20.523916 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 01:08:20.524042 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:20.523930 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tqlrw\"" Jul 06 01:08:20.530403 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:20.530383 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af57sxv"] Jul 06 01:08:20.551873 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:20.551841 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzkkn\" (UniqueName: \"kubernetes.io/projected/b8af459e-63e3-47c7-829d-3e8e7766ca07-kube-api-access-kzkkn\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af57sxv\" (UID: \"b8af459e-63e3-47c7-829d-3e8e7766ca07\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af57sxv" Jul 06 01:08:20.552033 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:20.551899 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8af459e-63e3-47c7-829d-3e8e7766ca07-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af57sxv\" (UID: \"b8af459e-63e3-47c7-829d-3e8e7766ca07\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af57sxv" Jul 06 01:08:20.552033 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:20.551956 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b8af459e-63e3-47c7-829d-3e8e7766ca07-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af57sxv\" (UID: \"b8af459e-63e3-47c7-829d-3e8e7766ca07\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af57sxv" Jul 06 01:08:20.652809 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:20.652765 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzkkn\" (UniqueName: \"kubernetes.io/projected/b8af459e-63e3-47c7-829d-3e8e7766ca07-kube-api-access-kzkkn\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af57sxv\" (UID: \"b8af459e-63e3-47c7-829d-3e8e7766ca07\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af57sxv" Jul 06 01:08:20.653007 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:20.652817 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8af459e-63e3-47c7-829d-3e8e7766ca07-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af57sxv\" (UID: \"b8af459e-63e3-47c7-829d-3e8e7766ca07\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af57sxv" Jul 06 01:08:20.653007 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:20.652853 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b8af459e-63e3-47c7-829d-3e8e7766ca07-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af57sxv\" (UID: \"b8af459e-63e3-47c7-829d-3e8e7766ca07\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af57sxv" Jul 06 01:08:20.653285 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:20.653260 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8af459e-63e3-47c7-829d-3e8e7766ca07-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af57sxv\" (UID: \"b8af459e-63e3-47c7-829d-3e8e7766ca07\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af57sxv" Jul 06 01:08:20.653360 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:20.653273 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b8af459e-63e3-47c7-829d-3e8e7766ca07-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af57sxv\" (UID: \"b8af459e-63e3-47c7-829d-3e8e7766ca07\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af57sxv" Jul 06 01:08:20.661385 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:20.661354 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzkkn\" (UniqueName: \"kubernetes.io/projected/b8af459e-63e3-47c7-829d-3e8e7766ca07-kube-api-access-kzkkn\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af57sxv\" (UID: \"b8af459e-63e3-47c7-829d-3e8e7766ca07\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af57sxv" Jul 06 01:08:20.830607 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:20.830521 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af57sxv" Jul 06 01:08:20.965767 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:20.965720 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af57sxv"] Jul 06 01:08:20.967760 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:08:20.967731 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8af459e_63e3_47c7_829d_3e8e7766ca07.slice/crio-07e8d3c61b279491d7eeb968964fc0cb3e615187a8c751431a94616adb2dcf7e WatchSource:0}: Error finding container 07e8d3c61b279491d7eeb968964fc0cb3e615187a8c751431a94616adb2dcf7e: Status 404 returned error can't find the container with id 07e8d3c61b279491d7eeb968964fc0cb3e615187a8c751431a94616adb2dcf7e Jul 06 01:08:21.455477 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:21.455437 2553 generic.go:356] "Generic (PLEG): container finished" podID="b8af459e-63e3-47c7-829d-3e8e7766ca07" containerID="9cd8b6060ef79cac4b9b9d402c740014f81a7f32a7c1409b78e373b071587452" exitCode=0 Jul 06 01:08:21.455651 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:21.455474 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af57sxv" event={"ID":"b8af459e-63e3-47c7-829d-3e8e7766ca07","Type":"ContainerDied","Data":"9cd8b6060ef79cac4b9b9d402c740014f81a7f32a7c1409b78e373b071587452"} Jul 06 01:08:21.455651 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:21.455562 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af57sxv" event={"ID":"b8af459e-63e3-47c7-829d-3e8e7766ca07","Type":"ContainerStarted","Data":"07e8d3c61b279491d7eeb968964fc0cb3e615187a8c751431a94616adb2dcf7e"} Jul 06 01:08:22.461981 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:22.461943 2553 generic.go:356] "Generic (PLEG): container finished" podID="b8af459e-63e3-47c7-829d-3e8e7766ca07" containerID="2a38698a1c9877b43e6949928028590a9f73ffa51922b417a08ca2c2136f5f9d" exitCode=0 Jul 06 01:08:22.462348 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:22.462035 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af57sxv" event={"ID":"b8af459e-63e3-47c7-829d-3e8e7766ca07","Type":"ContainerDied","Data":"2a38698a1c9877b43e6949928028590a9f73ffa51922b417a08ca2c2136f5f9d"} Jul 06 01:08:23.468721 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:23.468688 2553 generic.go:356] "Generic (PLEG): container finished" podID="b8af459e-63e3-47c7-829d-3e8e7766ca07" containerID="4cc69ab19a22358f640c68e289144b48277393b5f8a8339f0d60840c30ce98bf" exitCode=0 Jul 06 01:08:23.469157 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:23.468751 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af57sxv" event={"ID":"b8af459e-63e3-47c7-829d-3e8e7766ca07","Type":"ContainerDied","Data":"4cc69ab19a22358f640c68e289144b48277393b5f8a8339f0d60840c30ce98bf"} Jul 06 01:08:24.598847 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:24.598822 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af57sxv" Jul 06 01:08:24.685280 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:24.685248 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzkkn\" (UniqueName: \"kubernetes.io/projected/b8af459e-63e3-47c7-829d-3e8e7766ca07-kube-api-access-kzkkn\") pod \"b8af459e-63e3-47c7-829d-3e8e7766ca07\" (UID: \"b8af459e-63e3-47c7-829d-3e8e7766ca07\") " Jul 06 01:08:24.685483 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:24.685318 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b8af459e-63e3-47c7-829d-3e8e7766ca07-util\") pod \"b8af459e-63e3-47c7-829d-3e8e7766ca07\" (UID: \"b8af459e-63e3-47c7-829d-3e8e7766ca07\") " Jul 06 01:08:24.685483 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:24.685348 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8af459e-63e3-47c7-829d-3e8e7766ca07-bundle\") pod \"b8af459e-63e3-47c7-829d-3e8e7766ca07\" (UID: \"b8af459e-63e3-47c7-829d-3e8e7766ca07\") " Jul 06 01:08:24.686153 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:24.686125 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8af459e-63e3-47c7-829d-3e8e7766ca07-bundle" (OuterVolumeSpecName: "bundle") pod "b8af459e-63e3-47c7-829d-3e8e7766ca07" (UID: "b8af459e-63e3-47c7-829d-3e8e7766ca07"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:08:24.687386 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:24.687368 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8af459e-63e3-47c7-829d-3e8e7766ca07-kube-api-access-kzkkn" (OuterVolumeSpecName: "kube-api-access-kzkkn") pod "b8af459e-63e3-47c7-829d-3e8e7766ca07" (UID: "b8af459e-63e3-47c7-829d-3e8e7766ca07"). InnerVolumeSpecName "kube-api-access-kzkkn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:08:24.690942 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:24.690916 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8af459e-63e3-47c7-829d-3e8e7766ca07-util" (OuterVolumeSpecName: "util") pod "b8af459e-63e3-47c7-829d-3e8e7766ca07" (UID: "b8af459e-63e3-47c7-829d-3e8e7766ca07"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:08:24.786623 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:24.786542 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b8af459e-63e3-47c7-829d-3e8e7766ca07-util\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:08:24.786623 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:24.786571 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b8af459e-63e3-47c7-829d-3e8e7766ca07-bundle\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:08:24.786623 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:24.786581 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzkkn\" (UniqueName: \"kubernetes.io/projected/b8af459e-63e3-47c7-829d-3e8e7766ca07-kube-api-access-kzkkn\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:08:25.479512 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:25.479483 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af57sxv" Jul 06 01:08:25.479733 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:25.479487 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af57sxv" event={"ID":"b8af459e-63e3-47c7-829d-3e8e7766ca07","Type":"ContainerDied","Data":"07e8d3c61b279491d7eeb968964fc0cb3e615187a8c751431a94616adb2dcf7e"} Jul 06 01:08:25.479733 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:25.479602 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="07e8d3c61b279491d7eeb968964fc0cb3e615187a8c751431a94616adb2dcf7e" Jul 06 01:08:35.146493 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:35.146456 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm"] Jul 06 01:08:35.146956 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:35.146767 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8af459e-63e3-47c7-829d-3e8e7766ca07" containerName="pull" Jul 06 01:08:35.146956 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:35.146778 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8af459e-63e3-47c7-829d-3e8e7766ca07" containerName="pull" Jul 06 01:08:35.146956 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:35.146805 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8af459e-63e3-47c7-829d-3e8e7766ca07" containerName="extract" Jul 06 01:08:35.146956 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:35.146812 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8af459e-63e3-47c7-829d-3e8e7766ca07" containerName="extract" Jul 06 01:08:35.146956 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:35.146819 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8af459e-63e3-47c7-829d-3e8e7766ca07" containerName="util" Jul 06 01:08:35.146956 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:35.146825 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8af459e-63e3-47c7-829d-3e8e7766ca07" containerName="util" Jul 06 01:08:35.146956 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:35.146872 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8af459e-63e3-47c7-829d-3e8e7766ca07" containerName="extract" Jul 06 01:08:35.151951 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:35.151931 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm" Jul 06 01:08:35.155557 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:35.155535 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 01:08:35.155701 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:35.155579 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 01:08:35.155701 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:35.155634 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cv7kv\"" Jul 06 01:08:35.155903 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:35.155887 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 01:08:35.158814 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:35.158433 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 01:08:35.165545 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:35.165522 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm"] Jul 06 01:08:35.280362 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:35.280325 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ed6e379a-5ba3-479f-9093-2fb7b24a3654-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm\" (UID: \"ed6e379a-5ba3-479f-9093-2fb7b24a3654\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm" Jul 06 01:08:35.280537 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:35.280376 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ed6e379a-5ba3-479f-9093-2fb7b24a3654-manifests\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm\" (UID: \"ed6e379a-5ba3-479f-9093-2fb7b24a3654\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm" Jul 06 01:08:35.280537 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:35.280404 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed6e379a-5ba3-479f-9093-2fb7b24a3654-tmp\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm\" (UID: \"ed6e379a-5ba3-479f-9093-2fb7b24a3654\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm" Jul 06 01:08:35.280537 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:35.280433 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqx4n\" (UniqueName: \"kubernetes.io/projected/ed6e379a-5ba3-479f-9093-2fb7b24a3654-kube-api-access-tqx4n\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm\" (UID: \"ed6e379a-5ba3-479f-9093-2fb7b24a3654\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm" Jul 06 01:08:35.280537 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:35.280468 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ed6e379a-5ba3-479f-9093-2fb7b24a3654-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm\" (UID: \"ed6e379a-5ba3-479f-9093-2fb7b24a3654\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm" Jul 06 01:08:35.381064 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:35.381031 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqx4n\" (UniqueName: \"kubernetes.io/projected/ed6e379a-5ba3-479f-9093-2fb7b24a3654-kube-api-access-tqx4n\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm\" (UID: \"ed6e379a-5ba3-479f-9093-2fb7b24a3654\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm" Jul 06 01:08:35.381227 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:35.381080 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ed6e379a-5ba3-479f-9093-2fb7b24a3654-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm\" (UID: \"ed6e379a-5ba3-479f-9093-2fb7b24a3654\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm" Jul 06 01:08:35.381227 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:35.381143 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ed6e379a-5ba3-479f-9093-2fb7b24a3654-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm\" (UID: \"ed6e379a-5ba3-479f-9093-2fb7b24a3654\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm" Jul 06 01:08:35.381227 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:35.381183 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ed6e379a-5ba3-479f-9093-2fb7b24a3654-manifests\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm\" (UID: \"ed6e379a-5ba3-479f-9093-2fb7b24a3654\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm" Jul 06 01:08:35.381227 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:35.381206 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed6e379a-5ba3-479f-9093-2fb7b24a3654-tmp\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm\" (UID: \"ed6e379a-5ba3-479f-9093-2fb7b24a3654\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm" Jul 06 01:08:35.381710 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:35.381660 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ed6e379a-5ba3-479f-9093-2fb7b24a3654-manifests\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm\" (UID: \"ed6e379a-5ba3-479f-9093-2fb7b24a3654\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm" Jul 06 01:08:35.383565 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:35.383536 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ed6e379a-5ba3-479f-9093-2fb7b24a3654-tmp\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm\" (UID: \"ed6e379a-5ba3-479f-9093-2fb7b24a3654\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm" Jul 06 01:08:35.383703 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:35.383580 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ed6e379a-5ba3-479f-9093-2fb7b24a3654-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm\" (UID: \"ed6e379a-5ba3-479f-9093-2fb7b24a3654\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm" Jul 06 01:08:35.383703 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:35.383654 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ed6e379a-5ba3-479f-9093-2fb7b24a3654-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm\" (UID: \"ed6e379a-5ba3-479f-9093-2fb7b24a3654\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm" Jul 06 01:08:35.388696 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:35.388651 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqx4n\" (UniqueName: \"kubernetes.io/projected/ed6e379a-5ba3-479f-9093-2fb7b24a3654-kube-api-access-tqx4n\") pod \"opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm\" (UID: \"ed6e379a-5ba3-479f-9093-2fb7b24a3654\") " pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm" Jul 06 01:08:35.462861 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:35.462831 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm" Jul 06 01:08:35.598431 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:35.598405 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm"] Jul 06 01:08:35.600821 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:08:35.600783 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded6e379a_5ba3_479f_9093_2fb7b24a3654.slice/crio-5b9a86d4ed7e7da72df310a81e58b5eaad932b73414fdee55b03400cf8846400 WatchSource:0}: Error finding container 5b9a86d4ed7e7da72df310a81e58b5eaad932b73414fdee55b03400cf8846400: Status 404 returned error can't find the container with id 5b9a86d4ed7e7da72df310a81e58b5eaad932b73414fdee55b03400cf8846400 Jul 06 01:08:36.530677 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:36.530610 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm" event={"ID":"ed6e379a-5ba3-479f-9093-2fb7b24a3654","Type":"ContainerStarted","Data":"5b9a86d4ed7e7da72df310a81e58b5eaad932b73414fdee55b03400cf8846400"} Jul 06 01:08:39.549761 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:39.549719 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm" event={"ID":"ed6e379a-5ba3-479f-9093-2fb7b24a3654","Type":"ContainerStarted","Data":"af77e58942372e81a67aa8de75d0f790a9c123887552378bcb76ba0e25739bd8"} Jul 06 01:08:40.561875 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:40.561837 2553 generic.go:356] "Generic (PLEG): container finished" podID="ed6e379a-5ba3-479f-9093-2fb7b24a3654" containerID="af77e58942372e81a67aa8de75d0f790a9c123887552378bcb76ba0e25739bd8" exitCode=0 Jul 06 01:08:40.562358 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:40.561922 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm" event={"ID":"ed6e379a-5ba3-479f-9093-2fb7b24a3654","Type":"ContainerDied","Data":"af77e58942372e81a67aa8de75d0f790a9c123887552378bcb76ba0e25739bd8"} Jul 06 01:08:41.567911 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:41.567874 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm" event={"ID":"ed6e379a-5ba3-479f-9093-2fb7b24a3654","Type":"ContainerStarted","Data":"7803e1df6cf2d76c6ba0a737f727a49c9af3aa05dee4d0395efc934dcfc86e51"} Jul 06 01:08:41.568389 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:41.567945 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm" Jul 06 01:08:41.591297 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:41.591247 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm" podStartSLOduration=1.9382871879999999 podStartE2EDuration="6.591231138s" totalImagesPullingTime="3.589567933s" totalInitContainerRuntime="1.063376017s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:08:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:08:41.590089984 +0000 UTC m=+561.604463020" watchObservedRunningTime="2026-07-06 01:08:41.591231138 +0000 UTC m=+561.605604173" Jul 06 01:08:52.574649 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:52.574619 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm" Jul 06 01:08:54.883149 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:54.883113 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-557bfcf777-c6dmf"] Jul 06 01:08:54.886746 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:54.886729 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-557bfcf777-c6dmf" Jul 06 01:08:54.889661 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:54.889637 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-vbtwh\"" Jul 06 01:08:54.889804 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:54.889636 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 06 01:08:54.889804 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:54.889738 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 06 01:08:54.906401 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:54.906377 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-557bfcf777-c6dmf"] Jul 06 01:08:54.949415 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:54.949383 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8903edca-7fa6-423d-8d54-f9cfa83e2364-tmp\") pod \"kube-auth-proxy-557bfcf777-c6dmf\" (UID: \"8903edca-7fa6-423d-8d54-f9cfa83e2364\") " pod="openshift-ingress/kube-auth-proxy-557bfcf777-c6dmf" Jul 06 01:08:54.949582 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:54.949421 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzk9b\" (UniqueName: \"kubernetes.io/projected/8903edca-7fa6-423d-8d54-f9cfa83e2364-kube-api-access-wzk9b\") pod \"kube-auth-proxy-557bfcf777-c6dmf\" (UID: \"8903edca-7fa6-423d-8d54-f9cfa83e2364\") " pod="openshift-ingress/kube-auth-proxy-557bfcf777-c6dmf" Jul 06 01:08:54.949582 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:54.949518 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8903edca-7fa6-423d-8d54-f9cfa83e2364-tls-certs\") pod \"kube-auth-proxy-557bfcf777-c6dmf\" (UID: \"8903edca-7fa6-423d-8d54-f9cfa83e2364\") " pod="openshift-ingress/kube-auth-proxy-557bfcf777-c6dmf" Jul 06 01:08:55.050830 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:55.050800 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8903edca-7fa6-423d-8d54-f9cfa83e2364-tmp\") pod \"kube-auth-proxy-557bfcf777-c6dmf\" (UID: \"8903edca-7fa6-423d-8d54-f9cfa83e2364\") " pod="openshift-ingress/kube-auth-proxy-557bfcf777-c6dmf" Jul 06 01:08:55.050830 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:55.050835 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzk9b\" (UniqueName: \"kubernetes.io/projected/8903edca-7fa6-423d-8d54-f9cfa83e2364-kube-api-access-wzk9b\") pod \"kube-auth-proxy-557bfcf777-c6dmf\" (UID: \"8903edca-7fa6-423d-8d54-f9cfa83e2364\") " pod="openshift-ingress/kube-auth-proxy-557bfcf777-c6dmf" Jul 06 01:08:55.051093 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:55.050959 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8903edca-7fa6-423d-8d54-f9cfa83e2364-tls-certs\") pod \"kube-auth-proxy-557bfcf777-c6dmf\" (UID: \"8903edca-7fa6-423d-8d54-f9cfa83e2364\") " pod="openshift-ingress/kube-auth-proxy-557bfcf777-c6dmf" Jul 06 01:08:55.053153 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:55.053117 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8903edca-7fa6-423d-8d54-f9cfa83e2364-tmp\") pod \"kube-auth-proxy-557bfcf777-c6dmf\" (UID: \"8903edca-7fa6-423d-8d54-f9cfa83e2364\") " pod="openshift-ingress/kube-auth-proxy-557bfcf777-c6dmf" Jul 06 01:08:55.053400 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:55.053382 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8903edca-7fa6-423d-8d54-f9cfa83e2364-tls-certs\") pod \"kube-auth-proxy-557bfcf777-c6dmf\" (UID: \"8903edca-7fa6-423d-8d54-f9cfa83e2364\") " pod="openshift-ingress/kube-auth-proxy-557bfcf777-c6dmf" Jul 06 01:08:55.066777 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:55.066740 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzk9b\" (UniqueName: \"kubernetes.io/projected/8903edca-7fa6-423d-8d54-f9cfa83e2364-kube-api-access-wzk9b\") pod \"kube-auth-proxy-557bfcf777-c6dmf\" (UID: \"8903edca-7fa6-423d-8d54-f9cfa83e2364\") " pod="openshift-ingress/kube-auth-proxy-557bfcf777-c6dmf" Jul 06 01:08:55.082342 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:55.082307 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-pp54t"] Jul 06 01:08:55.085683 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:55.085647 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-pp54t" Jul 06 01:08:55.087938 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:55.087916 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 06 01:08:55.088049 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:55.088005 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-nm8fk\"" Jul 06 01:08:55.101092 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:55.101071 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-pp54t"] Jul 06 01:08:55.152002 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:55.151911 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3db998b9-c5fd-4d5f-b0c4-dc4115ccd60d-cert\") pod \"odh-model-controller-7998c67dc4-pp54t\" (UID: \"3db998b9-c5fd-4d5f-b0c4-dc4115ccd60d\") " pod="opendatahub/odh-model-controller-7998c67dc4-pp54t" Jul 06 01:08:55.152002 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:55.151962 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smdct\" (UniqueName: \"kubernetes.io/projected/3db998b9-c5fd-4d5f-b0c4-dc4115ccd60d-kube-api-access-smdct\") pod \"odh-model-controller-7998c67dc4-pp54t\" (UID: \"3db998b9-c5fd-4d5f-b0c4-dc4115ccd60d\") " pod="opendatahub/odh-model-controller-7998c67dc4-pp54t" Jul 06 01:08:55.196858 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:55.196821 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-557bfcf777-c6dmf" Jul 06 01:08:55.252891 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:55.252843 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3db998b9-c5fd-4d5f-b0c4-dc4115ccd60d-cert\") pod \"odh-model-controller-7998c67dc4-pp54t\" (UID: \"3db998b9-c5fd-4d5f-b0c4-dc4115ccd60d\") " pod="opendatahub/odh-model-controller-7998c67dc4-pp54t" Jul 06 01:08:55.253031 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:55.252918 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smdct\" (UniqueName: \"kubernetes.io/projected/3db998b9-c5fd-4d5f-b0c4-dc4115ccd60d-kube-api-access-smdct\") pod \"odh-model-controller-7998c67dc4-pp54t\" (UID: \"3db998b9-c5fd-4d5f-b0c4-dc4115ccd60d\") " pod="opendatahub/odh-model-controller-7998c67dc4-pp54t" Jul 06 01:08:55.255611 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:55.255585 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3db998b9-c5fd-4d5f-b0c4-dc4115ccd60d-cert\") pod \"odh-model-controller-7998c67dc4-pp54t\" (UID: \"3db998b9-c5fd-4d5f-b0c4-dc4115ccd60d\") " pod="opendatahub/odh-model-controller-7998c67dc4-pp54t" Jul 06 01:08:55.262630 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:55.262587 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smdct\" (UniqueName: \"kubernetes.io/projected/3db998b9-c5fd-4d5f-b0c4-dc4115ccd60d-kube-api-access-smdct\") pod \"odh-model-controller-7998c67dc4-pp54t\" (UID: \"3db998b9-c5fd-4d5f-b0c4-dc4115ccd60d\") " pod="opendatahub/odh-model-controller-7998c67dc4-pp54t" Jul 06 01:08:55.333336 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:55.333312 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-557bfcf777-c6dmf"] Jul 06 01:08:55.336158 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:08:55.336129 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8903edca_7fa6_423d_8d54_f9cfa83e2364.slice/crio-eed72996740a8a7b497db6f321e6b23c5a75f530671fe0ff9148552dd0128456 WatchSource:0}: Error finding container eed72996740a8a7b497db6f321e6b23c5a75f530671fe0ff9148552dd0128456: Status 404 returned error can't find the container with id eed72996740a8a7b497db6f321e6b23c5a75f530671fe0ff9148552dd0128456 Jul 06 01:08:55.395352 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:55.395321 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-pp54t" Jul 06 01:08:55.525308 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:55.525278 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-pp54t"] Jul 06 01:08:55.527778 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:08:55.527750 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3db998b9_c5fd_4d5f_b0c4_dc4115ccd60d.slice/crio-dd31aa982a46038b99070a3b10d1404259171c62d8ab39729a6e8e6202bca223 WatchSource:0}: Error finding container dd31aa982a46038b99070a3b10d1404259171c62d8ab39729a6e8e6202bca223: Status 404 returned error can't find the container with id dd31aa982a46038b99070a3b10d1404259171c62d8ab39729a6e8e6202bca223 Jul 06 01:08:55.634734 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:55.634687 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-pp54t" event={"ID":"3db998b9-c5fd-4d5f-b0c4-dc4115ccd60d","Type":"ContainerStarted","Data":"dd31aa982a46038b99070a3b10d1404259171c62d8ab39729a6e8e6202bca223"} Jul 06 01:08:55.635845 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:55.635816 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-557bfcf777-c6dmf" event={"ID":"8903edca-7fa6-423d-8d54-f9cfa83e2364","Type":"ContainerStarted","Data":"eed72996740a8a7b497db6f321e6b23c5a75f530671fe0ff9148552dd0128456"} Jul 06 01:08:55.936107 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:55.936066 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tfx2b"] Jul 06 01:08:55.939861 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:55.939828 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-tfx2b" Jul 06 01:08:55.942055 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:55.942027 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 06 01:08:55.942209 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:55.942183 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-67ppt\"" Jul 06 01:08:55.949769 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:55.949746 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tfx2b"] Jul 06 01:08:55.957468 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:55.957443 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntms6\" (UniqueName: \"kubernetes.io/projected/6a5a4eb9-521d-4d63-ae5f-b5222e99c072-kube-api-access-ntms6\") pod \"model-serving-api-54d89bd5fc-tfx2b\" (UID: \"6a5a4eb9-521d-4d63-ae5f-b5222e99c072\") " pod="opendatahub/model-serving-api-54d89bd5fc-tfx2b" Jul 06 01:08:55.957589 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:55.957481 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a5a4eb9-521d-4d63-ae5f-b5222e99c072-tls-certs\") pod \"model-serving-api-54d89bd5fc-tfx2b\" (UID: \"6a5a4eb9-521d-4d63-ae5f-b5222e99c072\") " pod="opendatahub/model-serving-api-54d89bd5fc-tfx2b" Jul 06 01:08:56.058383 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:56.058345 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntms6\" (UniqueName: \"kubernetes.io/projected/6a5a4eb9-521d-4d63-ae5f-b5222e99c072-kube-api-access-ntms6\") pod \"model-serving-api-54d89bd5fc-tfx2b\" (UID: \"6a5a4eb9-521d-4d63-ae5f-b5222e99c072\") " pod="opendatahub/model-serving-api-54d89bd5fc-tfx2b" Jul 06 01:08:56.058572 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:56.058399 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a5a4eb9-521d-4d63-ae5f-b5222e99c072-tls-certs\") pod \"model-serving-api-54d89bd5fc-tfx2b\" (UID: \"6a5a4eb9-521d-4d63-ae5f-b5222e99c072\") " pod="opendatahub/model-serving-api-54d89bd5fc-tfx2b" Jul 06 01:08:56.061336 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:56.061312 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a5a4eb9-521d-4d63-ae5f-b5222e99c072-tls-certs\") pod \"model-serving-api-54d89bd5fc-tfx2b\" (UID: \"6a5a4eb9-521d-4d63-ae5f-b5222e99c072\") " pod="opendatahub/model-serving-api-54d89bd5fc-tfx2b" Jul 06 01:08:56.067721 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:56.067696 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntms6\" (UniqueName: \"kubernetes.io/projected/6a5a4eb9-521d-4d63-ae5f-b5222e99c072-kube-api-access-ntms6\") pod \"model-serving-api-54d89bd5fc-tfx2b\" (UID: \"6a5a4eb9-521d-4d63-ae5f-b5222e99c072\") " pod="opendatahub/model-serving-api-54d89bd5fc-tfx2b" Jul 06 01:08:56.253817 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:56.253777 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-tfx2b" Jul 06 01:08:56.400039 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:56.400004 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tfx2b"] Jul 06 01:08:56.403237 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:08:56.403204 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a5a4eb9_521d_4d63_ae5f_b5222e99c072.slice/crio-bef65833e6660c862fb77782469539def59ea543c8e83dc56b5b1582f3fd42ee WatchSource:0}: Error finding container bef65833e6660c862fb77782469539def59ea543c8e83dc56b5b1582f3fd42ee: Status 404 returned error can't find the container with id bef65833e6660c862fb77782469539def59ea543c8e83dc56b5b1582f3fd42ee Jul 06 01:08:56.641891 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:08:56.641801 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-tfx2b" event={"ID":"6a5a4eb9-521d-4d63-ae5f-b5222e99c072","Type":"ContainerStarted","Data":"bef65833e6660c862fb77782469539def59ea543c8e83dc56b5b1582f3fd42ee"} Jul 06 01:09:00.665907 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:00.665871 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-tfx2b" event={"ID":"6a5a4eb9-521d-4d63-ae5f-b5222e99c072","Type":"ContainerStarted","Data":"2887b702d1d25951c61fcc3a0cb6edc66f4bda14cc057d15d3eb11d2376f71ad"} Jul 06 01:09:00.666415 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:00.666088 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-tfx2b" Jul 06 01:09:00.667500 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:00.667474 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-pp54t" event={"ID":"3db998b9-c5fd-4d5f-b0c4-dc4115ccd60d","Type":"ContainerStarted","Data":"bfc61d6e81d63543ddf2cbadb26ebcf37e9c34016e8f8a193c77ef1d796ca210"} Jul 06 01:09:00.667648 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:00.667522 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-pp54t" Jul 06 01:09:00.668927 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:00.668905 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-557bfcf777-c6dmf" event={"ID":"8903edca-7fa6-423d-8d54-f9cfa83e2364","Type":"ContainerStarted","Data":"fe666f8fef2e1ee6db09cda2e422e1905f3df700e57569d6b41209969ccecd64"} Jul 06 01:09:00.683252 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:00.683207 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-tfx2b" podStartSLOduration=2.50312454 podStartE2EDuration="5.683193788s" totalImagesPullingTime="3.180069248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:08:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:09:00.680721672 +0000 UTC m=+580.695094707" watchObservedRunningTime="2026-07-06 01:09:00.683193788 +0000 UTC m=+580.697566801" Jul 06 01:09:00.695985 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:00.695940 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-pp54t" podStartSLOduration=1.637454811 podStartE2EDuration="5.69592655s" totalImagesPullingTime="4.058471739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:08:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:09:00.694906527 +0000 UTC m=+580.709279563" watchObservedRunningTime="2026-07-06 01:09:00.69592655 +0000 UTC m=+580.710299586" Jul 06 01:09:00.711135 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:00.711083 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-557bfcf777-c6dmf" podStartSLOduration=2.4670690459999998 podStartE2EDuration="6.711068205s" totalImagesPullingTime="4.243999159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:08:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:09:00.710232408 +0000 UTC m=+580.724605444" watchObservedRunningTime="2026-07-06 01:09:00.711068205 +0000 UTC m=+580.725441240" Jul 06 01:09:01.381345 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:01.381025 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf"] Jul 06 01:09:01.384778 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:01.384755 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" Jul 06 01:09:01.387047 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:01.387019 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-9khg8\"" Jul 06 01:09:01.387230 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:01.387205 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 01:09:01.396844 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:01.396817 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf"] Jul 06 01:09:01.408837 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:01.408811 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d2e5fc4-718d-4691-8914-6c5dada44e9a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qlzsf\" (UID: \"1d2e5fc4-718d-4691-8914-6c5dada44e9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" Jul 06 01:09:01.408979 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:01.408870 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d2e5fc4-718d-4691-8914-6c5dada44e9a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qlzsf\" (UID: \"1d2e5fc4-718d-4691-8914-6c5dada44e9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" Jul 06 01:09:01.408979 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:01.408900 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d2e5fc4-718d-4691-8914-6c5dada44e9a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qlzsf\" (UID: \"1d2e5fc4-718d-4691-8914-6c5dada44e9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" Jul 06 01:09:01.408979 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:01.408923 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d2e5fc4-718d-4691-8914-6c5dada44e9a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qlzsf\" (UID: \"1d2e5fc4-718d-4691-8914-6c5dada44e9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" Jul 06 01:09:01.408979 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:01.408948 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d2e5fc4-718d-4691-8914-6c5dada44e9a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qlzsf\" (UID: \"1d2e5fc4-718d-4691-8914-6c5dada44e9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" Jul 06 01:09:01.409226 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:01.409072 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d2e5fc4-718d-4691-8914-6c5dada44e9a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qlzsf\" (UID: \"1d2e5fc4-718d-4691-8914-6c5dada44e9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" Jul 06 01:09:01.409226 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:01.409114 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d2e5fc4-718d-4691-8914-6c5dada44e9a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qlzsf\" (UID: \"1d2e5fc4-718d-4691-8914-6c5dada44e9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" Jul 06 01:09:01.409226 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:01.409145 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddhpn\" (UniqueName: \"kubernetes.io/projected/1d2e5fc4-718d-4691-8914-6c5dada44e9a-kube-api-access-ddhpn\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qlzsf\" (UID: \"1d2e5fc4-718d-4691-8914-6c5dada44e9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" Jul 06 01:09:01.409226 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:01.409175 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d2e5fc4-718d-4691-8914-6c5dada44e9a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qlzsf\" (UID: \"1d2e5fc4-718d-4691-8914-6c5dada44e9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" Jul 06 01:09:01.509757 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:01.509712 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d2e5fc4-718d-4691-8914-6c5dada44e9a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qlzsf\" (UID: \"1d2e5fc4-718d-4691-8914-6c5dada44e9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" Jul 06 01:09:01.509945 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:01.509805 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d2e5fc4-718d-4691-8914-6c5dada44e9a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qlzsf\" (UID: \"1d2e5fc4-718d-4691-8914-6c5dada44e9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" Jul 06 01:09:01.509945 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:01.509831 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d2e5fc4-718d-4691-8914-6c5dada44e9a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qlzsf\" (UID: \"1d2e5fc4-718d-4691-8914-6c5dada44e9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" Jul 06 01:09:01.509945 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:01.509855 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d2e5fc4-718d-4691-8914-6c5dada44e9a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qlzsf\" (UID: \"1d2e5fc4-718d-4691-8914-6c5dada44e9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" Jul 06 01:09:01.509945 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:01.509905 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d2e5fc4-718d-4691-8914-6c5dada44e9a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qlzsf\" (UID: \"1d2e5fc4-718d-4691-8914-6c5dada44e9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" Jul 06 01:09:01.510158 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:01.509952 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d2e5fc4-718d-4691-8914-6c5dada44e9a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qlzsf\" (UID: \"1d2e5fc4-718d-4691-8914-6c5dada44e9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" Jul 06 01:09:01.510158 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:01.509992 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d2e5fc4-718d-4691-8914-6c5dada44e9a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qlzsf\" (UID: \"1d2e5fc4-718d-4691-8914-6c5dada44e9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" Jul 06 01:09:01.510158 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:01.510020 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddhpn\" (UniqueName: \"kubernetes.io/projected/1d2e5fc4-718d-4691-8914-6c5dada44e9a-kube-api-access-ddhpn\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qlzsf\" (UID: \"1d2e5fc4-718d-4691-8914-6c5dada44e9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" Jul 06 01:09:01.510158 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:01.510049 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d2e5fc4-718d-4691-8914-6c5dada44e9a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qlzsf\" (UID: \"1d2e5fc4-718d-4691-8914-6c5dada44e9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" Jul 06 01:09:01.510364 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:01.510194 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d2e5fc4-718d-4691-8914-6c5dada44e9a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qlzsf\" (UID: \"1d2e5fc4-718d-4691-8914-6c5dada44e9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" Jul 06 01:09:01.510364 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:01.510273 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d2e5fc4-718d-4691-8914-6c5dada44e9a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qlzsf\" (UID: \"1d2e5fc4-718d-4691-8914-6c5dada44e9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" Jul 06 01:09:01.510552 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:01.510520 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d2e5fc4-718d-4691-8914-6c5dada44e9a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qlzsf\" (UID: \"1d2e5fc4-718d-4691-8914-6c5dada44e9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" Jul 06 01:09:01.510706 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:01.510623 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d2e5fc4-718d-4691-8914-6c5dada44e9a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qlzsf\" (UID: \"1d2e5fc4-718d-4691-8914-6c5dada44e9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" Jul 06 01:09:01.510706 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:01.510641 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d2e5fc4-718d-4691-8914-6c5dada44e9a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qlzsf\" (UID: \"1d2e5fc4-718d-4691-8914-6c5dada44e9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" Jul 06 01:09:01.512122 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:01.512100 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d2e5fc4-718d-4691-8914-6c5dada44e9a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qlzsf\" (UID: \"1d2e5fc4-718d-4691-8914-6c5dada44e9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" Jul 06 01:09:01.512391 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:01.512372 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d2e5fc4-718d-4691-8914-6c5dada44e9a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qlzsf\" (UID: \"1d2e5fc4-718d-4691-8914-6c5dada44e9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" Jul 06 01:09:01.525890 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:01.525862 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d2e5fc4-718d-4691-8914-6c5dada44e9a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qlzsf\" (UID: \"1d2e5fc4-718d-4691-8914-6c5dada44e9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" Jul 06 01:09:01.525999 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:01.525925 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddhpn\" (UniqueName: \"kubernetes.io/projected/1d2e5fc4-718d-4691-8914-6c5dada44e9a-kube-api-access-ddhpn\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678qlzsf\" (UID: \"1d2e5fc4-718d-4691-8914-6c5dada44e9a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" Jul 06 01:09:01.695873 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:01.695772 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" Jul 06 01:09:01.840106 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:01.840078 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf"] Jul 06 01:09:01.841916 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:09:01.841891 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d2e5fc4_718d_4691_8914_6c5dada44e9a.slice/crio-3b602f27b119b2fb4aa81445e83dbc968778f98ceddda90cdc705c9096360c36 WatchSource:0}: Error finding container 3b602f27b119b2fb4aa81445e83dbc968778f98ceddda90cdc705c9096360c36: Status 404 returned error can't find the container with id 3b602f27b119b2fb4aa81445e83dbc968778f98ceddda90cdc705c9096360c36 Jul 06 01:09:02.682799 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:02.682762 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" event={"ID":"1d2e5fc4-718d-4691-8914-6c5dada44e9a","Type":"ContainerStarted","Data":"3b602f27b119b2fb4aa81445e83dbc968778f98ceddda90cdc705c9096360c36"} Jul 06 01:09:03.357201 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:03.357153 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq8sx"] Jul 06 01:09:03.360781 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:03.360751 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq8sx" Jul 06 01:09:03.363455 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:03.363430 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 06 01:09:03.363580 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:03.363544 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 06 01:09:03.363638 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:03.363578 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 06 01:09:03.363890 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:03.363873 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-4trpw\"" Jul 06 01:09:03.372112 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:03.372087 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq8sx"] Jul 06 01:09:03.429003 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:03.428874 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1fc29533-1e75-4221-8c94-f489e17c0681-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-jq8sx\" (UID: \"1fc29533-1e75-4221-8c94-f489e17c0681\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq8sx" Jul 06 01:09:03.429218 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:03.429171 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzm6m\" (UniqueName: \"kubernetes.io/projected/1fc29533-1e75-4221-8c94-f489e17c0681-kube-api-access-bzm6m\") pod \"istiod-openshift-gateway-94bb8fbfd-jq8sx\" (UID: \"1fc29533-1e75-4221-8c94-f489e17c0681\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq8sx" Jul 06 01:09:03.429492 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:03.429432 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1fc29533-1e75-4221-8c94-f489e17c0681-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-jq8sx\" (UID: \"1fc29533-1e75-4221-8c94-f489e17c0681\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq8sx" Jul 06 01:09:03.429623 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:03.429559 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1fc29533-1e75-4221-8c94-f489e17c0681-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-jq8sx\" (UID: \"1fc29533-1e75-4221-8c94-f489e17c0681\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq8sx" Jul 06 01:09:03.429707 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:03.429624 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fc29533-1e75-4221-8c94-f489e17c0681-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-jq8sx\" (UID: \"1fc29533-1e75-4221-8c94-f489e17c0681\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq8sx" Jul 06 01:09:03.429707 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:03.429647 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1fc29533-1e75-4221-8c94-f489e17c0681-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-jq8sx\" (UID: \"1fc29533-1e75-4221-8c94-f489e17c0681\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq8sx" Jul 06 01:09:03.429825 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:03.429734 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fc29533-1e75-4221-8c94-f489e17c0681-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-jq8sx\" (UID: \"1fc29533-1e75-4221-8c94-f489e17c0681\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq8sx" Jul 06 01:09:03.531143 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:03.531102 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1fc29533-1e75-4221-8c94-f489e17c0681-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-jq8sx\" (UID: \"1fc29533-1e75-4221-8c94-f489e17c0681\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq8sx" Jul 06 01:09:03.531334 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:03.531151 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fc29533-1e75-4221-8c94-f489e17c0681-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-jq8sx\" (UID: \"1fc29533-1e75-4221-8c94-f489e17c0681\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq8sx" Jul 06 01:09:03.531334 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:03.531270 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1fc29533-1e75-4221-8c94-f489e17c0681-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-jq8sx\" (UID: \"1fc29533-1e75-4221-8c94-f489e17c0681\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq8sx" Jul 06 01:09:03.531455 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:03.531336 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fc29533-1e75-4221-8c94-f489e17c0681-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-jq8sx\" (UID: \"1fc29533-1e75-4221-8c94-f489e17c0681\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq8sx" Jul 06 01:09:03.531455 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:03.531404 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1fc29533-1e75-4221-8c94-f489e17c0681-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-jq8sx\" (UID: \"1fc29533-1e75-4221-8c94-f489e17c0681\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq8sx" Jul 06 01:09:03.531455 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:03.531451 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzm6m\" (UniqueName: \"kubernetes.io/projected/1fc29533-1e75-4221-8c94-f489e17c0681-kube-api-access-bzm6m\") pod \"istiod-openshift-gateway-94bb8fbfd-jq8sx\" (UID: \"1fc29533-1e75-4221-8c94-f489e17c0681\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq8sx" Jul 06 01:09:03.531608 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:03.531501 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1fc29533-1e75-4221-8c94-f489e17c0681-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-jq8sx\" (UID: \"1fc29533-1e75-4221-8c94-f489e17c0681\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq8sx" Jul 06 01:09:03.532444 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:03.532340 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1fc29533-1e75-4221-8c94-f489e17c0681-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-jq8sx\" (UID: \"1fc29533-1e75-4221-8c94-f489e17c0681\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq8sx" Jul 06 01:09:03.533981 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:03.533953 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1fc29533-1e75-4221-8c94-f489e17c0681-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-jq8sx\" (UID: \"1fc29533-1e75-4221-8c94-f489e17c0681\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq8sx" Jul 06 01:09:03.534317 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:03.534294 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1fc29533-1e75-4221-8c94-f489e17c0681-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-jq8sx\" (UID: \"1fc29533-1e75-4221-8c94-f489e17c0681\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq8sx" Jul 06 01:09:03.534394 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:03.534374 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1fc29533-1e75-4221-8c94-f489e17c0681-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-jq8sx\" (UID: \"1fc29533-1e75-4221-8c94-f489e17c0681\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq8sx" Jul 06 01:09:03.534488 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:03.534469 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fc29533-1e75-4221-8c94-f489e17c0681-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-jq8sx\" (UID: \"1fc29533-1e75-4221-8c94-f489e17c0681\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq8sx" Jul 06 01:09:03.539880 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:03.539855 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzm6m\" (UniqueName: \"kubernetes.io/projected/1fc29533-1e75-4221-8c94-f489e17c0681-kube-api-access-bzm6m\") pod \"istiod-openshift-gateway-94bb8fbfd-jq8sx\" (UID: \"1fc29533-1e75-4221-8c94-f489e17c0681\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq8sx" Jul 06 01:09:03.540039 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:03.540019 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fc29533-1e75-4221-8c94-f489e17c0681-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-jq8sx\" (UID: \"1fc29533-1e75-4221-8c94-f489e17c0681\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq8sx" Jul 06 01:09:03.672406 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:03.672308 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq8sx" Jul 06 01:09:03.840302 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:03.840225 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq8sx"] Jul 06 01:09:04.799838 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:09:04.799781 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fc29533_1e75_4221_8c94_f489e17c0681.slice/crio-867b2bee5614674135befa40de590f6569bb676a12f8e264f8baec5258bc987a WatchSource:0}: Error finding container 867b2bee5614674135befa40de590f6569bb676a12f8e264f8baec5258bc987a: Status 404 returned error can't find the container with id 867b2bee5614674135befa40de590f6569bb676a12f8e264f8baec5258bc987a Jul 06 01:09:04.863422 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:04.863381 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 06 01:09:04.863521 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:04.863460 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 06 01:09:04.863521 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:04.863491 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 06 01:09:05.339571 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:05.339536 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dhqht"] Jul 06 01:09:05.342829 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:05.342806 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dhqht" Jul 06 01:09:05.345213 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:05.345188 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-nhwnf\"" Jul 06 01:09:05.345213 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:05.345200 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 06 01:09:05.345566 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:05.345546 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-q26sx"] Jul 06 01:09:05.348955 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:05.348933 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-q26sx" Jul 06 01:09:05.352556 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:05.351590 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 06 01:09:05.352556 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:05.351860 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-mwvp5\"" Jul 06 01:09:05.353244 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:05.353217 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dhqht"] Jul 06 01:09:05.371290 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:05.371241 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-q26sx"] Jul 06 01:09:05.448231 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:05.448191 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fxqn\" (UniqueName: \"kubernetes.io/projected/704bbd8f-64ae-4fb0-a0f9-56aeca2b0b52-kube-api-access-6fxqn\") pod \"kserve-controller-manager-d6f4b65b8-dhqht\" (UID: \"704bbd8f-64ae-4fb0-a0f9-56aeca2b0b52\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dhqht" Jul 06 01:09:05.448408 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:05.448246 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/704bbd8f-64ae-4fb0-a0f9-56aeca2b0b52-cert\") pod \"kserve-controller-manager-d6f4b65b8-dhqht\" (UID: \"704bbd8f-64ae-4fb0-a0f9-56aeca2b0b52\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dhqht" Jul 06 01:09:05.448408 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:05.448264 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7wfs\" (UniqueName: \"kubernetes.io/projected/c55a933a-9e16-4999-b294-316a1fd4f9d9-kube-api-access-j7wfs\") pod \"llmisvc-controller-manager-777c6bd7d5-q26sx\" (UID: \"c55a933a-9e16-4999-b294-316a1fd4f9d9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-q26sx" Jul 06 01:09:05.448408 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:05.448371 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c55a933a-9e16-4999-b294-316a1fd4f9d9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-q26sx\" (UID: \"c55a933a-9e16-4999-b294-316a1fd4f9d9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-q26sx" Jul 06 01:09:05.549030 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:05.548989 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/704bbd8f-64ae-4fb0-a0f9-56aeca2b0b52-cert\") pod \"kserve-controller-manager-d6f4b65b8-dhqht\" (UID: \"704bbd8f-64ae-4fb0-a0f9-56aeca2b0b52\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dhqht" Jul 06 01:09:05.549206 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:05.549040 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7wfs\" (UniqueName: \"kubernetes.io/projected/c55a933a-9e16-4999-b294-316a1fd4f9d9-kube-api-access-j7wfs\") pod \"llmisvc-controller-manager-777c6bd7d5-q26sx\" (UID: \"c55a933a-9e16-4999-b294-316a1fd4f9d9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-q26sx" Jul 06 01:09:05.549206 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:09:05.549170 2553 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 06 01:09:05.549291 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:09:05.549245 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/704bbd8f-64ae-4fb0-a0f9-56aeca2b0b52-cert podName:704bbd8f-64ae-4fb0-a0f9-56aeca2b0b52 nodeName:}" failed. No retries permitted until 2026-07-06 01:09:06.04922072 +0000 UTC m=+586.063593751 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/704bbd8f-64ae-4fb0-a0f9-56aeca2b0b52-cert") pod "kserve-controller-manager-d6f4b65b8-dhqht" (UID: "704bbd8f-64ae-4fb0-a0f9-56aeca2b0b52") : secret "kserve-webhook-server-cert" not found Jul 06 01:09:05.549453 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:05.549426 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c55a933a-9e16-4999-b294-316a1fd4f9d9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-q26sx\" (UID: \"c55a933a-9e16-4999-b294-316a1fd4f9d9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-q26sx" Jul 06 01:09:05.549538 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:05.549470 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fxqn\" (UniqueName: \"kubernetes.io/projected/704bbd8f-64ae-4fb0-a0f9-56aeca2b0b52-kube-api-access-6fxqn\") pod \"kserve-controller-manager-d6f4b65b8-dhqht\" (UID: \"704bbd8f-64ae-4fb0-a0f9-56aeca2b0b52\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dhqht" Jul 06 01:09:05.549603 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:09:05.549583 2553 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 06 01:09:05.549684 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:09:05.549646 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c55a933a-9e16-4999-b294-316a1fd4f9d9-cert podName:c55a933a-9e16-4999-b294-316a1fd4f9d9 nodeName:}" failed. No retries permitted until 2026-07-06 01:09:06.049628196 +0000 UTC m=+586.064001211 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c55a933a-9e16-4999-b294-316a1fd4f9d9-cert") pod "llmisvc-controller-manager-777c6bd7d5-q26sx" (UID: "c55a933a-9e16-4999-b294-316a1fd4f9d9") : secret "llmisvc-webhook-server-cert" not found Jul 06 01:09:05.558799 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:05.558767 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7wfs\" (UniqueName: \"kubernetes.io/projected/c55a933a-9e16-4999-b294-316a1fd4f9d9-kube-api-access-j7wfs\") pod \"llmisvc-controller-manager-777c6bd7d5-q26sx\" (UID: \"c55a933a-9e16-4999-b294-316a1fd4f9d9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-q26sx" Jul 06 01:09:05.558928 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:05.558882 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fxqn\" (UniqueName: \"kubernetes.io/projected/704bbd8f-64ae-4fb0-a0f9-56aeca2b0b52-kube-api-access-6fxqn\") pod \"kserve-controller-manager-d6f4b65b8-dhqht\" (UID: \"704bbd8f-64ae-4fb0-a0f9-56aeca2b0b52\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dhqht" Jul 06 01:09:05.702921 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:05.702824 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" event={"ID":"1d2e5fc4-718d-4691-8914-6c5dada44e9a","Type":"ContainerStarted","Data":"6f1dbecdb77e10afe8d04aaf30dc5123982f4d5d619b8d09fd435fb5fb785c02"} Jul 06 01:09:05.704051 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:05.704025 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq8sx" event={"ID":"1fc29533-1e75-4221-8c94-f489e17c0681","Type":"ContainerStarted","Data":"867b2bee5614674135befa40de590f6569bb676a12f8e264f8baec5258bc987a"} Jul 06 01:09:05.766943 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:05.766886 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" podStartSLOduration=1.7477882660000001 podStartE2EDuration="4.766870079s" totalImagesPullingTime="3.019081813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:09:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:09:05.764141258 +0000 UTC m=+585.778514294" watchObservedRunningTime="2026-07-06 01:09:05.766870079 +0000 UTC m=+585.781243115" Jul 06 01:09:06.055165 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:06.055127 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/704bbd8f-64ae-4fb0-a0f9-56aeca2b0b52-cert\") pod \"kserve-controller-manager-d6f4b65b8-dhqht\" (UID: \"704bbd8f-64ae-4fb0-a0f9-56aeca2b0b52\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dhqht" Jul 06 01:09:06.055534 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:06.055216 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c55a933a-9e16-4999-b294-316a1fd4f9d9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-q26sx\" (UID: \"c55a933a-9e16-4999-b294-316a1fd4f9d9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-q26sx" Jul 06 01:09:06.057526 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:06.057502 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/704bbd8f-64ae-4fb0-a0f9-56aeca2b0b52-cert\") pod \"kserve-controller-manager-d6f4b65b8-dhqht\" (UID: \"704bbd8f-64ae-4fb0-a0f9-56aeca2b0b52\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dhqht" Jul 06 01:09:06.057638 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:06.057560 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c55a933a-9e16-4999-b294-316a1fd4f9d9-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-q26sx\" (UID: \"c55a933a-9e16-4999-b294-316a1fd4f9d9\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-q26sx" Jul 06 01:09:06.257578 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:06.257542 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dhqht" Jul 06 01:09:06.264731 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:06.264712 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-q26sx" Jul 06 01:09:06.403654 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:06.403626 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dhqht"] Jul 06 01:09:06.406243 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:09:06.406204 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod704bbd8f_64ae_4fb0_a0f9_56aeca2b0b52.slice/crio-26b6d1a64e7204b6f0b814a3fb4757dc0b74dcee5085d280bf10fef8f70eae10 WatchSource:0}: Error finding container 26b6d1a64e7204b6f0b814a3fb4757dc0b74dcee5085d280bf10fef8f70eae10: Status 404 returned error can't find the container with id 26b6d1a64e7204b6f0b814a3fb4757dc0b74dcee5085d280bf10fef8f70eae10 Jul 06 01:09:06.428301 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:06.428278 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-q26sx"] Jul 06 01:09:06.430407 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:09:06.430373 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc55a933a_9e16_4999_b294_316a1fd4f9d9.slice/crio-c8a712e52ff5352d339ff8eb7b6ded3dfdea53dad60ae09985a320fefa0afafd WatchSource:0}: Error finding container c8a712e52ff5352d339ff8eb7b6ded3dfdea53dad60ae09985a320fefa0afafd: Status 404 returned error can't find the container with id c8a712e52ff5352d339ff8eb7b6ded3dfdea53dad60ae09985a320fefa0afafd Jul 06 01:09:06.696731 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:06.696626 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" Jul 06 01:09:06.701173 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:06.701148 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" Jul 06 01:09:06.709480 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:06.709449 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dhqht" event={"ID":"704bbd8f-64ae-4fb0-a0f9-56aeca2b0b52","Type":"ContainerStarted","Data":"26b6d1a64e7204b6f0b814a3fb4757dc0b74dcee5085d280bf10fef8f70eae10"} Jul 06 01:09:06.710599 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:06.710577 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-q26sx" event={"ID":"c55a933a-9e16-4999-b294-316a1fd4f9d9","Type":"ContainerStarted","Data":"c8a712e52ff5352d339ff8eb7b6ded3dfdea53dad60ae09985a320fefa0afafd"} Jul 06 01:09:06.710784 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:06.710768 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" Jul 06 01:09:06.711605 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:06.711589 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678qlzsf" Jul 06 01:09:09.731423 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:09.731389 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dhqht" event={"ID":"704bbd8f-64ae-4fb0-a0f9-56aeca2b0b52","Type":"ContainerStarted","Data":"b6d6272896a64ba1e14531adc47e9accb4b0c2d1256d6bf49872beab4bad881d"} Jul 06 01:09:09.731816 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:09.731517 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dhqht" Jul 06 01:09:09.746606 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:09.746558 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dhqht" podStartSLOduration=2.092187564 podStartE2EDuration="4.746542732s" totalImagesPullingTime="2.654355168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:09:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:09:09.745392264 +0000 UTC m=+589.759765299" watchObservedRunningTime="2026-07-06 01:09:09.746542732 +0000 UTC m=+589.760915746" Jul 06 01:09:10.737652 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:10.737614 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-q26sx" event={"ID":"c55a933a-9e16-4999-b294-316a1fd4f9d9","Type":"ContainerStarted","Data":"d16f2d8f1db642fd67bd47e7bb7fc2e0c605ca3df18d990a4ef872e0f1b3e458"} Jul 06 01:09:10.738171 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:10.737825 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-q26sx" Jul 06 01:09:10.753483 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:10.753423 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-q26sx" podStartSLOduration=2.407137344 podStartE2EDuration="5.753404955s" totalImagesPullingTime="3.346267611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:09:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:09:10.752941074 +0000 UTC m=+590.767314109" watchObservedRunningTime="2026-07-06 01:09:10.753404955 +0000 UTC m=+590.767777991" Jul 06 01:09:11.678686 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:11.678641 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-pp54t" Jul 06 01:09:11.680414 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:11.680394 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-tfx2b" Jul 06 01:09:20.411630 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:20.411551 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-znllg_789b12fb-c3d0-428d-838c-f29718e69e2c/console-operator/1.log" Jul 06 01:09:20.412660 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:20.412637 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-znllg_789b12fb-c3d0-428d-838c-f29718e69e2c/console-operator/1.log" Jul 06 01:09:25.695090 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:25.694347 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 06 01:09:25.695090 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:25.694426 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 06 01:09:25.813446 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:25.813393 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq8sx" event={"ID":"1fc29533-1e75-4221-8c94-f489e17c0681","Type":"ContainerStarted","Data":"35c469f47534aacbeef171b5eb2b8984bc994003812691e9ad776a4a574cfd28"} Jul 06 01:09:25.813655 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:25.813519 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq8sx" Jul 06 01:09:25.836374 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:25.836313 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq8sx" podStartSLOduration=1.945260138 podStartE2EDuration="22.836292597s" totalImagesPullingTime="20.891032459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:09:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:09:25.833494342 +0000 UTC m=+605.847867369" watchObservedRunningTime="2026-07-06 01:09:25.836292597 +0000 UTC m=+605.850665633" Jul 06 01:09:26.820313 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:26.820278 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-jq8sx" Jul 06 01:09:40.742814 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:40.742778 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dhqht" Jul 06 01:09:41.746395 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:09:41.746361 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-q26sx" Jul 06 01:10:11.540202 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:11.540163 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85"] Jul 06 01:10:11.548715 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:11.548693 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85" Jul 06 01:10:11.551916 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:11.551887 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 01:10:11.552475 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:11.552452 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-c5ldt\"" Jul 06 01:10:11.552583 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:11.552527 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 01:10:11.553586 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:11.553562 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85"] Jul 06 01:10:11.649892 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:11.649854 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp4m7\" (UniqueName: \"kubernetes.io/projected/690269c5-6c7b-468e-a662-fd8d63006539-kube-api-access-xp4m7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85\" (UID: \"690269c5-6c7b-468e-a662-fd8d63006539\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85" Jul 06 01:10:11.650069 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:11.649915 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/690269c5-6c7b-468e-a662-fd8d63006539-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85\" (UID: \"690269c5-6c7b-468e-a662-fd8d63006539\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85" Jul 06 01:10:11.650069 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:11.649949 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/690269c5-6c7b-468e-a662-fd8d63006539-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85\" (UID: \"690269c5-6c7b-468e-a662-fd8d63006539\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85" Jul 06 01:10:11.750931 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:11.750894 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp4m7\" (UniqueName: \"kubernetes.io/projected/690269c5-6c7b-468e-a662-fd8d63006539-kube-api-access-xp4m7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85\" (UID: \"690269c5-6c7b-468e-a662-fd8d63006539\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85" Jul 06 01:10:11.751110 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:11.750958 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/690269c5-6c7b-468e-a662-fd8d63006539-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85\" (UID: \"690269c5-6c7b-468e-a662-fd8d63006539\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85" Jul 06 01:10:11.751110 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:11.750993 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/690269c5-6c7b-468e-a662-fd8d63006539-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85\" (UID: \"690269c5-6c7b-468e-a662-fd8d63006539\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85" Jul 06 01:10:11.751327 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:11.751308 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/690269c5-6c7b-468e-a662-fd8d63006539-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85\" (UID: \"690269c5-6c7b-468e-a662-fd8d63006539\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85" Jul 06 01:10:11.751366 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:11.751356 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/690269c5-6c7b-468e-a662-fd8d63006539-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85\" (UID: \"690269c5-6c7b-468e-a662-fd8d63006539\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85" Jul 06 01:10:11.759982 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:11.759959 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp4m7\" (UniqueName: \"kubernetes.io/projected/690269c5-6c7b-468e-a662-fd8d63006539-kube-api-access-xp4m7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85\" (UID: \"690269c5-6c7b-468e-a662-fd8d63006539\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85" Jul 06 01:10:11.859294 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:11.859211 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85" Jul 06 01:10:11.994272 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:11.994250 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85"] Jul 06 01:10:11.995859 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:10:11.995835 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod690269c5_6c7b_468e_a662_fd8d63006539.slice/crio-baf5a40a3d153059d66bc79aed497d8d2b79d9725959a2c118ca2b6cffa15ddf WatchSource:0}: Error finding container baf5a40a3d153059d66bc79aed497d8d2b79d9725959a2c118ca2b6cffa15ddf: Status 404 returned error can't find the container with id baf5a40a3d153059d66bc79aed497d8d2b79d9725959a2c118ca2b6cffa15ddf Jul 06 01:10:12.045633 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:12.045608 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85" event={"ID":"690269c5-6c7b-468e-a662-fd8d63006539","Type":"ContainerStarted","Data":"baf5a40a3d153059d66bc79aed497d8d2b79d9725959a2c118ca2b6cffa15ddf"} Jul 06 01:10:12.331325 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:12.331292 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv"] Jul 06 01:10:12.334962 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:12.334945 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv" Jul 06 01:10:12.343457 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:12.343432 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv"] Jul 06 01:10:12.458059 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:12.458021 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d2020dc-4327-463a-b3f5-08dd93d88338-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv\" (UID: \"2d2020dc-4327-463a-b3f5-08dd93d88338\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv" Jul 06 01:10:12.458241 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:12.458106 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d2020dc-4327-463a-b3f5-08dd93d88338-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv\" (UID: \"2d2020dc-4327-463a-b3f5-08dd93d88338\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv" Jul 06 01:10:12.458241 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:12.458131 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvtdd\" (UniqueName: \"kubernetes.io/projected/2d2020dc-4327-463a-b3f5-08dd93d88338-kube-api-access-gvtdd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv\" (UID: \"2d2020dc-4327-463a-b3f5-08dd93d88338\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv" Jul 06 01:10:12.558745 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:12.558699 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d2020dc-4327-463a-b3f5-08dd93d88338-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv\" (UID: \"2d2020dc-4327-463a-b3f5-08dd93d88338\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv" Jul 06 01:10:12.558745 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:12.558759 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvtdd\" (UniqueName: \"kubernetes.io/projected/2d2020dc-4327-463a-b3f5-08dd93d88338-kube-api-access-gvtdd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv\" (UID: \"2d2020dc-4327-463a-b3f5-08dd93d88338\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv" Jul 06 01:10:12.559174 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:12.558817 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d2020dc-4327-463a-b3f5-08dd93d88338-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv\" (UID: \"2d2020dc-4327-463a-b3f5-08dd93d88338\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv" Jul 06 01:10:12.559174 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:12.559117 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d2020dc-4327-463a-b3f5-08dd93d88338-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv\" (UID: \"2d2020dc-4327-463a-b3f5-08dd93d88338\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv" Jul 06 01:10:12.559174 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:12.559154 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d2020dc-4327-463a-b3f5-08dd93d88338-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv\" (UID: \"2d2020dc-4327-463a-b3f5-08dd93d88338\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv" Jul 06 01:10:12.567123 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:12.567092 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvtdd\" (UniqueName: \"kubernetes.io/projected/2d2020dc-4327-463a-b3f5-08dd93d88338-kube-api-access-gvtdd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv\" (UID: \"2d2020dc-4327-463a-b3f5-08dd93d88338\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv" Jul 06 01:10:12.645331 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:12.645246 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv" Jul 06 01:10:12.778992 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:12.778964 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv"] Jul 06 01:10:12.780952 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:10:12.780925 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d2020dc_4327_463a_b3f5_08dd93d88338.slice/crio-4eefb4fe4c77846af73e5f048a41051f95b038a717014a83ebe34792580636d8 WatchSource:0}: Error finding container 4eefb4fe4c77846af73e5f048a41051f95b038a717014a83ebe34792580636d8: Status 404 returned error can't find the container with id 4eefb4fe4c77846af73e5f048a41051f95b038a717014a83ebe34792580636d8 Jul 06 01:10:12.933584 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:12.933503 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s"] Jul 06 01:10:12.937132 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:12.937114 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s" Jul 06 01:10:12.944598 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:12.944563 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s"] Jul 06 01:10:13.052711 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:13.052678 2553 generic.go:356] "Generic (PLEG): container finished" podID="690269c5-6c7b-468e-a662-fd8d63006539" containerID="946a5d447595bc010a47ccc4830c7365291a9fb2f98ac3690348f1d78a5989cb" exitCode=0 Jul 06 01:10:13.052900 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:13.052754 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85" event={"ID":"690269c5-6c7b-468e-a662-fd8d63006539","Type":"ContainerDied","Data":"946a5d447595bc010a47ccc4830c7365291a9fb2f98ac3690348f1d78a5989cb"} Jul 06 01:10:13.054419 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:13.054399 2553 generic.go:356] "Generic (PLEG): container finished" podID="2d2020dc-4327-463a-b3f5-08dd93d88338" containerID="cccc4cbeb531bbfbeb7898145c014aed20a1df72a04de8e9d1799c52b47b2579" exitCode=0 Jul 06 01:10:13.054523 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:13.054473 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv" event={"ID":"2d2020dc-4327-463a-b3f5-08dd93d88338","Type":"ContainerDied","Data":"cccc4cbeb531bbfbeb7898145c014aed20a1df72a04de8e9d1799c52b47b2579"} Jul 06 01:10:13.054523 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:13.054513 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv" event={"ID":"2d2020dc-4327-463a-b3f5-08dd93d88338","Type":"ContainerStarted","Data":"4eefb4fe4c77846af73e5f048a41051f95b038a717014a83ebe34792580636d8"} Jul 06 01:10:13.063003 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:13.062981 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abb5cdd6-5790-4a3f-8bec-7fc2ef718234-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s\" (UID: \"abb5cdd6-5790-4a3f-8bec-7fc2ef718234\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s" Jul 06 01:10:13.063109 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:13.063014 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abb5cdd6-5790-4a3f-8bec-7fc2ef718234-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s\" (UID: \"abb5cdd6-5790-4a3f-8bec-7fc2ef718234\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s" Jul 06 01:10:13.063109 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:13.063048 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbs7j\" (UniqueName: \"kubernetes.io/projected/abb5cdd6-5790-4a3f-8bec-7fc2ef718234-kube-api-access-hbs7j\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s\" (UID: \"abb5cdd6-5790-4a3f-8bec-7fc2ef718234\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s" Jul 06 01:10:13.163576 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:13.163531 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abb5cdd6-5790-4a3f-8bec-7fc2ef718234-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s\" (UID: \"abb5cdd6-5790-4a3f-8bec-7fc2ef718234\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s" Jul 06 01:10:13.163801 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:13.163619 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbs7j\" (UniqueName: \"kubernetes.io/projected/abb5cdd6-5790-4a3f-8bec-7fc2ef718234-kube-api-access-hbs7j\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s\" (UID: \"abb5cdd6-5790-4a3f-8bec-7fc2ef718234\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s" Jul 06 01:10:13.163801 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:13.163756 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abb5cdd6-5790-4a3f-8bec-7fc2ef718234-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s\" (UID: \"abb5cdd6-5790-4a3f-8bec-7fc2ef718234\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s" Jul 06 01:10:13.164025 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:13.164001 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abb5cdd6-5790-4a3f-8bec-7fc2ef718234-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s\" (UID: \"abb5cdd6-5790-4a3f-8bec-7fc2ef718234\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s" Jul 06 01:10:13.164099 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:13.164080 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abb5cdd6-5790-4a3f-8bec-7fc2ef718234-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s\" (UID: \"abb5cdd6-5790-4a3f-8bec-7fc2ef718234\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s" Jul 06 01:10:13.171870 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:13.171847 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbs7j\" (UniqueName: \"kubernetes.io/projected/abb5cdd6-5790-4a3f-8bec-7fc2ef718234-kube-api-access-hbs7j\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s\" (UID: \"abb5cdd6-5790-4a3f-8bec-7fc2ef718234\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s" Jul 06 01:10:13.258847 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:13.258812 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s" Jul 06 01:10:13.334786 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:13.334690 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528"] Jul 06 01:10:13.338648 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:13.338631 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528" Jul 06 01:10:13.347947 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:13.347686 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528"] Jul 06 01:10:13.394645 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:13.394615 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s"] Jul 06 01:10:13.395552 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:10:13.395531 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabb5cdd6_5790_4a3f_8bec_7fc2ef718234.slice/crio-e8e39e2a68933e9c49c5bdb8c9ee0f170552e90574358f9f24c02958a353df4f WatchSource:0}: Error finding container e8e39e2a68933e9c49c5bdb8c9ee0f170552e90574358f9f24c02958a353df4f: Status 404 returned error can't find the container with id e8e39e2a68933e9c49c5bdb8c9ee0f170552e90574358f9f24c02958a353df4f Jul 06 01:10:13.466926 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:13.466884 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c0f901e-5c81-488c-9938-ff0c967ff4d6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528\" (UID: \"3c0f901e-5c81-488c-9938-ff0c967ff4d6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528" Jul 06 01:10:13.467057 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:13.466949 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c0f901e-5c81-488c-9938-ff0c967ff4d6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528\" (UID: \"3c0f901e-5c81-488c-9938-ff0c967ff4d6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528" Jul 06 01:10:13.467057 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:13.467000 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frdwz\" (UniqueName: \"kubernetes.io/projected/3c0f901e-5c81-488c-9938-ff0c967ff4d6-kube-api-access-frdwz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528\" (UID: \"3c0f901e-5c81-488c-9938-ff0c967ff4d6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528" Jul 06 01:10:13.567523 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:13.567439 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c0f901e-5c81-488c-9938-ff0c967ff4d6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528\" (UID: \"3c0f901e-5c81-488c-9938-ff0c967ff4d6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528" Jul 06 01:10:13.567523 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:13.567482 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c0f901e-5c81-488c-9938-ff0c967ff4d6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528\" (UID: \"3c0f901e-5c81-488c-9938-ff0c967ff4d6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528" Jul 06 01:10:13.567942 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:13.567525 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frdwz\" (UniqueName: \"kubernetes.io/projected/3c0f901e-5c81-488c-9938-ff0c967ff4d6-kube-api-access-frdwz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528\" (UID: \"3c0f901e-5c81-488c-9938-ff0c967ff4d6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528" Jul 06 01:10:13.567942 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:13.567804 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c0f901e-5c81-488c-9938-ff0c967ff4d6-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528\" (UID: \"3c0f901e-5c81-488c-9938-ff0c967ff4d6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528" Jul 06 01:10:13.567942 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:13.567852 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c0f901e-5c81-488c-9938-ff0c967ff4d6-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528\" (UID: \"3c0f901e-5c81-488c-9938-ff0c967ff4d6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528" Jul 06 01:10:13.575975 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:13.575955 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frdwz\" (UniqueName: \"kubernetes.io/projected/3c0f901e-5c81-488c-9938-ff0c967ff4d6-kube-api-access-frdwz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528\" (UID: \"3c0f901e-5c81-488c-9938-ff0c967ff4d6\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528" Jul 06 01:10:13.651651 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:13.651611 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528" Jul 06 01:10:13.789348 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:13.789324 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528"] Jul 06 01:10:13.859155 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:10:13.859080 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c0f901e_5c81_488c_9938_ff0c967ff4d6.slice/crio-66c6ea9b883716fb42b20cee1d2602b38724ab61f0b3c0a75263a4a71fa48504 WatchSource:0}: Error finding container 66c6ea9b883716fb42b20cee1d2602b38724ab61f0b3c0a75263a4a71fa48504: Status 404 returned error can't find the container with id 66c6ea9b883716fb42b20cee1d2602b38724ab61f0b3c0a75263a4a71fa48504 Jul 06 01:10:14.063353 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:14.063317 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85" event={"ID":"690269c5-6c7b-468e-a662-fd8d63006539","Type":"ContainerStarted","Data":"a71b726a5d33f1f074fa224572cc9a1b3e23c578cf639e7ec3715d49de939011"} Jul 06 01:10:14.065698 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:14.065643 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv" event={"ID":"2d2020dc-4327-463a-b3f5-08dd93d88338","Type":"ContainerStarted","Data":"39ee8bab2bb3f5620eacb19c36693634e3e361d2cb30dc61e18b560e61c5f5ca"} Jul 06 01:10:14.067744 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:14.067715 2553 generic.go:356] "Generic (PLEG): container finished" podID="abb5cdd6-5790-4a3f-8bec-7fc2ef718234" containerID="91405b53d44ce651a5ca5dd7aeb61a31118011ff2dbeb518a4751ace47ff3422" exitCode=0 Jul 06 01:10:14.067911 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:14.067859 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s" event={"ID":"abb5cdd6-5790-4a3f-8bec-7fc2ef718234","Type":"ContainerDied","Data":"91405b53d44ce651a5ca5dd7aeb61a31118011ff2dbeb518a4751ace47ff3422"} Jul 06 01:10:14.067911 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:14.067895 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s" event={"ID":"abb5cdd6-5790-4a3f-8bec-7fc2ef718234","Type":"ContainerStarted","Data":"e8e39e2a68933e9c49c5bdb8c9ee0f170552e90574358f9f24c02958a353df4f"} Jul 06 01:10:14.070641 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:14.070615 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528" event={"ID":"3c0f901e-5c81-488c-9938-ff0c967ff4d6","Type":"ContainerStarted","Data":"31d3d47a6868c0cbe6764f36ed2f8a7a7d31e699e522f88bd3a31888c38f4590"} Jul 06 01:10:14.070754 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:14.070697 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528" event={"ID":"3c0f901e-5c81-488c-9938-ff0c967ff4d6","Type":"ContainerStarted","Data":"66c6ea9b883716fb42b20cee1d2602b38724ab61f0b3c0a75263a4a71fa48504"} Jul 06 01:10:15.077412 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:15.077326 2553 generic.go:356] "Generic (PLEG): container finished" podID="690269c5-6c7b-468e-a662-fd8d63006539" containerID="a71b726a5d33f1f074fa224572cc9a1b3e23c578cf639e7ec3715d49de939011" exitCode=0 Jul 06 01:10:15.077886 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:15.077411 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85" event={"ID":"690269c5-6c7b-468e-a662-fd8d63006539","Type":"ContainerDied","Data":"a71b726a5d33f1f074fa224572cc9a1b3e23c578cf639e7ec3715d49de939011"} Jul 06 01:10:15.079392 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:15.079370 2553 generic.go:356] "Generic (PLEG): container finished" podID="2d2020dc-4327-463a-b3f5-08dd93d88338" containerID="39ee8bab2bb3f5620eacb19c36693634e3e361d2cb30dc61e18b560e61c5f5ca" exitCode=0 Jul 06 01:10:15.079467 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:15.079450 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv" event={"ID":"2d2020dc-4327-463a-b3f5-08dd93d88338","Type":"ContainerDied","Data":"39ee8bab2bb3f5620eacb19c36693634e3e361d2cb30dc61e18b560e61c5f5ca"} Jul 06 01:10:15.081343 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:15.081324 2553 generic.go:356] "Generic (PLEG): container finished" podID="abb5cdd6-5790-4a3f-8bec-7fc2ef718234" containerID="6e0c324ea1b68960bd30fa7a77d5f4d4e75eda50d15fc685c770e2b2081a3114" exitCode=0 Jul 06 01:10:15.081426 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:15.081398 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s" event={"ID":"abb5cdd6-5790-4a3f-8bec-7fc2ef718234","Type":"ContainerDied","Data":"6e0c324ea1b68960bd30fa7a77d5f4d4e75eda50d15fc685c770e2b2081a3114"} Jul 06 01:10:15.083136 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:15.083114 2553 generic.go:356] "Generic (PLEG): container finished" podID="3c0f901e-5c81-488c-9938-ff0c967ff4d6" containerID="31d3d47a6868c0cbe6764f36ed2f8a7a7d31e699e522f88bd3a31888c38f4590" exitCode=0 Jul 06 01:10:15.083208 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:15.083143 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528" event={"ID":"3c0f901e-5c81-488c-9938-ff0c967ff4d6","Type":"ContainerDied","Data":"31d3d47a6868c0cbe6764f36ed2f8a7a7d31e699e522f88bd3a31888c38f4590"} Jul 06 01:10:16.091127 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:16.091034 2553 generic.go:356] "Generic (PLEG): container finished" podID="690269c5-6c7b-468e-a662-fd8d63006539" containerID="4c50458b5e5719abebfb3dfd635c7f3e80cd7312860dd51761920a10d80ea547" exitCode=0 Jul 06 01:10:16.091548 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:16.091118 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85" event={"ID":"690269c5-6c7b-468e-a662-fd8d63006539","Type":"ContainerDied","Data":"4c50458b5e5719abebfb3dfd635c7f3e80cd7312860dd51761920a10d80ea547"} Jul 06 01:10:16.093184 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:16.093162 2553 generic.go:356] "Generic (PLEG): container finished" podID="2d2020dc-4327-463a-b3f5-08dd93d88338" containerID="a4a778e9facaabc1ec33e3a8723fc7ef0a5e705ce35e543ff0cd1e8bfa8e034c" exitCode=0 Jul 06 01:10:16.093314 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:16.093226 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv" event={"ID":"2d2020dc-4327-463a-b3f5-08dd93d88338","Type":"ContainerDied","Data":"a4a778e9facaabc1ec33e3a8723fc7ef0a5e705ce35e543ff0cd1e8bfa8e034c"} Jul 06 01:10:16.101464 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:16.101437 2553 generic.go:356] "Generic (PLEG): container finished" podID="abb5cdd6-5790-4a3f-8bec-7fc2ef718234" containerID="a69afc146c58b324786b7d342c14735ba2f6d08a6a6e41e0e8300e9c12db2133" exitCode=0 Jul 06 01:10:16.101573 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:16.101470 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s" event={"ID":"abb5cdd6-5790-4a3f-8bec-7fc2ef718234","Type":"ContainerDied","Data":"a69afc146c58b324786b7d342c14735ba2f6d08a6a6e41e0e8300e9c12db2133"} Jul 06 01:10:16.103390 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:16.103369 2553 generic.go:356] "Generic (PLEG): container finished" podID="3c0f901e-5c81-488c-9938-ff0c967ff4d6" containerID="49c4deca21bb5645f988e8e72e4bf025e72f8564c910dfd7886d8be29a7cdc99" exitCode=0 Jul 06 01:10:16.103498 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:16.103398 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528" event={"ID":"3c0f901e-5c81-488c-9938-ff0c967ff4d6","Type":"ContainerDied","Data":"49c4deca21bb5645f988e8e72e4bf025e72f8564c910dfd7886d8be29a7cdc99"} Jul 06 01:10:17.110991 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:17.110951 2553 generic.go:356] "Generic (PLEG): container finished" podID="3c0f901e-5c81-488c-9938-ff0c967ff4d6" containerID="60a3a16db125928ded5015d02a152f6fc8ebb30a121b1730ba3b89b5b8b2d13f" exitCode=0 Jul 06 01:10:17.111441 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:17.110986 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528" event={"ID":"3c0f901e-5c81-488c-9938-ff0c967ff4d6","Type":"ContainerDied","Data":"60a3a16db125928ded5015d02a152f6fc8ebb30a121b1730ba3b89b5b8b2d13f"} Jul 06 01:10:17.261788 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:17.261758 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s" Jul 06 01:10:17.315039 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:17.315012 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85" Jul 06 01:10:17.319178 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:17.319155 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv" Jul 06 01:10:17.404299 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:17.404217 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abb5cdd6-5790-4a3f-8bec-7fc2ef718234-bundle\") pod \"abb5cdd6-5790-4a3f-8bec-7fc2ef718234\" (UID: \"abb5cdd6-5790-4a3f-8bec-7fc2ef718234\") " Jul 06 01:10:17.404299 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:17.404265 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abb5cdd6-5790-4a3f-8bec-7fc2ef718234-util\") pod \"abb5cdd6-5790-4a3f-8bec-7fc2ef718234\" (UID: \"abb5cdd6-5790-4a3f-8bec-7fc2ef718234\") " Jul 06 01:10:17.404485 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:17.404312 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbs7j\" (UniqueName: \"kubernetes.io/projected/abb5cdd6-5790-4a3f-8bec-7fc2ef718234-kube-api-access-hbs7j\") pod \"abb5cdd6-5790-4a3f-8bec-7fc2ef718234\" (UID: \"abb5cdd6-5790-4a3f-8bec-7fc2ef718234\") " Jul 06 01:10:17.404776 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:17.404742 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abb5cdd6-5790-4a3f-8bec-7fc2ef718234-bundle" (OuterVolumeSpecName: "bundle") pod "abb5cdd6-5790-4a3f-8bec-7fc2ef718234" (UID: "abb5cdd6-5790-4a3f-8bec-7fc2ef718234"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:10:17.406496 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:17.406479 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abb5cdd6-5790-4a3f-8bec-7fc2ef718234-kube-api-access-hbs7j" (OuterVolumeSpecName: "kube-api-access-hbs7j") pod "abb5cdd6-5790-4a3f-8bec-7fc2ef718234" (UID: "abb5cdd6-5790-4a3f-8bec-7fc2ef718234"). InnerVolumeSpecName "kube-api-access-hbs7j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:10:17.409419 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:17.409381 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abb5cdd6-5790-4a3f-8bec-7fc2ef718234-util" (OuterVolumeSpecName: "util") pod "abb5cdd6-5790-4a3f-8bec-7fc2ef718234" (UID: "abb5cdd6-5790-4a3f-8bec-7fc2ef718234"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:10:17.505355 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:17.505321 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d2020dc-4327-463a-b3f5-08dd93d88338-util\") pod \"2d2020dc-4327-463a-b3f5-08dd93d88338\" (UID: \"2d2020dc-4327-463a-b3f5-08dd93d88338\") " Jul 06 01:10:17.505516 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:17.505411 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xp4m7\" (UniqueName: \"kubernetes.io/projected/690269c5-6c7b-468e-a662-fd8d63006539-kube-api-access-xp4m7\") pod \"690269c5-6c7b-468e-a662-fd8d63006539\" (UID: \"690269c5-6c7b-468e-a662-fd8d63006539\") " Jul 06 01:10:17.505516 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:17.505446 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/690269c5-6c7b-468e-a662-fd8d63006539-bundle\") pod \"690269c5-6c7b-468e-a662-fd8d63006539\" (UID: \"690269c5-6c7b-468e-a662-fd8d63006539\") " Jul 06 01:10:17.505516 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:17.505469 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/690269c5-6c7b-468e-a662-fd8d63006539-util\") pod \"690269c5-6c7b-468e-a662-fd8d63006539\" (UID: \"690269c5-6c7b-468e-a662-fd8d63006539\") " Jul 06 01:10:17.505516 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:17.505502 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d2020dc-4327-463a-b3f5-08dd93d88338-bundle\") pod \"2d2020dc-4327-463a-b3f5-08dd93d88338\" (UID: \"2d2020dc-4327-463a-b3f5-08dd93d88338\") " Jul 06 01:10:17.505733 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:17.505545 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvtdd\" (UniqueName: \"kubernetes.io/projected/2d2020dc-4327-463a-b3f5-08dd93d88338-kube-api-access-gvtdd\") pod \"2d2020dc-4327-463a-b3f5-08dd93d88338\" (UID: \"2d2020dc-4327-463a-b3f5-08dd93d88338\") " Jul 06 01:10:17.505848 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:17.505830 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abb5cdd6-5790-4a3f-8bec-7fc2ef718234-util\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:10:17.505979 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:17.505853 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbs7j\" (UniqueName: \"kubernetes.io/projected/abb5cdd6-5790-4a3f-8bec-7fc2ef718234-kube-api-access-hbs7j\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:10:17.505979 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:17.505867 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abb5cdd6-5790-4a3f-8bec-7fc2ef718234-bundle\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:10:17.506103 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:17.506073 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d2020dc-4327-463a-b3f5-08dd93d88338-bundle" (OuterVolumeSpecName: "bundle") pod "2d2020dc-4327-463a-b3f5-08dd93d88338" (UID: "2d2020dc-4327-463a-b3f5-08dd93d88338"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:10:17.506276 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:17.506252 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/690269c5-6c7b-468e-a662-fd8d63006539-bundle" (OuterVolumeSpecName: "bundle") pod "690269c5-6c7b-468e-a662-fd8d63006539" (UID: "690269c5-6c7b-468e-a662-fd8d63006539"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:10:17.507739 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:17.507708 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d2020dc-4327-463a-b3f5-08dd93d88338-kube-api-access-gvtdd" (OuterVolumeSpecName: "kube-api-access-gvtdd") pod "2d2020dc-4327-463a-b3f5-08dd93d88338" (UID: "2d2020dc-4327-463a-b3f5-08dd93d88338"). InnerVolumeSpecName "kube-api-access-gvtdd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:10:17.507935 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:17.507915 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/690269c5-6c7b-468e-a662-fd8d63006539-kube-api-access-xp4m7" (OuterVolumeSpecName: "kube-api-access-xp4m7") pod "690269c5-6c7b-468e-a662-fd8d63006539" (UID: "690269c5-6c7b-468e-a662-fd8d63006539"). InnerVolumeSpecName "kube-api-access-xp4m7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:10:17.510676 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:17.510636 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d2020dc-4327-463a-b3f5-08dd93d88338-util" (OuterVolumeSpecName: "util") pod "2d2020dc-4327-463a-b3f5-08dd93d88338" (UID: "2d2020dc-4327-463a-b3f5-08dd93d88338"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:10:17.511315 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:17.511295 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/690269c5-6c7b-468e-a662-fd8d63006539-util" (OuterVolumeSpecName: "util") pod "690269c5-6c7b-468e-a662-fd8d63006539" (UID: "690269c5-6c7b-468e-a662-fd8d63006539"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:10:17.606344 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:17.606304 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xp4m7\" (UniqueName: \"kubernetes.io/projected/690269c5-6c7b-468e-a662-fd8d63006539-kube-api-access-xp4m7\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:10:17.606344 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:17.606337 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/690269c5-6c7b-468e-a662-fd8d63006539-bundle\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:10:17.606344 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:17.606346 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/690269c5-6c7b-468e-a662-fd8d63006539-util\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:10:17.606344 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:17.606354 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d2020dc-4327-463a-b3f5-08dd93d88338-bundle\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:10:17.606603 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:17.606363 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvtdd\" (UniqueName: \"kubernetes.io/projected/2d2020dc-4327-463a-b3f5-08dd93d88338-kube-api-access-gvtdd\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:10:17.606603 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:17.606372 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d2020dc-4327-463a-b3f5-08dd93d88338-util\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:10:18.117706 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:18.117650 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85" Jul 06 01:10:18.118151 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:18.117660 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85" event={"ID":"690269c5-6c7b-468e-a662-fd8d63006539","Type":"ContainerDied","Data":"baf5a40a3d153059d66bc79aed497d8d2b79d9725959a2c118ca2b6cffa15ddf"} Jul 06 01:10:18.118151 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:18.117809 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="baf5a40a3d153059d66bc79aed497d8d2b79d9725959a2c118ca2b6cffa15ddf" Jul 06 01:10:18.119577 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:18.119559 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv" Jul 06 01:10:18.119734 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:18.119564 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv" event={"ID":"2d2020dc-4327-463a-b3f5-08dd93d88338","Type":"ContainerDied","Data":"4eefb4fe4c77846af73e5f048a41051f95b038a717014a83ebe34792580636d8"} Jul 06 01:10:18.119734 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:18.119697 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4eefb4fe4c77846af73e5f048a41051f95b038a717014a83ebe34792580636d8" Jul 06 01:10:18.121523 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:18.121501 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s" Jul 06 01:10:18.121629 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:18.121528 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s" event={"ID":"abb5cdd6-5790-4a3f-8bec-7fc2ef718234","Type":"ContainerDied","Data":"e8e39e2a68933e9c49c5bdb8c9ee0f170552e90574358f9f24c02958a353df4f"} Jul 06 01:10:18.121629 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:18.121566 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8e39e2a68933e9c49c5bdb8c9ee0f170552e90574358f9f24c02958a353df4f" Jul 06 01:10:18.260240 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:18.260215 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528" Jul 06 01:10:18.414496 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:18.414408 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c0f901e-5c81-488c-9938-ff0c967ff4d6-bundle\") pod \"3c0f901e-5c81-488c-9938-ff0c967ff4d6\" (UID: \"3c0f901e-5c81-488c-9938-ff0c967ff4d6\") " Jul 06 01:10:18.414496 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:18.414463 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c0f901e-5c81-488c-9938-ff0c967ff4d6-util\") pod \"3c0f901e-5c81-488c-9938-ff0c967ff4d6\" (UID: \"3c0f901e-5c81-488c-9938-ff0c967ff4d6\") " Jul 06 01:10:18.414705 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:18.414508 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frdwz\" (UniqueName: \"kubernetes.io/projected/3c0f901e-5c81-488c-9938-ff0c967ff4d6-kube-api-access-frdwz\") pod \"3c0f901e-5c81-488c-9938-ff0c967ff4d6\" (UID: \"3c0f901e-5c81-488c-9938-ff0c967ff4d6\") " Jul 06 01:10:18.414994 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:18.414964 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c0f901e-5c81-488c-9938-ff0c967ff4d6-bundle" (OuterVolumeSpecName: "bundle") pod "3c0f901e-5c81-488c-9938-ff0c967ff4d6" (UID: "3c0f901e-5c81-488c-9938-ff0c967ff4d6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:10:18.416649 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:18.416629 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c0f901e-5c81-488c-9938-ff0c967ff4d6-kube-api-access-frdwz" (OuterVolumeSpecName: "kube-api-access-frdwz") pod "3c0f901e-5c81-488c-9938-ff0c967ff4d6" (UID: "3c0f901e-5c81-488c-9938-ff0c967ff4d6"). InnerVolumeSpecName "kube-api-access-frdwz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:10:18.422441 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:18.422417 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c0f901e-5c81-488c-9938-ff0c967ff4d6-util" (OuterVolumeSpecName: "util") pod "3c0f901e-5c81-488c-9938-ff0c967ff4d6" (UID: "3c0f901e-5c81-488c-9938-ff0c967ff4d6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:10:18.516071 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:18.516038 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c0f901e-5c81-488c-9938-ff0c967ff4d6-bundle\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:10:18.516071 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:18.516065 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c0f901e-5c81-488c-9938-ff0c967ff4d6-util\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:10:18.516071 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:18.516074 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frdwz\" (UniqueName: \"kubernetes.io/projected/3c0f901e-5c81-488c-9938-ff0c967ff4d6-kube-api-access-frdwz\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:10:19.128510 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:19.128478 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528" Jul 06 01:10:19.128921 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:19.128512 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528" event={"ID":"3c0f901e-5c81-488c-9938-ff0c967ff4d6","Type":"ContainerDied","Data":"66c6ea9b883716fb42b20cee1d2602b38724ab61f0b3c0a75263a4a71fa48504"} Jul 06 01:10:19.128921 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:19.128586 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="66c6ea9b883716fb42b20cee1d2602b38724ab61f0b3c0a75263a4a71fa48504" Jul 06 01:10:56.295382 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.295342 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n2rgv"] Jul 06 01:10:56.295858 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.295725 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="690269c5-6c7b-468e-a662-fd8d63006539" containerName="extract" Jul 06 01:10:56.295858 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.295738 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="690269c5-6c7b-468e-a662-fd8d63006539" containerName="extract" Jul 06 01:10:56.295858 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.295749 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="690269c5-6c7b-468e-a662-fd8d63006539" containerName="pull" Jul 06 01:10:56.295858 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.295755 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="690269c5-6c7b-468e-a662-fd8d63006539" containerName="pull" Jul 06 01:10:56.295858 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.295763 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c0f901e-5c81-488c-9938-ff0c967ff4d6" containerName="pull" Jul 06 01:10:56.295858 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.295769 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c0f901e-5c81-488c-9938-ff0c967ff4d6" containerName="pull" Jul 06 01:10:56.295858 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.295778 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d2020dc-4327-463a-b3f5-08dd93d88338" containerName="util" Jul 06 01:10:56.295858 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.295783 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d2020dc-4327-463a-b3f5-08dd93d88338" containerName="util" Jul 06 01:10:56.295858 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.295788 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abb5cdd6-5790-4a3f-8bec-7fc2ef718234" containerName="pull" Jul 06 01:10:56.295858 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.295793 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="abb5cdd6-5790-4a3f-8bec-7fc2ef718234" containerName="pull" Jul 06 01:10:56.295858 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.295799 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c0f901e-5c81-488c-9938-ff0c967ff4d6" containerName="extract" Jul 06 01:10:56.295858 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.295804 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c0f901e-5c81-488c-9938-ff0c967ff4d6" containerName="extract" Jul 06 01:10:56.295858 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.295813 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d2020dc-4327-463a-b3f5-08dd93d88338" containerName="pull" Jul 06 01:10:56.295858 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.295827 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d2020dc-4327-463a-b3f5-08dd93d88338" containerName="pull" Jul 06 01:10:56.295858 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.295833 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d2020dc-4327-463a-b3f5-08dd93d88338" containerName="extract" Jul 06 01:10:56.295858 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.295838 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d2020dc-4327-463a-b3f5-08dd93d88338" containerName="extract" Jul 06 01:10:56.295858 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.295846 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c0f901e-5c81-488c-9938-ff0c967ff4d6" containerName="util" Jul 06 01:10:56.295858 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.295851 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c0f901e-5c81-488c-9938-ff0c967ff4d6" containerName="util" Jul 06 01:10:56.295858 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.295857 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abb5cdd6-5790-4a3f-8bec-7fc2ef718234" containerName="extract" Jul 06 01:10:56.295858 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.295862 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="abb5cdd6-5790-4a3f-8bec-7fc2ef718234" containerName="extract" Jul 06 01:10:56.295858 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.295869 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="690269c5-6c7b-468e-a662-fd8d63006539" containerName="util" Jul 06 01:10:56.296469 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.295874 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="690269c5-6c7b-468e-a662-fd8d63006539" containerName="util" Jul 06 01:10:56.296469 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.295880 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abb5cdd6-5790-4a3f-8bec-7fc2ef718234" containerName="util" Jul 06 01:10:56.296469 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.295884 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="abb5cdd6-5790-4a3f-8bec-7fc2ef718234" containerName="util" Jul 06 01:10:56.296469 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.295941 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d2020dc-4327-463a-b3f5-08dd93d88338" containerName="extract" Jul 06 01:10:56.296469 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.295950 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="abb5cdd6-5790-4a3f-8bec-7fc2ef718234" containerName="extract" Jul 06 01:10:56.296469 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.295957 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c0f901e-5c81-488c-9938-ff0c967ff4d6" containerName="extract" Jul 06 01:10:56.296469 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.295965 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="690269c5-6c7b-468e-a662-fd8d63006539" containerName="extract" Jul 06 01:10:56.300445 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.300426 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n2rgv" Jul 06 01:10:56.303046 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.303021 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 01:10:56.303191 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.303144 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 01:10:56.303277 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.303258 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ds892\"" Jul 06 01:10:56.312541 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.312518 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n2rgv"] Jul 06 01:10:56.455810 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.455766 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2bde844-d1cd-43cf-91f0-11927106b77a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-n2rgv\" (UID: \"a2bde844-d1cd-43cf-91f0-11927106b77a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n2rgv" Jul 06 01:10:56.455810 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.455811 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk67r\" (UniqueName: \"kubernetes.io/projected/a2bde844-d1cd-43cf-91f0-11927106b77a-kube-api-access-bk67r\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-n2rgv\" (UID: \"a2bde844-d1cd-43cf-91f0-11927106b77a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n2rgv" Jul 06 01:10:56.556477 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.556384 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2bde844-d1cd-43cf-91f0-11927106b77a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-n2rgv\" (UID: \"a2bde844-d1cd-43cf-91f0-11927106b77a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n2rgv" Jul 06 01:10:56.556477 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.556426 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk67r\" (UniqueName: \"kubernetes.io/projected/a2bde844-d1cd-43cf-91f0-11927106b77a-kube-api-access-bk67r\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-n2rgv\" (UID: \"a2bde844-d1cd-43cf-91f0-11927106b77a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n2rgv" Jul 06 01:10:56.556804 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.556783 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2bde844-d1cd-43cf-91f0-11927106b77a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-n2rgv\" (UID: \"a2bde844-d1cd-43cf-91f0-11927106b77a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n2rgv" Jul 06 01:10:56.564158 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.564127 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk67r\" (UniqueName: \"kubernetes.io/projected/a2bde844-d1cd-43cf-91f0-11927106b77a-kube-api-access-bk67r\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-n2rgv\" (UID: \"a2bde844-d1cd-43cf-91f0-11927106b77a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n2rgv" Jul 06 01:10:56.611847 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.611805 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n2rgv" Jul 06 01:10:56.749251 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.749228 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n2rgv"] Jul 06 01:10:56.751378 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:10:56.751353 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2bde844_d1cd_43cf_91f0_11927106b77a.slice/crio-8d7968bfe6181137bb641b326460695ac618ed7176bcf06f87a60762cd769f66 WatchSource:0}: Error finding container 8d7968bfe6181137bb641b326460695ac618ed7176bcf06f87a60762cd769f66: Status 404 returned error can't find the container with id 8d7968bfe6181137bb641b326460695ac618ed7176bcf06f87a60762cd769f66 Jul 06 01:10:56.925210 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.925112 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n2rgv"] Jul 06 01:10:56.935607 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.935579 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n2rgv"] Jul 06 01:10:56.952242 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.952213 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9p8zw"] Jul 06 01:10:56.957411 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.957375 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9p8zw" Jul 06 01:10:56.971743 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:56.971655 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9p8zw"] Jul 06 01:10:57.059738 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:57.059695 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc8xx\" (UniqueName: \"kubernetes.io/projected/f4daca35-3b6e-4db2-9d9d-515bc70222fd-kube-api-access-jc8xx\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9p8zw\" (UID: \"f4daca35-3b6e-4db2-9d9d-515bc70222fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9p8zw" Jul 06 01:10:57.059911 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:57.059747 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4daca35-3b6e-4db2-9d9d-515bc70222fd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9p8zw\" (UID: \"f4daca35-3b6e-4db2-9d9d-515bc70222fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9p8zw" Jul 06 01:10:57.161010 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:57.160972 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc8xx\" (UniqueName: \"kubernetes.io/projected/f4daca35-3b6e-4db2-9d9d-515bc70222fd-kube-api-access-jc8xx\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9p8zw\" (UID: \"f4daca35-3b6e-4db2-9d9d-515bc70222fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9p8zw" Jul 06 01:10:57.161186 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:57.161025 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4daca35-3b6e-4db2-9d9d-515bc70222fd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9p8zw\" (UID: \"f4daca35-3b6e-4db2-9d9d-515bc70222fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9p8zw" Jul 06 01:10:57.161426 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:57.161404 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4daca35-3b6e-4db2-9d9d-515bc70222fd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9p8zw\" (UID: \"f4daca35-3b6e-4db2-9d9d-515bc70222fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9p8zw" Jul 06 01:10:57.170450 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:57.170424 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc8xx\" (UniqueName: \"kubernetes.io/projected/f4daca35-3b6e-4db2-9d9d-515bc70222fd-kube-api-access-jc8xx\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9p8zw\" (UID: \"f4daca35-3b6e-4db2-9d9d-515bc70222fd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9p8zw" Jul 06 01:10:57.268647 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:57.268608 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9p8zw" Jul 06 01:10:57.739708 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:57.739657 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9p8zw"] Jul 06 01:10:57.795716 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:10:57.795659 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4daca35_3b6e_4db2_9d9d_515bc70222fd.slice/crio-442b082bccaf64d12f19680c25076b2a13db9709f653c76b031ea92561fd75eb WatchSource:0}: Error finding container 442b082bccaf64d12f19680c25076b2a13db9709f653c76b031ea92561fd75eb: Status 404 returned error can't find the container with id 442b082bccaf64d12f19680c25076b2a13db9709f653c76b031ea92561fd75eb Jul 06 01:10:58.327837 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:10:58.327796 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9p8zw" event={"ID":"f4daca35-3b6e-4db2-9d9d-515bc70222fd","Type":"ContainerStarted","Data":"442b082bccaf64d12f19680c25076b2a13db9709f653c76b031ea92561fd75eb"} Jul 06 01:11:02.353735 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:02.353644 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n2rgv" podUID="a2bde844-d1cd-43cf-91f0-11927106b77a" containerName="manager" containerID="cri-o://d74fb17dd9e54751b06c81c1a2c0181d8a76bf27e77b3821134b81ef0e1135d6" gracePeriod=2 Jul 06 01:11:02.355534 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:02.355494 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9p8zw" event={"ID":"f4daca35-3b6e-4db2-9d9d-515bc70222fd","Type":"ContainerStarted","Data":"eea735c8340e8dd91405ec1da0a8ff07190076340a8a4c238fcd429c9b71fc68"} Jul 06 01:11:02.355698 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:02.355573 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9p8zw" Jul 06 01:11:02.355887 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:11:02.355863 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-n2rgv\" is forbidden: User \"system:node:ip-10-0-135-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-61.ec2.internal' and this object" podUID="a2bde844-d1cd-43cf-91f0-11927106b77a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n2rgv" Jul 06 01:11:02.385174 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:02.385118 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9p8zw" podStartSLOduration=2.811918215 podStartE2EDuration="6.38510278s" totalImagesPullingTime="3.573184565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:11:02.384142657 +0000 UTC m=+702.398515695" watchObservedRunningTime="2026-07-06 01:11:02.38510278 +0000 UTC m=+702.399475816" Jul 06 01:11:02.386235 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:11:02.386195 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-n2rgv\" is forbidden: User \"system:node:ip-10-0-135-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-61.ec2.internal' and this object" podUID="a2bde844-d1cd-43cf-91f0-11927106b77a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n2rgv" Jul 06 01:11:02.597897 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:02.597869 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n2rgv" Jul 06 01:11:02.600013 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:11:02.599986 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-n2rgv\" is forbidden: User \"system:node:ip-10-0-135-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-61.ec2.internal' and this object" podUID="a2bde844-d1cd-43cf-91f0-11927106b77a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n2rgv" Jul 06 01:11:02.715938 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:02.715905 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bk67r\" (UniqueName: \"kubernetes.io/projected/a2bde844-d1cd-43cf-91f0-11927106b77a-kube-api-access-bk67r\") pod \"a2bde844-d1cd-43cf-91f0-11927106b77a\" (UID: \"a2bde844-d1cd-43cf-91f0-11927106b77a\") " Jul 06 01:11:02.716096 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:02.715989 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2bde844-d1cd-43cf-91f0-11927106b77a-extensions-socket-volume\") pod \"a2bde844-d1cd-43cf-91f0-11927106b77a\" (UID: \"a2bde844-d1cd-43cf-91f0-11927106b77a\") " Jul 06 01:11:02.716268 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:02.716246 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2bde844-d1cd-43cf-91f0-11927106b77a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a2bde844-d1cd-43cf-91f0-11927106b77a" (UID: "a2bde844-d1cd-43cf-91f0-11927106b77a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:11:02.718048 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:02.718027 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2bde844-d1cd-43cf-91f0-11927106b77a-kube-api-access-bk67r" (OuterVolumeSpecName: "kube-api-access-bk67r") pod "a2bde844-d1cd-43cf-91f0-11927106b77a" (UID: "a2bde844-d1cd-43cf-91f0-11927106b77a"). InnerVolumeSpecName "kube-api-access-bk67r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:11:02.817595 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:02.817558 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bk67r\" (UniqueName: \"kubernetes.io/projected/a2bde844-d1cd-43cf-91f0-11927106b77a-kube-api-access-bk67r\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:11:02.817595 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:02.817588 2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2bde844-d1cd-43cf-91f0-11927106b77a-extensions-socket-volume\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:11:03.361721 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:03.361650 2553 generic.go:356] "Generic (PLEG): container finished" podID="a2bde844-d1cd-43cf-91f0-11927106b77a" containerID="d74fb17dd9e54751b06c81c1a2c0181d8a76bf27e77b3821134b81ef0e1135d6" exitCode=2 Jul 06 01:11:03.362153 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:03.361730 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n2rgv" Jul 06 01:11:03.362153 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:03.361758 2553 scope.go:117] "RemoveContainer" containerID="d74fb17dd9e54751b06c81c1a2c0181d8a76bf27e77b3821134b81ef0e1135d6" Jul 06 01:11:03.364076 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:11:03.364049 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-n2rgv\" is forbidden: User \"system:node:ip-10-0-135-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-61.ec2.internal' and this object" podUID="a2bde844-d1cd-43cf-91f0-11927106b77a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n2rgv" Jul 06 01:11:03.371282 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:03.371265 2553 scope.go:117] "RemoveContainer" containerID="d74fb17dd9e54751b06c81c1a2c0181d8a76bf27e77b3821134b81ef0e1135d6" Jul 06 01:11:03.371558 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:11:03.371540 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d74fb17dd9e54751b06c81c1a2c0181d8a76bf27e77b3821134b81ef0e1135d6\": container with ID starting with d74fb17dd9e54751b06c81c1a2c0181d8a76bf27e77b3821134b81ef0e1135d6 not found: ID does not exist" containerID="d74fb17dd9e54751b06c81c1a2c0181d8a76bf27e77b3821134b81ef0e1135d6" Jul 06 01:11:03.371606 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:03.371568 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d74fb17dd9e54751b06c81c1a2c0181d8a76bf27e77b3821134b81ef0e1135d6"} err="failed to get container status \"d74fb17dd9e54751b06c81c1a2c0181d8a76bf27e77b3821134b81ef0e1135d6\": rpc error: code = NotFound desc = could not find container \"d74fb17dd9e54751b06c81c1a2c0181d8a76bf27e77b3821134b81ef0e1135d6\": container with ID starting with d74fb17dd9e54751b06c81c1a2c0181d8a76bf27e77b3821134b81ef0e1135d6 not found: ID does not exist" Jul 06 01:11:03.371834 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:11:03.371813 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-n2rgv\" is forbidden: User \"system:node:ip-10-0-135-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-61.ec2.internal' and this object" podUID="a2bde844-d1cd-43cf-91f0-11927106b77a" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n2rgv" Jul 06 01:11:04.492969 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:04.492939 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2bde844-d1cd-43cf-91f0-11927106b77a" path="/var/lib/kubelet/pods/a2bde844-d1cd-43cf-91f0-11927106b77a/volumes" Jul 06 01:11:13.364781 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:13.364704 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9p8zw" Jul 06 01:11:25.493658 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:25.493621 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9p8zw"] Jul 06 01:11:25.494089 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:25.493850 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9p8zw" podUID="f4daca35-3b6e-4db2-9d9d-515bc70222fd" containerName="manager" containerID="cri-o://eea735c8340e8dd91405ec1da0a8ff07190076340a8a4c238fcd429c9b71fc68" gracePeriod=10 Jul 06 01:11:25.746232 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:25.746170 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9p8zw" Jul 06 01:11:25.809613 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:25.809575 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4daca35-3b6e-4db2-9d9d-515bc70222fd-extensions-socket-volume\") pod \"f4daca35-3b6e-4db2-9d9d-515bc70222fd\" (UID: \"f4daca35-3b6e-4db2-9d9d-515bc70222fd\") " Jul 06 01:11:25.809839 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:25.809682 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jc8xx\" (UniqueName: \"kubernetes.io/projected/f4daca35-3b6e-4db2-9d9d-515bc70222fd-kube-api-access-jc8xx\") pod \"f4daca35-3b6e-4db2-9d9d-515bc70222fd\" (UID: \"f4daca35-3b6e-4db2-9d9d-515bc70222fd\") " Jul 06 01:11:25.810046 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:25.810021 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4daca35-3b6e-4db2-9d9d-515bc70222fd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f4daca35-3b6e-4db2-9d9d-515bc70222fd" (UID: "f4daca35-3b6e-4db2-9d9d-515bc70222fd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:11:25.811741 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:25.811718 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4daca35-3b6e-4db2-9d9d-515bc70222fd-kube-api-access-jc8xx" (OuterVolumeSpecName: "kube-api-access-jc8xx") pod "f4daca35-3b6e-4db2-9d9d-515bc70222fd" (UID: "f4daca35-3b6e-4db2-9d9d-515bc70222fd"). InnerVolumeSpecName "kube-api-access-jc8xx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:11:25.911112 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:25.911074 2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f4daca35-3b6e-4db2-9d9d-515bc70222fd-extensions-socket-volume\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:11:25.911112 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:25.911104 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jc8xx\" (UniqueName: \"kubernetes.io/projected/f4daca35-3b6e-4db2-9d9d-515bc70222fd-kube-api-access-jc8xx\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:11:26.486325 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:26.486290 2553 generic.go:356] "Generic (PLEG): container finished" podID="f4daca35-3b6e-4db2-9d9d-515bc70222fd" containerID="eea735c8340e8dd91405ec1da0a8ff07190076340a8a4c238fcd429c9b71fc68" exitCode=0 Jul 06 01:11:26.486517 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:26.486430 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9p8zw" Jul 06 01:11:26.492570 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:26.492541 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9p8zw" event={"ID":"f4daca35-3b6e-4db2-9d9d-515bc70222fd","Type":"ContainerDied","Data":"eea735c8340e8dd91405ec1da0a8ff07190076340a8a4c238fcd429c9b71fc68"} Jul 06 01:11:26.492722 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:26.492588 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9p8zw" event={"ID":"f4daca35-3b6e-4db2-9d9d-515bc70222fd","Type":"ContainerDied","Data":"442b082bccaf64d12f19680c25076b2a13db9709f653c76b031ea92561fd75eb"} Jul 06 01:11:26.492722 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:26.492610 2553 scope.go:117] "RemoveContainer" containerID="eea735c8340e8dd91405ec1da0a8ff07190076340a8a4c238fcd429c9b71fc68" Jul 06 01:11:26.502170 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:26.502015 2553 scope.go:117] "RemoveContainer" containerID="eea735c8340e8dd91405ec1da0a8ff07190076340a8a4c238fcd429c9b71fc68" Jul 06 01:11:26.502416 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:11:26.502313 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eea735c8340e8dd91405ec1da0a8ff07190076340a8a4c238fcd429c9b71fc68\": container with ID starting with eea735c8340e8dd91405ec1da0a8ff07190076340a8a4c238fcd429c9b71fc68 not found: ID does not exist" containerID="eea735c8340e8dd91405ec1da0a8ff07190076340a8a4c238fcd429c9b71fc68" Jul 06 01:11:26.502416 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:26.502342 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eea735c8340e8dd91405ec1da0a8ff07190076340a8a4c238fcd429c9b71fc68"} err="failed to get container status \"eea735c8340e8dd91405ec1da0a8ff07190076340a8a4c238fcd429c9b71fc68\": rpc error: code = NotFound desc = could not find container \"eea735c8340e8dd91405ec1da0a8ff07190076340a8a4c238fcd429c9b71fc68\": container with ID starting with eea735c8340e8dd91405ec1da0a8ff07190076340a8a4c238fcd429c9b71fc68 not found: ID does not exist" Jul 06 01:11:26.512272 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:26.512244 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9p8zw"] Jul 06 01:11:26.517984 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:26.517960 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9p8zw"] Jul 06 01:11:28.495527 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:28.495485 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4daca35-3b6e-4db2-9d9d-515bc70222fd" path="/var/lib/kubelet/pods/f4daca35-3b6e-4db2-9d9d-515bc70222fd/volumes" Jul 06 01:11:29.717569 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.717536 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc"] Jul 06 01:11:29.718140 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.718117 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4daca35-3b6e-4db2-9d9d-515bc70222fd" containerName="manager" Jul 06 01:11:29.718247 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.718143 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4daca35-3b6e-4db2-9d9d-515bc70222fd" containerName="manager" Jul 06 01:11:29.718247 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.718180 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2bde844-d1cd-43cf-91f0-11927106b77a" containerName="manager" Jul 06 01:11:29.718247 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.718189 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2bde844-d1cd-43cf-91f0-11927106b77a" containerName="manager" Jul 06 01:11:29.718398 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.718297 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4daca35-3b6e-4db2-9d9d-515bc70222fd" containerName="manager" Jul 06 01:11:29.718398 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.718314 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2bde844-d1cd-43cf-91f0-11927106b77a" containerName="manager" Jul 06 01:11:29.722847 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.722827 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:11:29.725496 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.725478 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-llbvg\"" Jul 06 01:11:29.733021 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.732987 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc"] Jul 06 01:11:29.845210 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.845163 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/807fa46e-238f-4307-8547-b0c77d15c9cd-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ntrsc\" (UID: \"807fa46e-238f-4307-8547-b0c77d15c9cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:11:29.845398 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.845229 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/807fa46e-238f-4307-8547-b0c77d15c9cd-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ntrsc\" (UID: \"807fa46e-238f-4307-8547-b0c77d15c9cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:11:29.845398 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.845280 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/807fa46e-238f-4307-8547-b0c77d15c9cd-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ntrsc\" (UID: \"807fa46e-238f-4307-8547-b0c77d15c9cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:11:29.845398 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.845303 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/807fa46e-238f-4307-8547-b0c77d15c9cd-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ntrsc\" (UID: \"807fa46e-238f-4307-8547-b0c77d15c9cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:11:29.845398 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.845368 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wd9s\" (UniqueName: \"kubernetes.io/projected/807fa46e-238f-4307-8547-b0c77d15c9cd-kube-api-access-8wd9s\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ntrsc\" (UID: \"807fa46e-238f-4307-8547-b0c77d15c9cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:11:29.845571 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.845400 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/807fa46e-238f-4307-8547-b0c77d15c9cd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ntrsc\" (UID: \"807fa46e-238f-4307-8547-b0c77d15c9cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:11:29.845571 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.845440 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/807fa46e-238f-4307-8547-b0c77d15c9cd-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ntrsc\" (UID: \"807fa46e-238f-4307-8547-b0c77d15c9cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:11:29.845571 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.845467 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/807fa46e-238f-4307-8547-b0c77d15c9cd-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ntrsc\" (UID: \"807fa46e-238f-4307-8547-b0c77d15c9cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:11:29.845571 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.845490 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/807fa46e-238f-4307-8547-b0c77d15c9cd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ntrsc\" (UID: \"807fa46e-238f-4307-8547-b0c77d15c9cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:11:29.946558 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.946518 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/807fa46e-238f-4307-8547-b0c77d15c9cd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ntrsc\" (UID: \"807fa46e-238f-4307-8547-b0c77d15c9cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:11:29.946809 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.946571 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/807fa46e-238f-4307-8547-b0c77d15c9cd-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ntrsc\" (UID: \"807fa46e-238f-4307-8547-b0c77d15c9cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:11:29.946809 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.946601 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/807fa46e-238f-4307-8547-b0c77d15c9cd-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ntrsc\" (UID: \"807fa46e-238f-4307-8547-b0c77d15c9cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:11:29.946809 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.946790 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/807fa46e-238f-4307-8547-b0c77d15c9cd-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ntrsc\" (UID: \"807fa46e-238f-4307-8547-b0c77d15c9cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:11:29.946981 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.946822 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/807fa46e-238f-4307-8547-b0c77d15c9cd-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ntrsc\" (UID: \"807fa46e-238f-4307-8547-b0c77d15c9cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:11:29.946981 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.946868 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wd9s\" (UniqueName: \"kubernetes.io/projected/807fa46e-238f-4307-8547-b0c77d15c9cd-kube-api-access-8wd9s\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ntrsc\" (UID: \"807fa46e-238f-4307-8547-b0c77d15c9cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:11:29.946981 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.946904 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/807fa46e-238f-4307-8547-b0c77d15c9cd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ntrsc\" (UID: \"807fa46e-238f-4307-8547-b0c77d15c9cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:11:29.946981 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.946952 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/807fa46e-238f-4307-8547-b0c77d15c9cd-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ntrsc\" (UID: \"807fa46e-238f-4307-8547-b0c77d15c9cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:11:29.947186 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.947006 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/807fa46e-238f-4307-8547-b0c77d15c9cd-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ntrsc\" (UID: \"807fa46e-238f-4307-8547-b0c77d15c9cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:11:29.947186 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.947062 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/807fa46e-238f-4307-8547-b0c77d15c9cd-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ntrsc\" (UID: \"807fa46e-238f-4307-8547-b0c77d15c9cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:11:29.947186 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.947099 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/807fa46e-238f-4307-8547-b0c77d15c9cd-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ntrsc\" (UID: \"807fa46e-238f-4307-8547-b0c77d15c9cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:11:29.947186 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.947137 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/807fa46e-238f-4307-8547-b0c77d15c9cd-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ntrsc\" (UID: \"807fa46e-238f-4307-8547-b0c77d15c9cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:11:29.947375 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.947308 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/807fa46e-238f-4307-8547-b0c77d15c9cd-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ntrsc\" (UID: \"807fa46e-238f-4307-8547-b0c77d15c9cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:11:29.947649 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.947628 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/807fa46e-238f-4307-8547-b0c77d15c9cd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ntrsc\" (UID: \"807fa46e-238f-4307-8547-b0c77d15c9cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:11:29.949146 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.949112 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/807fa46e-238f-4307-8547-b0c77d15c9cd-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ntrsc\" (UID: \"807fa46e-238f-4307-8547-b0c77d15c9cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:11:29.949247 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.949229 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/807fa46e-238f-4307-8547-b0c77d15c9cd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ntrsc\" (UID: \"807fa46e-238f-4307-8547-b0c77d15c9cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:11:29.955606 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.955579 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/807fa46e-238f-4307-8547-b0c77d15c9cd-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ntrsc\" (UID: \"807fa46e-238f-4307-8547-b0c77d15c9cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:11:29.955960 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:29.955939 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wd9s\" (UniqueName: \"kubernetes.io/projected/807fa46e-238f-4307-8547-b0c77d15c9cd-kube-api-access-8wd9s\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ntrsc\" (UID: \"807fa46e-238f-4307-8547-b0c77d15c9cd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:11:30.033882 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:30.033792 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:11:30.175273 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:30.175244 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc"] Jul 06 01:11:30.177185 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:11:30.177151 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod807fa46e_238f_4307_8547_b0c77d15c9cd.slice/crio-89722784af6ccb70506de71ad5f1a841d2db39e82e5b843012edf11b2899071e WatchSource:0}: Error finding container 89722784af6ccb70506de71ad5f1a841d2db39e82e5b843012edf11b2899071e: Status 404 returned error can't find the container with id 89722784af6ccb70506de71ad5f1a841d2db39e82e5b843012edf11b2899071e Jul 06 01:11:30.179309 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:30.179276 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 06 01:11:30.179374 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:30.179344 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 06 01:11:30.179411 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:30.179374 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 06 01:11:30.511359 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:30.511320 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" event={"ID":"807fa46e-238f-4307-8547-b0c77d15c9cd","Type":"ContainerStarted","Data":"2ec9bd0af95b323bd80398c61ee9dab119235538d356bb1054213418293e3a30"} Jul 06 01:11:30.511570 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:30.511379 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" event={"ID":"807fa46e-238f-4307-8547-b0c77d15c9cd","Type":"ContainerStarted","Data":"89722784af6ccb70506de71ad5f1a841d2db39e82e5b843012edf11b2899071e"} Jul 06 01:11:30.532994 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:30.532931 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" podStartSLOduration=1.532910401 podStartE2EDuration="1.532910401s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:11:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:11:30.529283132 +0000 UTC m=+730.543656170" watchObservedRunningTime="2026-07-06 01:11:30.532910401 +0000 UTC m=+730.547283439" Jul 06 01:11:31.034795 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:31.034753 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:11:31.039898 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:31.039870 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:11:31.517096 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:31.517061 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:11:31.518176 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:31.518154 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:11:42.452693 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:42.452644 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kjrjk"] Jul 06 01:11:42.461266 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:42.461233 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-kjrjk" Jul 06 01:11:42.463849 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:42.463823 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-c5ldt\"" Jul 06 01:11:42.463849 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:42.463842 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 01:11:42.464024 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:42.463823 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 06 01:11:42.464229 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:42.464210 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kjrjk"] Jul 06 01:11:42.464896 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:42.464870 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 01:11:42.549059 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:42.549026 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kjrjk"] Jul 06 01:11:42.561984 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:42.561960 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4vpg\" (UniqueName: \"kubernetes.io/projected/20c55c1b-023e-4cde-88fb-624c51b0b9dc-kube-api-access-x4vpg\") pod \"limitador-limitador-64c94fd64f-kjrjk\" (UID: \"20c55c1b-023e-4cde-88fb-624c51b0b9dc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kjrjk" Jul 06 01:11:42.562138 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:42.562119 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/20c55c1b-023e-4cde-88fb-624c51b0b9dc-config-file\") pod \"limitador-limitador-64c94fd64f-kjrjk\" (UID: \"20c55c1b-023e-4cde-88fb-624c51b0b9dc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kjrjk" Jul 06 01:11:42.663488 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:42.663446 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4vpg\" (UniqueName: \"kubernetes.io/projected/20c55c1b-023e-4cde-88fb-624c51b0b9dc-kube-api-access-x4vpg\") pod \"limitador-limitador-64c94fd64f-kjrjk\" (UID: \"20c55c1b-023e-4cde-88fb-624c51b0b9dc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kjrjk" Jul 06 01:11:42.663718 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:42.663531 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/20c55c1b-023e-4cde-88fb-624c51b0b9dc-config-file\") pod \"limitador-limitador-64c94fd64f-kjrjk\" (UID: \"20c55c1b-023e-4cde-88fb-624c51b0b9dc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kjrjk" Jul 06 01:11:42.664219 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:42.664195 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/20c55c1b-023e-4cde-88fb-624c51b0b9dc-config-file\") pod \"limitador-limitador-64c94fd64f-kjrjk\" (UID: \"20c55c1b-023e-4cde-88fb-624c51b0b9dc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kjrjk" Jul 06 01:11:42.671605 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:42.671573 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4vpg\" (UniqueName: \"kubernetes.io/projected/20c55c1b-023e-4cde-88fb-624c51b0b9dc-kube-api-access-x4vpg\") pod \"limitador-limitador-64c94fd64f-kjrjk\" (UID: \"20c55c1b-023e-4cde-88fb-624c51b0b9dc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-kjrjk" Jul 06 01:11:42.772450 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:42.772417 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-kjrjk" Jul 06 01:11:42.904322 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:42.904293 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kjrjk"] Jul 06 01:11:42.905320 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:11:42.905292 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20c55c1b_023e_4cde_88fb_624c51b0b9dc.slice/crio-32fe0cf0aab1511e5689eaa7543d21c857d2bc71f47d0c2ec7addffb93a51591 WatchSource:0}: Error finding container 32fe0cf0aab1511e5689eaa7543d21c857d2bc71f47d0c2ec7addffb93a51591: Status 404 returned error can't find the container with id 32fe0cf0aab1511e5689eaa7543d21c857d2bc71f47d0c2ec7addffb93a51591 Jul 06 01:11:43.587280 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:43.587238 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-kjrjk" event={"ID":"20c55c1b-023e-4cde-88fb-624c51b0b9dc","Type":"ContainerStarted","Data":"32fe0cf0aab1511e5689eaa7543d21c857d2bc71f47d0c2ec7addffb93a51591"} Jul 06 01:11:46.605537 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:46.605501 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-kjrjk" event={"ID":"20c55c1b-023e-4cde-88fb-624c51b0b9dc","Type":"ContainerStarted","Data":"9745ecc18e9aa73701e22a01ce97ab599ef90afd0bc283a371ab5379b8ce4e13"} Jul 06 01:11:46.605977 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:46.605583 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-kjrjk" Jul 06 01:11:46.624080 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:46.624025 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-kjrjk" podStartSLOduration=1.844787451 podStartE2EDuration="4.624008477s" totalImagesPullingTime="2.779221026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:11:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:11:46.621114573 +0000 UTC m=+746.635487608" watchObservedRunningTime="2026-07-06 01:11:46.624008477 +0000 UTC m=+746.638381512" Jul 06 01:11:57.613929 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:57.613891 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-kjrjk" Jul 06 01:11:59.626386 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:59.626344 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kjrjk"] Jul 06 01:11:59.626885 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:11:59.626540 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-kjrjk" podUID="20c55c1b-023e-4cde-88fb-624c51b0b9dc" containerName="limitador" containerID="cri-o://9745ecc18e9aa73701e22a01ce97ab599ef90afd0bc283a371ab5379b8ce4e13" gracePeriod=30 Jul 06 01:12:00.182662 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:00.182633 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-kjrjk" Jul 06 01:12:00.324006 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:00.323964 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/20c55c1b-023e-4cde-88fb-624c51b0b9dc-config-file\") pod \"20c55c1b-023e-4cde-88fb-624c51b0b9dc\" (UID: \"20c55c1b-023e-4cde-88fb-624c51b0b9dc\") " Jul 06 01:12:00.324184 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:00.324074 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4vpg\" (UniqueName: \"kubernetes.io/projected/20c55c1b-023e-4cde-88fb-624c51b0b9dc-kube-api-access-x4vpg\") pod \"20c55c1b-023e-4cde-88fb-624c51b0b9dc\" (UID: \"20c55c1b-023e-4cde-88fb-624c51b0b9dc\") " Jul 06 01:12:00.324388 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:00.324365 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20c55c1b-023e-4cde-88fb-624c51b0b9dc-config-file" (OuterVolumeSpecName: "config-file") pod "20c55c1b-023e-4cde-88fb-624c51b0b9dc" (UID: "20c55c1b-023e-4cde-88fb-624c51b0b9dc"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 01:12:00.326174 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:00.326150 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20c55c1b-023e-4cde-88fb-624c51b0b9dc-kube-api-access-x4vpg" (OuterVolumeSpecName: "kube-api-access-x4vpg") pod "20c55c1b-023e-4cde-88fb-624c51b0b9dc" (UID: "20c55c1b-023e-4cde-88fb-624c51b0b9dc"). InnerVolumeSpecName "kube-api-access-x4vpg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:12:00.425390 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:00.425346 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4vpg\" (UniqueName: \"kubernetes.io/projected/20c55c1b-023e-4cde-88fb-624c51b0b9dc-kube-api-access-x4vpg\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:12:00.425390 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:00.425382 2553 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/20c55c1b-023e-4cde-88fb-624c51b0b9dc-config-file\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:12:00.686311 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:00.686218 2553 generic.go:356] "Generic (PLEG): container finished" podID="20c55c1b-023e-4cde-88fb-624c51b0b9dc" containerID="9745ecc18e9aa73701e22a01ce97ab599ef90afd0bc283a371ab5379b8ce4e13" exitCode=0 Jul 06 01:12:00.686311 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:00.686263 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-kjrjk" Jul 06 01:12:00.686885 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:00.686264 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-kjrjk" event={"ID":"20c55c1b-023e-4cde-88fb-624c51b0b9dc","Type":"ContainerDied","Data":"9745ecc18e9aa73701e22a01ce97ab599ef90afd0bc283a371ab5379b8ce4e13"} Jul 06 01:12:00.686885 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:00.686398 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-kjrjk" event={"ID":"20c55c1b-023e-4cde-88fb-624c51b0b9dc","Type":"ContainerDied","Data":"32fe0cf0aab1511e5689eaa7543d21c857d2bc71f47d0c2ec7addffb93a51591"} Jul 06 01:12:00.686885 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:00.686434 2553 scope.go:117] "RemoveContainer" containerID="9745ecc18e9aa73701e22a01ce97ab599ef90afd0bc283a371ab5379b8ce4e13" Jul 06 01:12:00.695455 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:00.695435 2553 scope.go:117] "RemoveContainer" containerID="9745ecc18e9aa73701e22a01ce97ab599ef90afd0bc283a371ab5379b8ce4e13" Jul 06 01:12:00.695750 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:12:00.695722 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9745ecc18e9aa73701e22a01ce97ab599ef90afd0bc283a371ab5379b8ce4e13\": container with ID starting with 9745ecc18e9aa73701e22a01ce97ab599ef90afd0bc283a371ab5379b8ce4e13 not found: ID does not exist" containerID="9745ecc18e9aa73701e22a01ce97ab599ef90afd0bc283a371ab5379b8ce4e13" Jul 06 01:12:00.695864 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:00.695761 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9745ecc18e9aa73701e22a01ce97ab599ef90afd0bc283a371ab5379b8ce4e13"} err="failed to get container status \"9745ecc18e9aa73701e22a01ce97ab599ef90afd0bc283a371ab5379b8ce4e13\": rpc error: code = NotFound desc = could not find container \"9745ecc18e9aa73701e22a01ce97ab599ef90afd0bc283a371ab5379b8ce4e13\": container with ID starting with 9745ecc18e9aa73701e22a01ce97ab599ef90afd0bc283a371ab5379b8ce4e13 not found: ID does not exist" Jul 06 01:12:00.703548 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:00.703521 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kjrjk"] Jul 06 01:12:00.705603 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:00.705571 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-kjrjk"] Jul 06 01:12:02.492631 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:02.492598 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20c55c1b-023e-4cde-88fb-624c51b0b9dc" path="/var/lib/kubelet/pods/20c55c1b-023e-4cde-88fb-624c51b0b9dc/volumes" Jul 06 01:12:03.344627 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:03.344590 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-p7dp2"] Jul 06 01:12:03.344994 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:03.344981 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20c55c1b-023e-4cde-88fb-624c51b0b9dc" containerName="limitador" Jul 06 01:12:03.345041 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:03.344996 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="20c55c1b-023e-4cde-88fb-624c51b0b9dc" containerName="limitador" Jul 06 01:12:03.345085 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:03.345076 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="20c55c1b-023e-4cde-88fb-624c51b0b9dc" containerName="limitador" Jul 06 01:12:03.350102 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:03.350077 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-p7dp2" Jul 06 01:12:03.352749 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:03.352690 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 06 01:12:03.353298 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:03.353100 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-5zrsz\"" Jul 06 01:12:03.355902 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:03.355876 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-p7dp2"] Jul 06 01:12:03.454047 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:03.454009 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r65t5\" (UniqueName: \"kubernetes.io/projected/bb5cafcf-7c5b-4a54-ac96-deb59035f2cb-kube-api-access-r65t5\") pod \"postgres-69fb4594cf-p7dp2\" (UID: \"bb5cafcf-7c5b-4a54-ac96-deb59035f2cb\") " pod="opendatahub/postgres-69fb4594cf-p7dp2" Jul 06 01:12:03.454459 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:03.454068 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bb5cafcf-7c5b-4a54-ac96-deb59035f2cb-data\") pod \"postgres-69fb4594cf-p7dp2\" (UID: \"bb5cafcf-7c5b-4a54-ac96-deb59035f2cb\") " pod="opendatahub/postgres-69fb4594cf-p7dp2" Jul 06 01:12:03.555164 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:03.555126 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r65t5\" (UniqueName: \"kubernetes.io/projected/bb5cafcf-7c5b-4a54-ac96-deb59035f2cb-kube-api-access-r65t5\") pod \"postgres-69fb4594cf-p7dp2\" (UID: \"bb5cafcf-7c5b-4a54-ac96-deb59035f2cb\") " pod="opendatahub/postgres-69fb4594cf-p7dp2" Jul 06 01:12:03.555549 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:03.555179 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bb5cafcf-7c5b-4a54-ac96-deb59035f2cb-data\") pod \"postgres-69fb4594cf-p7dp2\" (UID: \"bb5cafcf-7c5b-4a54-ac96-deb59035f2cb\") " pod="opendatahub/postgres-69fb4594cf-p7dp2" Jul 06 01:12:03.555592 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:03.555546 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bb5cafcf-7c5b-4a54-ac96-deb59035f2cb-data\") pod \"postgres-69fb4594cf-p7dp2\" (UID: \"bb5cafcf-7c5b-4a54-ac96-deb59035f2cb\") " pod="opendatahub/postgres-69fb4594cf-p7dp2" Jul 06 01:12:03.568679 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:03.568644 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r65t5\" (UniqueName: \"kubernetes.io/projected/bb5cafcf-7c5b-4a54-ac96-deb59035f2cb-kube-api-access-r65t5\") pod \"postgres-69fb4594cf-p7dp2\" (UID: \"bb5cafcf-7c5b-4a54-ac96-deb59035f2cb\") " pod="opendatahub/postgres-69fb4594cf-p7dp2" Jul 06 01:12:03.663473 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:03.663383 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-p7dp2" Jul 06 01:12:03.801613 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:03.801588 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-p7dp2"] Jul 06 01:12:04.712257 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:04.712211 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-p7dp2" event={"ID":"bb5cafcf-7c5b-4a54-ac96-deb59035f2cb","Type":"ContainerStarted","Data":"a9898e1c669df1b3608106310e201eb155a798a78b7f6891cfd0693d2cce57f5"} Jul 06 01:12:08.737260 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:08.737225 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-p7dp2" event={"ID":"bb5cafcf-7c5b-4a54-ac96-deb59035f2cb","Type":"ContainerStarted","Data":"fe41320d40567b10402c105f6389aa7601968743a0647976a1aff3c29fb8fcde"} Jul 06 01:12:08.737701 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:08.737308 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-p7dp2" Jul 06 01:12:08.754966 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:08.754915 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-p7dp2" podStartSLOduration=1.03882765 podStartE2EDuration="5.754900394s" totalImagesPullingTime="4.716072744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:12:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:12:08.751761104 +0000 UTC m=+768.766134140" watchObservedRunningTime="2026-07-06 01:12:08.754900394 +0000 UTC m=+768.769273430" Jul 06 01:12:14.771938 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:14.771906 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-p7dp2" Jul 06 01:12:21.352176 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:21.352138 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-85d77df7bc-mrrqj"] Jul 06 01:12:21.358820 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:21.358795 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85d77df7bc-mrrqj" Jul 06 01:12:21.362265 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:21.362231 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 06 01:12:21.363405 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:21.363385 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 06 01:12:21.363534 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:21.363407 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6kc7g\"" Jul 06 01:12:21.366299 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:21.366137 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85d77df7bc-mrrqj"] Jul 06 01:12:21.411480 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:21.411439 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2f84fc45-2a3f-4018-b394-ed9859ed0b41-webhook-cert\") pod \"maas-controller-85d77df7bc-mrrqj\" (UID: \"2f84fc45-2a3f-4018-b394-ed9859ed0b41\") " pod="opendatahub/maas-controller-85d77df7bc-mrrqj" Jul 06 01:12:21.411639 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:21.411521 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j88md\" (UniqueName: \"kubernetes.io/projected/2f84fc45-2a3f-4018-b394-ed9859ed0b41-kube-api-access-j88md\") pod \"maas-controller-85d77df7bc-mrrqj\" (UID: \"2f84fc45-2a3f-4018-b394-ed9859ed0b41\") " pod="opendatahub/maas-controller-85d77df7bc-mrrqj" Jul 06 01:12:21.512028 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:21.511992 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j88md\" (UniqueName: \"kubernetes.io/projected/2f84fc45-2a3f-4018-b394-ed9859ed0b41-kube-api-access-j88md\") pod \"maas-controller-85d77df7bc-mrrqj\" (UID: \"2f84fc45-2a3f-4018-b394-ed9859ed0b41\") " pod="opendatahub/maas-controller-85d77df7bc-mrrqj" Jul 06 01:12:21.512197 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:21.512049 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2f84fc45-2a3f-4018-b394-ed9859ed0b41-webhook-cert\") pod \"maas-controller-85d77df7bc-mrrqj\" (UID: \"2f84fc45-2a3f-4018-b394-ed9859ed0b41\") " pod="opendatahub/maas-controller-85d77df7bc-mrrqj" Jul 06 01:12:21.512197 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:12:21.512138 2553 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 06 01:12:21.512321 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:12:21.512207 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f84fc45-2a3f-4018-b394-ed9859ed0b41-webhook-cert podName:2f84fc45-2a3f-4018-b394-ed9859ed0b41 nodeName:}" failed. No retries permitted until 2026-07-06 01:12:22.0121826 +0000 UTC m=+782.026555614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/2f84fc45-2a3f-4018-b394-ed9859ed0b41-webhook-cert") pod "maas-controller-85d77df7bc-mrrqj" (UID: "2f84fc45-2a3f-4018-b394-ed9859ed0b41") : secret "maas-controller-webhook-cert" not found Jul 06 01:12:21.522489 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:21.522461 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j88md\" (UniqueName: \"kubernetes.io/projected/2f84fc45-2a3f-4018-b394-ed9859ed0b41-kube-api-access-j88md\") pod \"maas-controller-85d77df7bc-mrrqj\" (UID: \"2f84fc45-2a3f-4018-b394-ed9859ed0b41\") " pod="opendatahub/maas-controller-85d77df7bc-mrrqj" Jul 06 01:12:21.545299 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:21.545262 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7c9c5cd9fb-7fvlp"] Jul 06 01:12:21.549902 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:21.549878 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c9c5cd9fb-7fvlp" Jul 06 01:12:21.560256 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:21.560227 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c9c5cd9fb-7fvlp"] Jul 06 01:12:21.612883 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:21.612798 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86z7j\" (UniqueName: \"kubernetes.io/projected/bc341162-b556-41f9-915c-6d627336e8d5-kube-api-access-86z7j\") pod \"maas-controller-7c9c5cd9fb-7fvlp\" (UID: \"bc341162-b556-41f9-915c-6d627336e8d5\") " pod="opendatahub/maas-controller-7c9c5cd9fb-7fvlp" Jul 06 01:12:21.613032 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:21.612903 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc341162-b556-41f9-915c-6d627336e8d5-webhook-cert\") pod \"maas-controller-7c9c5cd9fb-7fvlp\" (UID: \"bc341162-b556-41f9-915c-6d627336e8d5\") " pod="opendatahub/maas-controller-7c9c5cd9fb-7fvlp" Jul 06 01:12:21.713367 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:21.713331 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86z7j\" (UniqueName: \"kubernetes.io/projected/bc341162-b556-41f9-915c-6d627336e8d5-kube-api-access-86z7j\") pod \"maas-controller-7c9c5cd9fb-7fvlp\" (UID: \"bc341162-b556-41f9-915c-6d627336e8d5\") " pod="opendatahub/maas-controller-7c9c5cd9fb-7fvlp" Jul 06 01:12:21.713538 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:21.713398 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc341162-b556-41f9-915c-6d627336e8d5-webhook-cert\") pod \"maas-controller-7c9c5cd9fb-7fvlp\" (UID: \"bc341162-b556-41f9-915c-6d627336e8d5\") " pod="opendatahub/maas-controller-7c9c5cd9fb-7fvlp" Jul 06 01:12:21.715849 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:21.715821 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc341162-b556-41f9-915c-6d627336e8d5-webhook-cert\") pod \"maas-controller-7c9c5cd9fb-7fvlp\" (UID: \"bc341162-b556-41f9-915c-6d627336e8d5\") " pod="opendatahub/maas-controller-7c9c5cd9fb-7fvlp" Jul 06 01:12:21.720579 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:21.720554 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86z7j\" (UniqueName: \"kubernetes.io/projected/bc341162-b556-41f9-915c-6d627336e8d5-kube-api-access-86z7j\") pod \"maas-controller-7c9c5cd9fb-7fvlp\" (UID: \"bc341162-b556-41f9-915c-6d627336e8d5\") " pod="opendatahub/maas-controller-7c9c5cd9fb-7fvlp" Jul 06 01:12:21.861356 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:21.861315 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c9c5cd9fb-7fvlp" Jul 06 01:12:21.996197 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:21.996168 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c9c5cd9fb-7fvlp"] Jul 06 01:12:21.997911 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:12:21.997877 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc341162_b556_41f9_915c_6d627336e8d5.slice/crio-92c881bb3645ab14ddd5f0ae55d8f85077281526e1f077926a1b17e6ffa815f7 WatchSource:0}: Error finding container 92c881bb3645ab14ddd5f0ae55d8f85077281526e1f077926a1b17e6ffa815f7: Status 404 returned error can't find the container with id 92c881bb3645ab14ddd5f0ae55d8f85077281526e1f077926a1b17e6ffa815f7 Jul 06 01:12:22.016399 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:22.016373 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2f84fc45-2a3f-4018-b394-ed9859ed0b41-webhook-cert\") pod \"maas-controller-85d77df7bc-mrrqj\" (UID: \"2f84fc45-2a3f-4018-b394-ed9859ed0b41\") " pod="opendatahub/maas-controller-85d77df7bc-mrrqj" Jul 06 01:12:22.018947 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:22.018915 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2f84fc45-2a3f-4018-b394-ed9859ed0b41-webhook-cert\") pod \"maas-controller-85d77df7bc-mrrqj\" (UID: \"2f84fc45-2a3f-4018-b394-ed9859ed0b41\") " pod="opendatahub/maas-controller-85d77df7bc-mrrqj" Jul 06 01:12:22.270347 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:22.270308 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85d77df7bc-mrrqj" Jul 06 01:12:22.407598 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:22.407574 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85d77df7bc-mrrqj"] Jul 06 01:12:22.410114 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:12:22.410083 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f84fc45_2a3f_4018_b394_ed9859ed0b41.slice/crio-984caa2c43a7956346ae0f0b2d053ca2a06c97c62275b7efaaeff686fa69b14f WatchSource:0}: Error finding container 984caa2c43a7956346ae0f0b2d053ca2a06c97c62275b7efaaeff686fa69b14f: Status 404 returned error can't find the container with id 984caa2c43a7956346ae0f0b2d053ca2a06c97c62275b7efaaeff686fa69b14f Jul 06 01:12:22.814483 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:22.814438 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85d77df7bc-mrrqj" event={"ID":"2f84fc45-2a3f-4018-b394-ed9859ed0b41","Type":"ContainerStarted","Data":"984caa2c43a7956346ae0f0b2d053ca2a06c97c62275b7efaaeff686fa69b14f"} Jul 06 01:12:22.816333 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:22.816290 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c9c5cd9fb-7fvlp" event={"ID":"bc341162-b556-41f9-915c-6d627336e8d5","Type":"ContainerStarted","Data":"92c881bb3645ab14ddd5f0ae55d8f85077281526e1f077926a1b17e6ffa815f7"} Jul 06 01:12:24.830527 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:24.830490 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85d77df7bc-mrrqj" event={"ID":"2f84fc45-2a3f-4018-b394-ed9859ed0b41","Type":"ContainerStarted","Data":"13c2b316a643baa1f452da8096554e209728bb0278da6e64aea10019d0975e1e"} Jul 06 01:12:24.830986 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:24.830609 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-85d77df7bc-mrrqj" Jul 06 01:12:24.832297 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:24.832266 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c9c5cd9fb-7fvlp" event={"ID":"bc341162-b556-41f9-915c-6d627336e8d5","Type":"ContainerStarted","Data":"78a2e548d5688a97e545d5d0bf5535aa561d2e29752e54edc00c88c54c815e92"} Jul 06 01:12:24.832432 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:24.832346 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7c9c5cd9fb-7fvlp" Jul 06 01:12:24.846702 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:24.846638 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-85d77df7bc-mrrqj" podStartSLOduration=2.068120046 podStartE2EDuration="3.846625908s" totalImagesPullingTime="1.778505862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:12:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:12:24.845259656 +0000 UTC m=+784.859632707" watchObservedRunningTime="2026-07-06 01:12:24.846625908 +0000 UTC m=+784.860998943" Jul 06 01:12:24.863414 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:24.863366 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7c9c5cd9fb-7fvlp" podStartSLOduration=1.6805869869999999 podStartE2EDuration="3.863354825s" totalImagesPullingTime="2.182767838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:12:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:12:24.862454088 +0000 UTC m=+784.876827125" watchObservedRunningTime="2026-07-06 01:12:24.863354825 +0000 UTC m=+784.877727861" Jul 06 01:12:35.844842 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:35.844804 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-85d77df7bc-mrrqj" Jul 06 01:12:35.845368 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:35.845084 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7c9c5cd9fb-7fvlp" Jul 06 01:12:35.902852 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:35.902817 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85d77df7bc-mrrqj"] Jul 06 01:12:35.903053 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:35.903021 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-85d77df7bc-mrrqj" podUID="2f84fc45-2a3f-4018-b394-ed9859ed0b41" containerName="manager" containerID="cri-o://13c2b316a643baa1f452da8096554e209728bb0278da6e64aea10019d0975e1e" gracePeriod=30 Jul 06 01:12:36.158851 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:36.158822 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85d77df7bc-mrrqj" Jul 06 01:12:36.265934 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:36.265886 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j88md\" (UniqueName: \"kubernetes.io/projected/2f84fc45-2a3f-4018-b394-ed9859ed0b41-kube-api-access-j88md\") pod \"2f84fc45-2a3f-4018-b394-ed9859ed0b41\" (UID: \"2f84fc45-2a3f-4018-b394-ed9859ed0b41\") " Jul 06 01:12:36.266117 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:36.266062 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2f84fc45-2a3f-4018-b394-ed9859ed0b41-webhook-cert\") pod \"2f84fc45-2a3f-4018-b394-ed9859ed0b41\" (UID: \"2f84fc45-2a3f-4018-b394-ed9859ed0b41\") " Jul 06 01:12:36.268168 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:36.268142 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f84fc45-2a3f-4018-b394-ed9859ed0b41-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "2f84fc45-2a3f-4018-b394-ed9859ed0b41" (UID: "2f84fc45-2a3f-4018-b394-ed9859ed0b41"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 01:12:36.268247 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:36.268148 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f84fc45-2a3f-4018-b394-ed9859ed0b41-kube-api-access-j88md" (OuterVolumeSpecName: "kube-api-access-j88md") pod "2f84fc45-2a3f-4018-b394-ed9859ed0b41" (UID: "2f84fc45-2a3f-4018-b394-ed9859ed0b41"). InnerVolumeSpecName "kube-api-access-j88md". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:12:36.367436 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:36.367404 2553 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2f84fc45-2a3f-4018-b394-ed9859ed0b41-webhook-cert\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:12:36.367436 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:36.367431 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j88md\" (UniqueName: \"kubernetes.io/projected/2f84fc45-2a3f-4018-b394-ed9859ed0b41-kube-api-access-j88md\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:12:36.898212 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:36.898123 2553 generic.go:356] "Generic (PLEG): container finished" podID="2f84fc45-2a3f-4018-b394-ed9859ed0b41" containerID="13c2b316a643baa1f452da8096554e209728bb0278da6e64aea10019d0975e1e" exitCode=0 Jul 06 01:12:36.898212 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:36.898179 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85d77df7bc-mrrqj" Jul 06 01:12:36.898659 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:36.898214 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85d77df7bc-mrrqj" event={"ID":"2f84fc45-2a3f-4018-b394-ed9859ed0b41","Type":"ContainerDied","Data":"13c2b316a643baa1f452da8096554e209728bb0278da6e64aea10019d0975e1e"} Jul 06 01:12:36.898659 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:36.898270 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85d77df7bc-mrrqj" event={"ID":"2f84fc45-2a3f-4018-b394-ed9859ed0b41","Type":"ContainerDied","Data":"984caa2c43a7956346ae0f0b2d053ca2a06c97c62275b7efaaeff686fa69b14f"} Jul 06 01:12:36.898659 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:36.898296 2553 scope.go:117] "RemoveContainer" containerID="13c2b316a643baa1f452da8096554e209728bb0278da6e64aea10019d0975e1e" Jul 06 01:12:36.907347 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:36.907173 2553 scope.go:117] "RemoveContainer" containerID="13c2b316a643baa1f452da8096554e209728bb0278da6e64aea10019d0975e1e" Jul 06 01:12:36.907453 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:12:36.907430 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13c2b316a643baa1f452da8096554e209728bb0278da6e64aea10019d0975e1e\": container with ID starting with 13c2b316a643baa1f452da8096554e209728bb0278da6e64aea10019d0975e1e not found: ID does not exist" containerID="13c2b316a643baa1f452da8096554e209728bb0278da6e64aea10019d0975e1e" Jul 06 01:12:36.907495 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:36.907460 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13c2b316a643baa1f452da8096554e209728bb0278da6e64aea10019d0975e1e"} err="failed to get container status \"13c2b316a643baa1f452da8096554e209728bb0278da6e64aea10019d0975e1e\": rpc error: code = NotFound desc = could not find container \"13c2b316a643baa1f452da8096554e209728bb0278da6e64aea10019d0975e1e\": container with ID starting with 13c2b316a643baa1f452da8096554e209728bb0278da6e64aea10019d0975e1e not found: ID does not exist" Jul 06 01:12:36.915419 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:36.915397 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85d77df7bc-mrrqj"] Jul 06 01:12:36.917605 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:36.917587 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-85d77df7bc-mrrqj"] Jul 06 01:12:38.492705 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:38.492652 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f84fc45-2a3f-4018-b394-ed9859ed0b41" path="/var/lib/kubelet/pods/2f84fc45-2a3f-4018-b394-ed9859ed0b41/volumes" Jul 06 01:12:58.730762 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:58.730716 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-7b4df4f969-wr92z"] Jul 06 01:12:58.731144 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:58.731106 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f84fc45-2a3f-4018-b394-ed9859ed0b41" containerName="manager" Jul 06 01:12:58.731144 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:58.731118 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f84fc45-2a3f-4018-b394-ed9859ed0b41" containerName="manager" Jul 06 01:12:58.731216 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:58.731191 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f84fc45-2a3f-4018-b394-ed9859ed0b41" containerName="manager" Jul 06 01:12:58.736914 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:58.736894 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7b4df4f969-wr92z" Jul 06 01:12:58.740029 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:58.740009 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 06 01:12:58.740161 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:58.740010 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-84mvh\"" Jul 06 01:12:58.744204 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:58.744181 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7b4df4f969-wr92z"] Jul 06 01:12:58.752319 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:58.752287 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qwmg\" (UniqueName: \"kubernetes.io/projected/903364cb-8897-4cf1-b09a-159cace97e1e-kube-api-access-5qwmg\") pod \"maas-api-7b4df4f969-wr92z\" (UID: \"903364cb-8897-4cf1-b09a-159cace97e1e\") " pod="opendatahub/maas-api-7b4df4f969-wr92z" Jul 06 01:12:58.752438 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:58.752336 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/903364cb-8897-4cf1-b09a-159cace97e1e-maas-api-tls\") pod \"maas-api-7b4df4f969-wr92z\" (UID: \"903364cb-8897-4cf1-b09a-159cace97e1e\") " pod="opendatahub/maas-api-7b4df4f969-wr92z" Jul 06 01:12:58.752438 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:58.752393 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/903364cb-8897-4cf1-b09a-159cace97e1e-openshift-service-ca\") pod \"maas-api-7b4df4f969-wr92z\" (UID: \"903364cb-8897-4cf1-b09a-159cace97e1e\") " pod="opendatahub/maas-api-7b4df4f969-wr92z" Jul 06 01:12:58.853945 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:58.853906 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qwmg\" (UniqueName: \"kubernetes.io/projected/903364cb-8897-4cf1-b09a-159cace97e1e-kube-api-access-5qwmg\") pod \"maas-api-7b4df4f969-wr92z\" (UID: \"903364cb-8897-4cf1-b09a-159cace97e1e\") " pod="opendatahub/maas-api-7b4df4f969-wr92z" Jul 06 01:12:58.853945 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:58.853950 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/903364cb-8897-4cf1-b09a-159cace97e1e-maas-api-tls\") pod \"maas-api-7b4df4f969-wr92z\" (UID: \"903364cb-8897-4cf1-b09a-159cace97e1e\") " pod="opendatahub/maas-api-7b4df4f969-wr92z" Jul 06 01:12:58.854154 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:58.853974 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/903364cb-8897-4cf1-b09a-159cace97e1e-openshift-service-ca\") pod \"maas-api-7b4df4f969-wr92z\" (UID: \"903364cb-8897-4cf1-b09a-159cace97e1e\") " pod="opendatahub/maas-api-7b4df4f969-wr92z" Jul 06 01:12:58.854610 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:58.854587 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/903364cb-8897-4cf1-b09a-159cace97e1e-openshift-service-ca\") pod \"maas-api-7b4df4f969-wr92z\" (UID: \"903364cb-8897-4cf1-b09a-159cace97e1e\") " pod="opendatahub/maas-api-7b4df4f969-wr92z" Jul 06 01:12:58.856404 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:58.856385 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/903364cb-8897-4cf1-b09a-159cace97e1e-maas-api-tls\") pod \"maas-api-7b4df4f969-wr92z\" (UID: \"903364cb-8897-4cf1-b09a-159cace97e1e\") " pod="opendatahub/maas-api-7b4df4f969-wr92z" Jul 06 01:12:58.861563 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:58.861541 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qwmg\" (UniqueName: \"kubernetes.io/projected/903364cb-8897-4cf1-b09a-159cace97e1e-kube-api-access-5qwmg\") pod \"maas-api-7b4df4f969-wr92z\" (UID: \"903364cb-8897-4cf1-b09a-159cace97e1e\") " pod="opendatahub/maas-api-7b4df4f969-wr92z" Jul 06 01:12:59.048347 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:59.048267 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7b4df4f969-wr92z" Jul 06 01:12:59.221649 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:59.221611 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-z4grx"] Jul 06 01:12:59.227119 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:59.227100 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-z4grx" Jul 06 01:12:59.230327 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:59.230287 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-vbxxb\"" Jul 06 01:12:59.230500 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:59.230288 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 06 01:12:59.232821 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:59.232799 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-z4grx"] Jul 06 01:12:59.258573 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:59.258535 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/872e14ed-c94a-48f5-98b1-ff9923eec523-plugins-config-volume\") pod \"payload-pre-processing-7964457696-z4grx\" (UID: \"872e14ed-c94a-48f5-98b1-ff9923eec523\") " pod="openshift-ingress/payload-pre-processing-7964457696-z4grx" Jul 06 01:12:59.258741 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:59.258701 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkjhx\" (UniqueName: \"kubernetes.io/projected/872e14ed-c94a-48f5-98b1-ff9923eec523-kube-api-access-hkjhx\") pod \"payload-pre-processing-7964457696-z4grx\" (UID: \"872e14ed-c94a-48f5-98b1-ff9923eec523\") " pod="openshift-ingress/payload-pre-processing-7964457696-z4grx" Jul 06 01:12:59.269402 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:59.269368 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-zprmm"] Jul 06 01:12:59.273431 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:59.273410 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-zprmm" Jul 06 01:12:59.284391 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:59.284369 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-zprmm"] Jul 06 01:12:59.359516 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:59.359420 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkml2\" (UniqueName: \"kubernetes.io/projected/774794ca-e3f0-4b15-b80f-3fa7d015bc1e-kube-api-access-hkml2\") pod \"payload-processing-58f86c7798-zprmm\" (UID: \"774794ca-e3f0-4b15-b80f-3fa7d015bc1e\") " pod="openshift-ingress/payload-processing-58f86c7798-zprmm" Jul 06 01:12:59.359516 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:59.359479 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/774794ca-e3f0-4b15-b80f-3fa7d015bc1e-plugins-config-volume\") pod \"payload-processing-58f86c7798-zprmm\" (UID: \"774794ca-e3f0-4b15-b80f-3fa7d015bc1e\") " pod="openshift-ingress/payload-processing-58f86c7798-zprmm" Jul 06 01:12:59.359783 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:59.359585 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkjhx\" (UniqueName: \"kubernetes.io/projected/872e14ed-c94a-48f5-98b1-ff9923eec523-kube-api-access-hkjhx\") pod \"payload-pre-processing-7964457696-z4grx\" (UID: \"872e14ed-c94a-48f5-98b1-ff9923eec523\") " pod="openshift-ingress/payload-pre-processing-7964457696-z4grx" Jul 06 01:12:59.359783 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:59.359704 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/872e14ed-c94a-48f5-98b1-ff9923eec523-plugins-config-volume\") pod \"payload-pre-processing-7964457696-z4grx\" (UID: \"872e14ed-c94a-48f5-98b1-ff9923eec523\") " pod="openshift-ingress/payload-pre-processing-7964457696-z4grx" Jul 06 01:12:59.360580 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:59.360552 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/872e14ed-c94a-48f5-98b1-ff9923eec523-plugins-config-volume\") pod \"payload-pre-processing-7964457696-z4grx\" (UID: \"872e14ed-c94a-48f5-98b1-ff9923eec523\") " pod="openshift-ingress/payload-pre-processing-7964457696-z4grx" Jul 06 01:12:59.367718 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:59.367682 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkjhx\" (UniqueName: \"kubernetes.io/projected/872e14ed-c94a-48f5-98b1-ff9923eec523-kube-api-access-hkjhx\") pod \"payload-pre-processing-7964457696-z4grx\" (UID: \"872e14ed-c94a-48f5-98b1-ff9923eec523\") " pod="openshift-ingress/payload-pre-processing-7964457696-z4grx" Jul 06 01:12:59.405074 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:59.405012 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7b4df4f969-wr92z"] Jul 06 01:12:59.407682 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:12:59.407641 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod903364cb_8897_4cf1_b09a_159cace97e1e.slice/crio-d13eee28b33ebcd6159885810df46f6eb25639d12ce0089d9706346baa566c50 WatchSource:0}: Error finding container d13eee28b33ebcd6159885810df46f6eb25639d12ce0089d9706346baa566c50: Status 404 returned error can't find the container with id d13eee28b33ebcd6159885810df46f6eb25639d12ce0089d9706346baa566c50 Jul 06 01:12:59.409451 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:59.409424 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 01:12:59.461189 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:59.461154 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/774794ca-e3f0-4b15-b80f-3fa7d015bc1e-plugins-config-volume\") pod \"payload-processing-58f86c7798-zprmm\" (UID: \"774794ca-e3f0-4b15-b80f-3fa7d015bc1e\") " pod="openshift-ingress/payload-processing-58f86c7798-zprmm" Jul 06 01:12:59.461361 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:59.461254 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkml2\" (UniqueName: \"kubernetes.io/projected/774794ca-e3f0-4b15-b80f-3fa7d015bc1e-kube-api-access-hkml2\") pod \"payload-processing-58f86c7798-zprmm\" (UID: \"774794ca-e3f0-4b15-b80f-3fa7d015bc1e\") " pod="openshift-ingress/payload-processing-58f86c7798-zprmm" Jul 06 01:12:59.461902 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:59.461881 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/774794ca-e3f0-4b15-b80f-3fa7d015bc1e-plugins-config-volume\") pod \"payload-processing-58f86c7798-zprmm\" (UID: \"774794ca-e3f0-4b15-b80f-3fa7d015bc1e\") " pod="openshift-ingress/payload-processing-58f86c7798-zprmm" Jul 06 01:12:59.468599 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:59.468569 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkml2\" (UniqueName: \"kubernetes.io/projected/774794ca-e3f0-4b15-b80f-3fa7d015bc1e-kube-api-access-hkml2\") pod \"payload-processing-58f86c7798-zprmm\" (UID: \"774794ca-e3f0-4b15-b80f-3fa7d015bc1e\") " pod="openshift-ingress/payload-processing-58f86c7798-zprmm" Jul 06 01:12:59.539543 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:59.539505 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-z4grx" Jul 06 01:12:59.585651 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:59.585610 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-zprmm" Jul 06 01:12:59.719559 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:59.718127 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-z4grx"] Jul 06 01:12:59.772866 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:12:59.772836 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-zprmm"] Jul 06 01:12:59.774896 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:12:59.774791 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod774794ca_e3f0_4b15_b80f_3fa7d015bc1e.slice/crio-845221796f34b639c3aa4b5acf0793b8da5d467faebdd7553014e9322715ab80 WatchSource:0}: Error finding container 845221796f34b639c3aa4b5acf0793b8da5d467faebdd7553014e9322715ab80: Status 404 returned error can't find the container with id 845221796f34b639c3aa4b5acf0793b8da5d467faebdd7553014e9322715ab80 Jul 06 01:13:00.021518 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:00.021467 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7b4df4f969-wr92z" event={"ID":"903364cb-8897-4cf1-b09a-159cace97e1e","Type":"ContainerStarted","Data":"d13eee28b33ebcd6159885810df46f6eb25639d12ce0089d9706346baa566c50"} Jul 06 01:13:00.022768 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:00.022726 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-zprmm" event={"ID":"774794ca-e3f0-4b15-b80f-3fa7d015bc1e","Type":"ContainerStarted","Data":"845221796f34b639c3aa4b5acf0793b8da5d467faebdd7553014e9322715ab80"} Jul 06 01:13:00.024075 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:00.024045 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-z4grx" event={"ID":"872e14ed-c94a-48f5-98b1-ff9923eec523","Type":"ContainerStarted","Data":"d1854b20add9336773b884cd7dfe477102e3f6d48678a65f6af1c15535c6d231"} Jul 06 01:13:02.040399 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:02.040358 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7b4df4f969-wr92z" event={"ID":"903364cb-8897-4cf1-b09a-159cace97e1e","Type":"ContainerStarted","Data":"094bf296ee017fffb2cf1fd8e68cebcd8ca3e9e6d92e969eda0e654a4827649c"} Jul 06 01:13:02.041078 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:02.040560 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7b4df4f969-wr92z" Jul 06 01:13:02.042041 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:02.042017 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-zprmm" event={"ID":"774794ca-e3f0-4b15-b80f-3fa7d015bc1e","Type":"ContainerStarted","Data":"9119efc70d14fabe899c6fae6c73af865c2dae7a26cbaa62feb9edf9f454d354"} Jul 06 01:13:02.042166 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:02.042065 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-zprmm" Jul 06 01:13:02.043910 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:02.043858 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-z4grx" event={"ID":"872e14ed-c94a-48f5-98b1-ff9923eec523","Type":"ContainerStarted","Data":"53a8d2a0d2f6ca9391dfb7ffe52f527c38e64e65d98ca42a4087fa6cb1c9f487"} Jul 06 01:13:02.044077 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:02.043945 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-z4grx" Jul 06 01:13:02.056503 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:02.056447 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-7b4df4f969-wr92z" podStartSLOduration=1.782716975 podStartE2EDuration="4.056427775s" totalImagesPullingTime="2.2737108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:12:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:13:02.055534712 +0000 UTC m=+822.069907748" watchObservedRunningTime="2026-07-06 01:13:02.056427775 +0000 UTC m=+822.070800812" Jul 06 01:13:02.071504 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:02.071454 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-z4grx" podStartSLOduration=1.103681839 podStartE2EDuration="3.071438509s" totalImagesPullingTime="1.96775667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:12:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:13:02.069552501 +0000 UTC m=+822.083925554" watchObservedRunningTime="2026-07-06 01:13:02.071438509 +0000 UTC m=+822.085811546" Jul 06 01:13:02.085870 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:02.085824 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-zprmm" podStartSLOduration=1.17932061 podStartE2EDuration="3.085808025s" totalImagesPullingTime="1.906487415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:12:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:13:02.083564314 +0000 UTC m=+822.097937352" watchObservedRunningTime="2026-07-06 01:13:02.085808025 +0000 UTC m=+822.100181062" Jul 06 01:13:07.073993 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:07.073896 2553 generic.go:356] "Generic (PLEG): container finished" podID="807fa46e-238f-4307-8547-b0c77d15c9cd" containerID="2ec9bd0af95b323bd80398c61ee9dab119235538d356bb1054213418293e3a30" exitCode=0 Jul 06 01:13:07.073993 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:07.073965 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" event={"ID":"807fa46e-238f-4307-8547-b0c77d15c9cd","Type":"ContainerDied","Data":"2ec9bd0af95b323bd80398c61ee9dab119235538d356bb1054213418293e3a30"} Jul 06 01:13:07.074414 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:07.074335 2553 scope.go:117] "RemoveContainer" containerID="2ec9bd0af95b323bd80398c61ee9dab119235538d356bb1054213418293e3a30" Jul 06 01:13:07.075299 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:07.075270 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 06 01:13:07.075403 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:07.075339 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 06 01:13:07.075403 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:07.075372 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 06 01:13:08.055201 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:08.055172 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-7b4df4f969-wr92z" Jul 06 01:13:08.083364 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:08.083330 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" event={"ID":"807fa46e-238f-4307-8547-b0c77d15c9cd","Type":"ContainerStarted","Data":"62229425edb26eb70881c877f79a65ae752125df17614f2e2d5ded5fcf8e25bb"} Jul 06 01:13:09.034591 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:09.034555 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:13:09.034873 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:09.034814 2553 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-ntrsc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 06 01:13:09.034930 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:09.034904 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" podUID="807fa46e-238f-4307-8547-b0c77d15c9cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 06 01:13:10.034981 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:10.034944 2553 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-ntrsc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 06 01:13:10.035371 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:10.035018 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" podUID="807fa46e-238f-4307-8547-b0c77d15c9cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 06 01:13:11.035147 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:11.035102 2553 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-ntrsc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 06 01:13:11.035553 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:11.035170 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" podUID="807fa46e-238f-4307-8547-b0c77d15c9cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 06 01:13:12.035060 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:12.035015 2553 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-ntrsc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body= Jul 06 01:13:12.035239 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:12.035101 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" podUID="807fa46e-238f-4307-8547-b0c77d15c9cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" Jul 06 01:13:13.038930 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:13.038893 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:13:13.039394 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:13.039304 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:13:13.040052 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:13.040032 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ntrsc" Jul 06 01:13:13.052086 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:13.052066 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-z4grx" Jul 06 01:13:13.052189 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:13.052124 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-zprmm" Jul 06 01:13:46.646018 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:46.645980 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-s5v4k"] Jul 06 01:13:46.648544 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:46.648528 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5v4k" Jul 06 01:13:46.652086 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:46.652061 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 01:13:46.652227 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:46.652090 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xmhnf\"" Jul 06 01:13:46.652299 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:46.652097 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 06 01:13:46.652299 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:46.652115 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 01:13:46.658426 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:46.658400 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-s5v4k"] Jul 06 01:13:46.714242 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:46.714211 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fdce88da-aec2-4391-a206-8aead5283f6f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5v4k\" (UID: \"fdce88da-aec2-4391-a206-8aead5283f6f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5v4k" Jul 06 01:13:46.714242 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:46.714243 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fdce88da-aec2-4391-a206-8aead5283f6f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5v4k\" (UID: \"fdce88da-aec2-4391-a206-8aead5283f6f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5v4k" Jul 06 01:13:46.714430 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:46.714270 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fdce88da-aec2-4391-a206-8aead5283f6f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5v4k\" (UID: \"fdce88da-aec2-4391-a206-8aead5283f6f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5v4k" Jul 06 01:13:46.714430 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:46.714327 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fdce88da-aec2-4391-a206-8aead5283f6f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5v4k\" (UID: \"fdce88da-aec2-4391-a206-8aead5283f6f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5v4k" Jul 06 01:13:46.714430 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:46.714364 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbbj2\" (UniqueName: \"kubernetes.io/projected/fdce88da-aec2-4391-a206-8aead5283f6f-kube-api-access-jbbj2\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5v4k\" (UID: \"fdce88da-aec2-4391-a206-8aead5283f6f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5v4k" Jul 06 01:13:46.714430 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:46.714388 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdce88da-aec2-4391-a206-8aead5283f6f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5v4k\" (UID: \"fdce88da-aec2-4391-a206-8aead5283f6f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5v4k" Jul 06 01:13:46.815505 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:46.815470 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fdce88da-aec2-4391-a206-8aead5283f6f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5v4k\" (UID: \"fdce88da-aec2-4391-a206-8aead5283f6f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5v4k" Jul 06 01:13:46.815505 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:46.815508 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fdce88da-aec2-4391-a206-8aead5283f6f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5v4k\" (UID: \"fdce88da-aec2-4391-a206-8aead5283f6f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5v4k" Jul 06 01:13:46.815782 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:46.815531 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fdce88da-aec2-4391-a206-8aead5283f6f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5v4k\" (UID: \"fdce88da-aec2-4391-a206-8aead5283f6f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5v4k" Jul 06 01:13:46.815782 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:46.815550 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fdce88da-aec2-4391-a206-8aead5283f6f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5v4k\" (UID: \"fdce88da-aec2-4391-a206-8aead5283f6f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5v4k" Jul 06 01:13:46.815782 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:46.815568 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbbj2\" (UniqueName: \"kubernetes.io/projected/fdce88da-aec2-4391-a206-8aead5283f6f-kube-api-access-jbbj2\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5v4k\" (UID: \"fdce88da-aec2-4391-a206-8aead5283f6f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5v4k" Jul 06 01:13:46.815782 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:46.815586 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdce88da-aec2-4391-a206-8aead5283f6f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5v4k\" (UID: \"fdce88da-aec2-4391-a206-8aead5283f6f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5v4k" Jul 06 01:13:46.816007 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:46.815922 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fdce88da-aec2-4391-a206-8aead5283f6f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5v4k\" (UID: \"fdce88da-aec2-4391-a206-8aead5283f6f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5v4k" Jul 06 01:13:46.816007 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:46.815980 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fdce88da-aec2-4391-a206-8aead5283f6f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5v4k\" (UID: \"fdce88da-aec2-4391-a206-8aead5283f6f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5v4k" Jul 06 01:13:46.816085 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:46.816013 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fdce88da-aec2-4391-a206-8aead5283f6f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5v4k\" (UID: \"fdce88da-aec2-4391-a206-8aead5283f6f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5v4k" Jul 06 01:13:46.817938 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:46.817907 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fdce88da-aec2-4391-a206-8aead5283f6f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5v4k\" (UID: \"fdce88da-aec2-4391-a206-8aead5283f6f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5v4k" Jul 06 01:13:46.818172 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:46.818156 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdce88da-aec2-4391-a206-8aead5283f6f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5v4k\" (UID: \"fdce88da-aec2-4391-a206-8aead5283f6f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5v4k" Jul 06 01:13:46.824058 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:46.824032 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbbj2\" (UniqueName: \"kubernetes.io/projected/fdce88da-aec2-4391-a206-8aead5283f6f-kube-api-access-jbbj2\") pod \"e2e-trlp-test-simulated-kserve-598466548d-s5v4k\" (UID: \"fdce88da-aec2-4391-a206-8aead5283f6f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5v4k" Jul 06 01:13:46.961953 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:46.961917 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5v4k" Jul 06 01:13:47.099290 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:47.099265 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-s5v4k"] Jul 06 01:13:47.101262 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:13:47.101236 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdce88da_aec2_4391_a206_8aead5283f6f.slice/crio-0c2923647d00103c90193587278e5a2d8a957a2b8c6f29d6cfbc7f140a8957c3 WatchSource:0}: Error finding container 0c2923647d00103c90193587278e5a2d8a957a2b8c6f29d6cfbc7f140a8957c3: Status 404 returned error can't find the container with id 0c2923647d00103c90193587278e5a2d8a957a2b8c6f29d6cfbc7f140a8957c3 Jul 06 01:13:47.313873 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:47.313780 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5v4k" event={"ID":"fdce88da-aec2-4391-a206-8aead5283f6f","Type":"ContainerStarted","Data":"0c2923647d00103c90193587278e5a2d8a957a2b8c6f29d6cfbc7f140a8957c3"} Jul 06 01:13:48.322703 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:48.322626 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5v4k" event={"ID":"fdce88da-aec2-4391-a206-8aead5283f6f","Type":"ContainerStarted","Data":"ef744ce808ba760c363b20e47c8e2cd5e00b9f08bbe096d4261699060798c7da"} Jul 06 01:13:48.338375 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:48.338308 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5v4k" podStartSLOduration=1.319671058 podStartE2EDuration="2.338288605s" totalImagesPullingTime="1.018617547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:13:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:13:48.338082602 +0000 UTC m=+868.352455658" watchObservedRunningTime="2026-07-06 01:13:48.338288605 +0000 UTC m=+868.352661641" Jul 06 01:13:56.962074 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:56.962034 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5v4k" Jul 06 01:13:56.962542 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:56.962102 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5v4k" Jul 06 01:13:56.974240 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:56.974215 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5v4k" Jul 06 01:13:57.383030 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:13:57.382951 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-s5v4k" Jul 06 01:14:16.143517 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:14:16.143433 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-tz679"] Jul 06 01:14:16.146871 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:14:16.146844 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tz679" Jul 06 01:14:16.149337 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:14:16.149314 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 06 01:14:16.155327 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:14:16.155301 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-tz679"] Jul 06 01:14:16.189380 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:14:16.189341 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b44z6\" (UniqueName: \"kubernetes.io/projected/9a37f9aa-96ac-453a-a890-48b14dab47b7-kube-api-access-b44z6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tz679\" (UID: \"9a37f9aa-96ac-453a-a890-48b14dab47b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tz679" Jul 06 01:14:16.189539 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:14:16.189391 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a37f9aa-96ac-453a-a890-48b14dab47b7-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tz679\" (UID: \"9a37f9aa-96ac-453a-a890-48b14dab47b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tz679" Jul 06 01:14:16.189539 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:14:16.189421 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a37f9aa-96ac-453a-a890-48b14dab47b7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tz679\" (UID: \"9a37f9aa-96ac-453a-a890-48b14dab47b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tz679" Jul 06 01:14:16.189539 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:14:16.189507 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a37f9aa-96ac-453a-a890-48b14dab47b7-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tz679\" (UID: \"9a37f9aa-96ac-453a-a890-48b14dab47b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tz679" Jul 06 01:14:16.189730 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:14:16.189541 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a37f9aa-96ac-453a-a890-48b14dab47b7-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tz679\" (UID: \"9a37f9aa-96ac-453a-a890-48b14dab47b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tz679" Jul 06 01:14:16.189730 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:14:16.189569 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a37f9aa-96ac-453a-a890-48b14dab47b7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tz679\" (UID: \"9a37f9aa-96ac-453a-a890-48b14dab47b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tz679" Jul 06 01:14:16.290722 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:14:16.290649 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b44z6\" (UniqueName: \"kubernetes.io/projected/9a37f9aa-96ac-453a-a890-48b14dab47b7-kube-api-access-b44z6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tz679\" (UID: \"9a37f9aa-96ac-453a-a890-48b14dab47b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tz679" Jul 06 01:14:16.290913 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:14:16.290731 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a37f9aa-96ac-453a-a890-48b14dab47b7-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tz679\" (UID: \"9a37f9aa-96ac-453a-a890-48b14dab47b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tz679" Jul 06 01:14:16.290913 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:14:16.290796 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a37f9aa-96ac-453a-a890-48b14dab47b7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tz679\" (UID: \"9a37f9aa-96ac-453a-a890-48b14dab47b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tz679" Jul 06 01:14:16.290913 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:14:16.290837 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a37f9aa-96ac-453a-a890-48b14dab47b7-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tz679\" (UID: \"9a37f9aa-96ac-453a-a890-48b14dab47b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tz679" Jul 06 01:14:16.290913 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:14:16.290858 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a37f9aa-96ac-453a-a890-48b14dab47b7-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tz679\" (UID: \"9a37f9aa-96ac-453a-a890-48b14dab47b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tz679" Jul 06 01:14:16.290913 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:14:16.290888 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a37f9aa-96ac-453a-a890-48b14dab47b7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tz679\" (UID: \"9a37f9aa-96ac-453a-a890-48b14dab47b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tz679" Jul 06 01:14:16.291274 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:14:16.291246 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a37f9aa-96ac-453a-a890-48b14dab47b7-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tz679\" (UID: \"9a37f9aa-96ac-453a-a890-48b14dab47b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tz679" Jul 06 01:14:16.291394 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:14:16.291364 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a37f9aa-96ac-453a-a890-48b14dab47b7-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tz679\" (UID: \"9a37f9aa-96ac-453a-a890-48b14dab47b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tz679" Jul 06 01:14:16.291517 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:14:16.291425 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a37f9aa-96ac-453a-a890-48b14dab47b7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tz679\" (UID: \"9a37f9aa-96ac-453a-a890-48b14dab47b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tz679" Jul 06 01:14:16.293345 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:14:16.293321 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a37f9aa-96ac-453a-a890-48b14dab47b7-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tz679\" (UID: \"9a37f9aa-96ac-453a-a890-48b14dab47b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tz679" Jul 06 01:14:16.293514 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:14:16.293496 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a37f9aa-96ac-453a-a890-48b14dab47b7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tz679\" (UID: \"9a37f9aa-96ac-453a-a890-48b14dab47b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tz679" Jul 06 01:14:16.298627 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:14:16.298607 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b44z6\" (UniqueName: \"kubernetes.io/projected/9a37f9aa-96ac-453a-a890-48b14dab47b7-kube-api-access-b44z6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tz679\" (UID: \"9a37f9aa-96ac-453a-a890-48b14dab47b7\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tz679" Jul 06 01:14:16.481231 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:14:16.481198 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tz679" Jul 06 01:14:16.616837 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:14:16.616719 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-tz679"] Jul 06 01:14:16.619548 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:14:16.619516 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a37f9aa_96ac_453a_a890_48b14dab47b7.slice/crio-dd1219efa867ccdef7e07d018a45c84cbf3f03f1a0130a49469bf22ef81c0402 WatchSource:0}: Error finding container dd1219efa867ccdef7e07d018a45c84cbf3f03f1a0130a49469bf22ef81c0402: Status 404 returned error can't find the container with id dd1219efa867ccdef7e07d018a45c84cbf3f03f1a0130a49469bf22ef81c0402 Jul 06 01:14:17.482556 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:14:17.482515 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tz679" event={"ID":"9a37f9aa-96ac-453a-a890-48b14dab47b7","Type":"ContainerStarted","Data":"a5f52034025a597416f5235f67cc2e2e3ab2540994d27d364d011e2d437371c5"} Jul 06 01:14:17.483081 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:14:17.482579 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tz679" event={"ID":"9a37f9aa-96ac-453a-a890-48b14dab47b7","Type":"ContainerStarted","Data":"dd1219efa867ccdef7e07d018a45c84cbf3f03f1a0130a49469bf22ef81c0402"} Jul 06 01:14:17.502143 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:14:17.502084 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tz679" podStartSLOduration=1.300269617 podStartE2EDuration="1.502066697s" totalImagesPullingTime="201.79708ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:14:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:14:17.498769069 +0000 UTC m=+897.513142106" watchObservedRunningTime="2026-07-06 01:14:17.502066697 +0000 UTC m=+897.516439732" Jul 06 01:14:20.448349 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:14:20.448261 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-znllg_789b12fb-c3d0-428d-838c-f29718e69e2c/console-operator/1.log" Jul 06 01:14:20.451064 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:14:20.451039 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-znllg_789b12fb-c3d0-428d-838c-f29718e69e2c/console-operator/1.log" Jul 06 01:14:26.481559 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:14:26.481523 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tz679" Jul 06 01:14:26.481984 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:14:26.481585 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tz679" Jul 06 01:14:26.496340 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:14:26.496313 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tz679" Jul 06 01:14:26.547201 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:14:26.547169 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tz679" Jul 06 01:16:17.280978 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:17.280942 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c9c5cd9fb-7fvlp"] Jul 06 01:16:17.281581 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:17.281231 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7c9c5cd9fb-7fvlp" podUID="bc341162-b556-41f9-915c-6d627336e8d5" containerName="manager" containerID="cri-o://78a2e548d5688a97e545d5d0bf5535aa561d2e29752e54edc00c88c54c815e92" gracePeriod=30 Jul 06 01:16:17.535567 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:17.535507 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c9c5cd9fb-7fvlp" Jul 06 01:16:17.639896 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:17.639864 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86z7j\" (UniqueName: \"kubernetes.io/projected/bc341162-b556-41f9-915c-6d627336e8d5-kube-api-access-86z7j\") pod \"bc341162-b556-41f9-915c-6d627336e8d5\" (UID: \"bc341162-b556-41f9-915c-6d627336e8d5\") " Jul 06 01:16:17.640048 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:17.639973 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc341162-b556-41f9-915c-6d627336e8d5-webhook-cert\") pod \"bc341162-b556-41f9-915c-6d627336e8d5\" (UID: \"bc341162-b556-41f9-915c-6d627336e8d5\") " Jul 06 01:16:17.641909 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:17.641875 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc341162-b556-41f9-915c-6d627336e8d5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "bc341162-b556-41f9-915c-6d627336e8d5" (UID: "bc341162-b556-41f9-915c-6d627336e8d5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 01:16:17.642032 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:17.641998 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc341162-b556-41f9-915c-6d627336e8d5-kube-api-access-86z7j" (OuterVolumeSpecName: "kube-api-access-86z7j") pod "bc341162-b556-41f9-915c-6d627336e8d5" (UID: "bc341162-b556-41f9-915c-6d627336e8d5"). InnerVolumeSpecName "kube-api-access-86z7j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:16:17.741418 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:17.741380 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86z7j\" (UniqueName: \"kubernetes.io/projected/bc341162-b556-41f9-915c-6d627336e8d5-kube-api-access-86z7j\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:16:17.741418 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:17.741412 2553 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc341162-b556-41f9-915c-6d627336e8d5-webhook-cert\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:16:18.163500 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:18.163465 2553 generic.go:356] "Generic (PLEG): container finished" podID="bc341162-b556-41f9-915c-6d627336e8d5" containerID="78a2e548d5688a97e545d5d0bf5535aa561d2e29752e54edc00c88c54c815e92" exitCode=0 Jul 06 01:16:18.163712 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:18.163514 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c9c5cd9fb-7fvlp" Jul 06 01:16:18.163712 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:18.163552 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c9c5cd9fb-7fvlp" event={"ID":"bc341162-b556-41f9-915c-6d627336e8d5","Type":"ContainerDied","Data":"78a2e548d5688a97e545d5d0bf5535aa561d2e29752e54edc00c88c54c815e92"} Jul 06 01:16:18.163712 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:18.163610 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c9c5cd9fb-7fvlp" event={"ID":"bc341162-b556-41f9-915c-6d627336e8d5","Type":"ContainerDied","Data":"92c881bb3645ab14ddd5f0ae55d8f85077281526e1f077926a1b17e6ffa815f7"} Jul 06 01:16:18.163712 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:18.163640 2553 scope.go:117] "RemoveContainer" containerID="78a2e548d5688a97e545d5d0bf5535aa561d2e29752e54edc00c88c54c815e92" Jul 06 01:16:18.173687 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:18.173650 2553 scope.go:117] "RemoveContainer" containerID="78a2e548d5688a97e545d5d0bf5535aa561d2e29752e54edc00c88c54c815e92" Jul 06 01:16:18.173960 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:16:18.173941 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78a2e548d5688a97e545d5d0bf5535aa561d2e29752e54edc00c88c54c815e92\": container with ID starting with 78a2e548d5688a97e545d5d0bf5535aa561d2e29752e54edc00c88c54c815e92 not found: ID does not exist" containerID="78a2e548d5688a97e545d5d0bf5535aa561d2e29752e54edc00c88c54c815e92" Jul 06 01:16:18.174016 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:18.173970 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78a2e548d5688a97e545d5d0bf5535aa561d2e29752e54edc00c88c54c815e92"} err="failed to get container status \"78a2e548d5688a97e545d5d0bf5535aa561d2e29752e54edc00c88c54c815e92\": rpc error: code = NotFound desc = could not find container \"78a2e548d5688a97e545d5d0bf5535aa561d2e29752e54edc00c88c54c815e92\": container with ID starting with 78a2e548d5688a97e545d5d0bf5535aa561d2e29752e54edc00c88c54c815e92 not found: ID does not exist" Jul 06 01:16:18.184603 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:18.184568 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7c9c5cd9fb-7fvlp"] Jul 06 01:16:18.187792 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:18.187769 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7c9c5cd9fb-7fvlp"] Jul 06 01:16:18.493992 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:18.493950 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc341162-b556-41f9-915c-6d627336e8d5" path="/var/lib/kubelet/pods/bc341162-b556-41f9-915c-6d627336e8d5/volumes" Jul 06 01:16:18.956830 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:18.956741 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7c9c5cd9fb-8cpk2"] Jul 06 01:16:18.957251 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:18.957231 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc341162-b556-41f9-915c-6d627336e8d5" containerName="manager" Jul 06 01:16:18.957343 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:18.957253 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc341162-b556-41f9-915c-6d627336e8d5" containerName="manager" Jul 06 01:16:18.957415 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:18.957356 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc341162-b556-41f9-915c-6d627336e8d5" containerName="manager" Jul 06 01:16:18.961924 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:18.961900 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c9c5cd9fb-8cpk2" Jul 06 01:16:18.965510 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:18.965239 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 06 01:16:18.965510 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:18.965313 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 06 01:16:18.965510 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:18.965460 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6kc7g\"" Jul 06 01:16:18.969598 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:18.969570 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c9c5cd9fb-8cpk2"] Jul 06 01:16:19.054887 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:19.054852 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f7l2\" (UniqueName: \"kubernetes.io/projected/ee0bc880-6df3-49b0-804d-67501573457a-kube-api-access-7f7l2\") pod \"maas-controller-7c9c5cd9fb-8cpk2\" (UID: \"ee0bc880-6df3-49b0-804d-67501573457a\") " pod="opendatahub/maas-controller-7c9c5cd9fb-8cpk2" Jul 06 01:16:19.054887 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:19.054886 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee0bc880-6df3-49b0-804d-67501573457a-webhook-cert\") pod \"maas-controller-7c9c5cd9fb-8cpk2\" (UID: \"ee0bc880-6df3-49b0-804d-67501573457a\") " pod="opendatahub/maas-controller-7c9c5cd9fb-8cpk2" Jul 06 01:16:19.155619 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:19.155572 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f7l2\" (UniqueName: \"kubernetes.io/projected/ee0bc880-6df3-49b0-804d-67501573457a-kube-api-access-7f7l2\") pod \"maas-controller-7c9c5cd9fb-8cpk2\" (UID: \"ee0bc880-6df3-49b0-804d-67501573457a\") " pod="opendatahub/maas-controller-7c9c5cd9fb-8cpk2" Jul 06 01:16:19.155619 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:19.155618 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee0bc880-6df3-49b0-804d-67501573457a-webhook-cert\") pod \"maas-controller-7c9c5cd9fb-8cpk2\" (UID: \"ee0bc880-6df3-49b0-804d-67501573457a\") " pod="opendatahub/maas-controller-7c9c5cd9fb-8cpk2" Jul 06 01:16:19.158170 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:19.158151 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee0bc880-6df3-49b0-804d-67501573457a-webhook-cert\") pod \"maas-controller-7c9c5cd9fb-8cpk2\" (UID: \"ee0bc880-6df3-49b0-804d-67501573457a\") " pod="opendatahub/maas-controller-7c9c5cd9fb-8cpk2" Jul 06 01:16:19.163276 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:19.163257 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f7l2\" (UniqueName: \"kubernetes.io/projected/ee0bc880-6df3-49b0-804d-67501573457a-kube-api-access-7f7l2\") pod \"maas-controller-7c9c5cd9fb-8cpk2\" (UID: \"ee0bc880-6df3-49b0-804d-67501573457a\") " pod="opendatahub/maas-controller-7c9c5cd9fb-8cpk2" Jul 06 01:16:19.274521 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:19.274485 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7c9c5cd9fb-8cpk2" Jul 06 01:16:19.408402 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:19.408379 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7c9c5cd9fb-8cpk2"] Jul 06 01:16:19.410116 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:16:19.410086 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee0bc880_6df3_49b0_804d_67501573457a.slice/crio-d1716202c69f2871b6aa819ef7be10be20fa052afee2a24f1911cec0230bce0d WatchSource:0}: Error finding container d1716202c69f2871b6aa819ef7be10be20fa052afee2a24f1911cec0230bce0d: Status 404 returned error can't find the container with id d1716202c69f2871b6aa819ef7be10be20fa052afee2a24f1911cec0230bce0d Jul 06 01:16:20.178407 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:20.178369 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c9c5cd9fb-8cpk2" event={"ID":"ee0bc880-6df3-49b0-804d-67501573457a","Type":"ContainerStarted","Data":"4efa6128528c1f515a5da6191018e1a4f21095fdb3ac68ad6c7e701570326aa8"} Jul 06 01:16:20.178797 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:20.178431 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7c9c5cd9fb-8cpk2" event={"ID":"ee0bc880-6df3-49b0-804d-67501573457a","Type":"ContainerStarted","Data":"d1716202c69f2871b6aa819ef7be10be20fa052afee2a24f1911cec0230bce0d"} Jul 06 01:16:20.178797 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:20.178460 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7c9c5cd9fb-8cpk2" Jul 06 01:16:20.196185 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:20.196134 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7c9c5cd9fb-8cpk2" podStartSLOduration=1.628524818 podStartE2EDuration="2.19611823s" totalImagesPullingTime="567.593412ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:16:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:16:20.192458775 +0000 UTC m=+1020.206831832" watchObservedRunningTime="2026-07-06 01:16:20.19611823 +0000 UTC m=+1020.210491270" Jul 06 01:16:31.189564 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:16:31.189531 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7c9c5cd9fb-8cpk2" Jul 06 01:19:20.496602 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:19:20.496575 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-znllg_789b12fb-c3d0-428d-838c-f29718e69e2c/console-operator/1.log" Jul 06 01:19:20.500238 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:19:20.500213 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-znllg_789b12fb-c3d0-428d-838c-f29718e69e2c/console-operator/1.log" Jul 06 01:24:20.533878 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:24:20.533846 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-znllg_789b12fb-c3d0-428d-838c-f29718e69e2c/console-operator/1.log" Jul 06 01:24:20.541170 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:24:20.541147 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-znllg_789b12fb-c3d0-428d-838c-f29718e69e2c/console-operator/1.log" Jul 06 01:29:20.573931 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:29:20.573813 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-znllg_789b12fb-c3d0-428d-838c-f29718e69e2c/console-operator/1.log" Jul 06 01:29:20.582073 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:29:20.582052 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-znllg_789b12fb-c3d0-428d-838c-f29718e69e2c/console-operator/1.log" Jul 06 01:34:20.611035 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:20.610932 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-znllg_789b12fb-c3d0-428d-838c-f29718e69e2c/console-operator/1.log" Jul 06 01:34:20.619047 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:20.619024 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-znllg_789b12fb-c3d0-428d-838c-f29718e69e2c/console-operator/1.log" Jul 06 01:34:39.449560 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:39.449510 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7"] Jul 06 01:34:39.453630 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:39.453606 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7" Jul 06 01:34:39.457234 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:39.457208 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-c2d358\"/\"test-model-c2d358-kserve-self-signed-certs\"" Jul 06 01:34:39.457374 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:39.457209 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-c2d358\"/\"kube-root-ca.crt\"" Jul 06 01:34:39.457374 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:39.457208 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-c2d358\"/\"openshift-service-ca.crt\"" Jul 06 01:34:39.457374 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:39.457267 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-c2d358\"/\"default-dockercfg-69hnr\"" Jul 06 01:34:39.462867 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:39.462841 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7"] Jul 06 01:34:39.593506 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:39.593469 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/009ff798-7d4c-4d48-b08c-790843b1677d-model-cache\") pod \"test-model-c2d358-kserve-86b9f4d987-4p4q7\" (UID: \"009ff798-7d4c-4d48-b08c-790843b1677d\") " pod="ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7" Jul 06 01:34:39.593729 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:39.593536 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/009ff798-7d4c-4d48-b08c-790843b1677d-home\") pod \"test-model-c2d358-kserve-86b9f4d987-4p4q7\" (UID: \"009ff798-7d4c-4d48-b08c-790843b1677d\") " pod="ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7" Jul 06 01:34:39.593729 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:39.593635 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/009ff798-7d4c-4d48-b08c-790843b1677d-dshm\") pod \"test-model-c2d358-kserve-86b9f4d987-4p4q7\" (UID: \"009ff798-7d4c-4d48-b08c-790843b1677d\") " pod="ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7" Jul 06 01:34:39.593729 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:39.593658 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/009ff798-7d4c-4d48-b08c-790843b1677d-tmp-dir\") pod \"test-model-c2d358-kserve-86b9f4d987-4p4q7\" (UID: \"009ff798-7d4c-4d48-b08c-790843b1677d\") " pod="ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7" Jul 06 01:34:39.593729 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:39.593719 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd6rg\" (UniqueName: \"kubernetes.io/projected/009ff798-7d4c-4d48-b08c-790843b1677d-kube-api-access-zd6rg\") pod \"test-model-c2d358-kserve-86b9f4d987-4p4q7\" (UID: \"009ff798-7d4c-4d48-b08c-790843b1677d\") " pod="ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7" Jul 06 01:34:39.593954 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:39.593741 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/009ff798-7d4c-4d48-b08c-790843b1677d-tls-certs\") pod \"test-model-c2d358-kserve-86b9f4d987-4p4q7\" (UID: \"009ff798-7d4c-4d48-b08c-790843b1677d\") " pod="ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7" Jul 06 01:34:39.695099 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:39.695061 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/009ff798-7d4c-4d48-b08c-790843b1677d-model-cache\") pod \"test-model-c2d358-kserve-86b9f4d987-4p4q7\" (UID: \"009ff798-7d4c-4d48-b08c-790843b1677d\") " pod="ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7" Jul 06 01:34:39.695303 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:39.695122 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/009ff798-7d4c-4d48-b08c-790843b1677d-home\") pod \"test-model-c2d358-kserve-86b9f4d987-4p4q7\" (UID: \"009ff798-7d4c-4d48-b08c-790843b1677d\") " pod="ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7" Jul 06 01:34:39.695303 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:39.695162 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/009ff798-7d4c-4d48-b08c-790843b1677d-dshm\") pod \"test-model-c2d358-kserve-86b9f4d987-4p4q7\" (UID: \"009ff798-7d4c-4d48-b08c-790843b1677d\") " pod="ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7" Jul 06 01:34:39.695303 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:39.695178 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/009ff798-7d4c-4d48-b08c-790843b1677d-tmp-dir\") pod \"test-model-c2d358-kserve-86b9f4d987-4p4q7\" (UID: \"009ff798-7d4c-4d48-b08c-790843b1677d\") " pod="ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7" Jul 06 01:34:39.695303 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:39.695205 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd6rg\" (UniqueName: \"kubernetes.io/projected/009ff798-7d4c-4d48-b08c-790843b1677d-kube-api-access-zd6rg\") pod \"test-model-c2d358-kserve-86b9f4d987-4p4q7\" (UID: \"009ff798-7d4c-4d48-b08c-790843b1677d\") " pod="ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7" Jul 06 01:34:39.695303 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:39.695227 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/009ff798-7d4c-4d48-b08c-790843b1677d-tls-certs\") pod \"test-model-c2d358-kserve-86b9f4d987-4p4q7\" (UID: \"009ff798-7d4c-4d48-b08c-790843b1677d\") " pod="ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7" Jul 06 01:34:39.695614 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:39.695560 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/009ff798-7d4c-4d48-b08c-790843b1677d-model-cache\") pod \"test-model-c2d358-kserve-86b9f4d987-4p4q7\" (UID: \"009ff798-7d4c-4d48-b08c-790843b1677d\") " pod="ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7" Jul 06 01:34:39.695614 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:39.695603 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/009ff798-7d4c-4d48-b08c-790843b1677d-tmp-dir\") pod \"test-model-c2d358-kserve-86b9f4d987-4p4q7\" (UID: \"009ff798-7d4c-4d48-b08c-790843b1677d\") " pod="ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7" Jul 06 01:34:39.695734 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:39.695627 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/009ff798-7d4c-4d48-b08c-790843b1677d-home\") pod \"test-model-c2d358-kserve-86b9f4d987-4p4q7\" (UID: \"009ff798-7d4c-4d48-b08c-790843b1677d\") " pod="ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7" Jul 06 01:34:39.697563 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:39.697533 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/009ff798-7d4c-4d48-b08c-790843b1677d-dshm\") pod \"test-model-c2d358-kserve-86b9f4d987-4p4q7\" (UID: \"009ff798-7d4c-4d48-b08c-790843b1677d\") " pod="ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7" Jul 06 01:34:39.697681 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:39.697650 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/009ff798-7d4c-4d48-b08c-790843b1677d-tls-certs\") pod \"test-model-c2d358-kserve-86b9f4d987-4p4q7\" (UID: \"009ff798-7d4c-4d48-b08c-790843b1677d\") " pod="ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7" Jul 06 01:34:39.702685 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:39.702606 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd6rg\" (UniqueName: \"kubernetes.io/projected/009ff798-7d4c-4d48-b08c-790843b1677d-kube-api-access-zd6rg\") pod \"test-model-c2d358-kserve-86b9f4d987-4p4q7\" (UID: \"009ff798-7d4c-4d48-b08c-790843b1677d\") " pod="ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7" Jul 06 01:34:39.764717 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:39.764681 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7" Jul 06 01:34:39.902695 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:39.902653 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7"] Jul 06 01:34:39.904819 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:34:39.904792 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod009ff798_7d4c_4d48_b08c_790843b1677d.slice/crio-7029716a41b4db10708468b4d82e212b09ed5696e8dc34e562ea05b0d75aa46a WatchSource:0}: Error finding container 7029716a41b4db10708468b4d82e212b09ed5696e8dc34e562ea05b0d75aa46a: Status 404 returned error can't find the container with id 7029716a41b4db10708468b4d82e212b09ed5696e8dc34e562ea05b0d75aa46a Jul 06 01:34:40.427531 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:40.427429 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7" event={"ID":"009ff798-7d4c-4d48-b08c-790843b1677d","Type":"ContainerStarted","Data":"2acd670ea4e87fcec108b0b75b8da04faf4fee3dcf7e7c23ee0486bc1d880b51"} Jul 06 01:34:40.427531 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:40.427478 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7" event={"ID":"009ff798-7d4c-4d48-b08c-790843b1677d","Type":"ContainerStarted","Data":"7029716a41b4db10708468b4d82e212b09ed5696e8dc34e562ea05b0d75aa46a"} Jul 06 01:34:40.443237 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:40.443171 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7" podStartSLOduration=1.443156582 podStartE2EDuration="1.443156582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:34:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:34:40.442095869 +0000 UTC m=+2120.456468905" watchObservedRunningTime="2026-07-06 01:34:40.443156582 +0000 UTC m=+2120.457529618" Jul 06 01:34:49.765770 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:49.765735 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7" Jul 06 01:34:49.765770 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:49.765780 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7" Jul 06 01:34:49.779092 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:49.779066 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7" Jul 06 01:34:50.496390 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:34:50.496347 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7" Jul 06 01:35:11.665313 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:35:11.665277 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7"] Jul 06 01:35:26.686936 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:35:26.686877 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7" podUID="009ff798-7d4c-4d48-b08c-790843b1677d" containerName="main" containerID="cri-o://2acd670ea4e87fcec108b0b75b8da04faf4fee3dcf7e7c23ee0486bc1d880b51" gracePeriod=45 Jul 06 01:35:26.952488 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:35:26.952463 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7" Jul 06 01:35:27.028159 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:35:27.028126 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/009ff798-7d4c-4d48-b08c-790843b1677d-model-cache\") pod \"009ff798-7d4c-4d48-b08c-790843b1677d\" (UID: \"009ff798-7d4c-4d48-b08c-790843b1677d\") " Jul 06 01:35:27.028159 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:35:27.028159 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zd6rg\" (UniqueName: \"kubernetes.io/projected/009ff798-7d4c-4d48-b08c-790843b1677d-kube-api-access-zd6rg\") pod \"009ff798-7d4c-4d48-b08c-790843b1677d\" (UID: \"009ff798-7d4c-4d48-b08c-790843b1677d\") " Jul 06 01:35:27.028409 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:35:27.028225 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/009ff798-7d4c-4d48-b08c-790843b1677d-tmp-dir\") pod \"009ff798-7d4c-4d48-b08c-790843b1677d\" (UID: \"009ff798-7d4c-4d48-b08c-790843b1677d\") " Jul 06 01:35:27.028409 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:35:27.028276 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/009ff798-7d4c-4d48-b08c-790843b1677d-home\") pod \"009ff798-7d4c-4d48-b08c-790843b1677d\" (UID: \"009ff798-7d4c-4d48-b08c-790843b1677d\") " Jul 06 01:35:27.028409 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:35:27.028352 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/009ff798-7d4c-4d48-b08c-790843b1677d-dshm\") pod \"009ff798-7d4c-4d48-b08c-790843b1677d\" (UID: \"009ff798-7d4c-4d48-b08c-790843b1677d\") " Jul 06 01:35:27.028588 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:35:27.028411 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/009ff798-7d4c-4d48-b08c-790843b1677d-tls-certs\") pod \"009ff798-7d4c-4d48-b08c-790843b1677d\" (UID: \"009ff798-7d4c-4d48-b08c-790843b1677d\") " Jul 06 01:35:27.028588 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:35:27.028519 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/009ff798-7d4c-4d48-b08c-790843b1677d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "009ff798-7d4c-4d48-b08c-790843b1677d" (UID: "009ff798-7d4c-4d48-b08c-790843b1677d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:35:27.028588 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:35:27.028527 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/009ff798-7d4c-4d48-b08c-790843b1677d-model-cache" (OuterVolumeSpecName: "model-cache") pod "009ff798-7d4c-4d48-b08c-790843b1677d" (UID: "009ff798-7d4c-4d48-b08c-790843b1677d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:35:27.028728 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:35:27.028586 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/009ff798-7d4c-4d48-b08c-790843b1677d-home" (OuterVolumeSpecName: "home") pod "009ff798-7d4c-4d48-b08c-790843b1677d" (UID: "009ff798-7d4c-4d48-b08c-790843b1677d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:35:27.028862 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:35:27.028841 2553 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/009ff798-7d4c-4d48-b08c-790843b1677d-model-cache\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:35:27.028862 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:35:27.028860 2553 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/009ff798-7d4c-4d48-b08c-790843b1677d-tmp-dir\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:35:27.029044 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:35:27.028870 2553 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/009ff798-7d4c-4d48-b08c-790843b1677d-home\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:35:27.030653 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:35:27.030631 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/009ff798-7d4c-4d48-b08c-790843b1677d-dshm" (OuterVolumeSpecName: "dshm") pod "009ff798-7d4c-4d48-b08c-790843b1677d" (UID: "009ff798-7d4c-4d48-b08c-790843b1677d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:35:27.030653 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:35:27.030644 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/009ff798-7d4c-4d48-b08c-790843b1677d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "009ff798-7d4c-4d48-b08c-790843b1677d" (UID: "009ff798-7d4c-4d48-b08c-790843b1677d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 01:35:27.030799 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:35:27.030630 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/009ff798-7d4c-4d48-b08c-790843b1677d-kube-api-access-zd6rg" (OuterVolumeSpecName: "kube-api-access-zd6rg") pod "009ff798-7d4c-4d48-b08c-790843b1677d" (UID: "009ff798-7d4c-4d48-b08c-790843b1677d"). InnerVolumeSpecName "kube-api-access-zd6rg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:35:27.129853 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:35:27.129822 2553 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/009ff798-7d4c-4d48-b08c-790843b1677d-dshm\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:35:27.129853 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:35:27.129847 2553 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/009ff798-7d4c-4d48-b08c-790843b1677d-tls-certs\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:35:27.129853 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:35:27.129858 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zd6rg\" (UniqueName: \"kubernetes.io/projected/009ff798-7d4c-4d48-b08c-790843b1677d-kube-api-access-zd6rg\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:35:27.698378 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:35:27.698340 2553 generic.go:356] "Generic (PLEG): container finished" podID="009ff798-7d4c-4d48-b08c-790843b1677d" containerID="2acd670ea4e87fcec108b0b75b8da04faf4fee3dcf7e7c23ee0486bc1d880b51" exitCode=0 Jul 06 01:35:27.698802 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:35:27.698390 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7" Jul 06 01:35:27.698802 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:35:27.698420 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7" event={"ID":"009ff798-7d4c-4d48-b08c-790843b1677d","Type":"ContainerDied","Data":"2acd670ea4e87fcec108b0b75b8da04faf4fee3dcf7e7c23ee0486bc1d880b51"} Jul 06 01:35:27.698802 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:35:27.698465 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7" event={"ID":"009ff798-7d4c-4d48-b08c-790843b1677d","Type":"ContainerDied","Data":"7029716a41b4db10708468b4d82e212b09ed5696e8dc34e562ea05b0d75aa46a"} Jul 06 01:35:27.698802 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:35:27.698482 2553 scope.go:117] "RemoveContainer" containerID="2acd670ea4e87fcec108b0b75b8da04faf4fee3dcf7e7c23ee0486bc1d880b51" Jul 06 01:35:27.708367 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:35:27.708347 2553 scope.go:117] "RemoveContainer" containerID="2acd670ea4e87fcec108b0b75b8da04faf4fee3dcf7e7c23ee0486bc1d880b51" Jul 06 01:35:27.708613 ip-10-0-135-61 kubenswrapper[2553]: E0706 01:35:27.708594 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2acd670ea4e87fcec108b0b75b8da04faf4fee3dcf7e7c23ee0486bc1d880b51\": container with ID starting with 2acd670ea4e87fcec108b0b75b8da04faf4fee3dcf7e7c23ee0486bc1d880b51 not found: ID does not exist" containerID="2acd670ea4e87fcec108b0b75b8da04faf4fee3dcf7e7c23ee0486bc1d880b51" Jul 06 01:35:27.708701 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:35:27.708625 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2acd670ea4e87fcec108b0b75b8da04faf4fee3dcf7e7c23ee0486bc1d880b51"} err="failed to get container status \"2acd670ea4e87fcec108b0b75b8da04faf4fee3dcf7e7c23ee0486bc1d880b51\": rpc error: code = NotFound desc = could not find container \"2acd670ea4e87fcec108b0b75b8da04faf4fee3dcf7e7c23ee0486bc1d880b51\": container with ID starting with 2acd670ea4e87fcec108b0b75b8da04faf4fee3dcf7e7c23ee0486bc1d880b51 not found: ID does not exist" Jul 06 01:35:27.719955 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:35:27.719932 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7"] Jul 06 01:35:27.723725 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:35:27.723703 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-c2d358/test-model-c2d358-kserve-86b9f4d987-4p4q7"] Jul 06 01:35:28.493983 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:35:28.493952 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="009ff798-7d4c-4d48-b08c-790843b1677d" path="/var/lib/kubelet/pods/009ff798-7d4c-4d48-b08c-790843b1677d/volumes" Jul 06 01:39:20.647826 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:20.647702 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-znllg_789b12fb-c3d0-428d-838c-f29718e69e2c/console-operator/1.log" Jul 06 01:39:20.656987 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:20.656966 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-znllg_789b12fb-c3d0-428d-838c-f29718e69e2c/console-operator/1.log" Jul 06 01:39:50.955550 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:50.955450 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk"] Jul 06 01:39:50.956515 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:50.956481 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="009ff798-7d4c-4d48-b08c-790843b1677d" containerName="main" Jul 06 01:39:50.956515 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:50.956516 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="009ff798-7d4c-4d48-b08c-790843b1677d" containerName="main" Jul 06 01:39:50.956828 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:50.956809 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="009ff798-7d4c-4d48-b08c-790843b1677d" containerName="main" Jul 06 01:39:50.961006 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:50.960979 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk" Jul 06 01:39:50.964956 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:50.964926 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7b5094\"/\"sub-test-model-7b5094-kserve-self-signed-certs\"" Jul 06 01:39:50.965094 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:50.965068 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7b5094\"/\"openshift-service-ca.crt\"" Jul 06 01:39:50.965198 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:50.965180 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7b5094\"/\"default-dockercfg-skb6x\"" Jul 06 01:39:50.965318 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:50.965303 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7b5094\"/\"kube-root-ca.crt\"" Jul 06 01:39:50.969111 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:50.969085 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk"] Jul 06 01:39:51.096028 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:51.095990 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2118bb2c-9bee-44ea-b13a-c94e3195cb45-tmp-dir\") pod \"sub-test-model-7b5094-kserve-7bf987cb57-hv7wk\" (UID: \"2118bb2c-9bee-44ea-b13a-c94e3195cb45\") " pod="ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk" Jul 06 01:39:51.096194 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:51.096064 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2118bb2c-9bee-44ea-b13a-c94e3195cb45-dshm\") pod \"sub-test-model-7b5094-kserve-7bf987cb57-hv7wk\" (UID: \"2118bb2c-9bee-44ea-b13a-c94e3195cb45\") " pod="ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk" Jul 06 01:39:51.096194 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:51.096099 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2118bb2c-9bee-44ea-b13a-c94e3195cb45-model-cache\") pod \"sub-test-model-7b5094-kserve-7bf987cb57-hv7wk\" (UID: \"2118bb2c-9bee-44ea-b13a-c94e3195cb45\") " pod="ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk" Jul 06 01:39:51.096194 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:51.096170 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2118bb2c-9bee-44ea-b13a-c94e3195cb45-home\") pod \"sub-test-model-7b5094-kserve-7bf987cb57-hv7wk\" (UID: \"2118bb2c-9bee-44ea-b13a-c94e3195cb45\") " pod="ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk" Jul 06 01:39:51.096311 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:51.096201 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2118bb2c-9bee-44ea-b13a-c94e3195cb45-tls-certs\") pod \"sub-test-model-7b5094-kserve-7bf987cb57-hv7wk\" (UID: \"2118bb2c-9bee-44ea-b13a-c94e3195cb45\") " pod="ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk" Jul 06 01:39:51.096311 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:51.096240 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtlzv\" (UniqueName: \"kubernetes.io/projected/2118bb2c-9bee-44ea-b13a-c94e3195cb45-kube-api-access-xtlzv\") pod \"sub-test-model-7b5094-kserve-7bf987cb57-hv7wk\" (UID: \"2118bb2c-9bee-44ea-b13a-c94e3195cb45\") " pod="ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk" Jul 06 01:39:51.196827 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:51.196788 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2118bb2c-9bee-44ea-b13a-c94e3195cb45-tmp-dir\") pod \"sub-test-model-7b5094-kserve-7bf987cb57-hv7wk\" (UID: \"2118bb2c-9bee-44ea-b13a-c94e3195cb45\") " pod="ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk" Jul 06 01:39:51.197004 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:51.196838 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2118bb2c-9bee-44ea-b13a-c94e3195cb45-dshm\") pod \"sub-test-model-7b5094-kserve-7bf987cb57-hv7wk\" (UID: \"2118bb2c-9bee-44ea-b13a-c94e3195cb45\") " pod="ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk" Jul 06 01:39:51.197004 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:51.196958 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2118bb2c-9bee-44ea-b13a-c94e3195cb45-model-cache\") pod \"sub-test-model-7b5094-kserve-7bf987cb57-hv7wk\" (UID: \"2118bb2c-9bee-44ea-b13a-c94e3195cb45\") " pod="ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk" Jul 06 01:39:51.197134 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:51.197005 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2118bb2c-9bee-44ea-b13a-c94e3195cb45-home\") pod \"sub-test-model-7b5094-kserve-7bf987cb57-hv7wk\" (UID: \"2118bb2c-9bee-44ea-b13a-c94e3195cb45\") " pod="ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk" Jul 06 01:39:51.197134 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:51.197030 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2118bb2c-9bee-44ea-b13a-c94e3195cb45-tls-certs\") pod \"sub-test-model-7b5094-kserve-7bf987cb57-hv7wk\" (UID: \"2118bb2c-9bee-44ea-b13a-c94e3195cb45\") " pod="ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk" Jul 06 01:39:51.197243 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:51.197153 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtlzv\" (UniqueName: \"kubernetes.io/projected/2118bb2c-9bee-44ea-b13a-c94e3195cb45-kube-api-access-xtlzv\") pod \"sub-test-model-7b5094-kserve-7bf987cb57-hv7wk\" (UID: \"2118bb2c-9bee-44ea-b13a-c94e3195cb45\") " pod="ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk" Jul 06 01:39:51.197243 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:51.197223 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2118bb2c-9bee-44ea-b13a-c94e3195cb45-tmp-dir\") pod \"sub-test-model-7b5094-kserve-7bf987cb57-hv7wk\" (UID: \"2118bb2c-9bee-44ea-b13a-c94e3195cb45\") " pod="ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk" Jul 06 01:39:51.197355 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:51.197279 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2118bb2c-9bee-44ea-b13a-c94e3195cb45-home\") pod \"sub-test-model-7b5094-kserve-7bf987cb57-hv7wk\" (UID: \"2118bb2c-9bee-44ea-b13a-c94e3195cb45\") " pod="ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk" Jul 06 01:39:51.197417 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:51.197367 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2118bb2c-9bee-44ea-b13a-c94e3195cb45-model-cache\") pod \"sub-test-model-7b5094-kserve-7bf987cb57-hv7wk\" (UID: \"2118bb2c-9bee-44ea-b13a-c94e3195cb45\") " pod="ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk" Jul 06 01:39:51.199306 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:51.199280 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2118bb2c-9bee-44ea-b13a-c94e3195cb45-dshm\") pod \"sub-test-model-7b5094-kserve-7bf987cb57-hv7wk\" (UID: \"2118bb2c-9bee-44ea-b13a-c94e3195cb45\") " pod="ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk" Jul 06 01:39:51.199480 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:51.199461 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2118bb2c-9bee-44ea-b13a-c94e3195cb45-tls-certs\") pod \"sub-test-model-7b5094-kserve-7bf987cb57-hv7wk\" (UID: \"2118bb2c-9bee-44ea-b13a-c94e3195cb45\") " pod="ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk" Jul 06 01:39:51.208192 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:51.208115 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtlzv\" (UniqueName: \"kubernetes.io/projected/2118bb2c-9bee-44ea-b13a-c94e3195cb45-kube-api-access-xtlzv\") pod \"sub-test-model-7b5094-kserve-7bf987cb57-hv7wk\" (UID: \"2118bb2c-9bee-44ea-b13a-c94e3195cb45\") " pod="ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk" Jul 06 01:39:51.272782 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:51.272737 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk" Jul 06 01:39:51.419802 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:51.419772 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk"] Jul 06 01:39:51.420951 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:39:51.420920 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2118bb2c_9bee_44ea_b13a_c94e3195cb45.slice/crio-9b7b592eaf2dec0a39bcf2400ca25b6f9c570db62713378141deefda45369dab WatchSource:0}: Error finding container 9b7b592eaf2dec0a39bcf2400ca25b6f9c570db62713378141deefda45369dab: Status 404 returned error can't find the container with id 9b7b592eaf2dec0a39bcf2400ca25b6f9c570db62713378141deefda45369dab Jul 06 01:39:52.181135 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:52.181094 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk" event={"ID":"2118bb2c-9bee-44ea-b13a-c94e3195cb45","Type":"ContainerStarted","Data":"51a7761aed6f6486a6e2572be3f585efd5d566127e561416105abba4b496f382"} Jul 06 01:39:52.181135 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:52.181143 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk" event={"ID":"2118bb2c-9bee-44ea-b13a-c94e3195cb45","Type":"ContainerStarted","Data":"9b7b592eaf2dec0a39bcf2400ca25b6f9c570db62713378141deefda45369dab"} Jul 06 01:39:52.201703 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:39:52.201624 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk" podStartSLOduration=2.201599532 podStartE2EDuration="2.201599532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 01:39:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:39:52.198443773 +0000 UTC m=+2432.212816809" watchObservedRunningTime="2026-07-06 01:39:52.201599532 +0000 UTC m=+2432.215972569" Jul 06 01:40:01.273808 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:40:01.273752 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk" Jul 06 01:40:01.274241 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:40:01.273836 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk" Jul 06 01:40:01.286367 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:40:01.286332 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk" Jul 06 01:40:02.256211 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:40:02.256178 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk" Jul 06 01:40:45.367819 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:40:45.367784 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk"] Jul 06 01:41:00.388893 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:41:00.388842 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk" podUID="2118bb2c-9bee-44ea-b13a-c94e3195cb45" containerName="main" containerID="cri-o://51a7761aed6f6486a6e2572be3f585efd5d566127e561416105abba4b496f382" gracePeriod=45 Jul 06 01:41:00.578326 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:41:00.578292 2553 generic.go:356] "Generic (PLEG): container finished" podID="2118bb2c-9bee-44ea-b13a-c94e3195cb45" containerID="51a7761aed6f6486a6e2572be3f585efd5d566127e561416105abba4b496f382" exitCode=0 Jul 06 01:41:00.578487 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:41:00.578322 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk" event={"ID":"2118bb2c-9bee-44ea-b13a-c94e3195cb45","Type":"ContainerDied","Data":"51a7761aed6f6486a6e2572be3f585efd5d566127e561416105abba4b496f382"} Jul 06 01:41:00.649248 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:41:00.649188 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk" Jul 06 01:41:00.769290 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:41:00.769253 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2118bb2c-9bee-44ea-b13a-c94e3195cb45-home\") pod \"2118bb2c-9bee-44ea-b13a-c94e3195cb45\" (UID: \"2118bb2c-9bee-44ea-b13a-c94e3195cb45\") " Jul 06 01:41:00.769290 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:41:00.769307 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2118bb2c-9bee-44ea-b13a-c94e3195cb45-dshm\") pod \"2118bb2c-9bee-44ea-b13a-c94e3195cb45\" (UID: \"2118bb2c-9bee-44ea-b13a-c94e3195cb45\") " Jul 06 01:41:00.769557 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:41:00.769345 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2118bb2c-9bee-44ea-b13a-c94e3195cb45-model-cache\") pod \"2118bb2c-9bee-44ea-b13a-c94e3195cb45\" (UID: \"2118bb2c-9bee-44ea-b13a-c94e3195cb45\") " Jul 06 01:41:00.769557 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:41:00.769374 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtlzv\" (UniqueName: \"kubernetes.io/projected/2118bb2c-9bee-44ea-b13a-c94e3195cb45-kube-api-access-xtlzv\") pod \"2118bb2c-9bee-44ea-b13a-c94e3195cb45\" (UID: \"2118bb2c-9bee-44ea-b13a-c94e3195cb45\") " Jul 06 01:41:00.769557 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:41:00.769398 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2118bb2c-9bee-44ea-b13a-c94e3195cb45-tmp-dir\") pod \"2118bb2c-9bee-44ea-b13a-c94e3195cb45\" (UID: \"2118bb2c-9bee-44ea-b13a-c94e3195cb45\") " Jul 06 01:41:00.769557 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:41:00.769446 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2118bb2c-9bee-44ea-b13a-c94e3195cb45-tls-certs\") pod \"2118bb2c-9bee-44ea-b13a-c94e3195cb45\" (UID: \"2118bb2c-9bee-44ea-b13a-c94e3195cb45\") " Jul 06 01:41:00.769810 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:41:00.769611 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2118bb2c-9bee-44ea-b13a-c94e3195cb45-home" (OuterVolumeSpecName: "home") pod "2118bb2c-9bee-44ea-b13a-c94e3195cb45" (UID: "2118bb2c-9bee-44ea-b13a-c94e3195cb45"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:41:00.769810 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:41:00.769710 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2118bb2c-9bee-44ea-b13a-c94e3195cb45-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2118bb2c-9bee-44ea-b13a-c94e3195cb45" (UID: "2118bb2c-9bee-44ea-b13a-c94e3195cb45"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:41:00.769810 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:41:00.769730 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2118bb2c-9bee-44ea-b13a-c94e3195cb45-model-cache" (OuterVolumeSpecName: "model-cache") pod "2118bb2c-9bee-44ea-b13a-c94e3195cb45" (UID: "2118bb2c-9bee-44ea-b13a-c94e3195cb45"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:41:00.769959 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:41:00.769889 2553 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2118bb2c-9bee-44ea-b13a-c94e3195cb45-tmp-dir\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:41:00.769959 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:41:00.769909 2553 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2118bb2c-9bee-44ea-b13a-c94e3195cb45-home\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:41:00.769959 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:41:00.769922 2553 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2118bb2c-9bee-44ea-b13a-c94e3195cb45-model-cache\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:41:00.771738 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:41:00.771706 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2118bb2c-9bee-44ea-b13a-c94e3195cb45-dshm" (OuterVolumeSpecName: "dshm") pod "2118bb2c-9bee-44ea-b13a-c94e3195cb45" (UID: "2118bb2c-9bee-44ea-b13a-c94e3195cb45"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 01:41:00.771846 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:41:00.771750 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2118bb2c-9bee-44ea-b13a-c94e3195cb45-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2118bb2c-9bee-44ea-b13a-c94e3195cb45" (UID: "2118bb2c-9bee-44ea-b13a-c94e3195cb45"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 01:41:00.771846 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:41:00.771784 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2118bb2c-9bee-44ea-b13a-c94e3195cb45-kube-api-access-xtlzv" (OuterVolumeSpecName: "kube-api-access-xtlzv") pod "2118bb2c-9bee-44ea-b13a-c94e3195cb45" (UID: "2118bb2c-9bee-44ea-b13a-c94e3195cb45"). InnerVolumeSpecName "kube-api-access-xtlzv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 01:41:00.870512 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:41:00.870474 2553 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2118bb2c-9bee-44ea-b13a-c94e3195cb45-dshm\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:41:00.870512 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:41:00.870504 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtlzv\" (UniqueName: \"kubernetes.io/projected/2118bb2c-9bee-44ea-b13a-c94e3195cb45-kube-api-access-xtlzv\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:41:00.870512 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:41:00.870514 2553 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2118bb2c-9bee-44ea-b13a-c94e3195cb45-tls-certs\") on node \"ip-10-0-135-61.ec2.internal\" DevicePath \"\"" Jul 06 01:41:01.585192 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:41:01.585159 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk" event={"ID":"2118bb2c-9bee-44ea-b13a-c94e3195cb45","Type":"ContainerDied","Data":"9b7b592eaf2dec0a39bcf2400ca25b6f9c570db62713378141deefda45369dab"} Jul 06 01:41:01.585653 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:41:01.585204 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk" Jul 06 01:41:01.585653 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:41:01.585214 2553 scope.go:117] "RemoveContainer" containerID="51a7761aed6f6486a6e2572be3f585efd5d566127e561416105abba4b496f382" Jul 06 01:41:01.609620 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:41:01.609593 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk"] Jul 06 01:41:01.613279 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:41:01.613256 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-7b5094/sub-test-model-7b5094-kserve-7bf987cb57-hv7wk"] Jul 06 01:41:02.493686 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:41:02.493636 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2118bb2c-9bee-44ea-b13a-c94e3195cb45" path="/var/lib/kubelet/pods/2118bb2c-9bee-44ea-b13a-c94e3195cb45/volumes" Jul 06 01:43:07.451309 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:07.451275 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-dhqht_704bbd8f-64ae-4fb0-a0f9-56aeca2b0b52/manager/0.log" Jul 06 01:43:07.565424 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:07.565392 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-q26sx_c55a933a-9e16-4999-b294-316a1fd4f9d9/manager/0.log" Jul 06 01:43:07.685330 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:07.685300 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7b4df4f969-wr92z_903364cb-8897-4cf1-b09a-159cace97e1e/maas-api/0.log" Jul 06 01:43:08.056085 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:08.056043 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7c9c5cd9fb-8cpk2_ee0bc880-6df3-49b0-804d-67501573457a/manager/0.log" Jul 06 01:43:08.169093 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:08.169064 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-tfx2b_6a5a4eb9-521d-4d63-ae5f-b5222e99c072/server/0.log" Jul 06 01:43:08.283384 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:08.283353 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-pp54t_3db998b9-c5fd-4d5f-b0c4-dc4115ccd60d/manager/0.log" Jul 06 01:43:08.396114 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:08.396031 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm_ed6e379a-5ba3-479f-9093-2fb7b24a3654/copy-manifests/0.log" Jul 06 01:43:08.402579 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:08.402556 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm_ed6e379a-5ba3-479f-9093-2fb7b24a3654/manager/0.log" Jul 06 01:43:08.775001 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:08.774973 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-p7dp2_bb5cafcf-7c5b-4a54-ac96-deb59035f2cb/postgres/0.log" Jul 06 01:43:09.557031 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:09.557001 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv_2d2020dc-4327-463a-b3f5-08dd93d88338/pull/0.log" Jul 06 01:43:09.563384 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:09.563360 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv_2d2020dc-4327-463a-b3f5-08dd93d88338/extract/0.log" Jul 06 01:43:09.569323 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:09.569306 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv_2d2020dc-4327-463a-b3f5-08dd93d88338/util/0.log" Jul 06 01:43:09.680712 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:09.680659 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s_abb5cdd6-5790-4a3f-8bec-7fc2ef718234/util/0.log" Jul 06 01:43:09.687545 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:09.687524 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s_abb5cdd6-5790-4a3f-8bec-7fc2ef718234/pull/0.log" Jul 06 01:43:09.694149 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:09.694129 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s_abb5cdd6-5790-4a3f-8bec-7fc2ef718234/extract/0.log" Jul 06 01:43:09.807866 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:09.807772 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85_690269c5-6c7b-468e-a662-fd8d63006539/util/0.log" Jul 06 01:43:09.814444 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:09.814420 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85_690269c5-6c7b-468e-a662-fd8d63006539/pull/0.log" Jul 06 01:43:09.822722 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:09.822701 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85_690269c5-6c7b-468e-a662-fd8d63006539/extract/0.log" Jul 06 01:43:09.937023 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:09.936998 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528_3c0f901e-5c81-488c-9938-ff0c967ff4d6/util/0.log" Jul 06 01:43:09.943393 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:09.943374 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528_3c0f901e-5c81-488c-9938-ff0c967ff4d6/pull/0.log" Jul 06 01:43:09.949558 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:09.949540 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528_3c0f901e-5c81-488c-9938-ff0c967ff4d6/extract/0.log" Jul 06 01:43:11.298767 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:11.298738 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678qlzsf_1d2e5fc4-718d-4691-8914-6c5dada44e9a/istio-proxy/0.log" Jul 06 01:43:11.422348 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:11.422315 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jq8sx_1fc29533-1e75-4221-8c94-f489e17c0681/discovery/0.log" Jul 06 01:43:11.536999 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:11.536970 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-557bfcf777-c6dmf_8903edca-7fa6-423d-8d54-f9cfa83e2364/kube-auth-proxy/0.log" Jul 06 01:43:11.788494 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:11.788466 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ntrsc_807fa46e-238f-4307-8547-b0c77d15c9cd/istio-proxy/1.log" Jul 06 01:43:11.912158 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:11.912126 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-z4grx_872e14ed-c94a-48f5-98b1-ff9923eec523/payload-pre-processing/0.log" Jul 06 01:43:12.025023 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:12.024994 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zprmm_774794ca-e3f0-4b15-b80f-3fa7d015bc1e/payload-processing/0.log" Jul 06 01:43:12.139319 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:12.139234 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55758cd8ff-8lgbp_8c6f894e-5149-4c29-84ff-468f3cae5d80/router/0.log" Jul 06 01:43:12.730637 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:12.730612 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-s5v4k_fdce88da-aec2-4391-a206-8aead5283f6f/main/0.log" Jul 06 01:43:12.979017 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:12.978987 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-tz679_9a37f9aa-96ac-453a-a890-48b14dab47b7/main/0.log" Jul 06 01:43:20.225227 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:20.225191 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-29jzf_a0c517c0-a190-4429-84f8-1b1cae3a15d3/global-pull-secret-syncer/0.log" Jul 06 01:43:20.437297 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:20.437268 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qs4nj_ab933df1-be97-411c-9012-1eca2b14c318/konnectivity-agent/0.log" Jul 06 01:43:20.483174 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:20.483087 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-61.ec2.internal_fa4fbd7fe1f0fd86fc4d5f8945ab75a3/haproxy/0.log" Jul 06 01:43:24.401154 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:24.401122 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv_2d2020dc-4327-463a-b3f5-08dd93d88338/extract/0.log" Jul 06 01:43:24.428470 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:24.428441 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv_2d2020dc-4327-463a-b3f5-08dd93d88338/util/0.log" Jul 06 01:43:24.451946 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:24.451913 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759q6jzv_2d2020dc-4327-463a-b3f5-08dd93d88338/pull/0.log" Jul 06 01:43:24.503270 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:24.503239 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s_abb5cdd6-5790-4a3f-8bec-7fc2ef718234/extract/0.log" Jul 06 01:43:24.541211 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:24.541181 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s_abb5cdd6-5790-4a3f-8bec-7fc2ef718234/util/0.log" Jul 06 01:43:24.570478 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:24.570445 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sgn5s_abb5cdd6-5790-4a3f-8bec-7fc2ef718234/pull/0.log" Jul 06 01:43:24.594019 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:24.593991 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85_690269c5-6c7b-468e-a662-fd8d63006539/extract/0.log" Jul 06 01:43:24.616492 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:24.616462 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85_690269c5-6c7b-468e-a662-fd8d63006539/util/0.log" Jul 06 01:43:24.641190 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:24.641161 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t6v85_690269c5-6c7b-468e-a662-fd8d63006539/pull/0.log" Jul 06 01:43:24.668270 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:24.668202 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528_3c0f901e-5c81-488c-9938-ff0c967ff4d6/extract/0.log" Jul 06 01:43:24.691491 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:24.691467 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528_3c0f901e-5c81-488c-9938-ff0c967ff4d6/util/0.log" Jul 06 01:43:24.718256 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:24.718233 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef166528_3c0f901e-5c81-488c-9938-ff0c967ff4d6/pull/0.log" Jul 06 01:43:27.793312 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:27.793221 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-khdjc_d863b393-e7eb-42f0-afe7-371c3e9996c9/cluster-monitoring-operator/0.log" Jul 06 01:43:27.931312 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:27.931275 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-f9fzj_b24e9883-3bc0-43a3-a669-17b49ae0ffb8/monitoring-plugin/0.log" Jul 06 01:43:28.046059 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:28.045978 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q8fp2_4a8fea05-9512-4645-990e-2ce411026472/node-exporter/0.log" Jul 06 01:43:28.070133 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:28.070105 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q8fp2_4a8fea05-9512-4645-990e-2ce411026472/kube-rbac-proxy/0.log" Jul 06 01:43:28.096578 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:28.096554 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-q8fp2_4a8fea05-9512-4645-990e-2ce411026472/init-textfile/0.log" Jul 06 01:43:28.206702 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:28.206655 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-m55nn_79ae0875-ffd8-4438-8b0d-2bd328c43300/kube-rbac-proxy-main/0.log" Jul 06 01:43:28.228883 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:28.228854 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-m55nn_79ae0875-ffd8-4438-8b0d-2bd328c43300/kube-rbac-proxy-self/0.log" Jul 06 01:43:28.253392 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:28.253364 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-m55nn_79ae0875-ffd8-4438-8b0d-2bd328c43300/openshift-state-metrics/0.log" Jul 06 01:43:28.580032 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:28.580000 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-4s62f_0cfd645f-edf7-4ce4-a692-6d40e5d57d3e/prometheus-operator/0.log" Jul 06 01:43:28.601866 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:28.601838 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-4s62f_0cfd645f-edf7-4ce4-a692-6d40e5d57d3e/kube-rbac-proxy/0.log" Jul 06 01:43:28.734304 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:28.734273 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ff5f56fcf-2sktx_c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5/thanos-query/0.log" Jul 06 01:43:28.756679 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:28.756647 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ff5f56fcf-2sktx_c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5/kube-rbac-proxy-web/0.log" Jul 06 01:43:28.779211 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:28.779185 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ff5f56fcf-2sktx_c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5/kube-rbac-proxy/0.log" Jul 06 01:43:28.800758 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:28.800733 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ff5f56fcf-2sktx_c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5/prom-label-proxy/0.log" Jul 06 01:43:28.822303 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:28.822277 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ff5f56fcf-2sktx_c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5/kube-rbac-proxy-rules/0.log" Jul 06 01:43:28.849878 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:28.849778 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ff5f56fcf-2sktx_c19e44e5-b8a6-49b0-96ff-56b8bd12b8c5/kube-rbac-proxy-metrics/0.log" Jul 06 01:43:30.675735 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:30.675701 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-znllg_789b12fb-c3d0-428d-838c-f29718e69e2c/console-operator/1.log" Jul 06 01:43:30.680580 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:30.680560 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-znllg_789b12fb-c3d0-428d-838c-f29718e69e2c/console-operator/2.log" Jul 06 01:43:30.737199 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:30.737161 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gk2mn/perf-node-gather-daemonset-k64dc"] Jul 06 01:43:30.737777 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:30.737757 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2118bb2c-9bee-44ea-b13a-c94e3195cb45" containerName="main" Jul 06 01:43:30.737777 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:30.737777 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="2118bb2c-9bee-44ea-b13a-c94e3195cb45" containerName="main" Jul 06 01:43:30.737935 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:30.737850 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="2118bb2c-9bee-44ea-b13a-c94e3195cb45" containerName="main" Jul 06 01:43:30.741047 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:30.741017 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-k64dc" Jul 06 01:43:30.743507 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:30.743486 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gk2mn\"/\"kube-root-ca.crt\"" Jul 06 01:43:30.744482 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:30.744462 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gk2mn\"/\"openshift-service-ca.crt\"" Jul 06 01:43:30.744579 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:30.744462 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gk2mn\"/\"default-dockercfg-nbpn6\"" Jul 06 01:43:30.749705 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:30.749681 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gk2mn/perf-node-gather-daemonset-k64dc"] Jul 06 01:43:30.875553 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:30.875516 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2v7k\" (UniqueName: \"kubernetes.io/projected/3a06463a-1b83-4d54-8c86-daceafe06b62-kube-api-access-s2v7k\") pod \"perf-node-gather-daemonset-k64dc\" (UID: \"3a06463a-1b83-4d54-8c86-daceafe06b62\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-k64dc" Jul 06 01:43:30.875764 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:30.875577 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a06463a-1b83-4d54-8c86-daceafe06b62-lib-modules\") pod \"perf-node-gather-daemonset-k64dc\" (UID: \"3a06463a-1b83-4d54-8c86-daceafe06b62\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-k64dc" Jul 06 01:43:30.875764 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:30.875657 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a06463a-1b83-4d54-8c86-daceafe06b62-sys\") pod \"perf-node-gather-daemonset-k64dc\" (UID: \"3a06463a-1b83-4d54-8c86-daceafe06b62\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-k64dc" Jul 06 01:43:30.875764 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:30.875737 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a06463a-1b83-4d54-8c86-daceafe06b62-proc\") pod \"perf-node-gather-daemonset-k64dc\" (UID: \"3a06463a-1b83-4d54-8c86-daceafe06b62\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-k64dc" Jul 06 01:43:30.875764 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:30.875759 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a06463a-1b83-4d54-8c86-daceafe06b62-podres\") pod \"perf-node-gather-daemonset-k64dc\" (UID: \"3a06463a-1b83-4d54-8c86-daceafe06b62\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-k64dc" Jul 06 01:43:30.976946 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:30.976916 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2v7k\" (UniqueName: \"kubernetes.io/projected/3a06463a-1b83-4d54-8c86-daceafe06b62-kube-api-access-s2v7k\") pod \"perf-node-gather-daemonset-k64dc\" (UID: \"3a06463a-1b83-4d54-8c86-daceafe06b62\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-k64dc" Jul 06 01:43:30.977105 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:30.976965 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a06463a-1b83-4d54-8c86-daceafe06b62-lib-modules\") pod \"perf-node-gather-daemonset-k64dc\" (UID: \"3a06463a-1b83-4d54-8c86-daceafe06b62\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-k64dc" Jul 06 01:43:30.977105 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:30.976997 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a06463a-1b83-4d54-8c86-daceafe06b62-sys\") pod \"perf-node-gather-daemonset-k64dc\" (UID: \"3a06463a-1b83-4d54-8c86-daceafe06b62\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-k64dc" Jul 06 01:43:30.977105 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:30.977028 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a06463a-1b83-4d54-8c86-daceafe06b62-proc\") pod \"perf-node-gather-daemonset-k64dc\" (UID: \"3a06463a-1b83-4d54-8c86-daceafe06b62\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-k64dc" Jul 06 01:43:30.977105 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:30.977043 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a06463a-1b83-4d54-8c86-daceafe06b62-podres\") pod \"perf-node-gather-daemonset-k64dc\" (UID: \"3a06463a-1b83-4d54-8c86-daceafe06b62\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-k64dc" Jul 06 01:43:30.977320 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:30.977114 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a06463a-1b83-4d54-8c86-daceafe06b62-sys\") pod \"perf-node-gather-daemonset-k64dc\" (UID: \"3a06463a-1b83-4d54-8c86-daceafe06b62\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-k64dc" Jul 06 01:43:30.977320 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:30.977183 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a06463a-1b83-4d54-8c86-daceafe06b62-proc\") pod \"perf-node-gather-daemonset-k64dc\" (UID: \"3a06463a-1b83-4d54-8c86-daceafe06b62\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-k64dc" Jul 06 01:43:30.977320 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:30.977189 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a06463a-1b83-4d54-8c86-daceafe06b62-lib-modules\") pod \"perf-node-gather-daemonset-k64dc\" (UID: \"3a06463a-1b83-4d54-8c86-daceafe06b62\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-k64dc" Jul 06 01:43:30.977320 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:30.977248 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a06463a-1b83-4d54-8c86-daceafe06b62-podres\") pod \"perf-node-gather-daemonset-k64dc\" (UID: \"3a06463a-1b83-4d54-8c86-daceafe06b62\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-k64dc" Jul 06 01:43:30.984569 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:30.984546 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2v7k\" (UniqueName: \"kubernetes.io/projected/3a06463a-1b83-4d54-8c86-daceafe06b62-kube-api-access-s2v7k\") pod \"perf-node-gather-daemonset-k64dc\" (UID: \"3a06463a-1b83-4d54-8c86-daceafe06b62\") " pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-k64dc" Jul 06 01:43:31.050942 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:31.050897 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-k64dc" Jul 06 01:43:31.190112 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:31.190084 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gk2mn/perf-node-gather-daemonset-k64dc"] Jul 06 01:43:31.192235 ip-10-0-135-61 kubenswrapper[2553]: W0706 01:43:31.192199 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3a06463a_1b83_4d54_8c86_daceafe06b62.slice/crio-368e9db2a45301971ab706339e71179876f8ed0f93bbcb3e0ded90fc6a5fa5b0 WatchSource:0}: Error finding container 368e9db2a45301971ab706339e71179876f8ed0f93bbcb3e0ded90fc6a5fa5b0: Status 404 returned error can't find the container with id 368e9db2a45301971ab706339e71179876f8ed0f93bbcb3e0ded90fc6a5fa5b0 Jul 06 01:43:31.433748 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:31.433710 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-k64dc" event={"ID":"3a06463a-1b83-4d54-8c86-daceafe06b62","Type":"ContainerStarted","Data":"5396b4b62fe30ca3c21061f461b5e3788c4a613227da5d0127758b0eaec3a2aa"} Jul 06 01:43:31.433931 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:31.433763 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-k64dc" event={"ID":"3a06463a-1b83-4d54-8c86-daceafe06b62","Type":"ContainerStarted","Data":"368e9db2a45301971ab706339e71179876f8ed0f93bbcb3e0ded90fc6a5fa5b0"} Jul 06 01:43:31.433931 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:31.433807 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-k64dc" Jul 06 01:43:31.448884 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:31.448840 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-k64dc" podStartSLOduration=1.4488268899999999 podStartE2EDuration="1.44882689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 01:43:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 01:43:31.448041305 +0000 UTC m=+2651.462414344" watchObservedRunningTime="2026-07-06 01:43:31.44882689 +0000 UTC m=+2651.463199946" Jul 06 01:43:32.875207 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:32.875179 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2ftr2_261a7be8-29de-4ea5-9394-7cf8275dfd9c/dns/0.log" Jul 06 01:43:32.897427 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:32.897397 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2ftr2_261a7be8-29de-4ea5-9394-7cf8275dfd9c/kube-rbac-proxy/0.log" Jul 06 01:43:33.064415 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:33.064380 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fc8xr_74e85a91-ab9c-4c02-985f-48961dec5b3c/dns-node-resolver/0.log" Jul 06 01:43:33.648595 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:33.648567 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4zt7s_cb1b89be-8278-4871-99e2-d5710f5da0cc/node-ca/0.log" Jul 06 01:43:34.647882 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:34.647844 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678qlzsf_1d2e5fc4-718d-4691-8914-6c5dada44e9a/istio-proxy/0.log" Jul 06 01:43:34.755657 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:34.755627 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jq8sx_1fc29533-1e75-4221-8c94-f489e17c0681/discovery/0.log" Jul 06 01:43:34.776378 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:34.776352 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-557bfcf777-c6dmf_8903edca-7fa6-423d-8d54-f9cfa83e2364/kube-auth-proxy/0.log" Jul 06 01:43:34.831329 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:34.831300 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ntrsc_807fa46e-238f-4307-8547-b0c77d15c9cd/istio-proxy/0.log" Jul 06 01:43:34.866018 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:34.865985 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ntrsc_807fa46e-238f-4307-8547-b0c77d15c9cd/istio-proxy/1.log" Jul 06 01:43:34.898482 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:34.898409 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-z4grx_872e14ed-c94a-48f5-98b1-ff9923eec523/payload-pre-processing/0.log" Jul 06 01:43:34.945076 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:34.945041 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zprmm_774794ca-e3f0-4b15-b80f-3fa7d015bc1e/payload-processing/0.log" Jul 06 01:43:34.966611 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:34.966585 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55758cd8ff-8lgbp_8c6f894e-5149-4c29-84ff-468f3cae5d80/router/0.log" Jul 06 01:43:35.672965 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:35.672937 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n59gl_bb979aaf-8966-44b2-a762-bbd3052753a4/serve-healthcheck-canary/0.log" Jul 06 01:43:36.200593 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:36.200560 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-rrw4g_289da140-83a3-40ae-9470-bd4c6e476df6/insights-operator/0.log" Jul 06 01:43:36.201140 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:36.201121 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-rrw4g_289da140-83a3-40ae-9470-bd4c6e476df6/insights-operator/1.log" Jul 06 01:43:36.374932 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:36.374901 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wfsvc_f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3/kube-rbac-proxy/0.log" Jul 06 01:43:36.398933 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:36.398907 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wfsvc_f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3/exporter/0.log" Jul 06 01:43:36.422685 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:36.422642 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wfsvc_f4c7aa44-6ac7-49e1-8961-9ae41db2d2f3/extractor/0.log" Jul 06 01:43:37.450009 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:37.449979 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gk2mn/perf-node-gather-daemonset-k64dc" Jul 06 01:43:38.521023 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:38.520992 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-dhqht_704bbd8f-64ae-4fb0-a0f9-56aeca2b0b52/manager/0.log" Jul 06 01:43:38.639999 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:38.639965 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-q26sx_c55a933a-9e16-4999-b294-316a1fd4f9d9/manager/0.log" Jul 06 01:43:38.676783 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:38.676753 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7b4df4f969-wr92z_903364cb-8897-4cf1-b09a-159cace97e1e/maas-api/0.log" Jul 06 01:43:38.805450 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:38.805359 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7c9c5cd9fb-8cpk2_ee0bc880-6df3-49b0-804d-67501573457a/manager/0.log" Jul 06 01:43:38.825547 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:38.825515 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-tfx2b_6a5a4eb9-521d-4d63-ae5f-b5222e99c072/server/0.log" Jul 06 01:43:38.891547 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:38.891514 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-pp54t_3db998b9-c5fd-4d5f-b0c4-dc4115ccd60d/manager/0.log" Jul 06 01:43:38.915085 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:38.915053 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm_ed6e379a-5ba3-479f-9093-2fb7b24a3654/manager/0.log" Jul 06 01:43:38.936712 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:38.936687 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cdbc5c4f-5mkzm_ed6e379a-5ba3-479f-9093-2fb7b24a3654/copy-manifests/0.log" Jul 06 01:43:39.135338 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:39.135264 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-p7dp2_bb5cafcf-7c5b-4a54-ac96-deb59035f2cb/postgres/0.log" Jul 06 01:43:41.403178 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:41.403142 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678qlzsf_1d2e5fc4-718d-4691-8914-6c5dada44e9a/istio-proxy/0.log" Jul 06 01:43:41.516465 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:41.516436 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jq8sx_1fc29533-1e75-4221-8c94-f489e17c0681/discovery/0.log" Jul 06 01:43:41.526636 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:41.526610 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-557bfcf777-c6dmf_8903edca-7fa6-423d-8d54-f9cfa83e2364/kube-auth-proxy/0.log" Jul 06 01:43:41.569443 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:41.569413 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ntrsc_807fa46e-238f-4307-8547-b0c77d15c9cd/istio-proxy/0.log" Jul 06 01:43:41.595590 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:41.595562 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ntrsc_807fa46e-238f-4307-8547-b0c77d15c9cd/istio-proxy/1.log" Jul 06 01:43:41.617277 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:41.617252 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-z4grx_872e14ed-c94a-48f5-98b1-ff9923eec523/payload-pre-processing/0.log" Jul 06 01:43:41.658880 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:41.658789 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zprmm_774794ca-e3f0-4b15-b80f-3fa7d015bc1e/payload-processing/0.log" Jul 06 01:43:41.675700 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:41.675677 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55758cd8ff-8lgbp_8c6f894e-5149-4c29-84ff-468f3cae5d80/router/0.log" Jul 06 01:43:42.864271 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:42.864186 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678qlzsf_1d2e5fc4-718d-4691-8914-6c5dada44e9a/istio-proxy/0.log" Jul 06 01:43:42.963408 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:42.963378 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-jq8sx_1fc29533-1e75-4221-8c94-f489e17c0681/discovery/0.log" Jul 06 01:43:42.977210 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:42.977184 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-557bfcf777-c6dmf_8903edca-7fa6-423d-8d54-f9cfa83e2364/kube-auth-proxy/0.log" Jul 06 01:43:43.018755 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:43.018726 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ntrsc_807fa46e-238f-4307-8547-b0c77d15c9cd/istio-proxy/0.log" Jul 06 01:43:43.046878 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:43.046849 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ntrsc_807fa46e-238f-4307-8547-b0c77d15c9cd/istio-proxy/1.log" Jul 06 01:43:43.068500 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:43.068471 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-z4grx_872e14ed-c94a-48f5-98b1-ff9923eec523/payload-pre-processing/0.log" Jul 06 01:43:43.106278 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:43.106243 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zprmm_774794ca-e3f0-4b15-b80f-3fa7d015bc1e/payload-processing/0.log" Jul 06 01:43:43.120604 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:43.120532 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55758cd8ff-8lgbp_8c6f894e-5149-4c29-84ff-468f3cae5d80/router/0.log" Jul 06 01:43:46.116322 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:46.116293 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-q27c6_287d98a2-bc12-44af-87f9-c59dfbee9c0c/kube-storage-version-migrator-operator/1.log" Jul 06 01:43:46.117271 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:46.117248 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-q27c6_287d98a2-bc12-44af-87f9-c59dfbee9c0c/kube-storage-version-migrator-operator/0.log" Jul 06 01:43:47.197980 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:47.197901 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2l8g9_e0506c24-d40f-474c-891d-7a3695d5c055/kube-multus/0.log" Jul 06 01:43:47.267421 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:47.267395 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fd9gs_b06e2389-f65c-472b-96e1-a90b509a285f/kube-multus-additional-cni-plugins/0.log" Jul 06 01:43:47.290467 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:47.290437 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fd9gs_b06e2389-f65c-472b-96e1-a90b509a285f/egress-router-binary-copy/0.log" Jul 06 01:43:47.310818 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:47.310783 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fd9gs_b06e2389-f65c-472b-96e1-a90b509a285f/cni-plugins/0.log" Jul 06 01:43:47.334126 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:47.334100 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fd9gs_b06e2389-f65c-472b-96e1-a90b509a285f/bond-cni-plugin/0.log" Jul 06 01:43:47.354619 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:47.354595 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fd9gs_b06e2389-f65c-472b-96e1-a90b509a285f/routeoverride-cni/0.log" Jul 06 01:43:47.377758 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:47.377737 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fd9gs_b06e2389-f65c-472b-96e1-a90b509a285f/whereabouts-cni-bincopy/0.log" Jul 06 01:43:47.398041 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:47.398014 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fd9gs_b06e2389-f65c-472b-96e1-a90b509a285f/whereabouts-cni/0.log" Jul 06 01:43:47.769194 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:47.769161 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gn92r_4ae44021-3eed-4a62-9e80-47242e594a85/network-metrics-daemon/0.log" Jul 06 01:43:47.788243 ip-10-0-135-61 kubenswrapper[2553]: I0706 01:43:47.788216 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gn92r_4ae44021-3eed-4a62-9e80-47242e594a85/kube-rbac-proxy/0.log"