Jul 07 13:57:08.059483 ip-10-0-140-192 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 07 13:57:08.059493 ip-10-0-140-192 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 07 13:57:08.059500 ip-10-0-140-192 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 07 13:57:08.059883 ip-10-0-140-192 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 07 13:57:19.199818 ip-10-0-140-192 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 07 13:57:19.199835 ip-10-0-140-192 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot a3d60a86f887497498cb14935281a876 --
Jul 07 13:58:54.240224 ip-10-0-140-192 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 13:58:54.739555 ip-10-0-140-192 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 13:58:54.739555 ip-10-0-140-192 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 13:58:54.739555 ip-10-0-140-192 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 13:58:54.739555 ip-10-0-140-192 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 13:58:54.739555 ip-10-0-140-192 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 13:58:54.739555 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.696596    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 13:58:54.739555 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737849    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 13:58:54.739555 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737870    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 13:58:54.739555 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737874    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 13:58:54.739555 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737879    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 13:58:54.739555 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737882    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 13:58:54.739555 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737885    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 13:58:54.739555 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737888    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 13:58:54.739555 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737890    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 13:58:54.741572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737893    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 13:58:54.741572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737896    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 13:58:54.741572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737899    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 13:58:54.741572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737902    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 13:58:54.741572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737905    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 13:58:54.741572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737908    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 13:58:54.741572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737911    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 13:58:54.741572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737914    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 13:58:54.741572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737917    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 13:58:54.741572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737920    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 13:58:54.741572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737923    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 13:58:54.741572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737925    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 13:58:54.741572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737928    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 13:58:54.741572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737931    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 13:58:54.741572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737934    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 13:58:54.741572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737955    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 13:58:54.741572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737959    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 13:58:54.741572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737962    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 13:58:54.741572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737965    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 13:58:54.741572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737971    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 13:58:54.748997 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737974    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 13:58:54.748997 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737977    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 13:58:54.748997 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737979    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 13:58:54.748997 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737982    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 13:58:54.748997 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737985    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 13:58:54.748997 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737987    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 13:58:54.748997 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737990    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 13:58:54.748997 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737994    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 13:58:54.748997 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.737997    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 13:58:54.748997 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738000    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 13:58:54.748997 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738003    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 13:58:54.748997 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738005    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 13:58:54.748997 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738008    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 13:58:54.748997 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738010    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 13:58:54.748997 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738013    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 13:58:54.748997 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738016    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 13:58:54.748997 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738018    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 13:58:54.748997 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738021    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 13:58:54.748997 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738024    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 13:58:54.748997 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738026    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 13:58:54.750788 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738029    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 13:58:54.750788 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738032    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 13:58:54.750788 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738037    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 13:58:54.750788 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738042    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 13:58:54.750788 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738045    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 13:58:54.750788 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738048    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 13:58:54.750788 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738051    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 13:58:54.750788 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738054    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 13:58:54.750788 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738056    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 13:58:54.750788 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738059    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 13:58:54.750788 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738062    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 13:58:54.750788 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738064    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 13:58:54.750788 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738067    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 13:58:54.750788 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738069    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 13:58:54.750788 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738072    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 13:58:54.750788 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738074    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 13:58:54.750788 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738077    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 13:58:54.750788 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738079    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 13:58:54.750788 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738082    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 13:58:54.755390 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738085    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 13:58:54.755390 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738088    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 13:58:54.755390 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738090    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 13:58:54.755390 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738093    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 13:58:54.755390 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738097    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 13:58:54.755390 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738102    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 13:58:54.755390 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738105    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 13:58:54.755390 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738108    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 13:58:54.755390 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738112    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 13:58:54.755390 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738115    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 13:58:54.755390 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738117    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 13:58:54.755390 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738120    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 13:58:54.755390 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738123    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 13:58:54.755390 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738128    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 13:58:54.755390 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738131    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 13:58:54.755390 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738135    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 13:58:54.755390 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738139    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 13:58:54.755390 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738141    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 13:58:54.755390 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738144    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 13:58:54.780715 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738147    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 13:58:54.780715 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738150    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 13:58:54.780715 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738153    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 13:58:54.780715 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738155    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 13:58:54.780715 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738158    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 13:58:54.780715 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738160    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 13:58:54.780715 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738163    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 13:58:54.780715 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738166    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 13:58:54.780715 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738168    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 13:58:54.780715 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738171    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 13:58:54.780715 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738174    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 13:58:54.780715 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738177    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 13:58:54.780715 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738179    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 13:58:54.780715 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.738992    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 13:58:54.780715 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739001    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 13:58:54.780715 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739004    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 13:58:54.780715 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739007    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 13:58:54.780715 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739010    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 13:58:54.780715 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739013    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 13:58:54.780715 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739016    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 13:58:54.782706 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739018    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 13:58:54.782706 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739022    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 13:58:54.782706 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739024    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 13:58:54.782706 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739029    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 13:58:54.782706 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739033    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 13:58:54.782706 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739036    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 13:58:54.782706 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739039    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 13:58:54.782706 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739043    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 13:58:54.782706 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739046    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 13:58:54.782706 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739048    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 13:58:54.782706 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739053    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 13:58:54.782706 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739056    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 13:58:54.782706 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739059    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 13:58:54.782706 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739063    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 13:58:54.782706 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739067    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 13:58:54.782706 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739070    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 13:58:54.782706 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739074    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 13:58:54.782706 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739077    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 13:58:54.782706 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739080    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 13:58:54.785005 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739082    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 13:58:54.785005 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739085    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 13:58:54.785005 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739087    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 13:58:54.785005 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739093    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 13:58:54.785005 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739095    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 13:58:54.785005 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739098    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 13:58:54.785005 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739101    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 13:58:54.785005 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739104    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 13:58:54.785005 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739107    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 13:58:54.785005 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739110    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 13:58:54.785005 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739112    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 13:58:54.785005 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739115    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 13:58:54.785005 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739117    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 13:58:54.785005 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739120    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 13:58:54.785005 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739122    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 13:58:54.785005 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739125    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 13:58:54.785005 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739128    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 13:58:54.785005 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739130    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 13:58:54.785005 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739134    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 13:58:54.792488 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739138    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 13:58:54.792488 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739141    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 13:58:54.792488 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739144    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 13:58:54.792488 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739147    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 13:58:54.792488 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739149    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 13:58:54.792488 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739153    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 13:58:54.792488 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739155    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 13:58:54.792488 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739158    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 13:58:54.792488 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739160    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 13:58:54.792488 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739163    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 13:58:54.792488 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739166    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 13:58:54.792488 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739168    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 13:58:54.792488 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739171    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 13:58:54.792488 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739174    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 13:58:54.792488 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739176    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 13:58:54.792488 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739179    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 13:58:54.792488 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739182    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 13:58:54.792488 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739185    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 13:58:54.792488 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739187    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 13:58:54.792488 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739191    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 13:58:54.795726 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739194    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 13:58:54.795726 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739196    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 13:58:54.795726 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739199    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 13:58:54.795726 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739201    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 13:58:54.795726 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739204    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 13:58:54.795726 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739206    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 13:58:54.795726 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739209    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 13:58:54.795726 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739211    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 13:58:54.795726 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739215    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 13:58:54.795726 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739218    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 13:58:54.795726 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739220    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 13:58:54.795726 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739223    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 13:58:54.795726 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739225    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 13:58:54.795726 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739228    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 13:58:54.795726 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739230    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 13:58:54.795726 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739233    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 13:58:54.795726 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739236    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 13:58:54.795726 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739238    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 13:58:54.795726 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739241    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 13:58:54.795726 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739244    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 13:58:54.798071 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739246    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 13:58:54.798071 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739249    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 13:58:54.798071 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739251    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 13:58:54.798071 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739254    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 13:58:54.798071 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739256    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 13:58:54.798071 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739259    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 13:58:54.798071 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739261    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 13:58:54.798071 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739264    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 13:58:54.798071 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739268    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 13:58:54.798071 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739270    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 13:58:54.798071 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739273    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 13:58:54.798071 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739276    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 13:58:54.798071 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739279    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 13:58:54.798071 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739281    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 13:58:54.798071 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739688    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 13:58:54.798071 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739693    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 13:58:54.798071 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739695    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 13:58:54.798071 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739698    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 13:58:54.798071 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739701    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 13:58:54.798071 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739704    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 13:58:54.821548 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739707    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 13:58:54.821548 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739711    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 13:58:54.821548 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739715    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 13:58:54.821548 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739717    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 13:58:54.821548 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739720    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 13:58:54.821548 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739723    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 13:58:54.821548 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739726    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 13:58:54.821548 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739728    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 13:58:54.821548 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739731    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 13:58:54.821548 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739734    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 13:58:54.821548 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739737    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 13:58:54.821548 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739739    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 13:58:54.821548 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739742    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 13:58:54.821548 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739744    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 13:58:54.821548 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739747    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 13:58:54.821548 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739750    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 13:58:54.821548 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739752    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 13:58:54.821548 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739755    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 13:58:54.821548 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739757    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 13:58:54.821548 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739760    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 13:58:54.837374 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739763    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 13:58:54.837374 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739766    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 13:58:54.837374 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739768    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 13:58:54.837374 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739771    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 13:58:54.837374 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739774    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 13:58:54.837374 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739776    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 13:58:54.837374 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739779    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 13:58:54.837374 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739781    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 13:58:54.837374 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739784    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 13:58:54.837374 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739786    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 13:58:54.837374 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739789    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 13:58:54.837374 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739794    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 13:58:54.837374 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739798    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 13:58:54.837374 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739801    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 13:58:54.837374 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739804    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 13:58:54.837374 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739807    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 13:58:54.837374 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739810    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 13:58:54.837374 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739813    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 13:58:54.837374 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739815    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 13:58:54.827381 ip-10-0-140-192 systemd[1]: Started Kubernetes Kubelet.
Jul 07 13:58:54.886572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739819    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 13:58:54.886572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739822    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 13:58:54.886572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739825    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 13:58:54.886572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739830    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 13:58:54.886572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739834    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 13:58:54.886572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739837    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 13:58:54.886572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739840    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 13:58:54.886572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739843    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 13:58:54.886572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739846    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 13:58:54.886572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739848    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 13:58:54.886572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739851    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 13:58:54.886572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739853    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 13:58:54.886572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739856    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 13:58:54.886572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739859    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 13:58:54.886572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739861    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 13:58:54.886572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739864    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 13:58:54.886572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739867    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 13:58:54.886572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739869    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 13:58:54.886572 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739872    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 13:58:54.897809 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739875    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 13:58:54.897809 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739879    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 13:58:54.897809 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739881    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 13:58:54.897809 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739884    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 13:58:54.897809 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739886    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 13:58:54.897809 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739889    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 13:58:54.897809 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739891    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 13:58:54.897809 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739894    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 13:58:54.897809 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739896    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 13:58:54.897809 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739899    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 13:58:54.897809 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739901    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 13:58:54.897809 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739903    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 13:58:54.897809 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739906    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 13:58:54.897809 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739909    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 13:58:54.897809 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739911    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 13:58:54.897809 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739913    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 13:58:54.897809 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739917    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 13:58:54.897809 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739920    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 13:58:54.897809 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739923    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 13:58:54.897809 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739926    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 13:58:54.897809 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739929    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 13:58:55.067138 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739931    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 13:58:55.067138 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739934    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 13:58:55.067138 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739951    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 13:58:55.067138 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739954    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 13:58:55.067138 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739956    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 13:58:55.067138 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739958    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 13:58:55.067138 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739961    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 13:58:55.067138 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739964    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 13:58:55.067138 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739967    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 13:58:55.067138 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739969    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 13:58:55.067138 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739972    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 13:58:55.067138 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739975    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 13:58:55.067138 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739977    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 13:58:55.067138 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.739980    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 13:58:55.067138 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740058    2576 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 13:58:55.067138 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740066    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 13:58:55.067138 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740073    2576 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 13:58:55.067138 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740078    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 13:58:55.067138 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740082    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 13:58:55.067138 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740085    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 13:58:55.067138 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740090    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 13:58:55.086826 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740094    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 13:58:55.086826 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740097    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 13:58:55.086826 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740100    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 13:58:55.086826 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740104    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 13:58:55.086826 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740107    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 13:58:55.086826 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740111    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 13:58:55.086826 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740115    2576 flags.go:64] FLAG: --cgroup-root=""
Jul 07 13:58:55.086826 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740118    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 13:58:55.086826 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740121    2576 flags.go:64] FLAG: --client-ca-file=""
Jul 07 13:58:55.086826 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740125    2576 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 13:58:55.086826 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740128    2576 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 13:58:55.086826 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740132    2576 flags.go:64] FLAG: --cluster-domain=""
Jul 07 13:58:55.086826 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740135    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 13:58:55.086826 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740138    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 13:58:55.086826 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740141    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 13:58:55.086826 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740145    2576 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 13:58:55.086826 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740149    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 13:58:55.086826 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740152    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 13:58:55.086826 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740155    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 13:58:55.086826 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740158    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 13:58:55.086826 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740161    2576 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 13:58:55.086826 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740164    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 13:58:55.086826 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740169    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 13:58:55.086826 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740172    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 13:58:55.090029 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740175    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 13:58:55.090029 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740180    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 13:58:55.090029 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740183    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 13:58:55.090029 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740186    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 13:58:55.090029 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740189    2576 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 13:58:55.090029 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740192    2576 flags.go:64] FLAG: --enable-server="true"
Jul 07 13:58:55.090029 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740195    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 13:58:55.090029 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740199    2576 flags.go:64] FLAG: --event-burst="100"
Jul 07 13:58:55.090029 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740202    2576 flags.go:64] FLAG: --event-qps="50"
Jul 07 13:58:55.090029 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740205    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 13:58:55.090029 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740208    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 13:58:55.090029 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740216    2576 flags.go:64] FLAG: --eviction-hard=""
Jul 07 13:58:55.090029 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740220    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 13:58:55.090029 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740222    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 13:58:55.090029 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740227    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 13:58:55.090029 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740230    2576 flags.go:64] FLAG: --eviction-soft=""
Jul 07 13:58:55.090029 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740233    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 13:58:55.090029 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740236    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 13:58:55.090029 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740240    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 13:58:55.090029 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740243    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 13:58:55.090029 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740246    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 13:58:55.090029 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740248    2576 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 13:58:55.090029 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740251    2576 flags.go:64] FLAG: --feature-gates=""
Jul 07 13:58:55.090029 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740255    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 13:58:55.090029 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740258    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 13:58:55.093085 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740261    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 13:58:55.093085 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740264    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 13:58:55.093085 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740267    2576 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 13:58:55.093085 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740270    2576 flags.go:64] FLAG: --help="false"
Jul 07 13:58:55.093085 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740273    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-140-192.ec2.internal"
Jul 07 13:58:55.093085 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740277    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 13:58:55.093085 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740280    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 13:58:55.093085 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740283    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 13:58:55.093085 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740286    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 13:58:55.093085 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740290    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 13:58:55.093085 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740292    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 13:58:55.093085 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740295    2576 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 13:58:55.093085 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740298    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 13:58:55.093085 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740300    2576 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 13:58:55.093085 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740303    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 13:58:55.093085 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740306    2576 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 13:58:55.093085 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740309    2576 flags.go:64] FLAG: --kube-reserved=""
Jul 07 13:58:55.093085 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740312    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 13:58:55.093085 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740314    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 13:58:55.093085 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740317    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 13:58:55.093085 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740320    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 13:58:55.093085 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740324    2576 flags.go:64] FLAG: --lock-file=""
Jul 07 13:58:55.093085 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740327    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 13:58:55.093085 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740330    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 13:58:55.095098 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740333    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 13:58:55.095098 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740338    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 13:58:55.095098 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740342    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 13:58:55.095098 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740345    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 13:58:55.095098 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740348    2576 flags.go:64] FLAG: --logging-format="text"
Jul 07 13:58:55.095098 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740350    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 13:58:55.095098 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740353    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 13:58:55.095098 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740356    2576 flags.go:64] FLAG: --manifest-url=""
Jul 07 13:58:55.095098 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740359    2576 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 13:58:55.095098 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740363    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 13:58:55.095098 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740366    2576 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 13:58:55.095098 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740371    2576 flags.go:64] FLAG: --max-pods="110"
Jul 07 13:58:55.095098 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740374    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 13:58:55.095098 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740378    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 13:58:55.095098 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740381    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 13:58:55.095098 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740384    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 13:58:55.095098 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740386    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 13:58:55.095098 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740389    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 13:58:55.095098 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740392    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 13:58:55.095098 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740400    2576 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 13:58:55.095098 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740403    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 13:58:55.095098 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740406    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 13:58:55.095098 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740409    2576 flags.go:64] FLAG: --pod-cidr=""
Jul 07 13:58:55.097875 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740412    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 13:58:55.097875 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740417    2576 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 13:58:55.097875 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740420    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 13:58:55.097875 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740423    2576 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 13:58:55.097875 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740425    2576 flags.go:64] FLAG: --port="10250"
Jul 07 13:58:55.097875 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740429    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 13:58:55.097875 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740433    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03387c877fde3aa69"
Jul 07 13:58:55.097875 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740436    2576 flags.go:64] FLAG: --qos-reserved=""
Jul 07 13:58:55.097875 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740439    2576 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 13:58:55.097875 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740441    2576 flags.go:64] FLAG: --register-node="true"
Jul 07 13:58:55.097875 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740444    2576 flags.go:64] FLAG: --register-with-taints=""
Jul 07 13:58:55.097875 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740448    2576 flags.go:64] FLAG: --registry-burst="10"
Jul 07 13:58:55.097875 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740452    2576 flags.go:64] FLAG: --registry-qps="5"
Jul 07 13:58:55.097875 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740455    2576 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 13:58:55.097875 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740458    2576 flags.go:64] FLAG: --reserved-memory=""
Jul 07 13:58:55.097875 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740461    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 13:58:55.097875 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740465    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 13:58:55.097875 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740468    2576 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 13:58:55.097875 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740471    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 13:58:55.097875 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740474    2576 flags.go:64] FLAG: --runonce="false"
Jul 07 13:58:55.097875 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740477    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 13:58:55.097875 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740480    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 13:58:55.097875 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740483    2576 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 13:58:55.097875 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740487    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 13:58:55.097875 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740490    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 13:58:55.099855 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740493    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 13:58:55.099855 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740496    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 13:58:55.099855 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740499    2576 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 13:58:55.099855 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740502    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 13:58:55.099855 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740505    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 13:58:55.099855 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740508    2576 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 13:58:55.099855 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740511    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 13:58:55.099855 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740514    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 13:58:55.099855 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740517    2576 flags.go:64] FLAG: --system-cgroups=""
Jul 07 13:58:55.099855 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740520    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 13:58:55.099855 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740525    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 13:58:55.099855 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740528    2576 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 13:58:55.099855 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740531    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 13:58:55.099855 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740536    2576 flags.go:64] FLAG: --tls-min-version=""
Jul 07 13:58:55.099855 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740539    2576 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 13:58:55.099855 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740542    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 13:58:55.099855 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740545    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 13:58:55.099855 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740548    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 13:58:55.099855 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740550    2576 flags.go:64] FLAG: --v="2"
Jul 07 13:58:55.099855 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740554    2576 flags.go:64] FLAG: --version="false"
Jul 07 13:58:55.099855 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740559    2576 flags.go:64] FLAG: --vmodule=""
Jul 07 13:58:55.099855 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740562    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 13:58:55.099855 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.740566    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 13:58:55.099855 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740691    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 13:58:55.099855 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740695    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 13:58:55.102774 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740698    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 13:58:55.102774 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740701    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 13:58:55.102774 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740703    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 13:58:55.102774 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740706    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 13:58:55.102774 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740709    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 13:58:55.102774 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740712    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 13:58:55.102774 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740715    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 13:58:55.102774 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740717    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 13:58:55.102774 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740720    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 13:58:55.102774 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740723    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 13:58:55.102774 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740725    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 13:58:55.102774 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740728    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 13:58:55.102774 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740731    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 13:58:55.102774 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740733    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 13:58:55.102774 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740736    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 13:58:55.102774 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740738    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 13:58:55.102774 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740741    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 13:58:55.102774 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740743    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 13:58:55.102774 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740746    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 13:58:55.102774 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740748    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 13:58:55.104649 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740752    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 13:58:55.104649 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740755    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 13:58:55.104649 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740757    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 13:58:55.104649 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740760    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 13:58:55.104649 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740763    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 13:58:55.104649 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740765    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 13:58:55.104649 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740768    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 13:58:55.104649 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740771    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 13:58:55.104649 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740773    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 13:58:55.104649 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740777    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 13:58:55.104649 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740781    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 13:58:55.104649 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740783    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 13:58:55.104649 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740786    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 13:58:55.104649 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740788    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 13:58:55.104649 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740791    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 13:58:55.104649 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740794    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 13:58:55.104649 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740796    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 13:58:55.104649 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740801    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 13:58:55.104649 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740804    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 13:58:55.104649 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740807    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 13:58:55.107343 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740811    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 13:58:55.107343 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740815    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 13:58:55.107343 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740818    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 13:58:55.107343 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740821    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 13:58:55.107343 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740824    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 13:58:55.107343 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740826    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 13:58:55.107343 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740829    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 13:58:55.107343 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740832    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 13:58:55.107343 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740834    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 13:58:55.107343 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740837    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 13:58:55.107343 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740840    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 13:58:55.107343 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740843    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 13:58:55.107343 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740847    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 13:58:55.107343 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740849    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 13:58:55.107343 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740852    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 13:58:55.107343 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740855    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 13:58:55.107343 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740857    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 13:58:55.107343 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740860    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 13:58:55.107343 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740862    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 13:58:55.107343 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740865    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 13:58:55.109137 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740868    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 13:58:55.109137 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740871    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 13:58:55.109137 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740873    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 13:58:55.109137 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740876    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 13:58:55.109137 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740878    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 13:58:55.109137 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740881    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 13:58:55.109137 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740883    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 13:58:55.109137 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740886    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 13:58:55.109137 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740888    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 13:58:55.109137 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740893    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 13:58:55.109137 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740896    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 13:58:55.109137 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740900    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 13:58:55.109137 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740903    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 13:58:55.109137 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740906    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 13:58:55.109137 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740909    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 13:58:55.109137 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740911    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 13:58:55.109137 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740914    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 13:58:55.109137 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740917    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 13:58:55.109137 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740920    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 13:58:55.111750 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740922    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 13:58:55.111750 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740924    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 13:58:55.111750 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740927    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 13:58:55.111750 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740929    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 13:58:55.111750 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740932    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 13:58:55.111750 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740952    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 13:58:55.111750 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740956    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 13:58:55.111750 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740958    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 13:58:55.111750 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740961    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 13:58:55.111750 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740964    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 13:58:55.111750 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740966    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 13:58:55.111750 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740969    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 13:58:55.111750 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740972    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 13:58:55.111750 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740974    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 13:58:55.111750 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740977    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 13:58:55.111750 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740980    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 13:58:55.111750 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740983    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 13:58:55.111750 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.740986    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 13:58:55.117529 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.741847    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 13:58:55.117529 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.757145    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 13:58:55.117529 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.757164    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 13:58:55.117529 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.757959    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 13:58:55.117529 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.757971    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 13:58:55.117529 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758035    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 13:58:55.117529 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758041    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 13:58:55.117529 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758044    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 13:58:55.117529 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758047    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 13:58:55.117529 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758052    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 13:58:55.117529 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758055    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 13:58:55.117529 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758058    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 13:58:55.117529 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758062    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 13:58:55.117529 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758064    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 13:58:55.117529 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758067    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 13:58:55.120073 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758072    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 13:58:55.120073 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758076    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 13:58:55.120073 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758080    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 13:58:55.120073 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758083    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 13:58:55.120073 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758086    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 13:58:55.120073 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758089    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 13:58:55.120073 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758092    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 13:58:55.120073 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758096    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 13:58:55.120073 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758100    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 13:58:55.120073 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758103    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 13:58:55.120073 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758107    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 13:58:55.120073 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758111    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 13:58:55.120073 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758114    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 13:58:55.120073 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758119    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 13:58:55.120073 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758124    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 13:58:55.120073 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758127    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 13:58:55.120073 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758129    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 13:58:55.120073 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758132    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 13:58:55.120073 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758134    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 13:58:55.120073 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758137    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 13:58:55.127033 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758141    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 13:58:55.127033 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758145    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 13:58:55.127033 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758149    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 13:58:55.127033 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758152    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 13:58:55.127033 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758157    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 13:58:55.127033 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758161    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 13:58:55.127033 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758164    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 13:58:55.127033 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758167    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 13:58:55.127033 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758170    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 13:58:55.127033 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758173    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 13:58:55.127033 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758175    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 13:58:55.127033 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758178    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 13:58:55.127033 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758182    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 13:58:55.127033 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758186    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 13:58:55.127033 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758189    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 13:58:55.127033 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758192    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 13:58:55.127033 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758194    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 13:58:55.127033 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758197    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 13:58:55.127033 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758201    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 13:58:55.129360 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758205    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 13:58:55.129360 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758207    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 13:58:55.129360 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758210    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 13:58:55.129360 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758213    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 13:58:55.129360 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758215    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 13:58:55.129360 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758218    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 13:58:55.129360 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758221    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 13:58:55.129360 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758224    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 13:58:55.129360 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758227    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 13:58:55.129360 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758230    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 13:58:55.129360 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758234    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 13:58:55.129360 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758237    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 13:58:55.129360 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758241    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 13:58:55.129360 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758245    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 13:58:55.129360 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758248    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 13:58:55.129360 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758251    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 13:58:55.129360 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758253    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 13:58:55.129360 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758256    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 13:58:55.129360 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758259    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 13:58:55.129360 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758262    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 13:58:55.133796 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758265    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 13:58:55.133796 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758268    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 13:58:55.133796 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758272    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 13:58:55.133796 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758275    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 13:58:55.133796 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758277    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 13:58:55.133796 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758280    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 13:58:55.133796 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758283    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 13:58:55.133796 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758288    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 13:58:55.133796 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758292    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 13:58:55.133796 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758295    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 13:58:55.133796 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758298    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 13:58:55.133796 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758301    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 13:58:55.133796 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758303    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 13:58:55.133796 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758306    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 13:58:55.133796 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758309    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 13:58:55.133796 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758313    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 13:58:55.133796 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758316    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 13:58:55.133796 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758319    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 13:58:55.133796 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758322    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 13:58:55.134583 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758325    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 13:58:55.134583 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758327    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 13:58:55.134583 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758332    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 13:58:55.134583 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758336    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 13:58:55.134583 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758339    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 13:58:55.134583 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758341    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 13:58:55.134583 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758344    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 13:58:55.134583 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758346    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 13:58:55.134583 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758350    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 13:58:55.134583 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758354    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 13:58:55.134583 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758356    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 13:58:55.134583 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.758361    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 13:58:55.134583 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758496    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 13:58:55.134583 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758501    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 13:58:55.134583 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758503    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 13:58:55.135120 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758507    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 13:58:55.135120 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758511    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 13:58:55.135120 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758514    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 13:58:55.135120 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758517    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 13:58:55.135120 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758519    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 13:58:55.135120 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758522    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 13:58:55.135120 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758525    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 13:58:55.135120 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758529    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 13:58:55.135120 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758533    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 13:58:55.135120 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758537    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 13:58:55.135120 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758540    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 13:58:55.135120 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758543    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 13:58:55.135120 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758546    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 13:58:55.135120 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758550    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 13:58:55.135120 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758554    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 13:58:55.135120 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758557    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 13:58:55.135120 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758560    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 13:58:55.135120 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758563    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 13:58:55.135120 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758565    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 13:58:55.135120 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758568    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 13:58:55.135648 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758572    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 13:58:55.135648 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758575    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 13:58:55.135648 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758578    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 13:58:55.135648 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758582    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 13:58:55.135648 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758585    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 13:58:55.135648 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758589    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 13:58:55.135648 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758591    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 13:58:55.135648 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758594    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 13:58:55.135648 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758600    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 13:58:55.135648 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758604    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 13:58:55.135648 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758607    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 13:58:55.135648 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758610    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 13:58:55.135648 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758612    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 13:58:55.135648 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758615    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 13:58:55.135648 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758618    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 13:58:55.135648 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758622    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 13:58:55.135648 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758626    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 13:58:55.135648 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758629    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 13:58:55.135648 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758631    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 13:58:55.136222 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758636    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 13:58:55.136222 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758641    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 13:58:55.136222 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758644    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 13:58:55.136222 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758647    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 13:58:55.136222 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758650    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 13:58:55.136222 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758652    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 13:58:55.136222 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758655    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 13:58:55.136222 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758657    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 13:58:55.136222 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758660    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 13:58:55.136222 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758664    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 13:58:55.136222 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758668    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 13:58:55.136222 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758671    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 13:58:55.136222 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758673    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 13:58:55.136222 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758676    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 13:58:55.136222 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758680    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 13:58:55.136222 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758684    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 13:58:55.136222 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758688    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 13:58:55.136222 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758691    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 13:58:55.136222 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758693    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 13:58:55.136858 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758696    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 13:58:55.136858 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758700    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 13:58:55.136858 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758705    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 13:58:55.136858 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758709    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 13:58:55.136858 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758712    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 13:58:55.136858 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758715    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 13:58:55.136858 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758717    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 13:58:55.136858 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758720    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 13:58:55.136858 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758724    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 13:58:55.136858 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758728    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 13:58:55.136858 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758731    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 13:58:55.136858 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758733    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 13:58:55.136858 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758736    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 13:58:55.136858 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758740    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 13:58:55.136858 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758744    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 13:58:55.136858 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758748    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 13:58:55.136858 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758751    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 13:58:55.136858 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758753    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 13:58:55.136858 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758756    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 13:58:55.136858 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758758    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 13:58:55.137457 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758761    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 13:58:55.137457 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758763    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 13:58:55.137457 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758766    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 13:58:55.137457 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758770    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 13:58:55.137457 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758773    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 13:58:55.137457 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758775    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 13:58:55.137457 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758778    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 13:58:55.137457 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758781    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 13:58:55.137457 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758784    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 13:58:55.137457 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758787    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 13:58:55.137457 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758791    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 13:58:55.137457 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758794    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 13:58:55.137457 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758797    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 13:58:55.137457 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758799    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 13:58:55.137457 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758803    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 13:58:55.137457 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758806    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 13:58:55.137457 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758809    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 13:58:55.137457 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:54.758814    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 13:58:55.137947 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.758818    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 13:58:55.137947 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.758974    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 13:58:55.137947 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.762286    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 13:58:55.137947 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.763806    2576 server.go:1019] "Starting client certificate rotation"
Jul 07 13:58:55.137947 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.763906    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 13:58:55.137947 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.763955    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 13:58:55.137947 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.766680    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 13:58:55.137947 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.767961    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 13:58:55.137947 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.782822    2576 log.go:25] "Validated CRI v1 runtime API"
Jul 07 13:58:55.137947 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.785185    2576 log.go:25] "Validated CRI v1 image API"
Jul 07 13:58:55.137947 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.785990    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 13:58:55.137947 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.789668    2576 fs.go:135] Filesystem UUIDs: map[2323c944-797c-4946-9aba-525e872a4646:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 7b7c7f5f-6e39-4a83-84ed-e31420aefd69:/dev/nvme0n1p3]
Jul 07 13:58:55.138334 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.789687    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 13:58:55.138334 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.794707    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 13:58:55.138570 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.797030    2576 manager.go:216] Machine: {Timestamp:2026-07-07 13:58:54.795528682 +0000 UTC m=+0.407807647 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099368 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2abb2e39797d1cb81b28d21448eeb6 SystemUUID:ec2abb2e-3979-7d1c-b81b-28d21448eeb6 BootID:a3d60a86-f887-4974-98cb-14935281a876 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cc:2c:e0:a0:7b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cc:2c:e0:a0:7b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:e9:89:2f:01:28 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 13:58:55.138570 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.797175    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 13:58:55.138570 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.797279    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 13:58:55.138570 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.801411    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 13:58:55.138570 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.801442    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-192.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 13:58:55.138570 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.802308    2576 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 13:58:55.138570 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.802322    2576 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 13:58:55.138570 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.802331    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 13:58:55.138570 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.803303    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 13:58:55.138570 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.805508    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 13:58:55.138570 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.809411    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 13:58:55.138570 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.809523    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 13:58:55.138570 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.809553    2576 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 13:58:55.138570 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.809562    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 13:58:55.138570 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.809577    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 13:58:55.138570 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.809589    2576 kubelet.go:398] "Adding apiserver pod source"
Jul 07 13:58:55.138570 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.809598    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 13:58:55.138570 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.809982    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.809998    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.813043    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.815464    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.815491    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.816991    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.817003    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.817009    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.817015    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.817024    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.817030    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.817038    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.817044    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.817050    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.817057    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.817066    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.817071    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.818877    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.818886    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:54.821647    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:54.821647    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-192.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.822321    2576 server.go:1268] "Started kubelet"
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.822409    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.826797    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.827032    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.829301    2576 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.829313    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:54.829452    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.832569    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-192.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:54.832653    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-192.ec2.internal.18c0069f8fe2c306  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-192.ec2.internal,UID:ip-10-0-140-192.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-192.ec2.internal,},FirstTimestamp:2026-07-07 13:58:54.822286086 +0000 UTC m=+0.434565050,LastTimestamp:2026-07-07 13:58:54.822286086 +0000 UTC m=+0.434565050,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-192.ec2.internal,}"
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.838036    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.838044    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:54.838144    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-192.ec2.internal\" not found"
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.838773    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.838780    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.838794    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.838903    2576 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.838910    2576 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.839146    2576 factory.go:153] Registering CRI-O factory
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.839158    2576 factory.go:223] Registration of the crio container factory successfully
Jul 07 13:58:55.139184 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.839202    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.839210    2576 factory.go:55] Registering systemd factory
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.839215    2576 factory.go:223] Registration of the systemd container factory successfully
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.839232    2576 factory.go:103] Registering Raw factory
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.839244    2576 manager.go:1196] Started watching for new ooms in manager
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.839517    2576 manager.go:349] Starting recovery of all containers
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:54.841645    2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-192.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:54.841774    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.846845    2576 manager.go:354] Recovery completed
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.847094    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6fzk6"
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.850854    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.852588    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6fzk6"
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.853200    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.853223    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.853236    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientPID"
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.855836    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.855851    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.855871    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.855869    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.856981    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.857015    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.857031    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientPID"
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:54.857013    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-192.ec2.internal.18c0069f91baa5ec  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-192.ec2.internal,UID:ip-10-0-140-192.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-192.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-192.ec2.internal,},FirstTimestamp:2026-07-07 13:58:54.853211628 +0000 UTC m=+0.465490597,LastTimestamp:2026-07-07 13:58:54.853211628 +0000 UTC m=+0.465490597,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-192.ec2.internal,}"
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.857147    2576 policy_none.go:49] "None policy: Start"
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.857166    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.857180    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.858257    2576 policy_none.go:47] "Start"
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:54.939012    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-192.ec2.internal\" not found"
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.940488    2576 manager.go:337] "Starting Device Plugin manager"
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:54.940517    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.940530    2576 server.go:87] "Starting device plugin registration server"
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.940813    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.940825    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.940949    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.941037    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:54.941045    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:54.941574    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:54.941625    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-192.ec2.internal\" not found"
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.041879    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 13:58:55.140269 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.042829    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 13:58:55.141339 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.042866    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 13:58:55.141339 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.042880    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientPID"
Jul 07 13:58:55.141339 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.042910    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-192.ec2.internal"
Jul 07 13:58:55.141339 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:55.048343    2576 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-192.ec2.internal\" not found" node="ip-10-0-140-192.ec2.internal"
Jul 07 13:58:55.141339 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.052374    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-192.ec2.internal"
Jul 07 13:58:55.141339 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:55.052390    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-192.ec2.internal\": node \"ip-10-0-140-192.ec2.internal\" not found"
Jul 07 13:58:55.141339 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.066954    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 13:58:55.141339 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.068145    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 13:58:55.141339 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.068191    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 13:58:55.141339 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.068218    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 13:58:55.141339 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:55.068256    2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 13:58:55.141339 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.070805    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 13:58:55.141339 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:55.129626    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-192.ec2.internal\" not found"
Jul 07 13:58:55.250765 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.168983    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-192.ec2.internal"]
Jul 07 13:58:55.250765 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.169081    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 13:58:55.250765 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.170210    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 13:58:55.250765 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.170236    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 13:58:55.250765 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.170247    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientPID"
Jul 07 13:58:55.250765 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.172342    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 13:58:55.250765 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.172454    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal"
Jul 07 13:58:55.250765 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.172486    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 13:58:55.250765 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.173244    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 13:58:55.250765 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.173262    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 13:58:55.250765 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.173272    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientPID"
Jul 07 13:58:55.250765 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.173667    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 13:58:55.250765 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.173688    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 13:58:55.250765 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.173701    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientPID"
Jul 07 13:58:55.250765 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.174650    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-192.ec2.internal"
Jul 07 13:58:55.250765 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.174676    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 13:58:55.250765 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.175326    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 13:58:55.250765 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.175346    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 13:58:55.250765 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.175359    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeHasSufficientPID"
Jul 07 13:58:55.250765 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:55.202603    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-192.ec2.internal\" not found" node="ip-10-0-140-192.ec2.internal"
Jul 07 13:58:55.250765 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:55.207064    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-192.ec2.internal\" not found" node="ip-10-0-140-192.ec2.internal"
Jul 07 13:58:55.250765 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:55.229986    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-192.ec2.internal\" not found"
Jul 07 13:58:55.434746 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:55.330397    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-192.ec2.internal\" not found"
Jul 07 13:58:55.434746 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.340735    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1708c56eb2b6c081bc50f9acca06f1da-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal\" (UID: \"1708c56eb2b6c081bc50f9acca06f1da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal"
Jul 07 13:58:55.434746 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.340765    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f58afcd1466e885d24b7a0e18eb4c8af-config\") pod \"kube-apiserver-proxy-ip-10-0-140-192.ec2.internal\" (UID: \"f58afcd1466e885d24b7a0e18eb4c8af\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-192.ec2.internal"
Jul 07 13:58:55.434746 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.340783    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1708c56eb2b6c081bc50f9acca06f1da-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal\" (UID: \"1708c56eb2b6c081bc50f9acca06f1da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal"
Jul 07 13:58:55.434746 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:55.430854    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-192.ec2.internal\" not found"
Jul 07 13:58:55.546759 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.440920    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1708c56eb2b6c081bc50f9acca06f1da-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal\" (UID: \"1708c56eb2b6c081bc50f9acca06f1da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal"
Jul 07 13:58:55.546759 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.440957    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1708c56eb2b6c081bc50f9acca06f1da-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal\" (UID: \"1708c56eb2b6c081bc50f9acca06f1da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal"
Jul 07 13:58:55.546759 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.440974    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f58afcd1466e885d24b7a0e18eb4c8af-config\") pod \"kube-apiserver-proxy-ip-10-0-140-192.ec2.internal\" (UID: \"f58afcd1466e885d24b7a0e18eb4c8af\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-192.ec2.internal"
Jul 07 13:58:55.546759 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.440999    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f58afcd1466e885d24b7a0e18eb4c8af-config\") pod \"kube-apiserver-proxy-ip-10-0-140-192.ec2.internal\" (UID: \"f58afcd1466e885d24b7a0e18eb4c8af\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-192.ec2.internal"
Jul 07 13:58:55.546759 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.441007    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1708c56eb2b6c081bc50f9acca06f1da-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal\" (UID: \"1708c56eb2b6c081bc50f9acca06f1da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal"
Jul 07 13:58:55.546759 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.441026    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1708c56eb2b6c081bc50f9acca06f1da-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal\" (UID: \"1708c56eb2b6c081bc50f9acca06f1da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal"
Jul 07 13:58:55.546759 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.506068    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal"
Jul 07 13:58:55.546759 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.511251    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-192.ec2.internal"
Jul 07 13:58:55.546759 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:55.531711    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-192.ec2.internal\" not found"
Jul 07 13:58:55.726488 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:55.632255    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-192.ec2.internal\" not found"
Jul 07 13:58:55.915501 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:55.732815    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-192.ec2.internal\" not found"
Jul 07 13:58:55.915501 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.763275    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 13:58:55.915501 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.763421    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 13:58:55.915501 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:55.833331    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-192.ec2.internal\" not found"
Jul 07 13:58:55.915501 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.854858    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 13:58:55.915501 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.855852    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 13:53:55 +0000 UTC" deadline="2028-04-07 18:29:50.565477616 +0000 UTC"
Jul 07 13:58:55.915501 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.855871    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15364h30m54.709609121s"
Jul 07 13:58:55.915501 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.872821    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 13:58:55.915501 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.882630    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 13:58:55.982199 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.939072    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal"
Jul 07 13:58:55.982199 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.960507    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 13:58:55.982199 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.961587    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-192.ec2.internal"
Jul 07 13:58:55.982199 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:55.973775    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 13:58:56.358034 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:56.357988    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf58afcd1466e885d24b7a0e18eb4c8af.slice/crio-57aa2454984b85e1ef0bad8fa4a8b76fa1fdb119a8cf6316f746457a8161a101 WatchSource:0}: Error finding container 57aa2454984b85e1ef0bad8fa4a8b76fa1fdb119a8cf6316f746457a8161a101: Status 404 returned error can't find the container with id 57aa2454984b85e1ef0bad8fa4a8b76fa1fdb119a8cf6316f746457a8161a101
Jul 07 13:58:56.362174 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.362159    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 13:58:56.524393 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:56.524360    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1708c56eb2b6c081bc50f9acca06f1da.slice/crio-def066be955d8394a715f5b2f1947b92a6ae1b22d5d9877deb6ce672c80ea891 WatchSource:0}: Error finding container def066be955d8394a715f5b2f1947b92a6ae1b22d5d9877deb6ce672c80ea891: Status 404 returned error can't find the container with id def066be955d8394a715f5b2f1947b92a6ae1b22d5d9877deb6ce672c80ea891
Jul 07 13:58:56.779012 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.778930    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 13:58:56.812951 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.812918    2576 apiserver.go:52] "Watching apiserver"
Jul 07 13:58:56.823965 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.823935    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 13:58:56.825637 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.825615    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd7ms","openshift-cluster-node-tuning-operator/tuned-dqqmt","openshift-network-diagnostics/network-check-target-ts9k4","openshift-network-operator/iptables-alerter-sc5hw","openshift-ovn-kubernetes/ovnkube-node-zdfvw","kube-system/global-pull-secret-syncer-jcfdk","kube-system/konnectivity-agent-p85j7","openshift-dns/node-resolver-zf8wq","openshift-image-registry/node-ca-46w5l","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal","openshift-multus/multus-additional-cni-plugins-6b9sv","openshift-multus/multus-brcxr","openshift-multus/network-metrics-daemon-qg8cp","kube-system/kube-apiserver-proxy-ip-10-0-140-192.ec2.internal"]
Jul 07 13:58:56.827314 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.827301    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zf8wq"
Jul 07 13:58:56.828517 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.828493    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8cp"
Jul 07 13:58:56.828631 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:56.828553    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8cp" podUID="767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea"
Jul 07 13:58:56.829802 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.829783    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts9k4"
Jul 07 13:58:56.829889 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:56.829859    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts9k4" podUID="6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d"
Jul 07 13:58:56.829946 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.829898    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sb6mq\""
Jul 07 13:58:56.830248 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.830233    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 13:58:56.830329 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.830233    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 13:58:56.831157 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.831139    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sc5hw"
Jul 07 13:58:56.832445 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.832424    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.833723 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.833703    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p85j7"
Jul 07 13:58:56.834216 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.834195    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 13:58:56.834539 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.834516    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 13:58:56.834687 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.834654    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 13:58:56.835111 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.835093    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd7ms"
Jul 07 13:58:56.835723 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.835706    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mwltc\""
Jul 07 13:58:56.836285 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.836268    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 13:58:56.836386 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:56.836322    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcfdk" podUID="57cf19e7-ca31-4cc2-bb09-5ca82de4355b"
Jul 07 13:58:56.837647 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.837627    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 13:58:56.837729 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.837686    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-46w5l"
Jul 07 13:58:56.837878 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.837861    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 13:58:56.838466 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.838450    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 13:58:56.838640 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.838622    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 13:58:56.839238 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.839217    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 13:58:56.839238 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.839237    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 13:58:56.839392 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.839266    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 13:58:56.839392 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.839238    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ggsck\""
Jul 07 13:58:56.839392 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.839395    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nbrvp\""
Jul 07 13:58:56.839608 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.839587    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-252w8\""
Jul 07 13:58:56.839724 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.839688    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 13:58:56.839805 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.839773    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 13:58:56.839978 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.839942    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6b9sv"
Jul 07 13:58:56.840114 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.840097    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 13:58:56.840188 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.840117    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 13:58:56.841711 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.841691    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 13:58:56.841797 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.841767    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 13:58:56.841952 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.841932    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-l9rsc\""
Jul 07 13:58:56.843236 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.843212    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-llr8z\""
Jul 07 13:58:56.843338 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.843214    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 13:58:56.843760 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.843736    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:56.844890 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.844865    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 13:58:56.845577 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.845559    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:56.848005 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.847990    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/163b5d62-53dc-43d9-ae6e-ddf552abd570-sys-fs\") pod \"aws-ebs-csi-driver-node-qd7ms\" (UID: \"163b5d62-53dc-43d9-ae6e-ddf552abd570\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd7ms"
Jul 07 13:58:56.848106 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.848014    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/26899eb9-0edc-407d-9cd4-1f68fa5aa8f4-iptables-alerter-script\") pod \"iptables-alerter-sc5hw\" (UID: \"26899eb9-0edc-407d-9cd4-1f68fa5aa8f4\") " pod="openshift-network-operator/iptables-alerter-sc5hw"
Jul 07 13:58:56.848106 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.848043    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-system-cni-dir\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.848106 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.848080    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/64574840-04b3-464f-b59f-c76b9e84f72e-multus-daemon-config\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.848261 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.848114    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/26899eb9-0edc-407d-9cd4-1f68fa5aa8f4-host-slash\") pod \"iptables-alerter-sc5hw\" (UID: \"26899eb9-0edc-407d-9cd4-1f68fa5aa8f4\") " pod="openshift-network-operator/iptables-alerter-sc5hw"
Jul 07 13:58:56.848261 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.848175    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb58a368-1974-4d27-a323-5c6a8024c9ea-host\") pod \"node-ca-46w5l\" (UID: \"bb58a368-1974-4d27-a323-5c6a8024c9ea\") " pod="openshift-image-registry/node-ca-46w5l"
Jul 07 13:58:56.848261 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.848210    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/282d2c99-4c08-4f51-9625-89428d9d7ccb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6b9sv\" (UID: \"282d2c99-4c08-4f51-9625-89428d9d7ccb\") " pod="openshift-multus/multus-additional-cni-plugins-6b9sv"
Jul 07 13:58:56.848261 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.848243    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clnw8\" (UniqueName: \"kubernetes.io/projected/282d2c99-4c08-4f51-9625-89428d9d7ccb-kube-api-access-clnw8\") pod \"multus-additional-cni-plugins-6b9sv\" (UID: \"282d2c99-4c08-4f51-9625-89428d9d7ccb\") " pod="openshift-multus/multus-additional-cni-plugins-6b9sv"
Jul 07 13:58:56.848449 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.848273    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-multus-cni-dir\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.848449 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.848299    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-host-run-multus-certs\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.848449 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.848326    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/163b5d62-53dc-43d9-ae6e-ddf552abd570-registration-dir\") pod \"aws-ebs-csi-driver-node-qd7ms\" (UID: \"163b5d62-53dc-43d9-ae6e-ddf552abd570\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd7ms"
Jul 07 13:58:56.848449 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.848358    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6jh7\" (UniqueName: \"kubernetes.io/projected/767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea-kube-api-access-l6jh7\") pod \"network-metrics-daemon-qg8cp\" (UID: \"767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea\") " pod="openshift-multus/network-metrics-daemon-qg8cp"
Jul 07 13:58:56.848449 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.848403    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57cf19e7-ca31-4cc2-bb09-5ca82de4355b-original-pull-secret\") pod \"global-pull-secret-syncer-jcfdk\" (UID: \"57cf19e7-ca31-4cc2-bb09-5ca82de4355b\") " pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 13:58:56.848449 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.848430    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/282d2c99-4c08-4f51-9625-89428d9d7ccb-system-cni-dir\") pod \"multus-additional-cni-plugins-6b9sv\" (UID: \"282d2c99-4c08-4f51-9625-89428d9d7ccb\") " pod="openshift-multus/multus-additional-cni-plugins-6b9sv"
Jul 07 13:58:56.848449 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.848446    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-host-run-k8s-cni-cncf-io\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.848666 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.848473    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-host-var-lib-cni-bin\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.848666 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.848511    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-host-var-lib-kubelet\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.848666 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.848543    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rdrq\" (UniqueName: \"kubernetes.io/projected/163b5d62-53dc-43d9-ae6e-ddf552abd570-kube-api-access-6rdrq\") pod \"aws-ebs-csi-driver-node-qd7ms\" (UID: \"163b5d62-53dc-43d9-ae6e-ddf552abd570\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd7ms"
Jul 07 13:58:56.848666 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.848579    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea-metrics-certs\") pod \"network-metrics-daemon-qg8cp\" (UID: \"767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea\") " pod="openshift-multus/network-metrics-daemon-qg8cp"
Jul 07 13:58:56.848666 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.848627    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/282d2c99-4c08-4f51-9625-89428d9d7ccb-cni-binary-copy\") pod \"multus-additional-cni-plugins-6b9sv\" (UID: \"282d2c99-4c08-4f51-9625-89428d9d7ccb\") " pod="openshift-multus/multus-additional-cni-plugins-6b9sv"
Jul 07 13:58:56.848666 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.848657    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/282d2c99-4c08-4f51-9625-89428d9d7ccb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6b9sv\" (UID: \"282d2c99-4c08-4f51-9625-89428d9d7ccb\") " pod="openshift-multus/multus-additional-cni-plugins-6b9sv"
Jul 07 13:58:56.848896 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.848691    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/634f658b-6022-40f7-9c4c-3c14e6f9c27e-tmp-dir\") pod \"node-resolver-zf8wq\" (UID: \"634f658b-6022-40f7-9c4c-3c14e6f9c27e\") " pod="openshift-dns/node-resolver-zf8wq"
Jul 07 13:58:56.848896 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.848719    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt2wk\" (UniqueName: \"kubernetes.io/projected/634f658b-6022-40f7-9c4c-3c14e6f9c27e-kube-api-access-nt2wk\") pod \"node-resolver-zf8wq\" (UID: \"634f658b-6022-40f7-9c4c-3c14e6f9c27e\") " pod="openshift-dns/node-resolver-zf8wq"
Jul 07 13:58:56.848896 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.848752    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-multus-conf-dir\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.848896 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.848787    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8ffz\" (UniqueName: \"kubernetes.io/projected/64574840-04b3-464f-b59f-c76b9e84f72e-kube-api-access-v8ffz\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.848896 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.848813    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/20f34439-6845-4778-b380-3cf2e9f47125-konnectivity-ca\") pod \"konnectivity-agent-p85j7\" (UID: \"20f34439-6845-4778-b380-3cf2e9f47125\") " pod="kube-system/konnectivity-agent-p85j7"
Jul 07 13:58:56.848896 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.848838    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s48z5\" (UniqueName: \"kubernetes.io/projected/26899eb9-0edc-407d-9cd4-1f68fa5aa8f4-kube-api-access-s48z5\") pod \"iptables-alerter-sc5hw\" (UID: \"26899eb9-0edc-407d-9cd4-1f68fa5aa8f4\") " pod="openshift-network-operator/iptables-alerter-sc5hw"
Jul 07 13:58:56.848896 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.848866    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/57cf19e7-ca31-4cc2-bb09-5ca82de4355b-kubelet-config\") pod \"global-pull-secret-syncer-jcfdk\" (UID: \"57cf19e7-ca31-4cc2-bb09-5ca82de4355b\") " pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 13:58:56.849210 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.848911    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/634f658b-6022-40f7-9c4c-3c14e6f9c27e-hosts-file\") pod \"node-resolver-zf8wq\" (UID: \"634f658b-6022-40f7-9c4c-3c14e6f9c27e\") " pod="openshift-dns/node-resolver-zf8wq"
Jul 07 13:58:56.849210 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.848939    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-os-release\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.849210 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.848960    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 13:58:56.849210 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.848982    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/163b5d62-53dc-43d9-ae6e-ddf552abd570-device-dir\") pod \"aws-ebs-csi-driver-node-qd7ms\" (UID: \"163b5d62-53dc-43d9-ae6e-ddf552abd570\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd7ms"
Jul 07 13:58:56.849210 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.848972    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 13:58:56.849210 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.849008    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cq94\" (UniqueName: \"kubernetes.io/projected/6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d-kube-api-access-9cq94\") pod \"network-check-target-ts9k4\" (UID: \"6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d\") " pod="openshift-network-diagnostics/network-check-target-ts9k4"
Jul 07 13:58:56.849210 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.849032    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/282d2c99-4c08-4f51-9625-89428d9d7ccb-cnibin\") pod \"multus-additional-cni-plugins-6b9sv\" (UID: \"282d2c99-4c08-4f51-9625-89428d9d7ccb\") " pod="openshift-multus/multus-additional-cni-plugins-6b9sv"
Jul 07 13:58:56.849210 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.849070    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/163b5d62-53dc-43d9-ae6e-ddf552abd570-socket-dir\") pod \"aws-ebs-csi-driver-node-qd7ms\" (UID: \"163b5d62-53dc-43d9-ae6e-ddf552abd570\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd7ms"
Jul 07 13:58:56.849210 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.849097    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/163b5d62-53dc-43d9-ae6e-ddf552abd570-etc-selinux\") pod \"aws-ebs-csi-driver-node-qd7ms\" (UID: \"163b5d62-53dc-43d9-ae6e-ddf552abd570\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd7ms"
Jul 07 13:58:56.849210 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.849124    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/57cf19e7-ca31-4cc2-bb09-5ca82de4355b-dbus\") pod \"global-pull-secret-syncer-jcfdk\" (UID: \"57cf19e7-ca31-4cc2-bb09-5ca82de4355b\") " pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 13:58:56.849210 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.849149    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znttf\" (UniqueName: \"kubernetes.io/projected/bb58a368-1974-4d27-a323-5c6a8024c9ea-kube-api-access-znttf\") pod \"node-ca-46w5l\" (UID: \"bb58a368-1974-4d27-a323-5c6a8024c9ea\") " pod="openshift-image-registry/node-ca-46w5l"
Jul 07 13:58:56.849210 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.849175    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/282d2c99-4c08-4f51-9625-89428d9d7ccb-os-release\") pod \"multus-additional-cni-plugins-6b9sv\" (UID: \"282d2c99-4c08-4f51-9625-89428d9d7ccb\") " pod="openshift-multus/multus-additional-cni-plugins-6b9sv"
Jul 07 13:58:56.849210 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.849200    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-cnibin\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.849788 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.849223    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-host-run-netns\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.849788 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.849246    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-hostroot\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.849788 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.849268    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/20f34439-6845-4778-b380-3cf2e9f47125-agent-certs\") pod \"konnectivity-agent-p85j7\" (UID: \"20f34439-6845-4778-b380-3cf2e9f47125\") " pod="kube-system/konnectivity-agent-p85j7"
Jul 07 13:58:56.849788 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.849290    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bb58a368-1974-4d27-a323-5c6a8024c9ea-serviceca\") pod \"node-ca-46w5l\" (UID: \"bb58a368-1974-4d27-a323-5c6a8024c9ea\") " pod="openshift-image-registry/node-ca-46w5l"
Jul 07 13:58:56.849788 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.849325    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/282d2c99-4c08-4f51-9625-89428d9d7ccb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6b9sv\" (UID: \"282d2c99-4c08-4f51-9625-89428d9d7ccb\") " pod="openshift-multus/multus-additional-cni-plugins-6b9sv"
Jul 07 13:58:56.849788 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.849350    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/64574840-04b3-464f-b59f-c76b9e84f72e-cni-binary-copy\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.849788 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.849366    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-multus-socket-dir-parent\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.849788 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.849381    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-host-var-lib-cni-multus\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.849788 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.849419    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-etc-kubernetes\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.849788 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.849448    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/163b5d62-53dc-43d9-ae6e-ddf552abd570-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qd7ms\" (UID: \"163b5d62-53dc-43d9-ae6e-ddf552abd570\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd7ms"
Jul 07 13:58:56.849788 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.849456    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 13:58:56.849788 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.849464    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 13:58:56.849788 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.849588    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 13:58:56.849788 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.849619    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5gqrv\""
Jul 07 13:58:56.849788 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.849656    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s2qhx\""
Jul 07 13:58:56.849788 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.849464    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 13:58:56.850610 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.849802    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 13:58:56.850610 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.849849    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 13:58:56.853344 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.853328    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 13:58:56.884079 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.884057    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mpsb7"
Jul 07 13:58:56.893926 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.893905    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mpsb7"
Jul 07 13:58:56.939603 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.939576    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 13:58:56.950643 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.950607    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-run-openvswitch\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:56.950733 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.950656    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-system-cni-dir\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.950733 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.950679    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/64574840-04b3-464f-b59f-c76b9e84f72e-multus-daemon-config\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.950733 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.950704    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/282d2c99-4c08-4f51-9625-89428d9d7ccb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6b9sv\" (UID: \"282d2c99-4c08-4f51-9625-89428d9d7ccb\") " pod="openshift-multus/multus-additional-cni-plugins-6b9sv"
Jul 07 13:58:56.950835 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.950751    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-system-cni-dir\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.950835 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.950762    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-host-slash\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:56.950835 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.950822    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-multus-cni-dir\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.950925 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.950853    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-host-run-multus-certs\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.950925 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.950879    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6jh7\" (UniqueName: \"kubernetes.io/projected/767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea-kube-api-access-l6jh7\") pod \"network-metrics-daemon-qg8cp\" (UID: \"767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea\") " pod="openshift-multus/network-metrics-daemon-qg8cp"
Jul 07 13:58:56.950925 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.950909    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-host-cni-bin\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:56.951057 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.950933    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-host-cni-netd\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:56.951057 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.950974    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-host-run-multus-certs\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.951057 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.950976    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-host-var-lib-cni-bin\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.951057 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951025    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-host-var-lib-cni-bin\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.951057 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951027    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-host-var-lib-kubelet\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.951372 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951067    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rdrq\" (UniqueName: \"kubernetes.io/projected/163b5d62-53dc-43d9-ae6e-ddf552abd570-kube-api-access-6rdrq\") pod \"aws-ebs-csi-driver-node-qd7ms\" (UID: \"163b5d62-53dc-43d9-ae6e-ddf552abd570\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd7ms"
Jul 07 13:58:56.951372 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951067    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-multus-cni-dir\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.951372 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951093    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-log-socket\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:56.951372 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951117    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9b610f2e-6770-48cb-8e57-501a48a6e7f5-run\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:56.951372 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951129    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-host-var-lib-kubelet\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.951372 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951142    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/634f658b-6022-40f7-9c4c-3c14e6f9c27e-tmp-dir\") pod \"node-resolver-zf8wq\" (UID: \"634f658b-6022-40f7-9c4c-3c14e6f9c27e\") " pod="openshift-dns/node-resolver-zf8wq"
Jul 07 13:58:56.951372 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951185    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt2wk\" (UniqueName: \"kubernetes.io/projected/634f658b-6022-40f7-9c4c-3c14e6f9c27e-kube-api-access-nt2wk\") pod \"node-resolver-zf8wq\" (UID: \"634f658b-6022-40f7-9c4c-3c14e6f9c27e\") " pod="openshift-dns/node-resolver-zf8wq"
Jul 07 13:58:56.951372 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951217    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-multus-conf-dir\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.951372 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951252    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/20f34439-6845-4778-b380-3cf2e9f47125-konnectivity-ca\") pod \"konnectivity-agent-p85j7\" (UID: \"20f34439-6845-4778-b380-3cf2e9f47125\") " pod="kube-system/konnectivity-agent-p85j7"
Jul 07 13:58:56.951372 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951281    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s48z5\" (UniqueName: \"kubernetes.io/projected/26899eb9-0edc-407d-9cd4-1f68fa5aa8f4-kube-api-access-s48z5\") pod \"iptables-alerter-sc5hw\" (UID: \"26899eb9-0edc-407d-9cd4-1f68fa5aa8f4\") " pod="openshift-network-operator/iptables-alerter-sc5hw"
Jul 07 13:58:56.951372 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951279    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-multus-conf-dir\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.951372 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951317    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/57cf19e7-ca31-4cc2-bb09-5ca82de4355b-kubelet-config\") pod \"global-pull-secret-syncer-jcfdk\" (UID: \"57cf19e7-ca31-4cc2-bb09-5ca82de4355b\") " pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 13:58:56.951372 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951347    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/282d2c99-4c08-4f51-9625-89428d9d7ccb-cnibin\") pod \"multus-additional-cni-plugins-6b9sv\" (UID: \"282d2c99-4c08-4f51-9625-89428d9d7ccb\") " pod="openshift-multus/multus-additional-cni-plugins-6b9sv"
Jul 07 13:58:56.952002 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951376    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-os-release\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.952002 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951415    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/282d2c99-4c08-4f51-9625-89428d9d7ccb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6b9sv\" (UID: \"282d2c99-4c08-4f51-9625-89428d9d7ccb\") " pod="openshift-multus/multus-additional-cni-plugins-6b9sv"
Jul 07 13:58:56.952002 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951438    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cq94\" (UniqueName: \"kubernetes.io/projected/6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d-kube-api-access-9cq94\") pod \"network-check-target-ts9k4\" (UID: \"6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d\") " pod="openshift-network-diagnostics/network-check-target-ts9k4"
Jul 07 13:58:56.952002 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951468    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-host-run-netns\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:56.952002 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951484    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/57cf19e7-ca31-4cc2-bb09-5ca82de4355b-kubelet-config\") pod \"global-pull-secret-syncer-jcfdk\" (UID: \"57cf19e7-ca31-4cc2-bb09-5ca82de4355b\") " pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 13:58:56.952002 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951495    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-etc-openvswitch\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:56.952002 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951523    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-ovnkube-script-lib\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:56.952002 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951549    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9b610f2e-6770-48cb-8e57-501a48a6e7f5-lib-modules\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:56.952002 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951568    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/634f658b-6022-40f7-9c4c-3c14e6f9c27e-tmp-dir\") pod \"node-resolver-zf8wq\" (UID: \"634f658b-6022-40f7-9c4c-3c14e6f9c27e\") " pod="openshift-dns/node-resolver-zf8wq"
Jul 07 13:58:56.952002 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951575    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9b610f2e-6770-48cb-8e57-501a48a6e7f5-etc-tuned\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:56.952002 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951623    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/282d2c99-4c08-4f51-9625-89428d9d7ccb-cnibin\") pod \"multus-additional-cni-plugins-6b9sv\" (UID: \"282d2c99-4c08-4f51-9625-89428d9d7ccb\") " pod="openshift-multus/multus-additional-cni-plugins-6b9sv"
Jul 07 13:58:56.952002 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951655    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znttf\" (UniqueName: \"kubernetes.io/projected/bb58a368-1974-4d27-a323-5c6a8024c9ea-kube-api-access-znttf\") pod \"node-ca-46w5l\" (UID: \"bb58a368-1974-4d27-a323-5c6a8024c9ea\") " pod="openshift-image-registry/node-ca-46w5l"
Jul 07 13:58:56.952002 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951690    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9b610f2e-6770-48cb-8e57-501a48a6e7f5-etc-sysctl-d\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:56.952002 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951731    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b610f2e-6770-48cb-8e57-501a48a6e7f5-sys\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:56.952002 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951737    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-os-release\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.952002 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951750    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-host-run-netns\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.952002 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951773    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/20f34439-6845-4778-b380-3cf2e9f47125-agent-certs\") pod \"konnectivity-agent-p85j7\" (UID: \"20f34439-6845-4778-b380-3cf2e9f47125\") " pod="kube-system/konnectivity-agent-p85j7"
Jul 07 13:58:56.952791 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951792    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bb58a368-1974-4d27-a323-5c6a8024c9ea-serviceca\") pod \"node-ca-46w5l\" (UID: \"bb58a368-1974-4d27-a323-5c6a8024c9ea\") " pod="openshift-image-registry/node-ca-46w5l"
Jul 07 13:58:56.952791 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951806    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-host-run-netns\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.952791 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951810    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-run-systemd\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:56.952791 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951950    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-ovnkube-config\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:56.952791 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951963    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/64574840-04b3-464f-b59f-c76b9e84f72e-multus-daemon-config\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.952791 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.951998    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b610f2e-6770-48cb-8e57-501a48a6e7f5-etc-kubernetes\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:56.952791 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.952045    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/64574840-04b3-464f-b59f-c76b9e84f72e-cni-binary-copy\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.952791 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.952090    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-host-var-lib-cni-multus\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.952791 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.952118    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-etc-kubernetes\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.952791 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.952145    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/163b5d62-53dc-43d9-ae6e-ddf552abd570-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qd7ms\" (UID: \"163b5d62-53dc-43d9-ae6e-ddf552abd570\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd7ms"
Jul 07 13:58:56.952791 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.952164    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/20f34439-6845-4778-b380-3cf2e9f47125-konnectivity-ca\") pod \"konnectivity-agent-p85j7\" (UID: \"20f34439-6845-4778-b380-3cf2e9f47125\") " pod="kube-system/konnectivity-agent-p85j7"
Jul 07 13:58:56.952791 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.952190    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-host-var-lib-cni-multus\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.952791 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.952211    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/163b5d62-53dc-43d9-ae6e-ddf552abd570-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qd7ms\" (UID: \"163b5d62-53dc-43d9-ae6e-ddf552abd570\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd7ms"
Jul 07 13:58:56.952791 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.952233    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/26899eb9-0edc-407d-9cd4-1f68fa5aa8f4-iptables-alerter-script\") pod \"iptables-alerter-sc5hw\" (UID: \"26899eb9-0edc-407d-9cd4-1f68fa5aa8f4\") " pod="openshift-network-operator/iptables-alerter-sc5hw"
Jul 07 13:58:56.952791 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.952251    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-etc-kubernetes\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.952791 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.952268    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-run-ovn\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:56.952791 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.952292    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb58a368-1974-4d27-a323-5c6a8024c9ea-host\") pod \"node-ca-46w5l\" (UID: \"bb58a368-1974-4d27-a323-5c6a8024c9ea\") " pod="openshift-image-registry/node-ca-46w5l"
Jul 07 13:58:56.952791 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.952269    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 13:58:56.953597 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.952329    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bb58a368-1974-4d27-a323-5c6a8024c9ea-serviceca\") pod \"node-ca-46w5l\" (UID: \"bb58a368-1974-4d27-a323-5c6a8024c9ea\") " pod="openshift-image-registry/node-ca-46w5l"
Jul 07 13:58:56.953597 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.952333    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clnw8\" (UniqueName: \"kubernetes.io/projected/282d2c99-4c08-4f51-9625-89428d9d7ccb-kube-api-access-clnw8\") pod \"multus-additional-cni-plugins-6b9sv\" (UID: \"282d2c99-4c08-4f51-9625-89428d9d7ccb\") " pod="openshift-multus/multus-additional-cni-plugins-6b9sv"
Jul 07 13:58:56.953597 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.952361    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb58a368-1974-4d27-a323-5c6a8024c9ea-host\") pod \"node-ca-46w5l\" (UID: \"bb58a368-1974-4d27-a323-5c6a8024c9ea\") " pod="openshift-image-registry/node-ca-46w5l"
Jul 07 13:58:56.953597 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.952384    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-host-run-ovn-kubernetes\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:56.953597 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.952417    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-ovn-node-metrics-cert\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:56.953597 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.952447    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b610f2e-6770-48cb-8e57-501a48a6e7f5-host\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:56.953597 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.952486    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/163b5d62-53dc-43d9-ae6e-ddf552abd570-registration-dir\") pod \"aws-ebs-csi-driver-node-qd7ms\" (UID: \"163b5d62-53dc-43d9-ae6e-ddf552abd570\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd7ms"
Jul 07 13:58:56.953597 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.952542    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57cf19e7-ca31-4cc2-bb09-5ca82de4355b-original-pull-secret\") pod \"global-pull-secret-syncer-jcfdk\" (UID: \"57cf19e7-ca31-4cc2-bb09-5ca82de4355b\") " pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 13:58:56.953597 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.952555    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/163b5d62-53dc-43d9-ae6e-ddf552abd570-registration-dir\") pod \"aws-ebs-csi-driver-node-qd7ms\" (UID: \"163b5d62-53dc-43d9-ae6e-ddf552abd570\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd7ms"
Jul 07 13:58:56.953597 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.952583    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/282d2c99-4c08-4f51-9625-89428d9d7ccb-system-cni-dir\") pod \"multus-additional-cni-plugins-6b9sv\" (UID: \"282d2c99-4c08-4f51-9625-89428d9d7ccb\") " pod="openshift-multus/multus-additional-cni-plugins-6b9sv"
Jul 07 13:58:56.953597 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.952597    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/64574840-04b3-464f-b59f-c76b9e84f72e-cni-binary-copy\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.953597 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.952609    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:56.953597 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.952641    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9b610f2e-6770-48cb-8e57-501a48a6e7f5-etc-sysconfig\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:56.953597 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:56.952648    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 13:58:56.953597 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.952687    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/282d2c99-4c08-4f51-9625-89428d9d7ccb-system-cni-dir\") pod \"multus-additional-cni-plugins-6b9sv\" (UID: \"282d2c99-4c08-4f51-9625-89428d9d7ccb\") " pod="openshift-multus/multus-additional-cni-plugins-6b9sv"
Jul 07 13:58:56.953597 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.952727    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b610f2e-6770-48cb-8e57-501a48a6e7f5-var-lib-kubelet\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:56.953597 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.952757    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-host-run-k8s-cni-cncf-io\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.954296 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.952774    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/26899eb9-0edc-407d-9cd4-1f68fa5aa8f4-iptables-alerter-script\") pod \"iptables-alerter-sc5hw\" (UID: \"26899eb9-0edc-407d-9cd4-1f68fa5aa8f4\") " pod="openshift-network-operator/iptables-alerter-sc5hw"
Jul 07 13:58:56.954296 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:56.952836    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57cf19e7-ca31-4cc2-bb09-5ca82de4355b-original-pull-secret podName:57cf19e7-ca31-4cc2-bb09-5ca82de4355b nodeName:}" failed. No retries permitted until 2026-07-07 13:58:57.452809577 +0000 UTC m=+3.065088554 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57cf19e7-ca31-4cc2-bb09-5ca82de4355b-original-pull-secret") pod "global-pull-secret-syncer-jcfdk" (UID: "57cf19e7-ca31-4cc2-bb09-5ca82de4355b") : object "kube-system"/"original-pull-secret" not registered
Jul 07 13:58:56.954296 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.952854    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-host-run-k8s-cni-cncf-io\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.954296 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.952852    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea-metrics-certs\") pod \"network-metrics-daemon-qg8cp\" (UID: \"767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea\") " pod="openshift-multus/network-metrics-daemon-qg8cp"
Jul 07 13:58:56.954296 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.952886    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/282d2c99-4c08-4f51-9625-89428d9d7ccb-cni-binary-copy\") pod \"multus-additional-cni-plugins-6b9sv\" (UID: \"282d2c99-4c08-4f51-9625-89428d9d7ccb\") " pod="openshift-multus/multus-additional-cni-plugins-6b9sv"
Jul 07 13:58:56.954296 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.952954    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/282d2c99-4c08-4f51-9625-89428d9d7ccb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6b9sv\" (UID: \"282d2c99-4c08-4f51-9625-89428d9d7ccb\") " pod="openshift-multus/multus-additional-cni-plugins-6b9sv"
Jul 07 13:58:56.954296 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:56.952988    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 13:58:56.954296 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953025    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9b610f2e-6770-48cb-8e57-501a48a6e7f5-etc-modprobe-d\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:56.954296 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:56.953042    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea-metrics-certs podName:767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea nodeName:}" failed. No retries permitted until 2026-07-07 13:58:57.453027191 +0000 UTC m=+3.065306162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea-metrics-certs") pod "network-metrics-daemon-qg8cp" (UID: "767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 13:58:56.954296 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953077    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9b610f2e-6770-48cb-8e57-501a48a6e7f5-etc-systemd\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:56.954296 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953159    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z52x9\" (UniqueName: \"kubernetes.io/projected/9b610f2e-6770-48cb-8e57-501a48a6e7f5-kube-api-access-z52x9\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:56.954296 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953216    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8ffz\" (UniqueName: \"kubernetes.io/projected/64574840-04b3-464f-b59f-c76b9e84f72e-kube-api-access-v8ffz\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.954296 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953244    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/634f658b-6022-40f7-9c4c-3c14e6f9c27e-hosts-file\") pod \"node-resolver-zf8wq\" (UID: \"634f658b-6022-40f7-9c4c-3c14e6f9c27e\") " pod="openshift-dns/node-resolver-zf8wq"
Jul 07 13:58:56.954296 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953323    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/282d2c99-4c08-4f51-9625-89428d9d7ccb-cni-binary-copy\") pod \"multus-additional-cni-plugins-6b9sv\" (UID: \"282d2c99-4c08-4f51-9625-89428d9d7ccb\") " pod="openshift-multus/multus-additional-cni-plugins-6b9sv"
Jul 07 13:58:56.954296 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953342    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/634f658b-6022-40f7-9c4c-3c14e6f9c27e-hosts-file\") pod \"node-resolver-zf8wq\" (UID: \"634f658b-6022-40f7-9c4c-3c14e6f9c27e\") " pod="openshift-dns/node-resolver-zf8wq"
Jul 07 13:58:56.954296 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953310    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/163b5d62-53dc-43d9-ae6e-ddf552abd570-device-dir\") pod \"aws-ebs-csi-driver-node-qd7ms\" (UID: \"163b5d62-53dc-43d9-ae6e-ddf552abd570\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd7ms"
Jul 07 13:58:56.954836 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953379    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/163b5d62-53dc-43d9-ae6e-ddf552abd570-device-dir\") pod \"aws-ebs-csi-driver-node-qd7ms\" (UID: \"163b5d62-53dc-43d9-ae6e-ddf552abd570\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd7ms"
Jul 07 13:58:56.954836 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953381    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-systemd-units\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:56.954836 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953425    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-node-log\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:56.954836 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953442    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9b610f2e-6770-48cb-8e57-501a48a6e7f5-etc-sysctl-conf\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:56.954836 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953495    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/163b5d62-53dc-43d9-ae6e-ddf552abd570-socket-dir\") pod \"aws-ebs-csi-driver-node-qd7ms\" (UID: \"163b5d62-53dc-43d9-ae6e-ddf552abd570\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd7ms"
Jul 07 13:58:56.954836 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953518    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/163b5d62-53dc-43d9-ae6e-ddf552abd570-etc-selinux\") pod \"aws-ebs-csi-driver-node-qd7ms\" (UID: \"163b5d62-53dc-43d9-ae6e-ddf552abd570\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd7ms"
Jul 07 13:58:56.954836 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953534    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/57cf19e7-ca31-4cc2-bb09-5ca82de4355b-dbus\") pod \"global-pull-secret-syncer-jcfdk\" (UID: \"57cf19e7-ca31-4cc2-bb09-5ca82de4355b\") " pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 13:58:56.954836 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953544    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/282d2c99-4c08-4f51-9625-89428d9d7ccb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6b9sv\" (UID: \"282d2c99-4c08-4f51-9625-89428d9d7ccb\") " pod="openshift-multus/multus-additional-cni-plugins-6b9sv"
Jul 07 13:58:56.954836 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953550    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/282d2c99-4c08-4f51-9625-89428d9d7ccb-os-release\") pod \"multus-additional-cni-plugins-6b9sv\" (UID: \"282d2c99-4c08-4f51-9625-89428d9d7ccb\") " pod="openshift-multus/multus-additional-cni-plugins-6b9sv"
Jul 07 13:58:56.954836 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953604    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/282d2c99-4c08-4f51-9625-89428d9d7ccb-os-release\") pod \"multus-additional-cni-plugins-6b9sv\" (UID: \"282d2c99-4c08-4f51-9625-89428d9d7ccb\") " pod="openshift-multus/multus-additional-cni-plugins-6b9sv"
Jul 07 13:58:56.954836 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953604    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2lkr\" (UniqueName: \"kubernetes.io/projected/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-kube-api-access-k2lkr\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:56.954836 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953627    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/163b5d62-53dc-43d9-ae6e-ddf552abd570-socket-dir\") pod \"aws-ebs-csi-driver-node-qd7ms\" (UID: \"163b5d62-53dc-43d9-ae6e-ddf552abd570\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd7ms"
Jul 07 13:58:56.954836 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953632    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/57cf19e7-ca31-4cc2-bb09-5ca82de4355b-dbus\") pod \"global-pull-secret-syncer-jcfdk\" (UID: \"57cf19e7-ca31-4cc2-bb09-5ca82de4355b\") " pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 13:58:56.954836 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953660    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-cnibin\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.954836 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953692    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-hostroot\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.954836 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953721    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/282d2c99-4c08-4f51-9625-89428d9d7ccb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6b9sv\" (UID: \"282d2c99-4c08-4f51-9625-89428d9d7ccb\") " pod="openshift-multus/multus-additional-cni-plugins-6b9sv"
Jul 07 13:58:56.954836 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953724    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-cnibin\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.955378 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953743    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/163b5d62-53dc-43d9-ae6e-ddf552abd570-etc-selinux\") pod \"aws-ebs-csi-driver-node-qd7ms\" (UID: \"163b5d62-53dc-43d9-ae6e-ddf552abd570\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd7ms"
Jul 07 13:58:56.955378 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953751    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-host-kubelet\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:56.955378 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953750    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-hostroot\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.955378 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953778    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-var-lib-openvswitch\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:56.955378 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953801    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-env-overrides\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:56.955378 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953829    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b610f2e-6770-48cb-8e57-501a48a6e7f5-tmp\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:56.955378 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953858    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-multus-socket-dir-parent\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.955378 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953871    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/282d2c99-4c08-4f51-9625-89428d9d7ccb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6b9sv\" (UID: \"282d2c99-4c08-4f51-9625-89428d9d7ccb\") " pod="openshift-multus/multus-additional-cni-plugins-6b9sv"
Jul 07 13:58:56.955378 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953905    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/163b5d62-53dc-43d9-ae6e-ddf552abd570-sys-fs\") pod \"aws-ebs-csi-driver-node-qd7ms\" (UID: \"163b5d62-53dc-43d9-ae6e-ddf552abd570\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd7ms"
Jul 07 13:58:56.955378 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953911    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/64574840-04b3-464f-b59f-c76b9e84f72e-multus-socket-dir-parent\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.955378 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953973    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/26899eb9-0edc-407d-9cd4-1f68fa5aa8f4-host-slash\") pod \"iptables-alerter-sc5hw\" (UID: \"26899eb9-0edc-407d-9cd4-1f68fa5aa8f4\") " pod="openshift-network-operator/iptables-alerter-sc5hw"
Jul 07 13:58:56.955378 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.953992    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/163b5d62-53dc-43d9-ae6e-ddf552abd570-sys-fs\") pod \"aws-ebs-csi-driver-node-qd7ms\" (UID: \"163b5d62-53dc-43d9-ae6e-ddf552abd570\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd7ms"
Jul 07 13:58:56.955378 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.954052    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/26899eb9-0edc-407d-9cd4-1f68fa5aa8f4-host-slash\") pod \"iptables-alerter-sc5hw\" (UID: \"26899eb9-0edc-407d-9cd4-1f68fa5aa8f4\") " pod="openshift-network-operator/iptables-alerter-sc5hw"
Jul 07 13:58:56.956175 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.956151    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/20f34439-6845-4778-b380-3cf2e9f47125-agent-certs\") pod \"konnectivity-agent-p85j7\" (UID: \"20f34439-6845-4778-b380-3cf2e9f47125\") " pod="kube-system/konnectivity-agent-p85j7"
Jul 07 13:58:56.963641 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:56.963617    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 13:58:56.963755 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:56.963648    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 13:58:56.963755 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:56.963665    2576 projected.go:196] Error preparing data for projected volume kube-api-access-9cq94 for pod openshift-network-diagnostics/network-check-target-ts9k4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 13:58:56.963849 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:56.963778    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d-kube-api-access-9cq94 podName:6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d nodeName:}" failed. No retries permitted until 2026-07-07 13:58:57.463758247 +0000 UTC m=+3.076037220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9cq94" (UniqueName: "kubernetes.io/projected/6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d-kube-api-access-9cq94") pod "network-check-target-ts9k4" (UID: "6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 13:58:56.966784 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.966735    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt2wk\" (UniqueName: \"kubernetes.io/projected/634f658b-6022-40f7-9c4c-3c14e6f9c27e-kube-api-access-nt2wk\") pod \"node-resolver-zf8wq\" (UID: \"634f658b-6022-40f7-9c4c-3c14e6f9c27e\") " pod="openshift-dns/node-resolver-zf8wq"
Jul 07 13:58:56.966784 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.966766    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rdrq\" (UniqueName: \"kubernetes.io/projected/163b5d62-53dc-43d9-ae6e-ddf552abd570-kube-api-access-6rdrq\") pod \"aws-ebs-csi-driver-node-qd7ms\" (UID: \"163b5d62-53dc-43d9-ae6e-ddf552abd570\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd7ms"
Jul 07 13:58:56.966965 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.966835    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znttf\" (UniqueName: \"kubernetes.io/projected/bb58a368-1974-4d27-a323-5c6a8024c9ea-kube-api-access-znttf\") pod \"node-ca-46w5l\" (UID: \"bb58a368-1974-4d27-a323-5c6a8024c9ea\") " pod="openshift-image-registry/node-ca-46w5l"
Jul 07 13:58:56.966965 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.966850    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s48z5\" (UniqueName: \"kubernetes.io/projected/26899eb9-0edc-407d-9cd4-1f68fa5aa8f4-kube-api-access-s48z5\") pod \"iptables-alerter-sc5hw\" (UID: \"26899eb9-0edc-407d-9cd4-1f68fa5aa8f4\") " pod="openshift-network-operator/iptables-alerter-sc5hw"
Jul 07 13:58:56.966965 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.966857    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8ffz\" (UniqueName: \"kubernetes.io/projected/64574840-04b3-464f-b59f-c76b9e84f72e-kube-api-access-v8ffz\") pod \"multus-brcxr\" (UID: \"64574840-04b3-464f-b59f-c76b9e84f72e\") " pod="openshift-multus/multus-brcxr"
Jul 07 13:58:56.969128 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.967387    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6jh7\" (UniqueName: \"kubernetes.io/projected/767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea-kube-api-access-l6jh7\") pod \"network-metrics-daemon-qg8cp\" (UID: \"767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea\") " pod="openshift-multus/network-metrics-daemon-qg8cp"
Jul 07 13:58:56.969733 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:56.969711    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clnw8\" (UniqueName: \"kubernetes.io/projected/282d2c99-4c08-4f51-9625-89428d9d7ccb-kube-api-access-clnw8\") pod \"multus-additional-cni-plugins-6b9sv\" (UID: \"282d2c99-4c08-4f51-9625-89428d9d7ccb\") " pod="openshift-multus/multus-additional-cni-plugins-6b9sv"
Jul 07 13:58:57.054550 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.054433    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9b610f2e-6770-48cb-8e57-501a48a6e7f5-etc-sysctl-d\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:57.054550 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.054485    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b610f2e-6770-48cb-8e57-501a48a6e7f5-sys\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:57.054550 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.054506    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-run-systemd\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.054550 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.054523    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-ovnkube-config\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.054550 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.054543    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b610f2e-6770-48cb-8e57-501a48a6e7f5-etc-kubernetes\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:57.055097 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.054578    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b610f2e-6770-48cb-8e57-501a48a6e7f5-sys\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:57.055097 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.054594    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-run-systemd\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.055097 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.054611    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b610f2e-6770-48cb-8e57-501a48a6e7f5-etc-kubernetes\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:57.055097 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.054622    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-run-ovn\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.055097 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.054654    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-host-run-ovn-kubernetes\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.055097 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.054661    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9b610f2e-6770-48cb-8e57-501a48a6e7f5-etc-sysctl-d\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:57.055097 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.054673    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-ovn-node-metrics-cert\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.055097 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.054707    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-host-run-ovn-kubernetes\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.055097 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.054716    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-run-ovn\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.055097 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.054739    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b610f2e-6770-48cb-8e57-501a48a6e7f5-host\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:57.055097 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.054793    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.055097 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.054823    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9b610f2e-6770-48cb-8e57-501a48a6e7f5-etc-sysconfig\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:57.055097 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.054832    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b610f2e-6770-48cb-8e57-501a48a6e7f5-host\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:57.055097 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.054840    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.055097 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.054847    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b610f2e-6770-48cb-8e57-501a48a6e7f5-var-lib-kubelet\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:57.055097 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.054881    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9b610f2e-6770-48cb-8e57-501a48a6e7f5-etc-sysconfig\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:57.055097 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.054892    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b610f2e-6770-48cb-8e57-501a48a6e7f5-var-lib-kubelet\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:57.055964 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.054908    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9b610f2e-6770-48cb-8e57-501a48a6e7f5-etc-modprobe-d\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:57.055964 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.054934    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9b610f2e-6770-48cb-8e57-501a48a6e7f5-etc-systemd\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:57.055964 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.054980    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z52x9\" (UniqueName: \"kubernetes.io/projected/9b610f2e-6770-48cb-8e57-501a48a6e7f5-kube-api-access-z52x9\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:57.055964 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055013    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-systemd-units\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.055964 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055026    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9b610f2e-6770-48cb-8e57-501a48a6e7f5-etc-systemd\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:57.055964 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055038    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9b610f2e-6770-48cb-8e57-501a48a6e7f5-etc-modprobe-d\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:57.055964 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055038    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-node-log\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.055964 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055077    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-systemd-units\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.055964 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055082    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9b610f2e-6770-48cb-8e57-501a48a6e7f5-etc-sysctl-conf\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:57.055964 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055128    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2lkr\" (UniqueName: \"kubernetes.io/projected/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-kube-api-access-k2lkr\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.055964 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055161    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-host-kubelet\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.055964 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055164    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-node-log\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.055964 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055187    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-var-lib-openvswitch\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.055964 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055196    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9b610f2e-6770-48cb-8e57-501a48a6e7f5-etc-sysctl-conf\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:57.055964 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055212    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-env-overrides\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.055964 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055236    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-ovnkube-config\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.055964 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055246    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-var-lib-openvswitch\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.055964 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055257    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b610f2e-6770-48cb-8e57-501a48a6e7f5-tmp\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:57.056960 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055258    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-host-kubelet\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.056960 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055301    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-run-openvswitch\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.056960 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055329    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-host-slash\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.056960 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055358    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-host-cni-bin\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.056960 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055381    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-host-cni-netd\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.056960 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055388    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-run-openvswitch\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.056960 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055432    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-log-socket\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.056960 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055440    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-host-cni-bin\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.056960 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055429    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-host-slash\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.056960 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055458    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9b610f2e-6770-48cb-8e57-501a48a6e7f5-run\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:57.056960 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055501    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-log-socket\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.056960 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055513    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9b610f2e-6770-48cb-8e57-501a48a6e7f5-run\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:57.056960 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055522    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-host-run-netns\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.056960 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055553    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-etc-openvswitch\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.056960 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055559    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-host-run-netns\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.056960 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055559    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-host-cni-netd\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.056960 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055584    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-ovnkube-script-lib\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.056960 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055602    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-etc-openvswitch\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.057888 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055642    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-env-overrides\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.057888 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055611    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9b610f2e-6770-48cb-8e57-501a48a6e7f5-lib-modules\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:57.057888 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055739    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9b610f2e-6770-48cb-8e57-501a48a6e7f5-etc-tuned\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:57.057888 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.055787    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9b610f2e-6770-48cb-8e57-501a48a6e7f5-lib-modules\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:57.057888 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.056220    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-ovnkube-script-lib\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.057888 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.057705    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-ovn-node-metrics-cert\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.057888 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.057773    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b610f2e-6770-48cb-8e57-501a48a6e7f5-tmp\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:57.058161 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.058078    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9b610f2e-6770-48cb-8e57-501a48a6e7f5-etc-tuned\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:57.072644 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.072594    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal" event={"ID":"1708c56eb2b6c081bc50f9acca06f1da","Type":"ContainerStarted","Data":"def066be955d8394a715f5b2f1947b92a6ae1b22d5d9877deb6ce672c80ea891"}
Jul 07 13:58:57.073746 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.073718    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-192.ec2.internal" event={"ID":"f58afcd1466e885d24b7a0e18eb4c8af","Type":"ContainerStarted","Data":"57aa2454984b85e1ef0bad8fa4a8b76fa1fdb119a8cf6316f746457a8161a101"}
Jul 07 13:58:57.078602 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.078582    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2lkr\" (UniqueName: \"kubernetes.io/projected/9bcfc7b3-a523-42e2-add9-c7f0f1e187ce-kube-api-access-k2lkr\") pod \"ovnkube-node-zdfvw\" (UID: \"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.080802 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.080784    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z52x9\" (UniqueName: \"kubernetes.io/projected/9b610f2e-6770-48cb-8e57-501a48a6e7f5-kube-api-access-z52x9\") pod \"tuned-dqqmt\" (UID: \"9b610f2e-6770-48cb-8e57-501a48a6e7f5\") " pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:57.137539 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.137499    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zf8wq"
Jul 07 13:58:57.147149 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.147126    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sc5hw"
Jul 07 13:58:57.147516 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:57.147494    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod634f658b_6022_40f7_9c4c_3c14e6f9c27e.slice/crio-1a119c3f4f367ac2b168242333c9bd9503599ec2aefe5b25f51775feb02ed44b WatchSource:0}: Error finding container 1a119c3f4f367ac2b168242333c9bd9503599ec2aefe5b25f51775feb02ed44b: Status 404 returned error can't find the container with id 1a119c3f4f367ac2b168242333c9bd9503599ec2aefe5b25f51775feb02ed44b
Jul 07 13:58:57.155063 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.155007    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-brcxr"
Jul 07 13:58:57.155588 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:57.155566    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26899eb9_0edc_407d_9cd4_1f68fa5aa8f4.slice/crio-8bf0b314f4a41fb69e9f3fc0e4e3b4289834bdd820512b481a597b140a982ac0 WatchSource:0}: Error finding container 8bf0b314f4a41fb69e9f3fc0e4e3b4289834bdd820512b481a597b140a982ac0: Status 404 returned error can't find the container with id 8bf0b314f4a41fb69e9f3fc0e4e3b4289834bdd820512b481a597b140a982ac0
Jul 07 13:58:57.160110 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.160089    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p85j7"
Jul 07 13:58:57.162684 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:57.162661    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64574840_04b3_464f_b59f_c76b9e84f72e.slice/crio-7ec3ca72b8e4b1d1a9f01a40e100746a74f75059375a2b4971a823d31a76e3c5 WatchSource:0}: Error finding container 7ec3ca72b8e4b1d1a9f01a40e100746a74f75059375a2b4971a823d31a76e3c5: Status 404 returned error can't find the container with id 7ec3ca72b8e4b1d1a9f01a40e100746a74f75059375a2b4971a823d31a76e3c5
Jul 07 13:58:57.165679 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.165660    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd7ms"
Jul 07 13:58:57.171107 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.171084    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-46w5l"
Jul 07 13:58:57.171596 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:57.171576    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20f34439_6845_4778_b380_3cf2e9f47125.slice/crio-d48bb62fa9ab21d90f935f09eb371d161b28388dcc1e57bc127271ae572a1ad2 WatchSource:0}: Error finding container d48bb62fa9ab21d90f935f09eb371d161b28388dcc1e57bc127271ae572a1ad2: Status 404 returned error can't find the container with id d48bb62fa9ab21d90f935f09eb371d161b28388dcc1e57bc127271ae572a1ad2
Jul 07 13:58:57.177356 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.177327    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6b9sv"
Jul 07 13:58:57.177850 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:57.177822    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod163b5d62_53dc_43d9_ae6e_ddf552abd570.slice/crio-c75615640956dcf55ef70580225b791fca5fa9708feacdff1f52d07e019fd2fa WatchSource:0}: Error finding container c75615640956dcf55ef70580225b791fca5fa9708feacdff1f52d07e019fd2fa: Status 404 returned error can't find the container with id c75615640956dcf55ef70580225b791fca5fa9708feacdff1f52d07e019fd2fa
Jul 07 13:58:57.180033 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:57.179986    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb58a368_1974_4d27_a323_5c6a8024c9ea.slice/crio-f548824812e3961358c649666a82d081c4e46d59945c230cf27ae1fd6463b7e0 WatchSource:0}: Error finding container f548824812e3961358c649666a82d081c4e46d59945c230cf27ae1fd6463b7e0: Status 404 returned error can't find the container with id f548824812e3961358c649666a82d081c4e46d59945c230cf27ae1fd6463b7e0
Jul 07 13:58:57.182681 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.182658    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:58:57.186585 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.186566    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dqqmt"
Jul 07 13:58:57.187299 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:57.187272    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod282d2c99_4c08_4f51_9625_89428d9d7ccb.slice/crio-1521cb6499a64735100c63b668d06b80ff2443d04e2af7c750b7c30429dce014 WatchSource:0}: Error finding container 1521cb6499a64735100c63b668d06b80ff2443d04e2af7c750b7c30429dce014: Status 404 returned error can't find the container with id 1521cb6499a64735100c63b668d06b80ff2443d04e2af7c750b7c30429dce014
Jul 07 13:58:57.197095 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:57.197068    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bcfc7b3_a523_42e2_add9_c7f0f1e187ce.slice/crio-0a07a25c289c22e8cf25cdaca4d449248ef5ba4d26b7c733b7f910633f3c6948 WatchSource:0}: Error finding container 0a07a25c289c22e8cf25cdaca4d449248ef5ba4d26b7c733b7f910633f3c6948: Status 404 returned error can't find the container with id 0a07a25c289c22e8cf25cdaca4d449248ef5ba4d26b7c733b7f910633f3c6948
Jul 07 13:58:57.201025 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:58:57.200996    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b610f2e_6770_48cb_8e57_501a48a6e7f5.slice/crio-c0c2fe789b4065e0dc914d9135ceb257a71630c1e46fa76f4c66807bd14e590b WatchSource:0}: Error finding container c0c2fe789b4065e0dc914d9135ceb257a71630c1e46fa76f4c66807bd14e590b: Status 404 returned error can't find the container with id c0c2fe789b4065e0dc914d9135ceb257a71630c1e46fa76f4c66807bd14e590b
Jul 07 13:58:57.459030 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.458625    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57cf19e7-ca31-4cc2-bb09-5ca82de4355b-original-pull-secret\") pod \"global-pull-secret-syncer-jcfdk\" (UID: \"57cf19e7-ca31-4cc2-bb09-5ca82de4355b\") " pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 13:58:57.459030 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.458680    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea-metrics-certs\") pod \"network-metrics-daemon-qg8cp\" (UID: \"767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea\") " pod="openshift-multus/network-metrics-daemon-qg8cp"
Jul 07 13:58:57.459030 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:57.458828    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 13:58:57.459030 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:57.458890    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea-metrics-certs podName:767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea nodeName:}" failed. No retries permitted until 2026-07-07 13:58:58.458871546 +0000 UTC m=+4.071150517 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea-metrics-certs") pod "network-metrics-daemon-qg8cp" (UID: "767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 13:58:57.459030 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:57.458956    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 13:58:57.459030 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:57.459006    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57cf19e7-ca31-4cc2-bb09-5ca82de4355b-original-pull-secret podName:57cf19e7-ca31-4cc2-bb09-5ca82de4355b nodeName:}" failed. No retries permitted until 2026-07-07 13:58:58.458977635 +0000 UTC m=+4.071256603 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57cf19e7-ca31-4cc2-bb09-5ca82de4355b-original-pull-secret") pod "global-pull-secret-syncer-jcfdk" (UID: "57cf19e7-ca31-4cc2-bb09-5ca82de4355b") : object "kube-system"/"original-pull-secret" not registered
Jul 07 13:58:57.559775 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.559739    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cq94\" (UniqueName: \"kubernetes.io/projected/6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d-kube-api-access-9cq94\") pod \"network-check-target-ts9k4\" (UID: \"6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d\") " pod="openshift-network-diagnostics/network-check-target-ts9k4"
Jul 07 13:58:57.559976 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:57.559931    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 13:58:57.559976 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:57.559972    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 13:58:57.560071 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:57.559985    2576 projected.go:196] Error preparing data for projected volume kube-api-access-9cq94 for pod openshift-network-diagnostics/network-check-target-ts9k4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 13:58:57.560071 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:57.560042    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d-kube-api-access-9cq94 podName:6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d nodeName:}" failed. No retries permitted until 2026-07-07 13:58:58.56002731 +0000 UTC m=+4.172306267 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9cq94" (UniqueName: "kubernetes.io/projected/6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d-kube-api-access-9cq94") pod "network-check-target-ts9k4" (UID: "6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 13:58:57.896265 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.896043    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 13:53:57 +0000 UTC" deadline="2028-02-17 00:02:51.87455058 +0000 UTC"
Jul 07 13:58:57.896265 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:57.896109    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14146h3m53.97844636s"
Jul 07 13:58:58.069433 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:58.069396    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts9k4"
Jul 07 13:58:58.070204 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:58.069600    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts9k4" podUID="6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d"
Jul 07 13:58:58.082921 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:58.082823    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p85j7" event={"ID":"20f34439-6845-4778-b380-3cf2e9f47125","Type":"ContainerStarted","Data":"d48bb62fa9ab21d90f935f09eb371d161b28388dcc1e57bc127271ae572a1ad2"}
Jul 07 13:58:58.087925 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:58.087888    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zf8wq" event={"ID":"634f658b-6022-40f7-9c4c-3c14e6f9c27e","Type":"ContainerStarted","Data":"1a119c3f4f367ac2b168242333c9bd9503599ec2aefe5b25f51775feb02ed44b"}
Jul 07 13:58:58.091633 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:58.091601    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dqqmt" event={"ID":"9b610f2e-6770-48cb-8e57-501a48a6e7f5","Type":"ContainerStarted","Data":"c0c2fe789b4065e0dc914d9135ceb257a71630c1e46fa76f4c66807bd14e590b"}
Jul 07 13:58:58.095676 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:58.095643    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw" event={"ID":"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce","Type":"ContainerStarted","Data":"0a07a25c289c22e8cf25cdaca4d449248ef5ba4d26b7c733b7f910633f3c6948"}
Jul 07 13:58:58.099316 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:58.099260    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6b9sv" event={"ID":"282d2c99-4c08-4f51-9625-89428d9d7ccb","Type":"ContainerStarted","Data":"1521cb6499a64735100c63b668d06b80ff2443d04e2af7c750b7c30429dce014"}
Jul 07 13:58:58.104134 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:58.104096    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-46w5l" event={"ID":"bb58a368-1974-4d27-a323-5c6a8024c9ea","Type":"ContainerStarted","Data":"f548824812e3961358c649666a82d081c4e46d59945c230cf27ae1fd6463b7e0"}
Jul 07 13:58:58.107606 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:58.107570    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd7ms" event={"ID":"163b5d62-53dc-43d9-ae6e-ddf552abd570","Type":"ContainerStarted","Data":"c75615640956dcf55ef70580225b791fca5fa9708feacdff1f52d07e019fd2fa"}
Jul 07 13:58:58.111444 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:58.111391    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-brcxr" event={"ID":"64574840-04b3-464f-b59f-c76b9e84f72e","Type":"ContainerStarted","Data":"7ec3ca72b8e4b1d1a9f01a40e100746a74f75059375a2b4971a823d31a76e3c5"}
Jul 07 13:58:58.114136 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:58.114057    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sc5hw" event={"ID":"26899eb9-0edc-407d-9cd4-1f68fa5aa8f4","Type":"ContainerStarted","Data":"8bf0b314f4a41fb69e9f3fc0e4e3b4289834bdd820512b481a597b140a982ac0"}
Jul 07 13:58:58.466367 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:58.466319    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57cf19e7-ca31-4cc2-bb09-5ca82de4355b-original-pull-secret\") pod \"global-pull-secret-syncer-jcfdk\" (UID: \"57cf19e7-ca31-4cc2-bb09-5ca82de4355b\") " pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 13:58:58.466592 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:58.466386    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea-metrics-certs\") pod \"network-metrics-daemon-qg8cp\" (UID: \"767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea\") " pod="openshift-multus/network-metrics-daemon-qg8cp"
Jul 07 13:58:58.466592 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:58.466551    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 13:58:58.466707 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:58.466625    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea-metrics-certs podName:767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea nodeName:}" failed. No retries permitted until 2026-07-07 13:59:00.466604433 +0000 UTC m=+6.078883410 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea-metrics-certs") pod "network-metrics-daemon-qg8cp" (UID: "767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 13:58:58.466779 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:58.466709    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 13:58:58.466779 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:58.466766    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57cf19e7-ca31-4cc2-bb09-5ca82de4355b-original-pull-secret podName:57cf19e7-ca31-4cc2-bb09-5ca82de4355b nodeName:}" failed. No retries permitted until 2026-07-07 13:59:00.466748764 +0000 UTC m=+6.079027725 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57cf19e7-ca31-4cc2-bb09-5ca82de4355b-original-pull-secret") pod "global-pull-secret-syncer-jcfdk" (UID: "57cf19e7-ca31-4cc2-bb09-5ca82de4355b") : object "kube-system"/"original-pull-secret" not registered
Jul 07 13:58:58.566959 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:58.566916    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cq94\" (UniqueName: \"kubernetes.io/projected/6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d-kube-api-access-9cq94\") pod \"network-check-target-ts9k4\" (UID: \"6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d\") " pod="openshift-network-diagnostics/network-check-target-ts9k4"
Jul 07 13:58:58.567198 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:58.567146    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 13:58:58.567198 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:58.567175    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 13:58:58.567198 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:58.567189    2576 projected.go:196] Error preparing data for projected volume kube-api-access-9cq94 for pod openshift-network-diagnostics/network-check-target-ts9k4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 13:58:58.567453 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:58.567251    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d-kube-api-access-9cq94 podName:6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d nodeName:}" failed. No retries permitted until 2026-07-07 13:59:00.567229542 +0000 UTC m=+6.179508511 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9cq94" (UniqueName: "kubernetes.io/projected/6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d-kube-api-access-9cq94") pod "network-check-target-ts9k4" (UID: "6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 13:58:58.896646 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:58.896553    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 13:53:57 +0000 UTC" deadline="2028-03-28 06:09:28.258309436 +0000 UTC"
Jul 07 13:58:58.896646 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:58.896598    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15112h10m29.361717307s"
Jul 07 13:58:59.079672 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:59.079640    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 13:58:59.080183 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:59.079783    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcfdk" podUID="57cf19e7-ca31-4cc2-bb09-5ca82de4355b"
Jul 07 13:58:59.080274 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:58:59.080245    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8cp"
Jul 07 13:58:59.080386 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:58:59.080362    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8cp" podUID="767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea"
Jul 07 13:59:00.069210 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:00.069119    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts9k4"
Jul 07 13:59:00.069402 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:00.069267    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts9k4" podUID="6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d"
Jul 07 13:59:00.483560 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:00.483524    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57cf19e7-ca31-4cc2-bb09-5ca82de4355b-original-pull-secret\") pod \"global-pull-secret-syncer-jcfdk\" (UID: \"57cf19e7-ca31-4cc2-bb09-5ca82de4355b\") " pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 13:59:00.484090 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:00.483575    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea-metrics-certs\") pod \"network-metrics-daemon-qg8cp\" (UID: \"767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea\") " pod="openshift-multus/network-metrics-daemon-qg8cp"
Jul 07 13:59:00.484090 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:00.483729    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 13:59:00.484090 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:00.483759    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 13:59:00.484090 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:00.483794    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea-metrics-certs podName:767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea nodeName:}" failed. No retries permitted until 2026-07-07 13:59:04.483773371 +0000 UTC m=+10.096052342 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea-metrics-certs") pod "network-metrics-daemon-qg8cp" (UID: "767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 13:59:00.484090 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:00.483862    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57cf19e7-ca31-4cc2-bb09-5ca82de4355b-original-pull-secret podName:57cf19e7-ca31-4cc2-bb09-5ca82de4355b nodeName:}" failed. No retries permitted until 2026-07-07 13:59:04.483846752 +0000 UTC m=+10.096125718 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57cf19e7-ca31-4cc2-bb09-5ca82de4355b-original-pull-secret") pod "global-pull-secret-syncer-jcfdk" (UID: "57cf19e7-ca31-4cc2-bb09-5ca82de4355b") : object "kube-system"/"original-pull-secret" not registered
Jul 07 13:59:00.584754 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:00.584709    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cq94\" (UniqueName: \"kubernetes.io/projected/6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d-kube-api-access-9cq94\") pod \"network-check-target-ts9k4\" (UID: \"6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d\") " pod="openshift-network-diagnostics/network-check-target-ts9k4"
Jul 07 13:59:00.584993 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:00.584939    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 13:59:00.584993 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:00.584966    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 13:59:00.585153 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:00.585008    2576 projected.go:196] Error preparing data for projected volume kube-api-access-9cq94 for pod openshift-network-diagnostics/network-check-target-ts9k4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 13:59:00.585153 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:00.585072    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d-kube-api-access-9cq94 podName:6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d nodeName:}" failed. No retries permitted until 2026-07-07 13:59:04.585053131 +0000 UTC m=+10.197332132 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9cq94" (UniqueName: "kubernetes.io/projected/6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d-kube-api-access-9cq94") pod "network-check-target-ts9k4" (UID: "6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 13:59:01.082011 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:01.081780    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8cp"
Jul 07 13:59:01.082960 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:01.082233    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8cp" podUID="767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea"
Jul 07 13:59:01.082960 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:01.082751    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 13:59:01.082960 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:01.082888    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcfdk" podUID="57cf19e7-ca31-4cc2-bb09-5ca82de4355b"
Jul 07 13:59:02.070039 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:02.069476    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts9k4"
Jul 07 13:59:02.070039 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:02.069613    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts9k4" podUID="6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d"
Jul 07 13:59:03.068493 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:03.068458    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 13:59:03.068709 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:03.068506    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8cp"
Jul 07 13:59:03.068709 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:03.068658    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcfdk" podUID="57cf19e7-ca31-4cc2-bb09-5ca82de4355b"
Jul 07 13:59:03.068935 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:03.068892    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8cp" podUID="767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea"
Jul 07 13:59:04.069257 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:04.069219    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts9k4"
Jul 07 13:59:04.069756 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:04.069371    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts9k4" podUID="6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d"
Jul 07 13:59:04.521620 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:04.521573    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57cf19e7-ca31-4cc2-bb09-5ca82de4355b-original-pull-secret\") pod \"global-pull-secret-syncer-jcfdk\" (UID: \"57cf19e7-ca31-4cc2-bb09-5ca82de4355b\") " pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 13:59:04.521828 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:04.521647    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea-metrics-certs\") pod \"network-metrics-daemon-qg8cp\" (UID: \"767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea\") " pod="openshift-multus/network-metrics-daemon-qg8cp"
Jul 07 13:59:04.521828 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:04.521730    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 13:59:04.521828 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:04.521780    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 13:59:04.521828 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:04.521823    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57cf19e7-ca31-4cc2-bb09-5ca82de4355b-original-pull-secret podName:57cf19e7-ca31-4cc2-bb09-5ca82de4355b nodeName:}" failed. No retries permitted until 2026-07-07 13:59:12.52180025 +0000 UTC m=+18.134079220 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57cf19e7-ca31-4cc2-bb09-5ca82de4355b-original-pull-secret") pod "global-pull-secret-syncer-jcfdk" (UID: "57cf19e7-ca31-4cc2-bb09-5ca82de4355b") : object "kube-system"/"original-pull-secret" not registered
Jul 07 13:59:04.522062 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:04.521846    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea-metrics-certs podName:767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea nodeName:}" failed. No retries permitted until 2026-07-07 13:59:12.52183477 +0000 UTC m=+18.134113721 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea-metrics-certs") pod "network-metrics-daemon-qg8cp" (UID: "767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 13:59:04.622079 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:04.622037    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cq94\" (UniqueName: \"kubernetes.io/projected/6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d-kube-api-access-9cq94\") pod \"network-check-target-ts9k4\" (UID: \"6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d\") " pod="openshift-network-diagnostics/network-check-target-ts9k4"
Jul 07 13:59:04.622261 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:04.622227    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 13:59:04.622261 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:04.622247    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 13:59:04.622261 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:04.622258    2576 projected.go:196] Error preparing data for projected volume kube-api-access-9cq94 for pod openshift-network-diagnostics/network-check-target-ts9k4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 13:59:04.622417 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:04.622327    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d-kube-api-access-9cq94 podName:6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d nodeName:}" failed. No retries permitted until 2026-07-07 13:59:12.622306585 +0000 UTC m=+18.234585560 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9cq94" (UniqueName: "kubernetes.io/projected/6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d-kube-api-access-9cq94") pod "network-check-target-ts9k4" (UID: "6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 13:59:05.072636 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:05.072455    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 13:59:05.072636 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:05.072593    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcfdk" podUID="57cf19e7-ca31-4cc2-bb09-5ca82de4355b"
Jul 07 13:59:05.073209 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:05.072665    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8cp"
Jul 07 13:59:05.073209 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:05.072779    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8cp" podUID="767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea"
Jul 07 13:59:06.069270 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:06.069222    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts9k4"
Jul 07 13:59:06.069466 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:06.069355    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts9k4" podUID="6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d"
Jul 07 13:59:07.072359 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:07.072323    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 13:59:07.072822 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:07.072448    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcfdk" podUID="57cf19e7-ca31-4cc2-bb09-5ca82de4355b"
Jul 07 13:59:07.072822 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:07.072812    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8cp"
Jul 07 13:59:07.073076 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:07.072920    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8cp" podUID="767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea"
Jul 07 13:59:08.069376 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:08.069346    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts9k4"
Jul 07 13:59:08.069558 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:08.069478    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts9k4" podUID="6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d"
Jul 07 13:59:09.069314 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:09.069280    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8cp"
Jul 07 13:59:09.069752 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:09.069325    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 13:59:09.069752 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:09.069438    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8cp" podUID="767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea"
Jul 07 13:59:09.069752 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:09.069537    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcfdk" podUID="57cf19e7-ca31-4cc2-bb09-5ca82de4355b"
Jul 07 13:59:10.068998 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:10.068957    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts9k4"
Jul 07 13:59:10.069167 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:10.069084    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts9k4" podUID="6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d"
Jul 07 13:59:11.069615 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:11.069377    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8cp"
Jul 07 13:59:11.070138 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:11.069430    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 13:59:11.070138 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:11.069739    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8cp" podUID="767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea"
Jul 07 13:59:11.070138 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:11.069797    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcfdk" podUID="57cf19e7-ca31-4cc2-bb09-5ca82de4355b"
Jul 07 13:59:12.069156 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:12.069114    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts9k4"
Jul 07 13:59:12.069353 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:12.069246    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts9k4" podUID="6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d"
Jul 07 13:59:12.585367 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:12.585323    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57cf19e7-ca31-4cc2-bb09-5ca82de4355b-original-pull-secret\") pod \"global-pull-secret-syncer-jcfdk\" (UID: \"57cf19e7-ca31-4cc2-bb09-5ca82de4355b\") " pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 13:59:12.585790 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:12.585377    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea-metrics-certs\") pod \"network-metrics-daemon-qg8cp\" (UID: \"767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea\") " pod="openshift-multus/network-metrics-daemon-qg8cp"
Jul 07 13:59:12.585790 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:12.585463    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 13:59:12.585790 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:12.585478    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 13:59:12.585790 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:12.585534    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea-metrics-certs podName:767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea nodeName:}" failed. No retries permitted until 2026-07-07 13:59:28.585514363 +0000 UTC m=+34.197793317 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea-metrics-certs") pod "network-metrics-daemon-qg8cp" (UID: "767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 13:59:12.585790 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:12.585555    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57cf19e7-ca31-4cc2-bb09-5ca82de4355b-original-pull-secret podName:57cf19e7-ca31-4cc2-bb09-5ca82de4355b nodeName:}" failed. No retries permitted until 2026-07-07 13:59:28.585543569 +0000 UTC m=+34.197822521 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57cf19e7-ca31-4cc2-bb09-5ca82de4355b-original-pull-secret") pod "global-pull-secret-syncer-jcfdk" (UID: "57cf19e7-ca31-4cc2-bb09-5ca82de4355b") : object "kube-system"/"original-pull-secret" not registered
Jul 07 13:59:12.685659 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:12.685619    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cq94\" (UniqueName: \"kubernetes.io/projected/6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d-kube-api-access-9cq94\") pod \"network-check-target-ts9k4\" (UID: \"6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d\") " pod="openshift-network-diagnostics/network-check-target-ts9k4"
Jul 07 13:59:12.685841 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:12.685818    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 13:59:12.685923 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:12.685848    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 13:59:12.685923 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:12.685862    2576 projected.go:196] Error preparing data for projected volume kube-api-access-9cq94 for pod openshift-network-diagnostics/network-check-target-ts9k4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 13:59:12.686032 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:12.685927    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d-kube-api-access-9cq94 podName:6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d nodeName:}" failed. No retries permitted until 2026-07-07 13:59:28.685905792 +0000 UTC m=+34.298184759 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9cq94" (UniqueName: "kubernetes.io/projected/6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d-kube-api-access-9cq94") pod "network-check-target-ts9k4" (UID: "6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 13:59:13.069158 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:13.069119    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8cp"
Jul 07 13:59:13.069335 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:13.069119    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 13:59:13.069335 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:13.069260    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8cp" podUID="767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea"
Jul 07 13:59:13.069335 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:13.069290    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcfdk" podUID="57cf19e7-ca31-4cc2-bb09-5ca82de4355b"
Jul 07 13:59:14.068529 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:14.068496    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts9k4"
Jul 07 13:59:14.068931 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:14.068623    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts9k4" podUID="6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d"
Jul 07 13:59:15.069180 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:15.069141    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8cp"
Jul 07 13:59:15.069646 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:15.069259    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8cp" podUID="767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea"
Jul 07 13:59:15.069646 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:15.069314    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 13:59:15.069646 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:15.069434    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcfdk" podUID="57cf19e7-ca31-4cc2-bb09-5ca82de4355b"
Jul 07 13:59:16.068397 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:16.068365    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts9k4"
Jul 07 13:59:16.068593 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:16.068486    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts9k4" podUID="6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d"
Jul 07 13:59:17.069132 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:17.069099    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8cp"
Jul 07 13:59:17.069595 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:17.069141    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 13:59:17.069595 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:17.069252    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8cp" podUID="767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea"
Jul 07 13:59:17.069595 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:17.069395    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcfdk" podUID="57cf19e7-ca31-4cc2-bb09-5ca82de4355b"
Jul 07 13:59:18.069117 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:18.068961    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts9k4"
Jul 07 13:59:18.069246 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:18.069188    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts9k4" podUID="6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d"
Jul 07 13:59:18.158764 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:18.158736    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dqqmt" event={"ID":"9b610f2e-6770-48cb-8e57-501a48a6e7f5","Type":"ContainerStarted","Data":"0803ca7f548ba567cd4c90319b910889affef22c9f4628ccd1717fb388bc52b1"}
Jul 07 13:59:18.160850 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:18.160833    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zdfvw_9bcfc7b3-a523-42e2-add9-c7f0f1e187ce/ovn-acl-logging/0.log"
Jul 07 13:59:18.161165 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:18.161147    2576 generic.go:356] "Generic (PLEG): container finished" podID="9bcfc7b3-a523-42e2-add9-c7f0f1e187ce" containerID="9b6f2d98d91027c8eda5bcc69fe58143b1097b90c4b57151f7a152641bfc1ea1" exitCode=1
Jul 07 13:59:18.161224 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:18.161208    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw" event={"ID":"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce","Type":"ContainerStarted","Data":"9cec781e631162724bf87fc1c9b09eedd017f86af3e2b0014ca12e05e19f3614"}
Jul 07 13:59:18.161277 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:18.161256    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw" event={"ID":"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce","Type":"ContainerStarted","Data":"cf8e3557427c3873001e4b8947eb5a162315b02de79e5c4eecc12d1a1f3ebad7"}
Jul 07 13:59:18.161319 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:18.161285    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw" event={"ID":"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce","Type":"ContainerDied","Data":"9b6f2d98d91027c8eda5bcc69fe58143b1097b90c4b57151f7a152641bfc1ea1"}
Jul 07 13:59:18.161319 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:18.161315    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw" event={"ID":"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce","Type":"ContainerStarted","Data":"5d37f927c119a49019e0a48ba629b10bd401971adc9c838b5692cb4352dd5fc9"}
Jul 07 13:59:18.162670 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:18.162644    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-brcxr" event={"ID":"64574840-04b3-464f-b59f-c76b9e84f72e","Type":"ContainerStarted","Data":"6fbc5743d96e75805968e3918d609c071dcf6b7a2d2446e60de6aada0d9df609"}
Jul 07 13:59:18.163849 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:18.163827    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-192.ec2.internal" event={"ID":"f58afcd1466e885d24b7a0e18eb4c8af","Type":"ContainerStarted","Data":"95047564d030a3c351c15b9e5c167e7dabdf4f72079bb1a7ac05160c758647df"}
Jul 07 13:59:18.177100 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:18.177051    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dqqmt" podStartSLOduration=2.075298714 podStartE2EDuration="22.17703413s" totalImagesPullingTime="20.101735416s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:58:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:18.176244509 +0000 UTC m=+23.788523481" watchObservedRunningTime="2026-07-07 13:59:18.17703413 +0000 UTC m=+23.789313102"
Jul 07 13:59:18.190695 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:18.190655    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-192.ec2.internal" podStartSLOduration=22.190641373 podStartE2EDuration="22.190641373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:58:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:18.190340945 +0000 UTC m=+23.802619909" watchObservedRunningTime="2026-07-07 13:59:18.190641373 +0000 UTC m=+23.802920344"
Jul 07 13:59:18.215923 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:18.215885    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-brcxr" podStartSLOduration=3.040623261 podStartE2EDuration="23.215871243s" totalImagesPullingTime="20.175247982s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:58:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:18.215093619 +0000 UTC m=+23.827372603" watchObservedRunningTime="2026-07-07 13:59:18.215871243 +0000 UTC m=+23.828150215"
Jul 07 13:59:19.069400 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:19.069157    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8cp"
Jul 07 13:59:19.070126 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:19.069217    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 13:59:19.070126 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:19.069518    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8cp" podUID="767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea"
Jul 07 13:59:19.070126 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:19.069574    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcfdk" podUID="57cf19e7-ca31-4cc2-bb09-5ca82de4355b"
Jul 07 13:59:19.167028 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:19.166993    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zf8wq" event={"ID":"634f658b-6022-40f7-9c4c-3c14e6f9c27e","Type":"ContainerStarted","Data":"9a1508c488303ffadc60269715dae88e6664b40f658fa70a3688a49d0f555f46"}
Jul 07 13:59:19.169593 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:19.169574    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zdfvw_9bcfc7b3-a523-42e2-add9-c7f0f1e187ce/ovn-acl-logging/0.log"
Jul 07 13:59:19.169918 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:19.169900    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw" event={"ID":"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce","Type":"ContainerStarted","Data":"24359b9778e5cbde2fe4d5fdf6ae9d35fbf3d29e59b210095dbf633966fa8040"}
Jul 07 13:59:19.170005 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:19.169983    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw" event={"ID":"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce","Type":"ContainerStarted","Data":"0a9ceca1fd6b5eaff7ff308c727114a9db583c2a645eb003b1f5d28e58f9a1c9"}
Jul 07 13:59:19.171323 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:19.171299    2576 generic.go:356] "Generic (PLEG): container finished" podID="282d2c99-4c08-4f51-9625-89428d9d7ccb" containerID="1398a1975449b9b043d5cb8ced279b6f5c00114b97ed115b8d2fb280653f4f34" exitCode=0
Jul 07 13:59:19.171423 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:19.171366    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6b9sv" event={"ID":"282d2c99-4c08-4f51-9625-89428d9d7ccb","Type":"ContainerDied","Data":"1398a1975449b9b043d5cb8ced279b6f5c00114b97ed115b8d2fb280653f4f34"}
Jul 07 13:59:19.172801 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:19.172780    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-46w5l" event={"ID":"bb58a368-1974-4d27-a323-5c6a8024c9ea","Type":"ContainerStarted","Data":"c8439993220274cabc0183b2810cc1be7eecaf7d4e9735b0881926ab9a3f25d7"}
Jul 07 13:59:19.174260 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:19.174227    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd7ms" event={"ID":"163b5d62-53dc-43d9-ae6e-ddf552abd570","Type":"ContainerStarted","Data":"e153906589aba01ffd4b77297408599143dc15fc64db09701cb00bcf85c0896d"}
Jul 07 13:59:19.175481 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:19.175463    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sc5hw" event={"ID":"26899eb9-0edc-407d-9cd4-1f68fa5aa8f4","Type":"ContainerStarted","Data":"27f7c3f56f93543ab9fdc5bda2b08634e6020124331e215716131c35cb6319c6"}
Jul 07 13:59:19.176991 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:19.176969    2576 generic.go:356] "Generic (PLEG): container finished" podID="1708c56eb2b6c081bc50f9acca06f1da" containerID="4b29ab3894272beca3a63f8cb497f84ca954481ef8def90deb7dfb9ed2997e98" exitCode=0
Jul 07 13:59:19.177073 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:19.177041    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal" event={"ID":"1708c56eb2b6c081bc50f9acca06f1da","Type":"ContainerDied","Data":"4b29ab3894272beca3a63f8cb497f84ca954481ef8def90deb7dfb9ed2997e98"}
Jul 07 13:59:19.178588 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:19.178566    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p85j7" event={"ID":"20f34439-6845-4778-b380-3cf2e9f47125","Type":"ContainerStarted","Data":"512412f59b3bd871a86b0b7b0bb40ea6c4e4c69554bcc00e6d260448b9c40bd7"}
Jul 07 13:59:19.182623 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:19.182589    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zf8wq" podStartSLOduration=4.026629674 podStartE2EDuration="24.182577816s" totalImagesPullingTime="20.155948142s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:58:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:19.182535863 +0000 UTC m=+24.794814876" watchObservedRunningTime="2026-07-07 13:59:19.182577816 +0000 UTC m=+24.794856787"
Jul 07 13:59:19.197393 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:19.197355    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sc5hw" podStartSLOduration=8.248984338 podStartE2EDuration="24.197343669s" totalImagesPullingTime="15.948359331s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:58:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:19.196829634 +0000 UTC m=+24.809108606" watchObservedRunningTime="2026-07-07 13:59:19.197343669 +0000 UTC m=+24.809622655"
Jul 07 13:59:19.213213 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:19.213169    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-p85j7" podStartSLOduration=7.281546976 podStartE2EDuration="23.213151212s" totalImagesPullingTime="15.931604236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:58:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:19.212555077 +0000 UTC m=+24.824834073" watchObservedRunningTime="2026-07-07 13:59:19.213151212 +0000 UTC m=+24.825430184"
Jul 07 13:59:20.069425 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:20.069390    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts9k4"
Jul 07 13:59:20.070025 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:20.069496    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts9k4" podUID="6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d"
Jul 07 13:59:20.181805 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:20.181756    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal" event={"ID":"1708c56eb2b6c081bc50f9acca06f1da","Type":"ContainerStarted","Data":"a57722a7a104b0c1e5803e594214adf757dd6645ceb72e9572488831c0ac1f7b"}
Jul 07 13:59:20.198603 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:20.198557    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-46w5l" podStartSLOduration=4.075981493 podStartE2EDuration="24.198542727s" totalImagesPullingTime="20.122561234s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:58:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:19.267861641 +0000 UTC m=+24.880140639" watchObservedRunningTime="2026-07-07 13:59:20.198542727 +0000 UTC m=+25.810821702"
Jul 07 13:59:20.198767 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:20.198627    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-192.ec2.internal" podStartSLOduration=24.198621865 podStartE2EDuration="24.198621865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:58:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:20.198044791 +0000 UTC m=+25.810323766" watchObservedRunningTime="2026-07-07 13:59:20.198621865 +0000 UTC m=+25.810900837"
Jul 07 13:59:20.390593 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:20.390573    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 13:59:20.953019 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:20.952924    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T13:59:20.390589572Z","UUID":"fb53deb6-6755-46de-9211-3b29b68615e0","Handler":null,"Name":"","Endpoint":""}
Jul 07 13:59:20.954176 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:20.954160    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 13:59:20.954267 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:20.954192    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 13:59:21.069045 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:21.069011    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8cp"
Jul 07 13:59:21.069045 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:21.069051    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 13:59:21.069290 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:21.069150    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8cp" podUID="767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea"
Jul 07 13:59:21.069290 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:21.069271    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcfdk" podUID="57cf19e7-ca31-4cc2-bb09-5ca82de4355b"
Jul 07 13:59:21.187231 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:21.187202    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zdfvw_9bcfc7b3-a523-42e2-add9-c7f0f1e187ce/ovn-acl-logging/0.log"
Jul 07 13:59:21.187719 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:21.187687    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw" event={"ID":"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce","Type":"ContainerStarted","Data":"a1a551356f16ab656cba03e3d257c07161bc143922a5da1484145c10823c15d0"}
Jul 07 13:59:21.189875 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:21.189844    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd7ms" event={"ID":"163b5d62-53dc-43d9-ae6e-ddf552abd570","Type":"ContainerStarted","Data":"6cc54ca155e17f2261fd21bfc61e590cc35117eda17c7b514a708556fe9897c3"}
Jul 07 13:59:21.530770 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:21.530632    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-p85j7"
Jul 07 13:59:21.531774 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:21.531752    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-p85j7"
Jul 07 13:59:22.068793 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:22.068571    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts9k4"
Jul 07 13:59:22.068928 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:22.068831    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts9k4" podUID="6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d"
Jul 07 13:59:22.194847 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:22.194795    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd7ms" event={"ID":"163b5d62-53dc-43d9-ae6e-ddf552abd570","Type":"ContainerStarted","Data":"665a383954be10031ccc0ac0bf066a07fc1a80255f63ed9229c94edbd744e73e"}
Jul 07 13:59:22.195307 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:22.195038    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-p85j7"
Jul 07 13:59:22.195459 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:22.195442    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-p85j7"
Jul 07 13:59:22.228772 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:22.228723    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd7ms" podStartSLOduration=2.936436193 podStartE2EDuration="26.228701991s" totalImagesPullingTime="23.292265798s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:58:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:22.214185938 +0000 UTC m=+27.826464936" watchObservedRunningTime="2026-07-07 13:59:22.228701991 +0000 UTC m=+27.840980964"
Jul 07 13:59:23.069180 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:23.069143    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8cp"
Jul 07 13:59:23.069337 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:23.069143    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 13:59:23.069337 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:23.069290    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8cp" podUID="767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea"
Jul 07 13:59:23.069337 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:23.069318    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcfdk" podUID="57cf19e7-ca31-4cc2-bb09-5ca82de4355b"
Jul 07 13:59:23.201073 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:23.201041    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zdfvw_9bcfc7b3-a523-42e2-add9-c7f0f1e187ce/ovn-acl-logging/0.log"
Jul 07 13:59:23.201971 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:23.201467    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw" event={"ID":"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce","Type":"ContainerStarted","Data":"fc668b76278386d2f196312761526d4c322701454322833dad5f209c2615b823"}
Jul 07 13:59:23.202038 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:23.201977    2576 scope.go:117] "RemoveContainer" containerID="9b6f2d98d91027c8eda5bcc69fe58143b1097b90c4b57151f7a152641bfc1ea1"
Jul 07 13:59:23.202169 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:23.202138    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:59:23.202240 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:23.202218    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:59:23.202297 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:23.202262    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:59:23.220901 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:23.220872    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:59:23.221710 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:23.221676    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:59:24.068555 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:24.068384    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts9k4"
Jul 07 13:59:24.068754 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:24.068651    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts9k4" podUID="6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d"
Jul 07 13:59:24.208032 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:24.207999    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zdfvw_9bcfc7b3-a523-42e2-add9-c7f0f1e187ce/ovn-acl-logging/0.log"
Jul 07 13:59:24.208533 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:24.208509    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw" event={"ID":"9bcfc7b3-a523-42e2-add9-c7f0f1e187ce","Type":"ContainerStarted","Data":"54e8a02e70bdc93dfcc2841cee897c8bcc8dde1f1a408d313d2007f5b30a45c5"}
Jul 07 13:59:24.239388 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:24.239331    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw" podStartSLOduration=7.788039426 podStartE2EDuration="28.239313944s" totalImagesPullingTime="20.451274518s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:58:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:24.237689287 +0000 UTC m=+29.849968296" watchObservedRunningTime="2026-07-07 13:59:24.239313944 +0000 UTC m=+29.851592917"
Jul 07 13:59:24.879995 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:24.879962    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jcfdk"]
Jul 07 13:59:24.880134 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:24.880106    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 13:59:24.880235 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:24.880216    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcfdk" podUID="57cf19e7-ca31-4cc2-bb09-5ca82de4355b"
Jul 07 13:59:24.882650 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:24.882622    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qg8cp"]
Jul 07 13:59:24.882771 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:24.882740    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8cp"
Jul 07 13:59:24.882852 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:24.882826    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8cp" podUID="767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea"
Jul 07 13:59:24.883453 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:24.883430    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ts9k4"]
Jul 07 13:59:24.883551 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:24.883525    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts9k4"
Jul 07 13:59:24.883632 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:24.883613    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts9k4" podUID="6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d"
Jul 07 13:59:26.069063 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:26.069033    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts9k4"
Jul 07 13:59:26.069480 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:26.069134    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts9k4" podUID="6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d"
Jul 07 13:59:26.214467 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:26.214436    2576 generic.go:356] "Generic (PLEG): container finished" podID="282d2c99-4c08-4f51-9625-89428d9d7ccb" containerID="4fc188b20e69b6f5900cc66d5e0572fa0287c83f7772150d5403a021b75ccf33" exitCode=0
Jul 07 13:59:26.214621 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:26.214485    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6b9sv" event={"ID":"282d2c99-4c08-4f51-9625-89428d9d7ccb","Type":"ContainerDied","Data":"4fc188b20e69b6f5900cc66d5e0572fa0287c83f7772150d5403a021b75ccf33"}
Jul 07 13:59:27.069480 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:27.069457    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8cp"
Jul 07 13:59:27.069764 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:27.069458    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 13:59:27.069764 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:27.069567    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8cp" podUID="767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea"
Jul 07 13:59:27.069764 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:27.069643    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcfdk" podUID="57cf19e7-ca31-4cc2-bb09-5ca82de4355b"
Jul 07 13:59:27.219300 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:27.219220    2576 generic.go:356] "Generic (PLEG): container finished" podID="282d2c99-4c08-4f51-9625-89428d9d7ccb" containerID="21e30a5dc8e5f11460a95a82f13ce4d1f266fddbe5b4d2c7a1a61c6fd9571e78" exitCode=0
Jul 07 13:59:27.219300 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:27.219271    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6b9sv" event={"ID":"282d2c99-4c08-4f51-9625-89428d9d7ccb","Type":"ContainerDied","Data":"21e30a5dc8e5f11460a95a82f13ce4d1f266fddbe5b4d2c7a1a61c6fd9571e78"}
Jul 07 13:59:28.068592 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:28.068438    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts9k4"
Jul 07 13:59:28.068715 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:28.068681    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts9k4" podUID="6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d"
Jul 07 13:59:28.223904 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:28.223866    2576 generic.go:356] "Generic (PLEG): container finished" podID="282d2c99-4c08-4f51-9625-89428d9d7ccb" containerID="2688b71f3d4181ce81c09eb2330e3c70bfa634b32928c7389919b0cc6a224fa0" exitCode=0
Jul 07 13:59:28.224316 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:28.223929    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6b9sv" event={"ID":"282d2c99-4c08-4f51-9625-89428d9d7ccb","Type":"ContainerDied","Data":"2688b71f3d4181ce81c09eb2330e3c70bfa634b32928c7389919b0cc6a224fa0"}
Jul 07 13:59:28.601590 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:28.601557    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57cf19e7-ca31-4cc2-bb09-5ca82de4355b-original-pull-secret\") pod \"global-pull-secret-syncer-jcfdk\" (UID: \"57cf19e7-ca31-4cc2-bb09-5ca82de4355b\") " pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 13:59:28.601590 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:28.601591    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea-metrics-certs\") pod \"network-metrics-daemon-qg8cp\" (UID: \"767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea\") " pod="openshift-multus/network-metrics-daemon-qg8cp"
Jul 07 13:59:28.601771 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:28.601700    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 13:59:28.601771 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:28.601753    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 13:59:28.601851 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:28.601761    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57cf19e7-ca31-4cc2-bb09-5ca82de4355b-original-pull-secret podName:57cf19e7-ca31-4cc2-bb09-5ca82de4355b nodeName:}" failed. No retries permitted until 2026-07-07 14:00:00.601747127 +0000 UTC m=+66.214026077 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/57cf19e7-ca31-4cc2-bb09-5ca82de4355b-original-pull-secret") pod "global-pull-secret-syncer-jcfdk" (UID: "57cf19e7-ca31-4cc2-bb09-5ca82de4355b") : object "kube-system"/"original-pull-secret" not registered
Jul 07 13:59:28.601851 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:28.601808    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea-metrics-certs podName:767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea nodeName:}" failed. No retries permitted until 2026-07-07 14:00:00.601796319 +0000 UTC m=+66.214075269 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea-metrics-certs") pod "network-metrics-daemon-qg8cp" (UID: "767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 13:59:28.701999 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:28.701970    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cq94\" (UniqueName: \"kubernetes.io/projected/6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d-kube-api-access-9cq94\") pod \"network-check-target-ts9k4\" (UID: \"6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d\") " pod="openshift-network-diagnostics/network-check-target-ts9k4"
Jul 07 13:59:28.702153 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:28.702079    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 13:59:28.702153 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:28.702092    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 13:59:28.702153 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:28.702100    2576 projected.go:196] Error preparing data for projected volume kube-api-access-9cq94 for pod openshift-network-diagnostics/network-check-target-ts9k4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 13:59:28.702153 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:28.702146    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d-kube-api-access-9cq94 podName:6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d nodeName:}" failed. No retries permitted until 2026-07-07 14:00:00.702132657 +0000 UTC m=+66.314411606 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9cq94" (UniqueName: "kubernetes.io/projected/6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d-kube-api-access-9cq94") pod "network-check-target-ts9k4" (UID: "6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 13:59:29.068880 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:29.068848    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8cp"
Jul 07 13:59:29.069059 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:29.068855    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 13:59:29.069059 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:29.068993    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8cp" podUID="767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea"
Jul 07 13:59:29.069059 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:29.069052    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcfdk" podUID="57cf19e7-ca31-4cc2-bb09-5ca82de4355b"
Jul 07 13:59:30.069322 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:30.069288    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts9k4"
Jul 07 13:59:30.069777 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:30.069421    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ts9k4" podUID="6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d"
Jul 07 13:59:31.068753 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.068722    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 13:59:31.068932 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.068770    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8cp"
Jul 07 13:59:31.068932 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:31.068892    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jcfdk" podUID="57cf19e7-ca31-4cc2-bb09-5ca82de4355b"
Jul 07 13:59:31.069085 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:31.069026    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8cp" podUID="767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea"
Jul 07 13:59:31.104595 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.104572    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-192.ec2.internal" event="NodeReady"
Jul 07 13:59:31.104921 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.104708    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 13:59:31.143155 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.143121    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rb7b4"]
Jul 07 13:59:31.145766 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.145567    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fr2kp"]
Jul 07 13:59:31.145766 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.145691    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rb7b4"
Jul 07 13:59:31.147888 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.147868    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7f89f8bd56-rpsql"]
Jul 07 13:59:31.148037 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.148010    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fr2kp"
Jul 07 13:59:31.149972 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.149954    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tlhfh"]
Jul 07 13:59:31.150117 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.150093    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 13:59:31.151600 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.151568    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-qtl92"]
Jul 07 13:59:31.151701 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.151687    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tlhfh"
Jul 07 13:59:31.153262 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.153244    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 07 13:59:31.153409 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.153390    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 07 13:59:31.153774 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.153748    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 13:59:31.153774 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.153761    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 07 13:59:31.153915 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.153751    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 07 13:59:31.154116 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.154099    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 07 13:59:31.154195 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.154142    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zvl8v\""
Jul 07 13:59:31.154662 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.154643    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 13:59:31.155836 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.155494    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7dffl\""
Jul 07 13:59:31.155836 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.155578    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-qtl92"
Jul 07 13:59:31.155836 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.155772    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 07 13:59:31.156033 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.155498    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6b78666d57-trzqd"]
Jul 07 13:59:31.157843 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.156958    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 07 13:59:31.157843 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.157210    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-qj9d6\""
Jul 07 13:59:31.157843 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.157393    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 07 13:59:31.157843 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.157580    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2sf6c\""
Jul 07 13:59:31.157843 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.157715    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 07 13:59:31.157843 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.157755    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 07 13:59:31.159817 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.159801    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-bglbr"]
Jul 07 13:59:31.159980 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.159963    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b78666d57-trzqd"
Jul 07 13:59:31.166074 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.165575    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 07 13:59:31.166074 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.165812    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 13:59:31.166074 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.165885    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 13:59:31.166074 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.166054    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 07 13:59:31.166332 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.166205    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xmv42\""
Jul 07 13:59:31.166332 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.166260    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-bglbr"
Jul 07 13:59:31.169270 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.166611    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 07 13:59:31.169270 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.166862    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 07 13:59:31.173463 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.170912    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 07 13:59:31.173463 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.171012    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 13:59:31.173463 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.171154    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 07 13:59:31.173463 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.171584    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-7swwn\""
Jul 07 13:59:31.173463 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.172302    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rb7b4"]
Jul 07 13:59:31.173463 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.172532    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 13:59:31.177829 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.177678    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-g4c5h\""
Jul 07 13:59:31.177829 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.177804    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fr2kp"]
Jul 07 13:59:31.178064 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.178020    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 07 13:59:31.178420 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.178084    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 07 13:59:31.178763 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.178627    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 07 13:59:31.178970 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.178922    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tlhfh"]
Jul 07 13:59:31.179152 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.179132    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 07 13:59:31.179847 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.179829    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-qtl92"]
Jul 07 13:59:31.180724 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.180630    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-bglbr"]
Jul 07 13:59:31.182976 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.181509    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f89f8bd56-rpsql"]
Jul 07 13:59:31.182976 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.182134    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 07 13:59:31.182976 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.182702    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-f76h8"]
Jul 07 13:59:31.184678 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.184234    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 07 13:59:31.185359 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.185322    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 07 13:59:31.186545 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.186524    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-mlpj4"]
Jul 07 13:59:31.189533 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.187637    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f76h8"
Jul 07 13:59:31.191329 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.190290    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 13:59:31.191329 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.191135    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 13:59:31.191608 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.191592    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7m8lp\""
Jul 07 13:59:31.194384 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.194357    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-2r2k8"]
Jul 07 13:59:31.194534 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.194518    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mlpj4"
Jul 07 13:59:31.197783 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.197765    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-887km"]
Jul 07 13:59:31.197961 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.197928    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 13:59:31.198045 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.197995    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 13:59:31.198221 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.198203    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-cc8dr\""
Jul 07 13:59:31.198370 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.198245    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-2r2k8"
Jul 07 13:59:31.204056 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.203690    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 07 13:59:31.204056 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.203774    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 07 13:59:31.204056 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.203689    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 07 13:59:31.204056 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.203971    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 07 13:59:31.204291 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.204166    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-46fq6\""
Jul 07 13:59:31.205284 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.205263    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-76dfd"]
Jul 07 13:59:31.205433 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.205381    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-887km"
Jul 07 13:59:31.208052 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.208035    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 13:59:31.208210 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.208182    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 13:59:31.208419 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.208400    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 13:59:31.208505 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.208416    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cgt9h\""
Jul 07 13:59:31.208757 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.208740    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b78666d57-trzqd"]
Jul 07 13:59:31.208877 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.208865    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-mlpj4"]
Jul 07 13:59:31.209001 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.208990    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-2r2k8"]
Jul 07 13:59:31.209113 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.209104    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-887km"]
Jul 07 13:59:31.209242 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.208826    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-76dfd"
Jul 07 13:59:31.209399 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.209193    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-76dfd"]
Jul 07 13:59:31.209524 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.209407    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f76h8"]
Jul 07 13:59:31.211786 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.211763    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 07 13:59:31.211883 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.211843    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 07 13:59:31.212537 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.212518    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 07 13:59:31.212741 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.212722    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 07 13:59:31.212839 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.212816    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-h57tk\""
Jul 07 13:59:31.216386 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.216362    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fsmz\" (UniqueName: \"kubernetes.io/projected/de7dff6f-6402-4f2a-b8fc-a93a6af0819d-kube-api-access-8fsmz\") pod \"cluster-samples-operator-56fcf86bf-rb7b4\" (UID: \"de7dff6f-6402-4f2a-b8fc-a93a6af0819d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rb7b4"
Jul 07 13:59:31.216496 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.216398    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b1219f1-d3d3-4533-8b55-546c7c1a4bc6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-fr2kp\" (UID: \"8b1219f1-d3d3-4533-8b55-546c7c1a4bc6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fr2kp"
Jul 07 13:59:31.216496 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.216426    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-bound-sa-token\") pod \"image-registry-7f89f8bd56-rpsql\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") " pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 13:59:31.216496 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.216465    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj8xg\" (UniqueName: \"kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-kube-api-access-xj8xg\") pod \"image-registry-7f89f8bd56-rpsql\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") " pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 13:59:31.216496 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.216492    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/722f8cec-0fcc-4d5d-992b-baf7533b6a04-trusted-ca\") pod \"image-registry-7f89f8bd56-rpsql\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") " pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 13:59:31.216701 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.216514    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-registry-tls\") pod \"image-registry-7f89f8bd56-rpsql\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") " pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 13:59:31.216701 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.216544    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/722f8cec-0fcc-4d5d-992b-baf7533b6a04-installation-pull-secrets\") pod \"image-registry-7f89f8bd56-rpsql\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") " pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 13:59:31.216701 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.216563    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de7dff6f-6402-4f2a-b8fc-a93a6af0819d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-rb7b4\" (UID: \"de7dff6f-6402-4f2a-b8fc-a93a6af0819d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rb7b4"
Jul 07 13:59:31.216701 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.216579    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd7qg\" (UniqueName: \"kubernetes.io/projected/8b1219f1-d3d3-4533-8b55-546c7c1a4bc6-kube-api-access-cd7qg\") pod \"cluster-monitoring-operator-64786d9cbb-fr2kp\" (UID: \"8b1219f1-d3d3-4533-8b55-546c7c1a4bc6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fr2kp"
Jul 07 13:59:31.216701 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.216606    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/722f8cec-0fcc-4d5d-992b-baf7533b6a04-image-registry-private-configuration\") pod \"image-registry-7f89f8bd56-rpsql\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") " pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 13:59:31.216701 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.216624    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/722f8cec-0fcc-4d5d-992b-baf7533b6a04-ca-trust-extracted\") pod \"image-registry-7f89f8bd56-rpsql\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") " pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 13:59:31.216701 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.216645    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/722f8cec-0fcc-4d5d-992b-baf7533b6a04-registry-certificates\") pod \"image-registry-7f89f8bd56-rpsql\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") " pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 13:59:31.216701 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.216672    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8b1219f1-d3d3-4533-8b55-546c7c1a4bc6-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-fr2kp\" (UID: \"8b1219f1-d3d3-4533-8b55-546c7c1a4bc6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fr2kp"
Jul 07 13:59:31.317969 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.317884    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-bound-sa-token\") pod \"image-registry-7f89f8bd56-rpsql\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") " pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 13:59:31.317969 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.317924    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d36dada3-7ddc-4de9-a1d5-62ff1f867dd9-serving-cert\") pod \"console-operator-68b757fb67-bglbr\" (UID: \"d36dada3-7ddc-4de9-a1d5-62ff1f867dd9\") " pod="openshift-console-operator/console-operator-68b757fb67-bglbr"
Jul 07 13:59:31.318202 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.317979    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c932b4f6-5a4a-45f4-aa12-03bc4845857d-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-qtl92\" (UID: \"c932b4f6-5a4a-45f4-aa12-03bc4845857d\") " pod="openshift-insights/insights-operator-5c847dcfc4-qtl92"
Jul 07 13:59:31.318202 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.318004    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfqj2\" (UniqueName: \"kubernetes.io/projected/463c4567-970d-458f-bde5-4897ed3ca45c-kube-api-access-nfqj2\") pod \"network-check-source-989f8b8dc-mlpj4\" (UID: \"463c4567-970d-458f-bde5-4897ed3ca45c\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mlpj4"
Jul 07 13:59:31.318202 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.318029    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d36dada3-7ddc-4de9-a1d5-62ff1f867dd9-trusted-ca\") pod \"console-operator-68b757fb67-bglbr\" (UID: \"d36dada3-7ddc-4de9-a1d5-62ff1f867dd9\") " pod="openshift-console-operator/console-operator-68b757fb67-bglbr"
Jul 07 13:59:31.318202 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.318054    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f87880be-2cb0-4728-b0e4-7f9dfe55d961-tmp-dir\") pod \"dns-default-f76h8\" (UID: \"f87880be-2cb0-4728-b0e4-7f9dfe55d961\") " pod="openshift-dns/dns-default-f76h8"
Jul 07 13:59:31.318202 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.318119    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23a16488-280d-46f3-a2f6-8e5441851c9f-service-ca-bundle\") pod \"router-default-6b78666d57-trzqd\" (UID: \"23a16488-280d-46f3-a2f6-8e5441851c9f\") " pod="openshift-ingress/router-default-6b78666d57-trzqd"
Jul 07 13:59:31.318202 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.318181    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/722f8cec-0fcc-4d5d-992b-baf7533b6a04-trusted-ca\") pod \"image-registry-7f89f8bd56-rpsql\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") " pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 13:59:31.318479 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.318210    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe2e0f1e-e3ad-4c6c-bdde-61135493ef8b-cert\") pod \"ingress-canary-887km\" (UID: \"fe2e0f1e-e3ad-4c6c-bdde-61135493ef8b\") " pod="openshift-ingress-canary/ingress-canary-887km"
Jul 07 13:59:31.318479 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.318238    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c932b4f6-5a4a-45f4-aa12-03bc4845857d-snapshots\") pod \"insights-operator-5c847dcfc4-qtl92\" (UID: \"c932b4f6-5a4a-45f4-aa12-03bc4845857d\") " pod="openshift-insights/insights-operator-5c847dcfc4-qtl92"
Jul 07 13:59:31.318479 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.318264    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-registry-tls\") pod \"image-registry-7f89f8bd56-rpsql\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") " pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 13:59:31.318479 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.318310    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de7dff6f-6402-4f2a-b8fc-a93a6af0819d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-rb7b4\" (UID: \"de7dff6f-6402-4f2a-b8fc-a93a6af0819d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rb7b4"
Jul 07 13:59:31.318479 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.318345    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f87880be-2cb0-4728-b0e4-7f9dfe55d961-metrics-tls\") pod \"dns-default-f76h8\" (UID: \"f87880be-2cb0-4728-b0e4-7f9dfe55d961\") " pod="openshift-dns/dns-default-f76h8"
Jul 07 13:59:31.318479 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:31.318360    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 13:59:31.318479 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.318374    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rqfl\" (UniqueName: \"kubernetes.io/projected/fe2e0f1e-e3ad-4c6c-bdde-61135493ef8b-kube-api-access-2rqfl\") pod \"ingress-canary-887km\" (UID: \"fe2e0f1e-e3ad-4c6c-bdde-61135493ef8b\") " pod="openshift-ingress-canary/ingress-canary-887km"
Jul 07 13:59:31.318479 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:31.318375    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f89f8bd56-rpsql: secret "image-registry-tls" not found
Jul 07 13:59:31.318479 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.318408    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/722f8cec-0fcc-4d5d-992b-baf7533b6a04-installation-pull-secrets\") pod \"image-registry-7f89f8bd56-rpsql\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") " pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 13:59:31.318479 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:31.318436    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 13:59:31.318479 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:31.318468    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-registry-tls podName:722f8cec-0fcc-4d5d-992b-baf7533b6a04 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:31.81844742 +0000 UTC m=+37.430726373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-registry-tls") pod "image-registry-7f89f8bd56-rpsql" (UID: "722f8cec-0fcc-4d5d-992b-baf7533b6a04") : secret "image-registry-tls" not found
Jul 07 13:59:31.319025 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:31.318498    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de7dff6f-6402-4f2a-b8fc-a93a6af0819d-samples-operator-tls podName:de7dff6f-6402-4f2a-b8fc-a93a6af0819d nodeName:}" failed. No retries permitted until 2026-07-07 13:59:31.818482457 +0000 UTC m=+37.430761421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/de7dff6f-6402-4f2a-b8fc-a93a6af0819d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-rb7b4" (UID: "de7dff6f-6402-4f2a-b8fc-a93a6af0819d") : secret "samples-operator-tls" not found
Jul 07 13:59:31.319025 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.318438    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d36dada3-7ddc-4de9-a1d5-62ff1f867dd9-config\") pod \"console-operator-68b757fb67-bglbr\" (UID: \"d36dada3-7ddc-4de9-a1d5-62ff1f867dd9\") " pod="openshift-console-operator/console-operator-68b757fb67-bglbr"
Jul 07 13:59:31.319025 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.318535    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/722f8cec-0fcc-4d5d-992b-baf7533b6a04-image-registry-private-configuration\") pod \"image-registry-7f89f8bd56-rpsql\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") " pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 13:59:31.319025 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.318563    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/722f8cec-0fcc-4d5d-992b-baf7533b6a04-registry-certificates\") pod \"image-registry-7f89f8bd56-rpsql\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") " pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 13:59:31.319025 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.318591    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm2nv\" (UniqueName: \"kubernetes.io/projected/a259d7f0-7c5d-44f1-b288-4f9460eda3d7-kube-api-access-qm2nv\") pod \"volume-data-source-validator-5d456fdbcd-tlhfh\" (UID: \"a259d7f0-7c5d-44f1-b288-4f9460eda3d7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tlhfh"
Jul 07 13:59:31.319025 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.318619    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj55n\" (UniqueName: \"kubernetes.io/projected/23a16488-280d-46f3-a2f6-8e5441851c9f-kube-api-access-qj55n\") pod \"router-default-6b78666d57-trzqd\" (UID: \"23a16488-280d-46f3-a2f6-8e5441851c9f\") " pod="openshift-ingress/router-default-6b78666d57-trzqd"
Jul 07 13:59:31.319025 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.318654    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/02ae2607-7b1c-4fcf-9528-5379c3534073-config\") pod \"service-ca-operator-5d46d9ffd4-2r2k8\" (UID: \"02ae2607-7b1c-4fcf-9528-5379c3534073\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-2r2k8"
Jul 07 13:59:31.319025 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.318681    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fsmz\" (UniqueName: \"kubernetes.io/projected/de7dff6f-6402-4f2a-b8fc-a93a6af0819d-kube-api-access-8fsmz\") pod \"cluster-samples-operator-56fcf86bf-rb7b4\" (UID: \"de7dff6f-6402-4f2a-b8fc-a93a6af0819d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rb7b4"
Jul 07 13:59:31.319025 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.318707    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/449662d7-d129-4774-bc10-7b32dc658f15-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-76dfd\" (UID: \"449662d7-d129-4774-bc10-7b32dc658f15\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-76dfd"
Jul 07 13:59:31.319025 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.318733    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/23a16488-280d-46f3-a2f6-8e5441851c9f-stats-auth\") pod \"router-default-6b78666d57-trzqd\" (UID: \"23a16488-280d-46f3-a2f6-8e5441851c9f\") " pod="openshift-ingress/router-default-6b78666d57-trzqd"
Jul 07 13:59:31.319025 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.318769    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/449662d7-d129-4774-bc10-7b32dc658f15-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-76dfd\" (UID: \"449662d7-d129-4774-bc10-7b32dc658f15\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-76dfd"
Jul 07 13:59:31.319025 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.318793    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f87880be-2cb0-4728-b0e4-7f9dfe55d961-config-volume\") pod \"dns-default-f76h8\" (UID: \"f87880be-2cb0-4728-b0e4-7f9dfe55d961\") " pod="openshift-dns/dns-default-f76h8"
Jul 07 13:59:31.319025 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.318816    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c932b4f6-5a4a-45f4-aa12-03bc4845857d-tmp\") pod \"insights-operator-5c847dcfc4-qtl92\" (UID: \"c932b4f6-5a4a-45f4-aa12-03bc4845857d\") " pod="openshift-insights/insights-operator-5c847dcfc4-qtl92"
Jul 07 13:59:31.319025 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.318857    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj8xg\" (UniqueName: \"kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-kube-api-access-xj8xg\") pod \"image-registry-7f89f8bd56-rpsql\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") " pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 13:59:31.319605 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.318883    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c932b4f6-5a4a-45f4-aa12-03bc4845857d-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-qtl92\" (UID: \"c932b4f6-5a4a-45f4-aa12-03bc4845857d\") " pod="openshift-insights/insights-operator-5c847dcfc4-qtl92"
Jul 07 13:59:31.319605 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.318915    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svttp\" (UniqueName: \"kubernetes.io/projected/d36dada3-7ddc-4de9-a1d5-62ff1f867dd9-kube-api-access-svttp\") pod \"console-operator-68b757fb67-bglbr\" (UID: \"d36dada3-7ddc-4de9-a1d5-62ff1f867dd9\") " pod="openshift-console-operator/console-operator-68b757fb67-bglbr"
Jul 07 13:59:31.319605 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.319001    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/23a16488-280d-46f3-a2f6-8e5441851c9f-default-certificate\") pod \"router-default-6b78666d57-trzqd\" (UID: \"23a16488-280d-46f3-a2f6-8e5441851c9f\") " pod="openshift-ingress/router-default-6b78666d57-trzqd"
Jul 07 13:59:31.319605 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.319059    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23a16488-280d-46f3-a2f6-8e5441851c9f-metrics-certs\") pod \"router-default-6b78666d57-trzqd\" (UID: \"23a16488-280d-46f3-a2f6-8e5441851c9f\") " pod="openshift-ingress/router-default-6b78666d57-trzqd"
Jul 07 13:59:31.319605 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.319100    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd7qg\" (UniqueName: \"kubernetes.io/projected/8b1219f1-d3d3-4533-8b55-546c7c1a4bc6-kube-api-access-cd7qg\") pod \"cluster-monitoring-operator-64786d9cbb-fr2kp\" (UID: \"8b1219f1-d3d3-4533-8b55-546c7c1a4bc6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fr2kp"
Jul 07 13:59:31.319605 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.319125    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb2b5\" (UniqueName: \"kubernetes.io/projected/02ae2607-7b1c-4fcf-9528-5379c3534073-kube-api-access-sb2b5\") pod \"service-ca-operator-5d46d9ffd4-2r2k8\" (UID: \"02ae2607-7b1c-4fcf-9528-5379c3534073\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-2r2k8"
Jul 07 13:59:31.319605 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.319176    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/722f8cec-0fcc-4d5d-992b-baf7533b6a04-ca-trust-extracted\") pod \"image-registry-7f89f8bd56-rpsql\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") " pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 13:59:31.319605 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.319282    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8b1219f1-d3d3-4533-8b55-546c7c1a4bc6-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-fr2kp\" (UID: \"8b1219f1-d3d3-4533-8b55-546c7c1a4bc6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fr2kp"
Jul 07 13:59:31.319605 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.319309    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqhtt\" (UniqueName: \"kubernetes.io/projected/f87880be-2cb0-4728-b0e4-7f9dfe55d961-kube-api-access-sqhtt\") pod \"dns-default-f76h8\" (UID: \"f87880be-2cb0-4728-b0e4-7f9dfe55d961\") " pod="openshift-dns/dns-default-f76h8"
Jul 07 13:59:31.319605 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.319406    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6qkh\" (UniqueName: \"kubernetes.io/projected/449662d7-d129-4774-bc10-7b32dc658f15-kube-api-access-l6qkh\") pod \"kube-storage-version-migrator-operator-846bf668f7-76dfd\" (UID: \"449662d7-d129-4774-bc10-7b32dc658f15\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-76dfd"
Jul 07 13:59:31.319605 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.319429    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/722f8cec-0fcc-4d5d-992b-baf7533b6a04-registry-certificates\") pod \"image-registry-7f89f8bd56-rpsql\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") " pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 13:59:31.319605 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.319499    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/02ae2607-7b1c-4fcf-9528-5379c3534073-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-2r2k8\" (UID: \"02ae2607-7b1c-4fcf-9528-5379c3534073\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-2r2k8"
Jul 07 13:59:31.319605 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.319551    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b1219f1-d3d3-4533-8b55-546c7c1a4bc6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-fr2kp\" (UID: \"8b1219f1-d3d3-4533-8b55-546c7c1a4bc6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fr2kp"
Jul 07 13:59:31.319605 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.319563    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/722f8cec-0fcc-4d5d-992b-baf7533b6a04-ca-trust-extracted\") pod \"image-registry-7f89f8bd56-rpsql\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") " pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 13:59:31.319605 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:31.319605    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 13:59:31.320256 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.319617    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c932b4f6-5a4a-45f4-aa12-03bc4845857d-serving-cert\") pod \"insights-operator-5c847dcfc4-qtl92\" (UID: \"c932b4f6-5a4a-45f4-aa12-03bc4845857d\") " pod="openshift-insights/insights-operator-5c847dcfc4-qtl92"
Jul 07 13:59:31.320256 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:31.319640    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b1219f1-d3d3-4533-8b55-546c7c1a4bc6-cluster-monitoring-operator-tls podName:8b1219f1-d3d3-4533-8b55-546c7c1a4bc6 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:31.819629621 +0000 UTC m=+37.431908591 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8b1219f1-d3d3-4533-8b55-546c7c1a4bc6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-fr2kp" (UID: "8b1219f1-d3d3-4533-8b55-546c7c1a4bc6") : secret "cluster-monitoring-operator-tls" not found
Jul 07 13:59:31.320256 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.319655    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxz8t\" (UniqueName: \"kubernetes.io/projected/c932b4f6-5a4a-45f4-aa12-03bc4845857d-kube-api-access-lxz8t\") pod \"insights-operator-5c847dcfc4-qtl92\" (UID: \"c932b4f6-5a4a-45f4-aa12-03bc4845857d\") " pod="openshift-insights/insights-operator-5c847dcfc4-qtl92"
Jul 07 13:59:31.320256 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.319968    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8b1219f1-d3d3-4533-8b55-546c7c1a4bc6-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-fr2kp\" (UID: \"8b1219f1-d3d3-4533-8b55-546c7c1a4bc6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fr2kp"
Jul 07 13:59:31.320256 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.320224    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/722f8cec-0fcc-4d5d-992b-baf7533b6a04-trusted-ca\") pod \"image-registry-7f89f8bd56-rpsql\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") " pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 13:59:31.323354 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.323328    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/722f8cec-0fcc-4d5d-992b-baf7533b6a04-image-registry-private-configuration\") pod \"image-registry-7f89f8bd56-rpsql\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") " pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 13:59:31.323354 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.323340    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/722f8cec-0fcc-4d5d-992b-baf7533b6a04-installation-pull-secrets\") pod \"image-registry-7f89f8bd56-rpsql\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") " pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 13:59:31.327577 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.327549    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-bound-sa-token\") pod \"image-registry-7f89f8bd56-rpsql\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") " pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 13:59:31.337334 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.337314    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd7qg\" (UniqueName: \"kubernetes.io/projected/8b1219f1-d3d3-4533-8b55-546c7c1a4bc6-kube-api-access-cd7qg\") pod \"cluster-monitoring-operator-64786d9cbb-fr2kp\" (UID: \"8b1219f1-d3d3-4533-8b55-546c7c1a4bc6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fr2kp"
Jul 07 13:59:31.337683 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.337664    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fsmz\" (UniqueName: \"kubernetes.io/projected/de7dff6f-6402-4f2a-b8fc-a93a6af0819d-kube-api-access-8fsmz\") pod \"cluster-samples-operator-56fcf86bf-rb7b4\" (UID: \"de7dff6f-6402-4f2a-b8fc-a93a6af0819d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rb7b4"
Jul 07 13:59:31.337788 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.337721    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj8xg\" (UniqueName: \"kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-kube-api-access-xj8xg\") pod \"image-registry-7f89f8bd56-rpsql\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") " pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 13:59:31.421193 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.421157    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svttp\" (UniqueName: \"kubernetes.io/projected/d36dada3-7ddc-4de9-a1d5-62ff1f867dd9-kube-api-access-svttp\") pod \"console-operator-68b757fb67-bglbr\" (UID: \"d36dada3-7ddc-4de9-a1d5-62ff1f867dd9\") " pod="openshift-console-operator/console-operator-68b757fb67-bglbr"
Jul 07 13:59:31.421193 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.421195    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/23a16488-280d-46f3-a2f6-8e5441851c9f-default-certificate\") pod \"router-default-6b78666d57-trzqd\" (UID: \"23a16488-280d-46f3-a2f6-8e5441851c9f\") " pod="openshift-ingress/router-default-6b78666d57-trzqd"
Jul 07 13:59:31.421584 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.421220    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23a16488-280d-46f3-a2f6-8e5441851c9f-metrics-certs\") pod \"router-default-6b78666d57-trzqd\" (UID: \"23a16488-280d-46f3-a2f6-8e5441851c9f\") " pod="openshift-ingress/router-default-6b78666d57-trzqd"
Jul 07 13:59:31.421584 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.421248    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb2b5\" (UniqueName: \"kubernetes.io/projected/02ae2607-7b1c-4fcf-9528-5379c3534073-kube-api-access-sb2b5\") pod \"service-ca-operator-5d46d9ffd4-2r2k8\" (UID: \"02ae2607-7b1c-4fcf-9528-5379c3534073\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-2r2k8"
Jul 07 13:59:31.421584 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.421275    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqhtt\" (UniqueName: \"kubernetes.io/projected/f87880be-2cb0-4728-b0e4-7f9dfe55d961-kube-api-access-sqhtt\") pod \"dns-default-f76h8\" (UID: \"f87880be-2cb0-4728-b0e4-7f9dfe55d961\") " pod="openshift-dns/dns-default-f76h8"
Jul 07 13:59:31.421584 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.421291    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6qkh\" (UniqueName: \"kubernetes.io/projected/449662d7-d129-4774-bc10-7b32dc658f15-kube-api-access-l6qkh\") pod \"kube-storage-version-migrator-operator-846bf668f7-76dfd\" (UID: \"449662d7-d129-4774-bc10-7b32dc658f15\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-76dfd"
Jul 07 13:59:31.421584 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.421337    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/02ae2607-7b1c-4fcf-9528-5379c3534073-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-2r2k8\" (UID: \"02ae2607-7b1c-4fcf-9528-5379c3534073\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-2r2k8"
Jul 07 13:59:31.421584 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.421391    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c932b4f6-5a4a-45f4-aa12-03bc4845857d-serving-cert\") pod \"insights-operator-5c847dcfc4-qtl92\" (UID: \"c932b4f6-5a4a-45f4-aa12-03bc4845857d\") " pod="openshift-insights/insights-operator-5c847dcfc4-qtl92"
Jul 07 13:59:31.421584 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.421415    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxz8t\" (UniqueName: \"kubernetes.io/projected/c932b4f6-5a4a-45f4-aa12-03bc4845857d-kube-api-access-lxz8t\") pod \"insights-operator-5c847dcfc4-qtl92\" (UID: \"c932b4f6-5a4a-45f4-aa12-03bc4845857d\") " pod="openshift-insights/insights-operator-5c847dcfc4-qtl92"
Jul 07 13:59:31.421584 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.421445    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d36dada3-7ddc-4de9-a1d5-62ff1f867dd9-serving-cert\") pod \"console-operator-68b757fb67-bglbr\" (UID: \"d36dada3-7ddc-4de9-a1d5-62ff1f867dd9\") " pod="openshift-console-operator/console-operator-68b757fb67-bglbr"
Jul 07 13:59:31.421584 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.421483    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c932b4f6-5a4a-45f4-aa12-03bc4845857d-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-qtl92\" (UID: \"c932b4f6-5a4a-45f4-aa12-03bc4845857d\") " pod="openshift-insights/insights-operator-5c847dcfc4-qtl92"
Jul 07 13:59:31.421584 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.421508    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfqj2\" (UniqueName: \"kubernetes.io/projected/463c4567-970d-458f-bde5-4897ed3ca45c-kube-api-access-nfqj2\") pod \"network-check-source-989f8b8dc-mlpj4\" (UID: \"463c4567-970d-458f-bde5-4897ed3ca45c\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mlpj4"
Jul 07 13:59:31.421584 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.421535    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d36dada3-7ddc-4de9-a1d5-62ff1f867dd9-trusted-ca\") pod \"console-operator-68b757fb67-bglbr\" (UID: \"d36dada3-7ddc-4de9-a1d5-62ff1f867dd9\") " pod="openshift-console-operator/console-operator-68b757fb67-bglbr"
Jul 07 13:59:31.421584 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.421558    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f87880be-2cb0-4728-b0e4-7f9dfe55d961-tmp-dir\") pod \"dns-default-f76h8\" (UID: \"f87880be-2cb0-4728-b0e4-7f9dfe55d961\") " pod="openshift-dns/dns-default-f76h8"
Jul 07 13:59:31.421584 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.421585    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23a16488-280d-46f3-a2f6-8e5441851c9f-service-ca-bundle\") pod \"router-default-6b78666d57-trzqd\" (UID: \"23a16488-280d-46f3-a2f6-8e5441851c9f\") " pod="openshift-ingress/router-default-6b78666d57-trzqd"
Jul 07 13:59:31.422289 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.421615    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe2e0f1e-e3ad-4c6c-bdde-61135493ef8b-cert\") pod \"ingress-canary-887km\" (UID: \"fe2e0f1e-e3ad-4c6c-bdde-61135493ef8b\") " pod="openshift-ingress-canary/ingress-canary-887km"
Jul 07 13:59:31.422289 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.421647    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c932b4f6-5a4a-45f4-aa12-03bc4845857d-snapshots\") pod \"insights-operator-5c847dcfc4-qtl92\" (UID: \"c932b4f6-5a4a-45f4-aa12-03bc4845857d\") " pod="openshift-insights/insights-operator-5c847dcfc4-qtl92"
Jul 07 13:59:31.422289 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.421697    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f87880be-2cb0-4728-b0e4-7f9dfe55d961-metrics-tls\") pod \"dns-default-f76h8\" (UID: \"f87880be-2cb0-4728-b0e4-7f9dfe55d961\") " pod="openshift-dns/dns-default-f76h8"
Jul 07 13:59:31.422289 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.421722    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rqfl\" (UniqueName: \"kubernetes.io/projected/fe2e0f1e-e3ad-4c6c-bdde-61135493ef8b-kube-api-access-2rqfl\") pod \"ingress-canary-887km\" (UID: \"fe2e0f1e-e3ad-4c6c-bdde-61135493ef8b\") " pod="openshift-ingress-canary/ingress-canary-887km"
Jul 07 13:59:31.422289 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.421753    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d36dada3-7ddc-4de9-a1d5-62ff1f867dd9-config\") pod \"console-operator-68b757fb67-bglbr\" (UID: \"d36dada3-7ddc-4de9-a1d5-62ff1f867dd9\") " pod="openshift-console-operator/console-operator-68b757fb67-bglbr"
Jul 07 13:59:31.422289 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.421785    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm2nv\" (UniqueName: \"kubernetes.io/projected/a259d7f0-7c5d-44f1-b288-4f9460eda3d7-kube-api-access-qm2nv\") pod \"volume-data-source-validator-5d456fdbcd-tlhfh\" (UID: \"a259d7f0-7c5d-44f1-b288-4f9460eda3d7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tlhfh"
Jul 07 13:59:31.422289 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.421811    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj55n\" (UniqueName: \"kubernetes.io/projected/23a16488-280d-46f3-a2f6-8e5441851c9f-kube-api-access-qj55n\") pod \"router-default-6b78666d57-trzqd\" (UID: \"23a16488-280d-46f3-a2f6-8e5441851c9f\") " pod="openshift-ingress/router-default-6b78666d57-trzqd"
Jul 07 13:59:31.422289 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.421868    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/02ae2607-7b1c-4fcf-9528-5379c3534073-config\") pod \"service-ca-operator-5d46d9ffd4-2r2k8\" (UID: \"02ae2607-7b1c-4fcf-9528-5379c3534073\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-2r2k8"
Jul 07 13:59:31.422289 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.421897    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/449662d7-d129-4774-bc10-7b32dc658f15-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-76dfd\" (UID: \"449662d7-d129-4774-bc10-7b32dc658f15\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-76dfd"
Jul 07 13:59:31.422289 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.421923    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/23a16488-280d-46f3-a2f6-8e5441851c9f-stats-auth\") pod \"router-default-6b78666d57-trzqd\" (UID: \"23a16488-280d-46f3-a2f6-8e5441851c9f\") " pod="openshift-ingress/router-default-6b78666d57-trzqd"
Jul 07 13:59:31.422289 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.421977    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/449662d7-d129-4774-bc10-7b32dc658f15-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-76dfd\" (UID: \"449662d7-d129-4774-bc10-7b32dc658f15\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-76dfd"
Jul 07 13:59:31.422289 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.422002    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f87880be-2cb0-4728-b0e4-7f9dfe55d961-config-volume\") pod \"dns-default-f76h8\" (UID: \"f87880be-2cb0-4728-b0e4-7f9dfe55d961\") " pod="openshift-dns/dns-default-f76h8"
Jul 07 13:59:31.422289 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.422029    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c932b4f6-5a4a-45f4-aa12-03bc4845857d-tmp\") pod \"insights-operator-5c847dcfc4-qtl92\" (UID: \"c932b4f6-5a4a-45f4-aa12-03bc4845857d\") " pod="openshift-insights/insights-operator-5c847dcfc4-qtl92"
Jul 07 13:59:31.422289 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.422078    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c932b4f6-5a4a-45f4-aa12-03bc4845857d-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-qtl92\" (UID: \"c932b4f6-5a4a-45f4-aa12-03bc4845857d\") " pod="openshift-insights/insights-operator-5c847dcfc4-qtl92"
Jul 07 13:59:31.422289 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:31.422251    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 13:59:31.423013 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:31.422322    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23a16488-280d-46f3-a2f6-8e5441851c9f-metrics-certs podName:23a16488-280d-46f3-a2f6-8e5441851c9f nodeName:}" failed. No retries permitted until 2026-07-07 13:59:31.922302445 +0000 UTC m=+37.534581401 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23a16488-280d-46f3-a2f6-8e5441851c9f-metrics-certs") pod "router-default-6b78666d57-trzqd" (UID: "23a16488-280d-46f3-a2f6-8e5441851c9f") : secret "router-metrics-certs-default" not found
Jul 07 13:59:31.423410 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.423380    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d36dada3-7ddc-4de9-a1d5-62ff1f867dd9-config\") pod \"console-operator-68b757fb67-bglbr\" (UID: \"d36dada3-7ddc-4de9-a1d5-62ff1f867dd9\") " pod="openshift-console-operator/console-operator-68b757fb67-bglbr"
Jul 07 13:59:31.423514 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.423387    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/02ae2607-7b1c-4fcf-9528-5379c3534073-config\") pod \"service-ca-operator-5d46d9ffd4-2r2k8\" (UID: \"02ae2607-7b1c-4fcf-9528-5379c3534073\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-2r2k8"
Jul 07 13:59:31.423514 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:31.423479    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23a16488-280d-46f3-a2f6-8e5441851c9f-service-ca-bundle podName:23a16488-280d-46f3-a2f6-8e5441851c9f nodeName:}" failed. No retries permitted until 2026-07-07 13:59:31.923461914 +0000 UTC m=+37.535740875 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/23a16488-280d-46f3-a2f6-8e5441851c9f-service-ca-bundle") pod "router-default-6b78666d57-trzqd" (UID: "23a16488-280d-46f3-a2f6-8e5441851c9f") : configmap references non-existent config key: service-ca.crt
Jul 07 13:59:31.423870 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.423844    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d36dada3-7ddc-4de9-a1d5-62ff1f867dd9-trusted-ca\") pod \"console-operator-68b757fb67-bglbr\" (UID: \"d36dada3-7ddc-4de9-a1d5-62ff1f867dd9\") " pod="openshift-console-operator/console-operator-68b757fb67-bglbr"
Jul 07 13:59:31.424816 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.423971    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c932b4f6-5a4a-45f4-aa12-03bc4845857d-snapshots\") pod \"insights-operator-5c847dcfc4-qtl92\" (UID: \"c932b4f6-5a4a-45f4-aa12-03bc4845857d\") " pod="openshift-insights/insights-operator-5c847dcfc4-qtl92"
Jul 07 13:59:31.424816 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.424040    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c932b4f6-5a4a-45f4-aa12-03bc4845857d-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-qtl92\" (UID: \"c932b4f6-5a4a-45f4-aa12-03bc4845857d\") " pod="openshift-insights/insights-operator-5c847dcfc4-qtl92"
Jul 07 13:59:31.424816 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:31.424065    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 13:59:31.424816 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:31.424104    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f87880be-2cb0-4728-b0e4-7f9dfe55d961-metrics-tls podName:f87880be-2cb0-4728-b0e4-7f9dfe55d961 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:31.924090522 +0000 UTC m=+37.536369500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f87880be-2cb0-4728-b0e4-7f9dfe55d961-metrics-tls") pod "dns-default-f76h8" (UID: "f87880be-2cb0-4728-b0e4-7f9dfe55d961") : secret "dns-default-metrics-tls" not found
Jul 07 13:59:31.424816 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.424134    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c932b4f6-5a4a-45f4-aa12-03bc4845857d-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-qtl92\" (UID: \"c932b4f6-5a4a-45f4-aa12-03bc4845857d\") " pod="openshift-insights/insights-operator-5c847dcfc4-qtl92"
Jul 07 13:59:31.424816 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.424507    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c932b4f6-5a4a-45f4-aa12-03bc4845857d-serving-cert\") pod \"insights-operator-5c847dcfc4-qtl92\" (UID: \"c932b4f6-5a4a-45f4-aa12-03bc4845857d\") " pod="openshift-insights/insights-operator-5c847dcfc4-qtl92"
Jul 07 13:59:31.424816 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.424538    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/449662d7-d129-4774-bc10-7b32dc658f15-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-76dfd\" (UID: \"449662d7-d129-4774-bc10-7b32dc658f15\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-76dfd"
Jul 07 13:59:31.424816 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.424612    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/23a16488-280d-46f3-a2f6-8e5441851c9f-default-certificate\") pod \"router-default-6b78666d57-trzqd\" (UID: \"23a16488-280d-46f3-a2f6-8e5441851c9f\") " pod="openshift-ingress/router-default-6b78666d57-trzqd"
Jul 07 13:59:31.424816 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.424710    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c932b4f6-5a4a-45f4-aa12-03bc4845857d-tmp\") pod \"insights-operator-5c847dcfc4-qtl92\" (UID: \"c932b4f6-5a4a-45f4-aa12-03bc4845857d\") " pod="openshift-insights/insights-operator-5c847dcfc4-qtl92"
Jul 07 13:59:31.424816 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.424710    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/02ae2607-7b1c-4fcf-9528-5379c3534073-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-2r2k8\" (UID: \"02ae2607-7b1c-4fcf-9528-5379c3534073\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-2r2k8"
Jul 07 13:59:31.424816 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.424777    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f87880be-2cb0-4728-b0e4-7f9dfe55d961-config-volume\") pod \"dns-default-f76h8\" (UID: \"f87880be-2cb0-4728-b0e4-7f9dfe55d961\") " pod="openshift-dns/dns-default-f76h8"
Jul 07 13:59:31.426088 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.426056    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe2e0f1e-e3ad-4c6c-bdde-61135493ef8b-cert\") pod \"ingress-canary-887km\" (UID: \"fe2e0f1e-e3ad-4c6c-bdde-61135493ef8b\") " pod="openshift-ingress-canary/ingress-canary-887km"
Jul 07 13:59:31.426230 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.426207    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/449662d7-d129-4774-bc10-7b32dc658f15-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-76dfd\" (UID: \"449662d7-d129-4774-bc10-7b32dc658f15\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-76dfd"
Jul 07 13:59:31.426482 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.426450    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f87880be-2cb0-4728-b0e4-7f9dfe55d961-tmp-dir\") pod \"dns-default-f76h8\" (UID: \"f87880be-2cb0-4728-b0e4-7f9dfe55d961\") " pod="openshift-dns/dns-default-f76h8"
Jul 07 13:59:31.426823 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.426807    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d36dada3-7ddc-4de9-a1d5-62ff1f867dd9-serving-cert\") pod \"console-operator-68b757fb67-bglbr\" (UID: \"d36dada3-7ddc-4de9-a1d5-62ff1f867dd9\") " pod="openshift-console-operator/console-operator-68b757fb67-bglbr"
Jul 07 13:59:31.427159 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.427140    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/23a16488-280d-46f3-a2f6-8e5441851c9f-stats-auth\") pod \"router-default-6b78666d57-trzqd\" (UID: \"23a16488-280d-46f3-a2f6-8e5441851c9f\") " pod="openshift-ingress/router-default-6b78666d57-trzqd"
Jul 07 13:59:31.434707 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.434684    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svttp\" (UniqueName: \"kubernetes.io/projected/d36dada3-7ddc-4de9-a1d5-62ff1f867dd9-kube-api-access-svttp\") pod \"console-operator-68b757fb67-bglbr\" (UID: \"d36dada3-7ddc-4de9-a1d5-62ff1f867dd9\") " pod="openshift-console-operator/console-operator-68b757fb67-bglbr"
Jul 07 13:59:31.435594 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.435457    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6qkh\" (UniqueName: \"kubernetes.io/projected/449662d7-d129-4774-bc10-7b32dc658f15-kube-api-access-l6qkh\") pod \"kube-storage-version-migrator-operator-846bf668f7-76dfd\" (UID: \"449662d7-d129-4774-bc10-7b32dc658f15\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-76dfd"
Jul 07 13:59:31.436905 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.436827    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqhtt\" (UniqueName: \"kubernetes.io/projected/f87880be-2cb0-4728-b0e4-7f9dfe55d961-kube-api-access-sqhtt\") pod \"dns-default-f76h8\" (UID: \"f87880be-2cb0-4728-b0e4-7f9dfe55d961\") " pod="openshift-dns/dns-default-f76h8"
Jul 07 13:59:31.439313 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.436918    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfqj2\" (UniqueName: \"kubernetes.io/projected/463c4567-970d-458f-bde5-4897ed3ca45c-kube-api-access-nfqj2\") pod \"network-check-source-989f8b8dc-mlpj4\" (UID: \"463c4567-970d-458f-bde5-4897ed3ca45c\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mlpj4"
Jul 07 13:59:31.439313 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.437514    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj55n\" (UniqueName: \"kubernetes.io/projected/23a16488-280d-46f3-a2f6-8e5441851c9f-kube-api-access-qj55n\") pod \"router-default-6b78666d57-trzqd\" (UID: \"23a16488-280d-46f3-a2f6-8e5441851c9f\") " pod="openshift-ingress/router-default-6b78666d57-trzqd"
Jul 07 13:59:31.439313 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.437720    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb2b5\" (UniqueName: \"kubernetes.io/projected/02ae2607-7b1c-4fcf-9528-5379c3534073-kube-api-access-sb2b5\") pod \"service-ca-operator-5d46d9ffd4-2r2k8\" (UID: \"02ae2607-7b1c-4fcf-9528-5379c3534073\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-2r2k8"
Jul 07 13:59:31.439313 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.437847    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxz8t\" (UniqueName: \"kubernetes.io/projected/c932b4f6-5a4a-45f4-aa12-03bc4845857d-kube-api-access-lxz8t\") pod \"insights-operator-5c847dcfc4-qtl92\" (UID: \"c932b4f6-5a4a-45f4-aa12-03bc4845857d\") " pod="openshift-insights/insights-operator-5c847dcfc4-qtl92"
Jul 07 13:59:31.439313 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.437955    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm2nv\" (UniqueName: \"kubernetes.io/projected/a259d7f0-7c5d-44f1-b288-4f9460eda3d7-kube-api-access-qm2nv\") pod \"volume-data-source-validator-5d456fdbcd-tlhfh\" (UID: \"a259d7f0-7c5d-44f1-b288-4f9460eda3d7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tlhfh"
Jul 07 13:59:31.441833 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.441773    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rqfl\" (UniqueName: \"kubernetes.io/projected/fe2e0f1e-e3ad-4c6c-bdde-61135493ef8b-kube-api-access-2rqfl\") pod \"ingress-canary-887km\" (UID: \"fe2e0f1e-e3ad-4c6c-bdde-61135493ef8b\") " pod="openshift-ingress-canary/ingress-canary-887km"
Jul 07 13:59:31.507104 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.507065    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tlhfh"
Jul 07 13:59:31.513296 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.513267    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-qtl92"
Jul 07 13:59:31.521171 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.521146    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-bglbr"
Jul 07 13:59:31.535706 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.535682    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mlpj4"
Jul 07 13:59:31.540875 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.540855    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-2r2k8"
Jul 07 13:59:31.547273 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.547252    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-887km"
Jul 07 13:59:31.554738 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.554714    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-76dfd"
Jul 07 13:59:31.696236 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.696045    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tlhfh"]
Jul 07 13:59:31.828415 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.828370    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b1219f1-d3d3-4533-8b55-546c7c1a4bc6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-fr2kp\" (UID: \"8b1219f1-d3d3-4533-8b55-546c7c1a4bc6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fr2kp"
Jul 07 13:59:31.828587 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.828466    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-registry-tls\") pod \"image-registry-7f89f8bd56-rpsql\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") " pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 13:59:31.828587 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:31.828544    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 13:59:31.828587 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.828565    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de7dff6f-6402-4f2a-b8fc-a93a6af0819d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-rb7b4\" (UID: \"de7dff6f-6402-4f2a-b8fc-a93a6af0819d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rb7b4"
Jul 07 13:59:31.828728 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:31.828549    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 13:59:31.828728 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:31.828628    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b1219f1-d3d3-4533-8b55-546c7c1a4bc6-cluster-monitoring-operator-tls podName:8b1219f1-d3d3-4533-8b55-546c7c1a4bc6 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:32.828606327 +0000 UTC m=+38.440885301 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8b1219f1-d3d3-4533-8b55-546c7c1a4bc6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-fr2kp" (UID: "8b1219f1-d3d3-4533-8b55-546c7c1a4bc6") : secret "cluster-monitoring-operator-tls" not found
Jul 07 13:59:31.828728 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:31.828634    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f89f8bd56-rpsql: secret "image-registry-tls" not found
Jul 07 13:59:31.828728 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:31.828669    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-registry-tls podName:722f8cec-0fcc-4d5d-992b-baf7533b6a04 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:32.8286597 +0000 UTC m=+38.440938655 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-registry-tls") pod "image-registry-7f89f8bd56-rpsql" (UID: "722f8cec-0fcc-4d5d-992b-baf7533b6a04") : secret "image-registry-tls" not found
Jul 07 13:59:31.828728 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:31.828673    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 13:59:31.828728 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:31.828725    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de7dff6f-6402-4f2a-b8fc-a93a6af0819d-samples-operator-tls podName:de7dff6f-6402-4f2a-b8fc-a93a6af0819d nodeName:}" failed. No retries permitted until 2026-07-07 13:59:32.828712119 +0000 UTC m=+38.440991069 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/de7dff6f-6402-4f2a-b8fc-a93a6af0819d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-rb7b4" (UID: "de7dff6f-6402-4f2a-b8fc-a93a6af0819d") : secret "samples-operator-tls" not found
Jul 07 13:59:31.929846 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.929735    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23a16488-280d-46f3-a2f6-8e5441851c9f-metrics-certs\") pod \"router-default-6b78666d57-trzqd\" (UID: \"23a16488-280d-46f3-a2f6-8e5441851c9f\") " pod="openshift-ingress/router-default-6b78666d57-trzqd"
Jul 07 13:59:31.929846 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.929839    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23a16488-280d-46f3-a2f6-8e5441851c9f-service-ca-bundle\") pod \"router-default-6b78666d57-trzqd\" (UID: \"23a16488-280d-46f3-a2f6-8e5441851c9f\") " pod="openshift-ingress/router-default-6b78666d57-trzqd"
Jul 07 13:59:31.930084 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:31.929882    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 13:59:31.930084 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:31.929892    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f87880be-2cb0-4728-b0e4-7f9dfe55d961-metrics-tls\") pod \"dns-default-f76h8\" (UID: \"f87880be-2cb0-4728-b0e4-7f9dfe55d961\") " pod="openshift-dns/dns-default-f76h8"
Jul 07 13:59:31.930084 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:31.929960    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23a16488-280d-46f3-a2f6-8e5441851c9f-metrics-certs podName:23a16488-280d-46f3-a2f6-8e5441851c9f nodeName:}" failed. No retries permitted until 2026-07-07 13:59:32.929926387 +0000 UTC m=+38.542205359 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23a16488-280d-46f3-a2f6-8e5441851c9f-metrics-certs") pod "router-default-6b78666d57-trzqd" (UID: "23a16488-280d-46f3-a2f6-8e5441851c9f") : secret "router-metrics-certs-default" not found
Jul 07 13:59:31.930084 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:31.930003    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 13:59:31.930280 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:31.930127    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f87880be-2cb0-4728-b0e4-7f9dfe55d961-metrics-tls podName:f87880be-2cb0-4728-b0e4-7f9dfe55d961 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:32.930114177 +0000 UTC m=+38.542393133 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f87880be-2cb0-4728-b0e4-7f9dfe55d961-metrics-tls") pod "dns-default-f76h8" (UID: "f87880be-2cb0-4728-b0e4-7f9dfe55d961") : secret "dns-default-metrics-tls" not found
Jul 07 13:59:31.930280 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:31.930188    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23a16488-280d-46f3-a2f6-8e5441851c9f-service-ca-bundle podName:23a16488-280d-46f3-a2f6-8e5441851c9f nodeName:}" failed. No retries permitted until 2026-07-07 13:59:32.930167433 +0000 UTC m=+38.542446399 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/23a16488-280d-46f3-a2f6-8e5441851c9f-service-ca-bundle") pod "router-default-6b78666d57-trzqd" (UID: "23a16488-280d-46f3-a2f6-8e5441851c9f") : configmap references non-existent config key: service-ca.crt
Jul 07 13:59:32.069091 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:32.069055    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts9k4"
Jul 07 13:59:32.071901 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:32.071878    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7rw24\""
Jul 07 13:59:32.838477 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:32.838447    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-registry-tls\") pod \"image-registry-7f89f8bd56-rpsql\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") " pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 13:59:32.839194 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:32.838486    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de7dff6f-6402-4f2a-b8fc-a93a6af0819d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-rb7b4\" (UID: \"de7dff6f-6402-4f2a-b8fc-a93a6af0819d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rb7b4"
Jul 07 13:59:32.839194 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:32.838613    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b1219f1-d3d3-4533-8b55-546c7c1a4bc6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-fr2kp\" (UID: \"8b1219f1-d3d3-4533-8b55-546c7c1a4bc6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fr2kp"
Jul 07 13:59:32.839194 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:32.838615    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 13:59:32.839194 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:32.838682    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 13:59:32.839194 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:32.838756    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de7dff6f-6402-4f2a-b8fc-a93a6af0819d-samples-operator-tls podName:de7dff6f-6402-4f2a-b8fc-a93a6af0819d nodeName:}" failed. No retries permitted until 2026-07-07 13:59:34.838736352 +0000 UTC m=+40.451015304 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/de7dff6f-6402-4f2a-b8fc-a93a6af0819d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-rb7b4" (UID: "de7dff6f-6402-4f2a-b8fc-a93a6af0819d") : secret "samples-operator-tls" not found
Jul 07 13:59:32.839194 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:32.838688    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f89f8bd56-rpsql: secret "image-registry-tls" not found
Jul 07 13:59:32.839194 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:32.838824    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-registry-tls podName:722f8cec-0fcc-4d5d-992b-baf7533b6a04 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:34.838812736 +0000 UTC m=+40.451091690 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-registry-tls") pod "image-registry-7f89f8bd56-rpsql" (UID: "722f8cec-0fcc-4d5d-992b-baf7533b6a04") : secret "image-registry-tls" not found
Jul 07 13:59:32.839194 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:32.838664    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 13:59:32.839194 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:32.838876    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b1219f1-d3d3-4533-8b55-546c7c1a4bc6-cluster-monitoring-operator-tls podName:8b1219f1-d3d3-4533-8b55-546c7c1a4bc6 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:34.838869373 +0000 UTC m=+40.451148323 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8b1219f1-d3d3-4533-8b55-546c7c1a4bc6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-fr2kp" (UID: "8b1219f1-d3d3-4533-8b55-546c7c1a4bc6") : secret "cluster-monitoring-operator-tls" not found
Jul 07 13:59:32.939747 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:32.939716    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23a16488-280d-46f3-a2f6-8e5441851c9f-service-ca-bundle\") pod \"router-default-6b78666d57-trzqd\" (UID: \"23a16488-280d-46f3-a2f6-8e5441851c9f\") " pod="openshift-ingress/router-default-6b78666d57-trzqd"
Jul 07 13:59:32.939926 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:32.939777    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f87880be-2cb0-4728-b0e4-7f9dfe55d961-metrics-tls\") pod \"dns-default-f76h8\" (UID: \"f87880be-2cb0-4728-b0e4-7f9dfe55d961\") " pod="openshift-dns/dns-default-f76h8"
Jul 07 13:59:32.939926 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:32.939863    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23a16488-280d-46f3-a2f6-8e5441851c9f-service-ca-bundle podName:23a16488-280d-46f3-a2f6-8e5441851c9f nodeName:}" failed. No retries permitted until 2026-07-07 13:59:34.939841792 +0000 UTC m=+40.552120759 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/23a16488-280d-46f3-a2f6-8e5441851c9f-service-ca-bundle") pod "router-default-6b78666d57-trzqd" (UID: "23a16488-280d-46f3-a2f6-8e5441851c9f") : configmap references non-existent config key: service-ca.crt
Jul 07 13:59:32.939926 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:32.939896    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23a16488-280d-46f3-a2f6-8e5441851c9f-metrics-certs\") pod \"router-default-6b78666d57-trzqd\" (UID: \"23a16488-280d-46f3-a2f6-8e5441851c9f\") " pod="openshift-ingress/router-default-6b78666d57-trzqd"
Jul 07 13:59:32.939926 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:32.939901    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 13:59:32.940138 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:32.939959    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f87880be-2cb0-4728-b0e4-7f9dfe55d961-metrics-tls podName:f87880be-2cb0-4728-b0e4-7f9dfe55d961 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:34.93992903 +0000 UTC m=+40.552207993 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f87880be-2cb0-4728-b0e4-7f9dfe55d961-metrics-tls") pod "dns-default-f76h8" (UID: "f87880be-2cb0-4728-b0e4-7f9dfe55d961") : secret "dns-default-metrics-tls" not found
Jul 07 13:59:32.940138 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:32.940058    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 13:59:32.940138 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:32.940113    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23a16488-280d-46f3-a2f6-8e5441851c9f-metrics-certs podName:23a16488-280d-46f3-a2f6-8e5441851c9f nodeName:}" failed. No retries permitted until 2026-07-07 13:59:34.940099613 +0000 UTC m=+40.552378580 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23a16488-280d-46f3-a2f6-8e5441851c9f-metrics-certs") pod "router-default-6b78666d57-trzqd" (UID: "23a16488-280d-46f3-a2f6-8e5441851c9f") : secret "router-metrics-certs-default" not found
Jul 07 13:59:33.069211 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:33.069181    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8cp"
Jul 07 13:59:33.069387 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:33.069227    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 13:59:33.072615 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:33.072591    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 13:59:33.072739 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:33.072636    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9zznv\""
Jul 07 13:59:33.072739 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:33.072676    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 13:59:33.167373 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:59:33.167305    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda259d7f0_7c5d_44f1_b288_4f9460eda3d7.slice/crio-5e3a7cc9b810d45f41917a377a79710bd997c94407be9ea65f2f7a8c543d1bc5 WatchSource:0}: Error finding container 5e3a7cc9b810d45f41917a377a79710bd997c94407be9ea65f2f7a8c543d1bc5: Status 404 returned error can't find the container with id 5e3a7cc9b810d45f41917a377a79710bd997c94407be9ea65f2f7a8c543d1bc5
Jul 07 13:59:33.244565 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:33.244487    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tlhfh" event={"ID":"a259d7f0-7c5d-44f1-b288-4f9460eda3d7","Type":"ContainerStarted","Data":"5e3a7cc9b810d45f41917a377a79710bd997c94407be9ea65f2f7a8c543d1bc5"}
Jul 07 13:59:33.384482 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:33.384435    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-qtl92"]
Jul 07 13:59:33.386001 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:33.385977    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-887km"]
Jul 07 13:59:33.394009 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:33.393908    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-2r2k8"]
Jul 07 13:59:33.397007 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:33.396959    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-mlpj4"]
Jul 07 13:59:33.412055 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:33.412031    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-76dfd"]
Jul 07 13:59:33.416468 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:33.416447    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-bglbr"]
Jul 07 13:59:33.487250 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:59:33.487221    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc932b4f6_5a4a_45f4_aa12_03bc4845857d.slice/crio-1eb300254647762a022d9d6d250343a951c895ac4d1c0545a335f986e5c52288 WatchSource:0}: Error finding container 1eb300254647762a022d9d6d250343a951c895ac4d1c0545a335f986e5c52288: Status 404 returned error can't find the container with id 1eb300254647762a022d9d6d250343a951c895ac4d1c0545a335f986e5c52288
Jul 07 13:59:33.487954 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:59:33.487910    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe2e0f1e_e3ad_4c6c_bdde_61135493ef8b.slice/crio-e1ce216d5232fb36fd30e65666ef7d3fe962d5e4d8427e364c4a2583c466b3a1 WatchSource:0}: Error finding container e1ce216d5232fb36fd30e65666ef7d3fe962d5e4d8427e364c4a2583c466b3a1: Status 404 returned error can't find the container with id e1ce216d5232fb36fd30e65666ef7d3fe962d5e4d8427e364c4a2583c466b3a1
Jul 07 13:59:33.489239 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:59:33.489112    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02ae2607_7b1c_4fcf_9528_5379c3534073.slice/crio-8f2e48a78227fa16bfed3b408557963596194259ec5ff97c7d6239abd61adce7 WatchSource:0}: Error finding container 8f2e48a78227fa16bfed3b408557963596194259ec5ff97c7d6239abd61adce7: Status 404 returned error can't find the container with id 8f2e48a78227fa16bfed3b408557963596194259ec5ff97c7d6239abd61adce7
Jul 07 13:59:33.490634 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:59:33.490060    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod463c4567_970d_458f_bde5_4897ed3ca45c.slice/crio-f25c81f624a178ae504e211eaaac54d8c9e0fcc3238058bd4c27c42e97e3f0c9 WatchSource:0}: Error finding container f25c81f624a178ae504e211eaaac54d8c9e0fcc3238058bd4c27c42e97e3f0c9: Status 404 returned error can't find the container with id f25c81f624a178ae504e211eaaac54d8c9e0fcc3238058bd4c27c42e97e3f0c9
Jul 07 13:59:33.491235 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:59:33.491050    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod449662d7_d129_4774_bc10_7b32dc658f15.slice/crio-0f885b6b0c9458c0a2e74d4d7065bc928456aa2a8913d1efd348d339e545a027 WatchSource:0}: Error finding container 0f885b6b0c9458c0a2e74d4d7065bc928456aa2a8913d1efd348d339e545a027: Status 404 returned error can't find the container with id 0f885b6b0c9458c0a2e74d4d7065bc928456aa2a8913d1efd348d339e545a027
Jul 07 13:59:33.491979 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:59:33.491917    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd36dada3_7ddc_4de9_a1d5_62ff1f867dd9.slice/crio-fd3eb27f1b87804c6735be9946b959af70d0610ba3cf9c6bbd6ab204d47205f5 WatchSource:0}: Error finding container fd3eb27f1b87804c6735be9946b959af70d0610ba3cf9c6bbd6ab204d47205f5: Status 404 returned error can't find the container with id fd3eb27f1b87804c6735be9946b959af70d0610ba3cf9c6bbd6ab204d47205f5
Jul 07 13:59:34.250808 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:34.250712    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-76dfd" event={"ID":"449662d7-d129-4774-bc10-7b32dc658f15","Type":"ContainerStarted","Data":"0f885b6b0c9458c0a2e74d4d7065bc928456aa2a8913d1efd348d339e545a027"}
Jul 07 13:59:34.262457 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:34.261353    2576 generic.go:356] "Generic (PLEG): container finished" podID="282d2c99-4c08-4f51-9625-89428d9d7ccb" containerID="3bbc6b6369d90f8cb26a6a3de9c85e476bf9c5cd3839e0c3b5fa8cdf99eec3e2" exitCode=0
Jul 07 13:59:34.262457 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:34.261450    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6b9sv" event={"ID":"282d2c99-4c08-4f51-9625-89428d9d7ccb","Type":"ContainerDied","Data":"3bbc6b6369d90f8cb26a6a3de9c85e476bf9c5cd3839e0c3b5fa8cdf99eec3e2"}
Jul 07 13:59:34.265659 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:34.265480    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mlpj4" event={"ID":"463c4567-970d-458f-bde5-4897ed3ca45c","Type":"ContainerStarted","Data":"f25c81f624a178ae504e211eaaac54d8c9e0fcc3238058bd4c27c42e97e3f0c9"}
Jul 07 13:59:34.275963 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:34.274817    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-bglbr" event={"ID":"d36dada3-7ddc-4de9-a1d5-62ff1f867dd9","Type":"ContainerStarted","Data":"fd3eb27f1b87804c6735be9946b959af70d0610ba3cf9c6bbd6ab204d47205f5"}
Jul 07 13:59:34.285180 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:34.285145    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-2r2k8" event={"ID":"02ae2607-7b1c-4fcf-9528-5379c3534073","Type":"ContainerStarted","Data":"8f2e48a78227fa16bfed3b408557963596194259ec5ff97c7d6239abd61adce7"}
Jul 07 13:59:34.289428 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:34.289360    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-887km" event={"ID":"fe2e0f1e-e3ad-4c6c-bdde-61135493ef8b","Type":"ContainerStarted","Data":"e1ce216d5232fb36fd30e65666ef7d3fe962d5e4d8427e364c4a2583c466b3a1"}
Jul 07 13:59:34.293662 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:34.293631    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-qtl92" event={"ID":"c932b4f6-5a4a-45f4-aa12-03bc4845857d","Type":"ContainerStarted","Data":"1eb300254647762a022d9d6d250343a951c895ac4d1c0545a335f986e5c52288"}
Jul 07 13:59:34.860601 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:34.859407    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b1219f1-d3d3-4533-8b55-546c7c1a4bc6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-fr2kp\" (UID: \"8b1219f1-d3d3-4533-8b55-546c7c1a4bc6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fr2kp"
Jul 07 13:59:34.860601 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:34.859692    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-registry-tls\") pod \"image-registry-7f89f8bd56-rpsql\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") " pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 13:59:34.860601 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:34.859724    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de7dff6f-6402-4f2a-b8fc-a93a6af0819d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-rb7b4\" (UID: \"de7dff6f-6402-4f2a-b8fc-a93a6af0819d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rb7b4"
Jul 07 13:59:34.860601 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:34.859890    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 13:59:34.860601 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:34.859970    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de7dff6f-6402-4f2a-b8fc-a93a6af0819d-samples-operator-tls podName:de7dff6f-6402-4f2a-b8fc-a93a6af0819d nodeName:}" failed. No retries permitted until 2026-07-07 13:59:38.859934109 +0000 UTC m=+44.472213061 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/de7dff6f-6402-4f2a-b8fc-a93a6af0819d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-rb7b4" (UID: "de7dff6f-6402-4f2a-b8fc-a93a6af0819d") : secret "samples-operator-tls" not found
Jul 07 13:59:34.860601 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:34.860242    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 13:59:34.860601 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:34.860258    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f89f8bd56-rpsql: secret "image-registry-tls" not found
Jul 07 13:59:34.860601 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:34.860307    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-registry-tls podName:722f8cec-0fcc-4d5d-992b-baf7533b6a04 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:38.860291086 +0000 UTC m=+44.472570050 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-registry-tls") pod "image-registry-7f89f8bd56-rpsql" (UID: "722f8cec-0fcc-4d5d-992b-baf7533b6a04") : secret "image-registry-tls" not found
Jul 07 13:59:34.860601 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:34.860362    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 13:59:34.860601 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:34.860433    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b1219f1-d3d3-4533-8b55-546c7c1a4bc6-cluster-monitoring-operator-tls podName:8b1219f1-d3d3-4533-8b55-546c7c1a4bc6 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:38.860414702 +0000 UTC m=+44.472693667 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8b1219f1-d3d3-4533-8b55-546c7c1a4bc6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-fr2kp" (UID: "8b1219f1-d3d3-4533-8b55-546c7c1a4bc6") : secret "cluster-monitoring-operator-tls" not found
Jul 07 13:59:34.961497 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:34.960492    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23a16488-280d-46f3-a2f6-8e5441851c9f-service-ca-bundle\") pod \"router-default-6b78666d57-trzqd\" (UID: \"23a16488-280d-46f3-a2f6-8e5441851c9f\") " pod="openshift-ingress/router-default-6b78666d57-trzqd"
Jul 07 13:59:34.961497 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:34.960563    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f87880be-2cb0-4728-b0e4-7f9dfe55d961-metrics-tls\") pod \"dns-default-f76h8\" (UID: \"f87880be-2cb0-4728-b0e4-7f9dfe55d961\") " pod="openshift-dns/dns-default-f76h8"
Jul 07 13:59:34.961497 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:34.960664    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23a16488-280d-46f3-a2f6-8e5441851c9f-metrics-certs\") pod \"router-default-6b78666d57-trzqd\" (UID: \"23a16488-280d-46f3-a2f6-8e5441851c9f\") " pod="openshift-ingress/router-default-6b78666d57-trzqd"
Jul 07 13:59:34.961497 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:34.960811    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 13:59:34.961497 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:34.960874    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23a16488-280d-46f3-a2f6-8e5441851c9f-metrics-certs podName:23a16488-280d-46f3-a2f6-8e5441851c9f nodeName:}" failed. No retries permitted until 2026-07-07 13:59:38.960855705 +0000 UTC m=+44.573134663 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23a16488-280d-46f3-a2f6-8e5441851c9f-metrics-certs") pod "router-default-6b78666d57-trzqd" (UID: "23a16488-280d-46f3-a2f6-8e5441851c9f") : secret "router-metrics-certs-default" not found
Jul 07 13:59:34.961497 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:34.961332    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23a16488-280d-46f3-a2f6-8e5441851c9f-service-ca-bundle podName:23a16488-280d-46f3-a2f6-8e5441851c9f nodeName:}" failed. No retries permitted until 2026-07-07 13:59:38.961315084 +0000 UTC m=+44.573594059 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/23a16488-280d-46f3-a2f6-8e5441851c9f-service-ca-bundle") pod "router-default-6b78666d57-trzqd" (UID: "23a16488-280d-46f3-a2f6-8e5441851c9f") : configmap references non-existent config key: service-ca.crt
Jul 07 13:59:34.961497 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:34.961422    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 13:59:34.961497 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:34.961456    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f87880be-2cb0-4728-b0e4-7f9dfe55d961-metrics-tls podName:f87880be-2cb0-4728-b0e4-7f9dfe55d961 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:38.961444277 +0000 UTC m=+44.573723239 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f87880be-2cb0-4728-b0e4-7f9dfe55d961-metrics-tls") pod "dns-default-f76h8" (UID: "f87880be-2cb0-4728-b0e4-7f9dfe55d961") : secret "dns-default-metrics-tls" not found
Jul 07 13:59:35.312960 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:35.312863    2576 generic.go:356] "Generic (PLEG): container finished" podID="282d2c99-4c08-4f51-9625-89428d9d7ccb" containerID="ef6f586561c3f42be6b2885bfe4cb341a86c45528a362be4e43a549c71c7e941" exitCode=0
Jul 07 13:59:35.313631 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:35.313013    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6b9sv" event={"ID":"282d2c99-4c08-4f51-9625-89428d9d7ccb","Type":"ContainerDied","Data":"ef6f586561c3f42be6b2885bfe4cb341a86c45528a362be4e43a549c71c7e941"}
Jul 07 13:59:35.318626 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:35.317554    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tlhfh" event={"ID":"a259d7f0-7c5d-44f1-b288-4f9460eda3d7","Type":"ContainerStarted","Data":"849966ebfce28953a5921b26c195829283e02bcd4181038555aeda730b711ac4"}
Jul 07 13:59:35.482215 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:35.482169    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:35.584422 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:35.584329    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:35.840987 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:35.840865    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:35.911933 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:35.911831    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:36.330317 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:36.330273    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6b9sv" event={"ID":"282d2c99-4c08-4f51-9625-89428d9d7ccb","Type":"ContainerStarted","Data":"9e3b90d0335ef92b85598ac1745cab07b61e7036f8bff90e37f9def6451ccc14"}
Jul 07 13:59:36.356253 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:36.356184    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6b9sv" podStartSLOduration=11.241327819 podStartE2EDuration="40.356163993s" totalImagesPullingTime="29.114836174s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:58:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:36.354609364 +0000 UTC m=+41.966888331" watchObservedRunningTime="2026-07-07 13:59:36.356163993 +0000 UTC m=+41.968442966"
Jul 07 13:59:36.357227 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:36.357190    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-tlhfh" podStartSLOduration=25.651022439 podStartE2EDuration="27.357177109s" totalImagesPullingTime="1.70615467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:59:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:35.364829512 +0000 UTC m=+40.977108486" watchObservedRunningTime="2026-07-07 13:59:36.357177109 +0000 UTC m=+41.969456083"
Jul 07 13:59:36.575761 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:36.575721    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:36.638698 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:36.638618    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:38.461386 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:38.461271    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:38.520544 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:38.520492    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:38.899305 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:38.899231    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b1219f1-d3d3-4533-8b55-546c7c1a4bc6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-fr2kp\" (UID: \"8b1219f1-d3d3-4533-8b55-546c7c1a4bc6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fr2kp"
Jul 07 13:59:38.899305 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:38.899293    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-registry-tls\") pod \"image-registry-7f89f8bd56-rpsql\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") " pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 13:59:38.899472 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:38.899311    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de7dff6f-6402-4f2a-b8fc-a93a6af0819d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-rb7b4\" (UID: \"de7dff6f-6402-4f2a-b8fc-a93a6af0819d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rb7b4"
Jul 07 13:59:38.899472 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:38.899381    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 13:59:38.899472 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:38.899441    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 13:59:38.899472 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:38.899449    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b1219f1-d3d3-4533-8b55-546c7c1a4bc6-cluster-monitoring-operator-tls podName:8b1219f1-d3d3-4533-8b55-546c7c1a4bc6 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:46.899434144 +0000 UTC m=+52.511713093 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8b1219f1-d3d3-4533-8b55-546c7c1a4bc6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-fr2kp" (UID: "8b1219f1-d3d3-4533-8b55-546c7c1a4bc6") : secret "cluster-monitoring-operator-tls" not found
Jul 07 13:59:38.899593 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:38.899483    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de7dff6f-6402-4f2a-b8fc-a93a6af0819d-samples-operator-tls podName:de7dff6f-6402-4f2a-b8fc-a93a6af0819d nodeName:}" failed. No retries permitted until 2026-07-07 13:59:46.89947176 +0000 UTC m=+52.511750710 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/de7dff6f-6402-4f2a-b8fc-a93a6af0819d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-rb7b4" (UID: "de7dff6f-6402-4f2a-b8fc-a93a6af0819d") : secret "samples-operator-tls" not found
Jul 07 13:59:38.899593 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:38.899442    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 13:59:38.899593 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:38.899500    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f89f8bd56-rpsql: secret "image-registry-tls" not found
Jul 07 13:59:38.899593 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:38.899538    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-registry-tls podName:722f8cec-0fcc-4d5d-992b-baf7533b6a04 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:46.899527468 +0000 UTC m=+52.511806435 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-registry-tls") pod "image-registry-7f89f8bd56-rpsql" (UID: "722f8cec-0fcc-4d5d-992b-baf7533b6a04") : secret "image-registry-tls" not found
Jul 07 13:59:38.999730 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:38.999693    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23a16488-280d-46f3-a2f6-8e5441851c9f-service-ca-bundle\") pod \"router-default-6b78666d57-trzqd\" (UID: \"23a16488-280d-46f3-a2f6-8e5441851c9f\") " pod="openshift-ingress/router-default-6b78666d57-trzqd"
Jul 07 13:59:38.999884 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:38.999744    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f87880be-2cb0-4728-b0e4-7f9dfe55d961-metrics-tls\") pod \"dns-default-f76h8\" (UID: \"f87880be-2cb0-4728-b0e4-7f9dfe55d961\") " pod="openshift-dns/dns-default-f76h8"
Jul 07 13:59:38.999884 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:38.999798    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23a16488-280d-46f3-a2f6-8e5441851c9f-metrics-certs\") pod \"router-default-6b78666d57-trzqd\" (UID: \"23a16488-280d-46f3-a2f6-8e5441851c9f\") " pod="openshift-ingress/router-default-6b78666d57-trzqd"
Jul 07 13:59:38.999884 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:38.999852    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23a16488-280d-46f3-a2f6-8e5441851c9f-service-ca-bundle podName:23a16488-280d-46f3-a2f6-8e5441851c9f nodeName:}" failed. No retries permitted until 2026-07-07 13:59:46.999834606 +0000 UTC m=+52.612113573 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/23a16488-280d-46f3-a2f6-8e5441851c9f-service-ca-bundle") pod "router-default-6b78666d57-trzqd" (UID: "23a16488-280d-46f3-a2f6-8e5441851c9f") : configmap references non-existent config key: service-ca.crt
Jul 07 13:59:39.000035 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:38.999917    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 13:59:39.000035 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:38.999992    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f87880be-2cb0-4728-b0e4-7f9dfe55d961-metrics-tls podName:f87880be-2cb0-4728-b0e4-7f9dfe55d961 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:46.99996874 +0000 UTC m=+52.612247694 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f87880be-2cb0-4728-b0e4-7f9dfe55d961-metrics-tls") pod "dns-default-f76h8" (UID: "f87880be-2cb0-4728-b0e4-7f9dfe55d961") : secret "dns-default-metrics-tls" not found
Jul 07 13:59:39.000035 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:38.999917    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 13:59:39.000148 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:39.000056    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23a16488-280d-46f3-a2f6-8e5441851c9f-metrics-certs podName:23a16488-280d-46f3-a2f6-8e5441851c9f nodeName:}" failed. No retries permitted until 2026-07-07 13:59:47.000039161 +0000 UTC m=+52.612318133 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23a16488-280d-46f3-a2f6-8e5441851c9f-metrics-certs") pod "router-default-6b78666d57-trzqd" (UID: "23a16488-280d-46f3-a2f6-8e5441851c9f") : secret "router-metrics-certs-default" not found
Jul 07 13:59:40.018201 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:40.018143    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-gt28z"]
Jul 07 13:59:40.050297 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:40.050269    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-gt28z"]
Jul 07 13:59:40.050457 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:40.050386    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-gt28z"
Jul 07 13:59:40.053153 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:40.053101    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 07 13:59:40.053153 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:40.053116    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 07 13:59:40.053350 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:40.053191    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hsls7\""
Jul 07 13:59:40.108987 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:40.108950    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/631e19ce-68c5-4c57-aa07-0a81e2c7f5f4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-gt28z\" (UID: \"631e19ce-68c5-4c57-aa07-0a81e2c7f5f4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-gt28z"
Jul 07 13:59:40.109132 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:40.109050    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/631e19ce-68c5-4c57-aa07-0a81e2c7f5f4-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-gt28z\" (UID: \"631e19ce-68c5-4c57-aa07-0a81e2c7f5f4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-gt28z"
Jul 07 13:59:40.209169 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:40.209122    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:40.209620 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:40.209599    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/631e19ce-68c5-4c57-aa07-0a81e2c7f5f4-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-gt28z\" (UID: \"631e19ce-68c5-4c57-aa07-0a81e2c7f5f4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-gt28z"
Jul 07 13:59:40.209876 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:40.209843    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/631e19ce-68c5-4c57-aa07-0a81e2c7f5f4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-gt28z\" (UID: \"631e19ce-68c5-4c57-aa07-0a81e2c7f5f4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-gt28z"
Jul 07 13:59:40.210046 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:40.210017    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 13:59:40.210126 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:40.210088    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/631e19ce-68c5-4c57-aa07-0a81e2c7f5f4-networking-console-plugin-cert podName:631e19ce-68c5-4c57-aa07-0a81e2c7f5f4 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:40.71007047 +0000 UTC m=+46.322349434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/631e19ce-68c5-4c57-aa07-0a81e2c7f5f4-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-gt28z" (UID: "631e19ce-68c5-4c57-aa07-0a81e2c7f5f4") : secret "networking-console-plugin-cert" not found
Jul 07 13:59:40.210467 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:40.210449    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/631e19ce-68c5-4c57-aa07-0a81e2c7f5f4-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-gt28z\" (UID: \"631e19ce-68c5-4c57-aa07-0a81e2c7f5f4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-gt28z"
Jul 07 13:59:40.309464 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:40.309342    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:40.714664 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:40.714628    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/631e19ce-68c5-4c57-aa07-0a81e2c7f5f4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-gt28z\" (UID: \"631e19ce-68c5-4c57-aa07-0a81e2c7f5f4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-gt28z"
Jul 07 13:59:40.714838 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:40.714810    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 13:59:40.714891 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:40.714880    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/631e19ce-68c5-4c57-aa07-0a81e2c7f5f4-networking-console-plugin-cert podName:631e19ce-68c5-4c57-aa07-0a81e2c7f5f4 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:41.714864085 +0000 UTC m=+47.327143034 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/631e19ce-68c5-4c57-aa07-0a81e2c7f5f4-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-gt28z" (UID: "631e19ce-68c5-4c57-aa07-0a81e2c7f5f4") : secret "networking-console-plugin-cert" not found
Jul 07 13:59:41.347563 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:41.347407    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mlpj4" event={"ID":"463c4567-970d-458f-bde5-4897ed3ca45c","Type":"ContainerStarted","Data":"32c19fbda811a41e617ee0ff9dcd3bc80d25aa234aa855a28744b721773fcdce"}
Jul 07 13:59:41.351068 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:41.349844    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-bglbr" event={"ID":"d36dada3-7ddc-4de9-a1d5-62ff1f867dd9","Type":"ContainerStarted","Data":"0188cd44a24aa8edab17ec676aa56e4183695502696c2d0ced5a967af3d3c1bb"}
Jul 07 13:59:41.351068 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:41.350598    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-bglbr"
Jul 07 13:59:41.352196 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:41.351960    2576 patch_prober.go:28] interesting pod/console-operator-68b757fb67-bglbr container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.11:8443/readyz\": dial tcp 10.132.0.11:8443: connect: connection refused" start-of-body=
Jul 07 13:59:41.352196 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:41.352024    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-68b757fb67-bglbr" podUID="d36dada3-7ddc-4de9-a1d5-62ff1f867dd9" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.11:8443/readyz\": dial tcp 10.132.0.11:8443: connect: connection refused"
Jul 07 13:59:41.352703 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:41.352655    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-2r2k8" event={"ID":"02ae2607-7b1c-4fcf-9528-5379c3534073","Type":"ContainerStarted","Data":"9e19d1bdc6c405a217da28e840fd677f1490864922de272703c0b2b3c8d17038"}
Jul 07 13:59:41.354976 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:41.354571    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-887km" event={"ID":"fe2e0f1e-e3ad-4c6c-bdde-61135493ef8b","Type":"ContainerStarted","Data":"373a053353aad7a470e10b68982d40a4a47b127c9495968d5f1c182608fb2276"}
Jul 07 13:59:41.357462 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:41.356756    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-qtl92" event={"ID":"c932b4f6-5a4a-45f4-aa12-03bc4845857d","Type":"ContainerStarted","Data":"ca11ef881b109e509370a6b9179a3912601ca3e2b2fd33325b7613a4614f499c"}
Jul 07 13:59:41.359353 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:41.359331    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-76dfd" event={"ID":"449662d7-d129-4774-bc10-7b32dc658f15","Type":"ContainerStarted","Data":"e689e2d525fbce0153e08dcaa66f2a740e28436d8431176929251720ec5f8a81"}
Jul 07 13:59:41.366529 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:41.366128    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-mlpj4" podStartSLOduration=20.728984668 podStartE2EDuration="28.366111637s" totalImagesPullingTime="7.637126969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:41.364638474 +0000 UTC m=+46.976917447" watchObservedRunningTime="2026-07-07 13:59:41.366111637 +0000 UTC m=+46.978390611"
Jul 07 13:59:41.401314 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:41.400271    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-2r2k8" podStartSLOduration=19.772715091 podStartE2EDuration="27.400249657s" totalImagesPullingTime="7.627534566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:59:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:41.381406031 +0000 UTC m=+46.993685004" watchObservedRunningTime="2026-07-07 13:59:41.400249657 +0000 UTC m=+47.012528631"
Jul 07 13:59:41.401314 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:41.400833    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-76dfd" podStartSLOduration=21.77387971 podStartE2EDuration="29.400825563s" totalImagesPullingTime="7.626945853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:59:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:41.399370232 +0000 UTC m=+47.011649203" watchObservedRunningTime="2026-07-07 13:59:41.400825563 +0000 UTC m=+47.013104536"
Jul 07 13:59:41.419758 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:41.419651    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-qtl92" podStartSLOduration=24.781582736 podStartE2EDuration="32.419632164s" totalImagesPullingTime="7.638049428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:59:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:41.418729574 +0000 UTC m=+47.031008549" watchObservedRunningTime="2026-07-07 13:59:41.419632164 +0000 UTC m=+47.031911139"
Jul 07 13:59:41.442726 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:41.442637    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-bglbr" podStartSLOduration=24.814974265 podStartE2EDuration="32.442603181s" totalImagesPullingTime="7.627628916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:59:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:41.441455684 +0000 UTC m=+47.053734660" watchObservedRunningTime="2026-07-07 13:59:41.442603181 +0000 UTC m=+47.054882154"
Jul 07 13:59:41.465248 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:41.465186    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-887km" podStartSLOduration=2.827225714 podStartE2EDuration="10.465166066s" totalImagesPullingTime="7.637940352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:41.464490261 +0000 UTC m=+47.076769238" watchObservedRunningTime="2026-07-07 13:59:41.465166066 +0000 UTC m=+47.077445037"
Jul 07 13:59:41.522327 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:41.522250    2576 patch_prober.go:28] interesting pod/console-operator-68b757fb67-bglbr container/console-operator namespace/openshift-console-operator: Liveness probe status=failure output="Get \"https://10.132.0.11:8443/healthz\": dial tcp 10.132.0.11:8443: connect: connection refused" start-of-body=
Jul 07 13:59:41.522327 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:41.522312    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-console-operator/console-operator-68b757fb67-bglbr" podUID="d36dada3-7ddc-4de9-a1d5-62ff1f867dd9" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.11:8443/healthz\": dial tcp 10.132.0.11:8443: connect: connection refused"
Jul 07 13:59:41.725789 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:41.725753    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/631e19ce-68c5-4c57-aa07-0a81e2c7f5f4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-gt28z\" (UID: \"631e19ce-68c5-4c57-aa07-0a81e2c7f5f4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-gt28z"
Jul 07 13:59:41.726052 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:41.725895    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 13:59:41.726052 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:41.725978    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/631e19ce-68c5-4c57-aa07-0a81e2c7f5f4-networking-console-plugin-cert podName:631e19ce-68c5-4c57-aa07-0a81e2c7f5f4 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:43.725960631 +0000 UTC m=+49.338239601 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/631e19ce-68c5-4c57-aa07-0a81e2c7f5f4-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-gt28z" (UID: "631e19ce-68c5-4c57-aa07-0a81e2c7f5f4") : secret "networking-console-plugin-cert" not found
Jul 07 13:59:42.027412 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:42.027374    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:42.089794 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:42.089748    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:42.342634 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:42.342549    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:42.365366 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:42.365336    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bglbr_d36dada3-7ddc-4de9-a1d5-62ff1f867dd9/console-operator/0.log"
Jul 07 13:59:42.365843 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:42.365393    2576 generic.go:356] "Generic (PLEG): container finished" podID="d36dada3-7ddc-4de9-a1d5-62ff1f867dd9" containerID="0188cd44a24aa8edab17ec676aa56e4183695502696c2d0ced5a967af3d3c1bb" exitCode=255
Jul 07 13:59:42.365843 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:42.365523    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-bglbr" event={"ID":"d36dada3-7ddc-4de9-a1d5-62ff1f867dd9","Type":"ContainerDied","Data":"0188cd44a24aa8edab17ec676aa56e4183695502696c2d0ced5a967af3d3c1bb"}
Jul 07 13:59:42.366287 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:42.366266    2576 scope.go:117] "RemoveContainer" containerID="0188cd44a24aa8edab17ec676aa56e4183695502696c2d0ced5a967af3d3c1bb"
Jul 07 13:59:42.404246 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:42.404216    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:42.629386 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:42.629296    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:42.689014 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:42.688986    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:43.078016 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.077986    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fj8vh"]
Jul 07 13:59:43.111838 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.111811    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fj8vh"]
Jul 07 13:59:43.112023 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.111915    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fj8vh"
Jul 07 13:59:43.114898 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.114874    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 13:59:43.115206 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.115191    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 13:59:43.115333 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.115316    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5hr8l\""
Jul 07 13:59:43.134381 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.134343    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:43.145843 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.145482    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8654fdc-761b-4a1a-964e-4ed6584e9132-data-volume\") pod \"insights-runtime-extractor-fj8vh\" (UID: \"b8654fdc-761b-4a1a-964e-4ed6584e9132\") " pod="openshift-insights/insights-runtime-extractor-fj8vh"
Jul 07 13:59:43.145843 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.145591    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8654fdc-761b-4a1a-964e-4ed6584e9132-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fj8vh\" (UID: \"b8654fdc-761b-4a1a-964e-4ed6584e9132\") " pod="openshift-insights/insights-runtime-extractor-fj8vh"
Jul 07 13:59:43.145843 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.145618    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hfxx\" (UniqueName: \"kubernetes.io/projected/b8654fdc-761b-4a1a-964e-4ed6584e9132-kube-api-access-4hfxx\") pod \"insights-runtime-extractor-fj8vh\" (UID: \"b8654fdc-761b-4a1a-964e-4ed6584e9132\") " pod="openshift-insights/insights-runtime-extractor-fj8vh"
Jul 07 13:59:43.145843 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.145694    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8654fdc-761b-4a1a-964e-4ed6584e9132-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fj8vh\" (UID: \"b8654fdc-761b-4a1a-964e-4ed6584e9132\") " pod="openshift-insights/insights-runtime-extractor-fj8vh"
Jul 07 13:59:43.145843 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.145747    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b8654fdc-761b-4a1a-964e-4ed6584e9132-crio-socket\") pod \"insights-runtime-extractor-fj8vh\" (UID: \"b8654fdc-761b-4a1a-964e-4ed6584e9132\") " pod="openshift-insights/insights-runtime-extractor-fj8vh"
Jul 07 13:59:43.200591 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.200562    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:43.247151 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.247119    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b8654fdc-761b-4a1a-964e-4ed6584e9132-crio-socket\") pod \"insights-runtime-extractor-fj8vh\" (UID: \"b8654fdc-761b-4a1a-964e-4ed6584e9132\") " pod="openshift-insights/insights-runtime-extractor-fj8vh"
Jul 07 13:59:43.247288 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.247177    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8654fdc-761b-4a1a-964e-4ed6584e9132-data-volume\") pod \"insights-runtime-extractor-fj8vh\" (UID: \"b8654fdc-761b-4a1a-964e-4ed6584e9132\") " pod="openshift-insights/insights-runtime-extractor-fj8vh"
Jul 07 13:59:43.247288 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.247256    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8654fdc-761b-4a1a-964e-4ed6584e9132-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fj8vh\" (UID: \"b8654fdc-761b-4a1a-964e-4ed6584e9132\") " pod="openshift-insights/insights-runtime-extractor-fj8vh"
Jul 07 13:59:43.247288 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.247277    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hfxx\" (UniqueName: \"kubernetes.io/projected/b8654fdc-761b-4a1a-964e-4ed6584e9132-kube-api-access-4hfxx\") pod \"insights-runtime-extractor-fj8vh\" (UID: \"b8654fdc-761b-4a1a-964e-4ed6584e9132\") " pod="openshift-insights/insights-runtime-extractor-fj8vh"
Jul 07 13:59:43.247417 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.247310    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b8654fdc-761b-4a1a-964e-4ed6584e9132-crio-socket\") pod \"insights-runtime-extractor-fj8vh\" (UID: \"b8654fdc-761b-4a1a-964e-4ed6584e9132\") " pod="openshift-insights/insights-runtime-extractor-fj8vh"
Jul 07 13:59:43.247417 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.247329    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8654fdc-761b-4a1a-964e-4ed6584e9132-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fj8vh\" (UID: \"b8654fdc-761b-4a1a-964e-4ed6584e9132\") " pod="openshift-insights/insights-runtime-extractor-fj8vh"
Jul 07 13:59:43.247417 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:43.247379    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 13:59:43.247516 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:43.247430    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 13:59:43.247516 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:43.247439    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b8654fdc-761b-4a1a-964e-4ed6584e9132-kube-rbac-proxy-cm podName:b8654fdc-761b-4a1a-964e-4ed6584e9132 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:43.747421394 +0000 UTC m=+49.359700358 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b8654fdc-761b-4a1a-964e-4ed6584e9132-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fj8vh" (UID: "b8654fdc-761b-4a1a-964e-4ed6584e9132") : configmap "kube-rbac-proxy" not found
Jul 07 13:59:43.247516 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.247458    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8654fdc-761b-4a1a-964e-4ed6584e9132-data-volume\") pod \"insights-runtime-extractor-fj8vh\" (UID: \"b8654fdc-761b-4a1a-964e-4ed6584e9132\") " pod="openshift-insights/insights-runtime-extractor-fj8vh"
Jul 07 13:59:43.247516 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:43.247485    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8654fdc-761b-4a1a-964e-4ed6584e9132-insights-runtime-extractor-tls podName:b8654fdc-761b-4a1a-964e-4ed6584e9132 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:43.747474259 +0000 UTC m=+49.359753222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b8654fdc-761b-4a1a-964e-4ed6584e9132-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fj8vh" (UID: "b8654fdc-761b-4a1a-964e-4ed6584e9132") : secret "insights-runtime-extractor-tls" not found
Jul 07 13:59:43.260232 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.260212    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hfxx\" (UniqueName: \"kubernetes.io/projected/b8654fdc-761b-4a1a-964e-4ed6584e9132-kube-api-access-4hfxx\") pod \"insights-runtime-extractor-fj8vh\" (UID: \"b8654fdc-761b-4a1a-964e-4ed6584e9132\") " pod="openshift-insights/insights-runtime-extractor-fj8vh"
Jul 07 13:59:43.336805 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.336721    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-fx5gg"]
Jul 07 13:59:43.366682 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.366654    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-fx5gg"]
Jul 07 13:59:43.367138 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.366734    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fx5gg"
Jul 07 13:59:43.369623 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.369597    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 07 13:59:43.369740 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.369646    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-69qtr\""
Jul 07 13:59:43.370225 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.370205    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 07 13:59:43.370869 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.370852    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bglbr_d36dada3-7ddc-4de9-a1d5-62ff1f867dd9/console-operator/1.log"
Jul 07 13:59:43.371312 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.371299    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bglbr_d36dada3-7ddc-4de9-a1d5-62ff1f867dd9/console-operator/0.log"
Jul 07 13:59:43.371407 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.371334    2576 generic.go:356] "Generic (PLEG): container finished" podID="d36dada3-7ddc-4de9-a1d5-62ff1f867dd9" containerID="06c8fcc76b5145d4ee06dc0c2dbb194521b7215ca3f6a1695b8968ca646cba49" exitCode=255
Jul 07 13:59:43.371407 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.371366    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-bglbr" event={"ID":"d36dada3-7ddc-4de9-a1d5-62ff1f867dd9","Type":"ContainerDied","Data":"06c8fcc76b5145d4ee06dc0c2dbb194521b7215ca3f6a1695b8968ca646cba49"}
Jul 07 13:59:43.371512 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.371417    2576 scope.go:117] "RemoveContainer" containerID="0188cd44a24aa8edab17ec676aa56e4183695502696c2d0ced5a967af3d3c1bb"
Jul 07 13:59:43.371599 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.371582    2576 scope.go:117] "RemoveContainer" containerID="06c8fcc76b5145d4ee06dc0c2dbb194521b7215ca3f6a1695b8968ca646cba49"
Jul 07 13:59:43.371804 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:43.371786    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-bglbr_openshift-console-operator(d36dada3-7ddc-4de9-a1d5-62ff1f867dd9)\"" pod="openshift-console-operator/console-operator-68b757fb67-bglbr" podUID="d36dada3-7ddc-4de9-a1d5-62ff1f867dd9"
Jul 07 13:59:43.385594 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.385573    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:43.449041 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.449002    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:43.449185 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.449165    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnvmm\" (UniqueName: \"kubernetes.io/projected/031cd0e2-51d9-4150-a830-44e06690ff06-kube-api-access-cnvmm\") pod \"migrator-d57d58cc9-fx5gg\" (UID: \"031cd0e2-51d9-4150-a830-44e06690ff06\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fx5gg"
Jul 07 13:59:43.550161 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.550129    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnvmm\" (UniqueName: \"kubernetes.io/projected/031cd0e2-51d9-4150-a830-44e06690ff06-kube-api-access-cnvmm\") pod \"migrator-d57d58cc9-fx5gg\" (UID: \"031cd0e2-51d9-4150-a830-44e06690ff06\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fx5gg"
Jul 07 13:59:43.558811 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.558786    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnvmm\" (UniqueName: \"kubernetes.io/projected/031cd0e2-51d9-4150-a830-44e06690ff06-kube-api-access-cnvmm\") pod \"migrator-d57d58cc9-fx5gg\" (UID: \"031cd0e2-51d9-4150-a830-44e06690ff06\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fx5gg"
Jul 07 13:59:43.677056 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.676981    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fx5gg"
Jul 07 13:59:43.752969 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.752922    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8654fdc-761b-4a1a-964e-4ed6584e9132-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fj8vh\" (UID: \"b8654fdc-761b-4a1a-964e-4ed6584e9132\") " pod="openshift-insights/insights-runtime-extractor-fj8vh"
Jul 07 13:59:43.753135 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.753012    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/631e19ce-68c5-4c57-aa07-0a81e2c7f5f4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-gt28z\" (UID: \"631e19ce-68c5-4c57-aa07-0a81e2c7f5f4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-gt28z"
Jul 07 13:59:43.753135 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:43.753095    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 13:59:43.753221 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:43.753142    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 13:59:43.753221 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:43.753175    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8654fdc-761b-4a1a-964e-4ed6584e9132-insights-runtime-extractor-tls podName:b8654fdc-761b-4a1a-964e-4ed6584e9132 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:44.753154031 +0000 UTC m=+50.365432995 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b8654fdc-761b-4a1a-964e-4ed6584e9132-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fj8vh" (UID: "b8654fdc-761b-4a1a-964e-4ed6584e9132") : secret "insights-runtime-extractor-tls" not found
Jul 07 13:59:43.753604 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:43.753193    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/631e19ce-68c5-4c57-aa07-0a81e2c7f5f4-networking-console-plugin-cert podName:631e19ce-68c5-4c57-aa07-0a81e2c7f5f4 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:47.753181791 +0000 UTC m=+53.365460745 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/631e19ce-68c5-4c57-aa07-0a81e2c7f5f4-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-gt28z" (UID: "631e19ce-68c5-4c57-aa07-0a81e2c7f5f4") : secret "networking-console-plugin-cert" not found
Jul 07 13:59:43.753649 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.753636    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8654fdc-761b-4a1a-964e-4ed6584e9132-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fj8vh\" (UID: \"b8654fdc-761b-4a1a-964e-4ed6584e9132\") " pod="openshift-insights/insights-runtime-extractor-fj8vh"
Jul 07 13:59:43.753753 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:43.753739    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 13:59:43.753800 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:43.753791    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b8654fdc-761b-4a1a-964e-4ed6584e9132-kube-rbac-proxy-cm podName:b8654fdc-761b-4a1a-964e-4ed6584e9132 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:44.753777691 +0000 UTC m=+50.366056654 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b8654fdc-761b-4a1a-964e-4ed6584e9132-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fj8vh" (UID: "b8654fdc-761b-4a1a-964e-4ed6584e9132") : configmap "kube-rbac-proxy" not found
Jul 07 13:59:43.837786 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:43.837749    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-fx5gg"]
Jul 07 13:59:43.840909 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:59:43.840878    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod031cd0e2_51d9_4150_a830_44e06690ff06.slice/crio-7c89c2da543cbef5ac6690bb4ae625668e2db9a9d21d32e9c4b4c19ea754c809 WatchSource:0}: Error finding container 7c89c2da543cbef5ac6690bb4ae625668e2db9a9d21d32e9c4b4c19ea754c809: Status 404 returned error can't find the container with id 7c89c2da543cbef5ac6690bb4ae625668e2db9a9d21d32e9c4b4c19ea754c809
Jul 07 13:59:44.377890 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:44.377862    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bglbr_d36dada3-7ddc-4de9-a1d5-62ff1f867dd9/console-operator/1.log"
Jul 07 13:59:44.378327 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:44.378219    2576 scope.go:117] "RemoveContainer" containerID="06c8fcc76b5145d4ee06dc0c2dbb194521b7215ca3f6a1695b8968ca646cba49"
Jul 07 13:59:44.378418 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:44.378393    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-bglbr_openshift-console-operator(d36dada3-7ddc-4de9-a1d5-62ff1f867dd9)\"" pod="openshift-console-operator/console-operator-68b757fb67-bglbr" podUID="d36dada3-7ddc-4de9-a1d5-62ff1f867dd9"
Jul 07 13:59:44.379097 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:44.379074    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fx5gg" event={"ID":"031cd0e2-51d9-4150-a830-44e06690ff06","Type":"ContainerStarted","Data":"7c89c2da543cbef5ac6690bb4ae625668e2db9a9d21d32e9c4b4c19ea754c809"}
Jul 07 13:59:44.463642 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:44.463617    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zf8wq_634f658b-6022-40f7-9c4c-3c14e6f9c27e/dns-node-resolver/0.log"
Jul 07 13:59:44.695061 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:44.695030    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-nhqtl"]
Jul 07 13:59:44.714480 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:44.714459    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-nhqtl"]
Jul 07 13:59:44.714612 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:44.714546    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-nhqtl"
Jul 07 13:59:44.718049 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:44.718022    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 07 13:59:44.718049 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:44.718025    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 07 13:59:44.718227 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:44.718189    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 07 13:59:44.718310 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:44.718293    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 07 13:59:44.718398 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:44.718366    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-57xhh\""
Jul 07 13:59:44.764349 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:44.764321    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8c2d41d9-6102-4abc-80f5-8a0aff169dcf-signing-key\") pod \"service-ca-758f599c5-nhqtl\" (UID: \"8c2d41d9-6102-4abc-80f5-8a0aff169dcf\") " pod="openshift-service-ca/service-ca-758f599c5-nhqtl"
Jul 07 13:59:44.764489 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:44.764358    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8654fdc-761b-4a1a-964e-4ed6584e9132-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fj8vh\" (UID: \"b8654fdc-761b-4a1a-964e-4ed6584e9132\") " pod="openshift-insights/insights-runtime-extractor-fj8vh"
Jul 07 13:59:44.764489 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:44.764398    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs5f9\" (UniqueName: \"kubernetes.io/projected/8c2d41d9-6102-4abc-80f5-8a0aff169dcf-kube-api-access-hs5f9\") pod \"service-ca-758f599c5-nhqtl\" (UID: \"8c2d41d9-6102-4abc-80f5-8a0aff169dcf\") " pod="openshift-service-ca/service-ca-758f599c5-nhqtl"
Jul 07 13:59:44.764489 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:44.764445    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8c2d41d9-6102-4abc-80f5-8a0aff169dcf-signing-cabundle\") pod \"service-ca-758f599c5-nhqtl\" (UID: \"8c2d41d9-6102-4abc-80f5-8a0aff169dcf\") " pod="openshift-service-ca/service-ca-758f599c5-nhqtl"
Jul 07 13:59:44.764489 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:44.764488    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 13:59:44.764652 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:44.764527    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8654fdc-761b-4a1a-964e-4ed6584e9132-insights-runtime-extractor-tls podName:b8654fdc-761b-4a1a-964e-4ed6584e9132 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:46.764515504 +0000 UTC m=+52.376794455 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b8654fdc-761b-4a1a-964e-4ed6584e9132-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fj8vh" (UID: "b8654fdc-761b-4a1a-964e-4ed6584e9132") : secret "insights-runtime-extractor-tls" not found
Jul 07 13:59:44.764652 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:44.764572    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8654fdc-761b-4a1a-964e-4ed6584e9132-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fj8vh\" (UID: \"b8654fdc-761b-4a1a-964e-4ed6584e9132\") " pod="openshift-insights/insights-runtime-extractor-fj8vh"
Jul 07 13:59:44.764652 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:44.764614    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 13:59:44.764652 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:44.764642    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b8654fdc-761b-4a1a-964e-4ed6584e9132-kube-rbac-proxy-cm podName:b8654fdc-761b-4a1a-964e-4ed6584e9132 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:46.764633888 +0000 UTC m=+52.376912838 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b8654fdc-761b-4a1a-964e-4ed6584e9132-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fj8vh" (UID: "b8654fdc-761b-4a1a-964e-4ed6584e9132") : configmap "kube-rbac-proxy" not found
Jul 07 13:59:44.803369 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:44.803336    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:44.865025 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:44.864992    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8c2d41d9-6102-4abc-80f5-8a0aff169dcf-signing-key\") pod \"service-ca-758f599c5-nhqtl\" (UID: \"8c2d41d9-6102-4abc-80f5-8a0aff169dcf\") " pod="openshift-service-ca/service-ca-758f599c5-nhqtl"
Jul 07 13:59:44.865207 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:44.865055    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs5f9\" (UniqueName: \"kubernetes.io/projected/8c2d41d9-6102-4abc-80f5-8a0aff169dcf-kube-api-access-hs5f9\") pod \"service-ca-758f599c5-nhqtl\" (UID: \"8c2d41d9-6102-4abc-80f5-8a0aff169dcf\") " pod="openshift-service-ca/service-ca-758f599c5-nhqtl"
Jul 07 13:59:44.865207 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:44.865080    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8c2d41d9-6102-4abc-80f5-8a0aff169dcf-signing-cabundle\") pod \"service-ca-758f599c5-nhqtl\" (UID: \"8c2d41d9-6102-4abc-80f5-8a0aff169dcf\") " pod="openshift-service-ca/service-ca-758f599c5-nhqtl"
Jul 07 13:59:44.865689 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:44.865669    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/8c2d41d9-6102-4abc-80f5-8a0aff169dcf-signing-cabundle\") pod \"service-ca-758f599c5-nhqtl\" (UID: \"8c2d41d9-6102-4abc-80f5-8a0aff169dcf\") " pod="openshift-service-ca/service-ca-758f599c5-nhqtl"
Jul 07 13:59:44.867370 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:44.867349    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/8c2d41d9-6102-4abc-80f5-8a0aff169dcf-signing-key\") pod \"service-ca-758f599c5-nhqtl\" (UID: \"8c2d41d9-6102-4abc-80f5-8a0aff169dcf\") " pod="openshift-service-ca/service-ca-758f599c5-nhqtl"
Jul 07 13:59:44.872894 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:44.872876    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs5f9\" (UniqueName: \"kubernetes.io/projected/8c2d41d9-6102-4abc-80f5-8a0aff169dcf-kube-api-access-hs5f9\") pod \"service-ca-758f599c5-nhqtl\" (UID: \"8c2d41d9-6102-4abc-80f5-8a0aff169dcf\") " pod="openshift-service-ca/service-ca-758f599c5-nhqtl"
Jul 07 13:59:44.904041 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:44.904005    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:45.023676 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:45.023607    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-nhqtl"
Jul 07 13:59:45.060002 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:45.059977    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-46w5l_bb58a368-1974-4d27-a323-5c6a8024c9ea/node-ca/0.log"
Jul 07 13:59:45.390168 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:45.390144    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-nhqtl"]
Jul 07 13:59:45.492670 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:59:45.492641    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c2d41d9_6102_4abc_80f5_8a0aff169dcf.slice/crio-3879c5f14c065af6ebea0e3a6950af9ed761fc9173f07f1806e3fb6bbfd95b45 WatchSource:0}: Error finding container 3879c5f14c065af6ebea0e3a6950af9ed761fc9173f07f1806e3fb6bbfd95b45: Status 404 returned error can't find the container with id 3879c5f14c065af6ebea0e3a6950af9ed761fc9173f07f1806e3fb6bbfd95b45
Jul 07 13:59:45.784044 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:45.784006    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:45.863545 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:45.863472    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-887km_fe2e0f1e-e3ad-4c6c-bdde-61135493ef8b/serve-healthcheck-canary/0.log"
Jul 07 13:59:46.391326 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:46.391292    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-nhqtl" event={"ID":"8c2d41d9-6102-4abc-80f5-8a0aff169dcf","Type":"ContainerStarted","Data":"0ffc13d0ed4dcf94bdf44721c7496142ac0fda00ce6cbcb1aad50759b3c37b63"}
Jul 07 13:59:46.391796 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:46.391378    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-nhqtl" event={"ID":"8c2d41d9-6102-4abc-80f5-8a0aff169dcf","Type":"ContainerStarted","Data":"3879c5f14c065af6ebea0e3a6950af9ed761fc9173f07f1806e3fb6bbfd95b45"}
Jul 07 13:59:46.392995 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:46.392972    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fx5gg" event={"ID":"031cd0e2-51d9-4150-a830-44e06690ff06","Type":"ContainerStarted","Data":"8d4412caaf2830059aacb3de97eccddfa56d1970c77998381534247232bbb91a"}
Jul 07 13:59:46.393147 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:46.393015    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fx5gg" event={"ID":"031cd0e2-51d9-4150-a830-44e06690ff06","Type":"ContainerStarted","Data":"670e347ba0dcceca24228081440d3ea5944c78269c8e5db24d04df3cf6fab4d5"}
Jul 07 13:59:46.411741 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:46.411697    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-nhqtl" podStartSLOduration=2.411684698 podStartE2EDuration="2.411684698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:59:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:46.410635268 +0000 UTC m=+52.022914251" watchObservedRunningTime="2026-07-07 13:59:46.411684698 +0000 UTC m=+52.023963669"
Jul 07 13:59:46.426633 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:46.426593    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-fx5gg" podStartSLOduration=1.7533985890000001 podStartE2EDuration="3.426581158s" totalImagesPullingTime="1.673182569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:59:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:46.425969947 +0000 UTC m=+52.038248934" watchObservedRunningTime="2026-07-07 13:59:46.426581158 +0000 UTC m=+52.038860172"
Jul 07 13:59:46.783824 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:46.783781    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8654fdc-761b-4a1a-964e-4ed6584e9132-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fj8vh\" (UID: \"b8654fdc-761b-4a1a-964e-4ed6584e9132\") " pod="openshift-insights/insights-runtime-extractor-fj8vh"
Jul 07 13:59:46.784059 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:46.783950    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 13:59:46.784059 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:46.783975    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8654fdc-761b-4a1a-964e-4ed6584e9132-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fj8vh\" (UID: \"b8654fdc-761b-4a1a-964e-4ed6584e9132\") " pod="openshift-insights/insights-runtime-extractor-fj8vh"
Jul 07 13:59:46.784059 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:46.784031    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8654fdc-761b-4a1a-964e-4ed6584e9132-insights-runtime-extractor-tls podName:b8654fdc-761b-4a1a-964e-4ed6584e9132 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:50.784015511 +0000 UTC m=+56.396294461 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b8654fdc-761b-4a1a-964e-4ed6584e9132-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fj8vh" (UID: "b8654fdc-761b-4a1a-964e-4ed6584e9132") : secret "insights-runtime-extractor-tls" not found
Jul 07 13:59:46.784637 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:46.784611    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8654fdc-761b-4a1a-964e-4ed6584e9132-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fj8vh\" (UID: \"b8654fdc-761b-4a1a-964e-4ed6584e9132\") " pod="openshift-insights/insights-runtime-extractor-fj8vh"
Jul 07 13:59:46.830990 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:46.830934    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:46.985595 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:46.985555    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-registry-tls\") pod \"image-registry-7f89f8bd56-rpsql\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") " pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 13:59:46.985595 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:46.985599    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de7dff6f-6402-4f2a-b8fc-a93a6af0819d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-rb7b4\" (UID: \"de7dff6f-6402-4f2a-b8fc-a93a6af0819d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rb7b4"
Jul 07 13:59:46.986148 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:46.985722    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 13:59:46.986148 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:46.985741    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f89f8bd56-rpsql: secret "image-registry-tls" not found
Jul 07 13:59:46.986148 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:46.985814    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-registry-tls podName:722f8cec-0fcc-4d5d-992b-baf7533b6a04 nodeName:}" failed. No retries permitted until 2026-07-07 14:00:02.985795528 +0000 UTC m=+68.598074484 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-registry-tls") pod "image-registry-7f89f8bd56-rpsql" (UID: "722f8cec-0fcc-4d5d-992b-baf7533b6a04") : secret "image-registry-tls" not found
Jul 07 13:59:46.986148 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:46.985833    2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 13:59:46.986148 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:46.985875    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b1219f1-d3d3-4533-8b55-546c7c1a4bc6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-fr2kp\" (UID: \"8b1219f1-d3d3-4533-8b55-546c7c1a4bc6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fr2kp"
Jul 07 13:59:46.986148 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:46.985913    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de7dff6f-6402-4f2a-b8fc-a93a6af0819d-samples-operator-tls podName:de7dff6f-6402-4f2a-b8fc-a93a6af0819d nodeName:}" failed. No retries permitted until 2026-07-07 14:00:02.985895909 +0000 UTC m=+68.598174890 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/de7dff6f-6402-4f2a-b8fc-a93a6af0819d-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-rb7b4" (UID: "de7dff6f-6402-4f2a-b8fc-a93a6af0819d") : secret "samples-operator-tls" not found
Jul 07 13:59:46.986148 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:46.985989    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 13:59:46.986148 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:46.986048    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b1219f1-d3d3-4533-8b55-546c7c1a4bc6-cluster-monitoring-operator-tls podName:8b1219f1-d3d3-4533-8b55-546c7c1a4bc6 nodeName:}" failed. No retries permitted until 2026-07-07 14:00:02.986034405 +0000 UTC m=+68.598313369 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8b1219f1-d3d3-4533-8b55-546c7c1a4bc6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-fr2kp" (UID: "8b1219f1-d3d3-4533-8b55-546c7c1a4bc6") : secret "cluster-monitoring-operator-tls" not found
Jul 07 13:59:47.086904 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:47.086779    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23a16488-280d-46f3-a2f6-8e5441851c9f-metrics-certs\") pod \"router-default-6b78666d57-trzqd\" (UID: \"23a16488-280d-46f3-a2f6-8e5441851c9f\") " pod="openshift-ingress/router-default-6b78666d57-trzqd"
Jul 07 13:59:47.087107 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:47.087006    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 13:59:47.087107 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:47.087069    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23a16488-280d-46f3-a2f6-8e5441851c9f-metrics-certs podName:23a16488-280d-46f3-a2f6-8e5441851c9f nodeName:}" failed. No retries permitted until 2026-07-07 14:00:03.087052398 +0000 UTC m=+68.699331362 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23a16488-280d-46f3-a2f6-8e5441851c9f-metrics-certs") pod "router-default-6b78666d57-trzqd" (UID: "23a16488-280d-46f3-a2f6-8e5441851c9f") : secret "router-metrics-certs-default" not found
Jul 07 13:59:47.087236 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:47.087119    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23a16488-280d-46f3-a2f6-8e5441851c9f-service-ca-bundle\") pod \"router-default-6b78666d57-trzqd\" (UID: \"23a16488-280d-46f3-a2f6-8e5441851c9f\") " pod="openshift-ingress/router-default-6b78666d57-trzqd"
Jul 07 13:59:47.087236 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:47.087187    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f87880be-2cb0-4728-b0e4-7f9dfe55d961-metrics-tls\") pod \"dns-default-f76h8\" (UID: \"f87880be-2cb0-4728-b0e4-7f9dfe55d961\") " pod="openshift-dns/dns-default-f76h8"
Jul 07 13:59:47.087339 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:47.087306    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 13:59:47.087389 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:47.087345    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f87880be-2cb0-4728-b0e4-7f9dfe55d961-metrics-tls podName:f87880be-2cb0-4728-b0e4-7f9dfe55d961 nodeName:}" failed. No retries permitted until 2026-07-07 14:00:03.087331357 +0000 UTC m=+68.699610321 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f87880be-2cb0-4728-b0e4-7f9dfe55d961-metrics-tls") pod "dns-default-f76h8" (UID: "f87880be-2cb0-4728-b0e4-7f9dfe55d961") : secret "dns-default-metrics-tls" not found
Jul 07 13:59:47.087597 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:47.087563    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23a16488-280d-46f3-a2f6-8e5441851c9f-service-ca-bundle podName:23a16488-280d-46f3-a2f6-8e5441851c9f nodeName:}" failed. No retries permitted until 2026-07-07 14:00:03.087548219 +0000 UTC m=+68.699827186 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/23a16488-280d-46f3-a2f6-8e5441851c9f-service-ca-bundle") pod "router-default-6b78666d57-trzqd" (UID: "23a16488-280d-46f3-a2f6-8e5441851c9f") : configmap references non-existent config key: service-ca.crt
Jul 07 13:59:47.088144 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:47.088120    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:47.185281 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:47.185226    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:47.367298 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:47.367202    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:47.429795 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:47.429763    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:47.593922 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:47.593883    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:47.768519 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:47.768482    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:47.794900 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:47.794866    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/631e19ce-68c5-4c57-aa07-0a81e2c7f5f4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-gt28z\" (UID: \"631e19ce-68c5-4c57-aa07-0a81e2c7f5f4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-gt28z"
Jul 07 13:59:47.795031 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:47.795013    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 13:59:47.795084 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:47.795073    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/631e19ce-68c5-4c57-aa07-0a81e2c7f5f4-networking-console-plugin-cert podName:631e19ce-68c5-4c57-aa07-0a81e2c7f5f4 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:55.795058265 +0000 UTC m=+61.407337216 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/631e19ce-68c5-4c57-aa07-0a81e2c7f5f4-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-gt28z" (UID: "631e19ce-68c5-4c57-aa07-0a81e2c7f5f4") : secret "networking-console-plugin-cert" not found
Jul 07 13:59:48.976704 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:48.976672    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:49.166193 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:49.166157    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:49.268021 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:49.267934    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:49.381196 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:49.381169    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:49.591288 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:49.591199    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:49.777923 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:49.777880    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:50.764366 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:50.764334    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:50.820104 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:50.820066    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8654fdc-761b-4a1a-964e-4ed6584e9132-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fj8vh\" (UID: \"b8654fdc-761b-4a1a-964e-4ed6584e9132\") " pod="openshift-insights/insights-runtime-extractor-fj8vh"
Jul 07 13:59:50.820305 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:50.820233    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 13:59:50.820368 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:50.820310    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8654fdc-761b-4a1a-964e-4ed6584e9132-insights-runtime-extractor-tls podName:b8654fdc-761b-4a1a-964e-4ed6584e9132 nodeName:}" failed. No retries permitted until 2026-07-07 13:59:58.820290276 +0000 UTC m=+64.432569242 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b8654fdc-761b-4a1a-964e-4ed6584e9132-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fj8vh" (UID: "b8654fdc-761b-4a1a-964e-4ed6584e9132") : secret "insights-runtime-extractor-tls" not found
Jul 07 13:59:50.866777 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:50.866743    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:51.182580 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:51.182498    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:51.351195 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:51.351161    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-bglbr"
Jul 07 13:59:51.351575 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:51.351562    2576 scope.go:117] "RemoveContainer" containerID="06c8fcc76b5145d4ee06dc0c2dbb194521b7215ca3f6a1695b8968ca646cba49"
Jul 07 13:59:51.351734 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:51.351716    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-bglbr_openshift-console-operator(d36dada3-7ddc-4de9-a1d5-62ff1f867dd9)\"" pod="openshift-console-operator/console-operator-68b757fb67-bglbr" podUID="d36dada3-7ddc-4de9-a1d5-62ff1f867dd9"
Jul 07 13:59:51.392641 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:51.392608    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:51.522194 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:51.522163    2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-bglbr"
Jul 07 13:59:51.522553 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:51.522540    2576 scope.go:117] "RemoveContainer" containerID="06c8fcc76b5145d4ee06dc0c2dbb194521b7215ca3f6a1695b8968ca646cba49"
Jul 07 13:59:51.522743 ip-10-0-140-192 kubenswrapper[2576]: E0707 13:59:51.522722    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-bglbr_openshift-console-operator(d36dada3-7ddc-4de9-a1d5-62ff1f867dd9)\"" pod="openshift-console-operator/console-operator-68b757fb67-bglbr" podUID="d36dada3-7ddc-4de9-a1d5-62ff1f867dd9"
Jul 07 13:59:51.587802 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:51.587754    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:51.650314 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:51.650283    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:51.970261 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:51.970230    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:52.370133 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:52.370056    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:53.032834 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:53.032797    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:53.384193 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:53.384099    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:53.566589 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:53.566559    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:53.775317 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:53.775278    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:53.963173 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:53.963141    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:54.374527 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:54.374495    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:54.978855 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:54.978822    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:55.221710 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:55.221687    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zdfvw"
Jul 07 13:59:55.369517 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:55.369428    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:55.568977 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:55.568924    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:55.865055 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:55.865020    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/631e19ce-68c5-4c57-aa07-0a81e2c7f5f4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-gt28z\" (UID: \"631e19ce-68c5-4c57-aa07-0a81e2c7f5f4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-gt28z"
Jul 07 13:59:55.867566 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:55.867531    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/631e19ce-68c5-4c57-aa07-0a81e2c7f5f4-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-gt28z\" (UID: \"631e19ce-68c5-4c57-aa07-0a81e2c7f5f4\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-gt28z"
Jul 07 13:59:55.964099 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:55.964067    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hsls7\""
Jul 07 13:59:55.969846 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:55.969817    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:55.971526 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:55.971510    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-gt28z"
Jul 07 13:59:56.117596 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:56.117572    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-gt28z"]
Jul 07 13:59:56.120473 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:59:56.120448    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod631e19ce_68c5_4c57_aa07_0a81e2c7f5f4.slice/crio-2376056e07c95fc3b8f3c13d89325abba6701f2120578a8abc7402a76bd9be82 WatchSource:0}: Error finding container 2376056e07c95fc3b8f3c13d89325abba6701f2120578a8abc7402a76bd9be82: Status 404 returned error can't find the container with id 2376056e07c95fc3b8f3c13d89325abba6701f2120578a8abc7402a76bd9be82
Jul 07 13:59:56.431246 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:56.431164    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-gt28z" event={"ID":"631e19ce-68c5-4c57-aa07-0a81e2c7f5f4","Type":"ContainerStarted","Data":"2376056e07c95fc3b8f3c13d89325abba6701f2120578a8abc7402a76bd9be82"}
Jul 07 13:59:56.582013 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:56.581980    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:56.975763 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:56.975728    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:57.075636 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:57.075604    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:57.176237 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:57.176207    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:57.277415 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:57.277248    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:57.576180 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:57.576107    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:57.777322 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:57.777293    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 13:59:58.439399 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:58.439364    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-gt28z" event={"ID":"631e19ce-68c5-4c57-aa07-0a81e2c7f5f4","Type":"ContainerStarted","Data":"219a07031eb0b20077c9c790354987f38c9155e044d10d9e5aaca0a1abaa671a"}
Jul 07 13:59:58.460155 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:58.457718    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-gt28z" podStartSLOduration=16.948482629 podStartE2EDuration="18.457692392s" totalImagesPullingTime="1.509209763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:59:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 13:59:58.455314804 +0000 UTC m=+64.067593774" watchObservedRunningTime="2026-07-07 13:59:58.457692392 +0000 UTC m=+64.069971364"
Jul 07 13:59:58.891733 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:58.891650    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8654fdc-761b-4a1a-964e-4ed6584e9132-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fj8vh\" (UID: \"b8654fdc-761b-4a1a-964e-4ed6584e9132\") " pod="openshift-insights/insights-runtime-extractor-fj8vh"
Jul 07 13:59:58.893912 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:58.893882    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8654fdc-761b-4a1a-964e-4ed6584e9132-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fj8vh\" (UID: \"b8654fdc-761b-4a1a-964e-4ed6584e9132\") " pod="openshift-insights/insights-runtime-extractor-fj8vh"
Jul 07 13:59:59.023534 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:59.023502    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5hr8l\""
Jul 07 13:59:59.030824 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:59.030806    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fj8vh"
Jul 07 13:59:59.182026 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:59.181999    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fj8vh"]
Jul 07 13:59:59.184673 ip-10-0-140-192 kubenswrapper[2576]: W0707 13:59:59.184648    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8654fdc_761b_4a1a_964e_4ed6584e9132.slice/crio-044bf6382d3b1ce4db99a52e4573f5f902a39eaf334316a73e1ee632533525e4 WatchSource:0}: Error finding container 044bf6382d3b1ce4db99a52e4573f5f902a39eaf334316a73e1ee632533525e4: Status 404 returned error can't find the container with id 044bf6382d3b1ce4db99a52e4573f5f902a39eaf334316a73e1ee632533525e4
Jul 07 13:59:59.443913 ip-10-0-140-192 kubenswrapper[2576]: I0707 13:59:59.443881    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fj8vh" event={"ID":"b8654fdc-761b-4a1a-964e-4ed6584e9132","Type":"ContainerStarted","Data":"044bf6382d3b1ce4db99a52e4573f5f902a39eaf334316a73e1ee632533525e4"}
Jul 07 14:00:00.616087 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:00.616047    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea-metrics-certs\") pod \"network-metrics-daemon-qg8cp\" (UID: \"767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea\") " pod="openshift-multus/network-metrics-daemon-qg8cp"
Jul 07 14:00:00.616560 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:00.616167    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57cf19e7-ca31-4cc2-bb09-5ca82de4355b-original-pull-secret\") pod \"global-pull-secret-syncer-jcfdk\" (UID: \"57cf19e7-ca31-4cc2-bb09-5ca82de4355b\") " pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 14:00:00.619157 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:00.619127    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 14:00:00.619299 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:00.619216    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 14:00:00.628995 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:00.628968    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea-metrics-certs\") pod \"network-metrics-daemon-qg8cp\" (UID: \"767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea\") " pod="openshift-multus/network-metrics-daemon-qg8cp"
Jul 07 14:00:00.629101 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:00.628973    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/57cf19e7-ca31-4cc2-bb09-5ca82de4355b-original-pull-secret\") pod \"global-pull-secret-syncer-jcfdk\" (UID: \"57cf19e7-ca31-4cc2-bb09-5ca82de4355b\") " pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 14:00:00.682064 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:00.682038    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9zznv\""
Jul 07 14:00:00.684156 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:00.684131    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jcfdk"
Jul 07 14:00:00.689276 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:00.689254    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8cp"
Jul 07 14:00:00.717838 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:00.717803    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cq94\" (UniqueName: \"kubernetes.io/projected/6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d-kube-api-access-9cq94\") pod \"network-check-target-ts9k4\" (UID: \"6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d\") " pod="openshift-network-diagnostics/network-check-target-ts9k4"
Jul 07 14:00:00.720373 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:00.720347    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cq94\" (UniqueName: \"kubernetes.io/projected/6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d-kube-api-access-9cq94\") pod \"network-check-target-ts9k4\" (UID: \"6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d\") " pod="openshift-network-diagnostics/network-check-target-ts9k4"
Jul 07 14:00:00.831350 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:00.831243    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jcfdk"]
Jul 07 14:00:00.849368 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:00.849292    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qg8cp"]
Jul 07 14:00:00.883235 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:00.883171    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7rw24\""
Jul 07 14:00:00.890682 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:00.890647    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ts9k4"
Jul 07 14:00:01.979659 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:00:01.979620    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57cf19e7_ca31_4cc2_bb09_5ca82de4355b.slice/crio-b36874f19868af7e97c0871e9ade834cb7f1f9ebeba2520bf868a00222dd0dd3 WatchSource:0}: Error finding container b36874f19868af7e97c0871e9ade834cb7f1f9ebeba2520bf868a00222dd0dd3: Status 404 returned error can't find the container with id b36874f19868af7e97c0871e9ade834cb7f1f9ebeba2520bf868a00222dd0dd3
Jul 07 14:00:01.980415 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:00:01.980242    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod767aa5e7_4a7e_4dd3_92b7_38d66a5fa4ea.slice/crio-ae7a5d1cfd3219233e8f5b7f99f2784653af664556efb1751e3efb597ddda3a0 WatchSource:0}: Error finding container ae7a5d1cfd3219233e8f5b7f99f2784653af664556efb1751e3efb597ddda3a0: Status 404 returned error can't find the container with id ae7a5d1cfd3219233e8f5b7f99f2784653af664556efb1751e3efb597ddda3a0
Jul 07 14:00:02.456482 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:02.456448    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jcfdk" event={"ID":"57cf19e7-ca31-4cc2-bb09-5ca82de4355b","Type":"ContainerStarted","Data":"b36874f19868af7e97c0871e9ade834cb7f1f9ebeba2520bf868a00222dd0dd3"}
Jul 07 14:00:02.457672 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:02.457646    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qg8cp" event={"ID":"767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea","Type":"ContainerStarted","Data":"ae7a5d1cfd3219233e8f5b7f99f2784653af664556efb1751e3efb597ddda3a0"}
Jul 07 14:00:03.013812 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:03.013596    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ts9k4"]
Jul 07 14:00:03.040608 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:03.040579    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b1219f1-d3d3-4533-8b55-546c7c1a4bc6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-fr2kp\" (UID: \"8b1219f1-d3d3-4533-8b55-546c7c1a4bc6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fr2kp"
Jul 07 14:00:03.040768 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:03.040633    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-registry-tls\") pod \"image-registry-7f89f8bd56-rpsql\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") " pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 14:00:03.040768 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:03.040651    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de7dff6f-6402-4f2a-b8fc-a93a6af0819d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-rb7b4\" (UID: \"de7dff6f-6402-4f2a-b8fc-a93a6af0819d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rb7b4"
Jul 07 14:00:03.043057 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:03.043032    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/de7dff6f-6402-4f2a-b8fc-a93a6af0819d-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-rb7b4\" (UID: \"de7dff6f-6402-4f2a-b8fc-a93a6af0819d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rb7b4"
Jul 07 14:00:03.043162 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:03.043032    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b1219f1-d3d3-4533-8b55-546c7c1a4bc6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-fr2kp\" (UID: \"8b1219f1-d3d3-4533-8b55-546c7c1a4bc6\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fr2kp"
Jul 07 14:00:03.043162 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:03.043115    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-registry-tls\") pod \"image-registry-7f89f8bd56-rpsql\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") " pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 14:00:03.121277 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:00:03.121246    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6343bdd0_d6a1_4cf1_9a89_2e9efc0cb69d.slice/crio-cd9bb828c611f90be11e3e67ee1ed9539b807c04175c400349650e4b817b94f3 WatchSource:0}: Error finding container cd9bb828c611f90be11e3e67ee1ed9539b807c04175c400349650e4b817b94f3: Status 404 returned error can't find the container with id cd9bb828c611f90be11e3e67ee1ed9539b807c04175c400349650e4b817b94f3
Jul 07 14:00:03.141242 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:03.141217    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23a16488-280d-46f3-a2f6-8e5441851c9f-metrics-certs\") pod \"router-default-6b78666d57-trzqd\" (UID: \"23a16488-280d-46f3-a2f6-8e5441851c9f\") " pod="openshift-ingress/router-default-6b78666d57-trzqd"
Jul 07 14:00:03.141362 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:03.141273    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23a16488-280d-46f3-a2f6-8e5441851c9f-service-ca-bundle\") pod \"router-default-6b78666d57-trzqd\" (UID: \"23a16488-280d-46f3-a2f6-8e5441851c9f\") " pod="openshift-ingress/router-default-6b78666d57-trzqd"
Jul 07 14:00:03.141362 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:03.141299    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f87880be-2cb0-4728-b0e4-7f9dfe55d961-metrics-tls\") pod \"dns-default-f76h8\" (UID: \"f87880be-2cb0-4728-b0e4-7f9dfe55d961\") " pod="openshift-dns/dns-default-f76h8"
Jul 07 14:00:03.141930 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:03.141906    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23a16488-280d-46f3-a2f6-8e5441851c9f-service-ca-bundle\") pod \"router-default-6b78666d57-trzqd\" (UID: \"23a16488-280d-46f3-a2f6-8e5441851c9f\") " pod="openshift-ingress/router-default-6b78666d57-trzqd"
Jul 07 14:00:03.143763 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:03.143741    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f87880be-2cb0-4728-b0e4-7f9dfe55d961-metrics-tls\") pod \"dns-default-f76h8\" (UID: \"f87880be-2cb0-4728-b0e4-7f9dfe55d961\") " pod="openshift-dns/dns-default-f76h8"
Jul 07 14:00:03.143841 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:03.143828    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23a16488-280d-46f3-a2f6-8e5441851c9f-metrics-certs\") pod \"router-default-6b78666d57-trzqd\" (UID: \"23a16488-280d-46f3-a2f6-8e5441851c9f\") " pod="openshift-ingress/router-default-6b78666d57-trzqd"
Jul 07 14:00:03.262143 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:03.262110    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zvl8v\""
Jul 07 14:00:03.269462 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:03.269442    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rb7b4"
Jul 07 14:00:03.271493 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:03.271453    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7dffl\""
Jul 07 14:00:03.279210 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:03.279189    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fr2kp"
Jul 07 14:00:03.294658 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:03.294640    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xmv42\""
Jul 07 14:00:03.298141 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:03.298122    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2sf6c\""
Jul 07 14:00:03.302252 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:03.302232    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b78666d57-trzqd"
Jul 07 14:00:03.306822 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:03.306802    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 14:00:03.331544 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:03.330879    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7m8lp\""
Jul 07 14:00:03.338856 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:03.338823    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f76h8"
Jul 07 14:00:03.453106 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:03.450057    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rb7b4"]
Jul 07 14:00:03.469033 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:03.468851    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ts9k4" event={"ID":"6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d","Type":"ContainerStarted","Data":"e731f51195fda25eda350a8fb0e4fc62e6b131554accbded948c27e643963d1e"}
Jul 07 14:00:03.469033 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:03.468912    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ts9k4" event={"ID":"6343bdd0-d6a1-4cf1-9a89-2e9efc0cb69d","Type":"ContainerStarted","Data":"cd9bb828c611f90be11e3e67ee1ed9539b807c04175c400349650e4b817b94f3"}
Jul 07 14:00:03.469485 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:03.469422    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ts9k4"
Jul 07 14:00:03.473252 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:03.473191    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fr2kp"]
Jul 07 14:00:03.476741 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:03.474986    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fj8vh" event={"ID":"b8654fdc-761b-4a1a-964e-4ed6584e9132","Type":"ContainerStarted","Data":"674f1585c85a6f683082f506ec329577701e8ef87a6df680a602a02ab1e024bc"}
Jul 07 14:00:03.487144 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:03.486592    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ts9k4" podStartSLOduration=68.48657061 podStartE2EDuration="1m8.48657061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:58:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:03.486178066 +0000 UTC m=+69.098457055" watchObservedRunningTime="2026-07-07 14:00:03.48657061 +0000 UTC m=+69.098849584"
Jul 07 14:00:03.524455 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:03.524362    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b78666d57-trzqd"]
Jul 07 14:00:03.527657 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:00:03.527610    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23a16488_280d_46f3_a2f6_8e5441851c9f.slice/crio-9886bdf2858667690f4f3c882ba47c816a75a5307f578bed2c61072b52797261 WatchSource:0}: Error finding container 9886bdf2858667690f4f3c882ba47c816a75a5307f578bed2c61072b52797261: Status 404 returned error can't find the container with id 9886bdf2858667690f4f3c882ba47c816a75a5307f578bed2c61072b52797261
Jul 07 14:00:03.546396 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:03.546366    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f89f8bd56-rpsql"]
Jul 07 14:00:03.549145 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:00:03.549116    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod722f8cec_0fcc_4d5d_992b_baf7533b6a04.slice/crio-dc8220b21d612264f105a54b95a362eb4101427826c863453cd341dc5e8e5b2c WatchSource:0}: Error finding container dc8220b21d612264f105a54b95a362eb4101427826c863453cd341dc5e8e5b2c: Status 404 returned error can't find the container with id dc8220b21d612264f105a54b95a362eb4101427826c863453cd341dc5e8e5b2c
Jul 07 14:00:03.572668 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:03.572644    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f76h8"]
Jul 07 14:00:03.575471 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:00:03.575448    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf87880be_2cb0_4728_b0e4_7f9dfe55d961.slice/crio-c9ff6c5b52a3925b6128f1000cab1a0d7062d233ace05e1ef3f9e4073afd6614 WatchSource:0}: Error finding container c9ff6c5b52a3925b6128f1000cab1a0d7062d233ace05e1ef3f9e4073afd6614: Status 404 returned error can't find the container with id c9ff6c5b52a3925b6128f1000cab1a0d7062d233ace05e1ef3f9e4073afd6614
Jul 07 14:00:04.480589 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:04.480552    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql" event={"ID":"722f8cec-0fcc-4d5d-992b-baf7533b6a04","Type":"ContainerStarted","Data":"2d1a62376d90b6e54495bb161614c67e20b29ce287b9e073deaabed50fb6b01a"}
Jul 07 14:00:04.481009 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:04.480658    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql" event={"ID":"722f8cec-0fcc-4d5d-992b-baf7533b6a04","Type":"ContainerStarted","Data":"dc8220b21d612264f105a54b95a362eb4101427826c863453cd341dc5e8e5b2c"}
Jul 07 14:00:04.482009 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:04.481982    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f76h8" event={"ID":"f87880be-2cb0-4728-b0e4-7f9dfe55d961","Type":"ContainerStarted","Data":"c9ff6c5b52a3925b6128f1000cab1a0d7062d233ace05e1ef3f9e4073afd6614"}
Jul 07 14:00:04.483123 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:04.483076    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 14:00:04.483829 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:04.483804    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rb7b4" event={"ID":"de7dff6f-6402-4f2a-b8fc-a93a6af0819d","Type":"ContainerStarted","Data":"52d4e020a2fd2f1a291af397c6f2ea77d381d6e9a0ef2564222b7df0c864d9c2"}
Jul 07 14:00:04.485565 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:04.485535    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b78666d57-trzqd" event={"ID":"23a16488-280d-46f3-a2f6-8e5441851c9f","Type":"ContainerStarted","Data":"c79daaa9e866d77d1003fc3c20213a562cbe8e03e5ea3b69e398b5a1d848c623"}
Jul 07 14:00:04.485641 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:04.485586    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b78666d57-trzqd" event={"ID":"23a16488-280d-46f3-a2f6-8e5441851c9f","Type":"ContainerStarted","Data":"9886bdf2858667690f4f3c882ba47c816a75a5307f578bed2c61072b52797261"}
Jul 07 14:00:04.487829 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:04.487781    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fr2kp" event={"ID":"8b1219f1-d3d3-4533-8b55-546c7c1a4bc6","Type":"ContainerStarted","Data":"8f063f426c67413626c26ba1fa0aa4ae3d2ec52bb177c3585d5abc1fddc5d564"}
Jul 07 14:00:04.532917 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:04.532854    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql" podStartSLOduration=68.532833306 podStartE2EDuration="1m8.532833306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:58:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:04.51017017 +0000 UTC m=+70.122449143" watchObservedRunningTime="2026-07-07 14:00:04.532833306 +0000 UTC m=+70.145112279"
Jul 07 14:00:04.533491 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:04.533444    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6b78666d57-trzqd" podStartSLOduration=55.533427693 podStartE2EDuration="55.533427693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:59:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:04.532051065 +0000 UTC m=+70.144330037" watchObservedRunningTime="2026-07-07 14:00:04.533427693 +0000 UTC m=+70.145706666"
Jul 07 14:00:05.072071 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:05.071622    2576 scope.go:117] "RemoveContainer" containerID="06c8fcc76b5145d4ee06dc0c2dbb194521b7215ca3f6a1695b8968ca646cba49"
Jul 07 14:00:05.302553 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:05.302514    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6b78666d57-trzqd"
Jul 07 14:00:05.309820 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:05.309790    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6b78666d57-trzqd"
Jul 07 14:00:05.496402 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:05.495483    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bglbr_d36dada3-7ddc-4de9-a1d5-62ff1f867dd9/console-operator/1.log"
Jul 07 14:00:05.496402 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:05.495604    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-bglbr" event={"ID":"d36dada3-7ddc-4de9-a1d5-62ff1f867dd9","Type":"ContainerStarted","Data":"218404a6f126c91f00c4b62677ee78f250cd320088d6a3311938d7762ffe7b0a"}
Jul 07 14:00:05.496873 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:05.496518    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-bglbr"
Jul 07 14:00:05.499835 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:05.499601    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qg8cp" event={"ID":"767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea","Type":"ContainerStarted","Data":"6a805bd27ccf7108a2ac757ccc4cefe24e43252cc3b4473d3f3838cd26c2cc9c"}
Jul 07 14:00:05.499835 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:05.499660    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qg8cp" event={"ID":"767aa5e7-4a7e-4dd3-92b7-38d66a5fa4ea","Type":"ContainerStarted","Data":"7d2f14f22b1be605c6548109788b887903b43eec2778bef8e4b977d0edb82fed"}
Jul 07 14:00:05.500088 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:05.500003    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6b78666d57-trzqd"
Jul 07 14:00:05.501816 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:05.501798    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6b78666d57-trzqd"
Jul 07 14:00:05.535206 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:05.534400    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qg8cp" podStartSLOduration=68.042344298 podStartE2EDuration="1m10.534377666s" totalImagesPullingTime="2.492033368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:58:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:05.533916208 +0000 UTC m=+71.146195182" watchObservedRunningTime="2026-07-07 14:00:05.534377666 +0000 UTC m=+71.146656641"
Jul 07 14:00:06.014826 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:06.014758    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-bglbr"
Jul 07 14:00:06.205549 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:06.205508    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:06.306560 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:06.306484    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:06.365418 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:06.365373    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:06.505380 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:06.505334    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fj8vh" event={"ID":"b8654fdc-761b-4a1a-964e-4ed6584e9132","Type":"ContainerStarted","Data":"a628750d79053021ca0d2a5c8171599ec68cb9a2bc6719d430ecea9c616d0fd7"}
Jul 07 14:00:06.507035 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:06.507012    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:06.692842 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:06.692808    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:07.239680 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.239620    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4c7b47c-lbsgt"]
Jul 07 14:00:07.243240 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.243005    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4c7b47c-lbsgt"
Jul 07 14:00:07.243589 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.243416    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-95b68b754-hlgqb"]
Jul 07 14:00:07.245569 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.245542    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:07.246236 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.246187    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-787464cbcd-9v7hg"]
Jul 07 14:00:07.246590 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.246570    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-95b68b754-hlgqb"
Jul 07 14:00:07.248735 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.248704    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-787464cbcd-9v7hg"
Jul 07 14:00:07.254579 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:00:07.252823    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"cluster-proxy-service-proxy-server-certificates\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" type="*v1.Secret"
Jul 07 14:00:07.254579 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:00:07.252965    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"cluster-proxy-hub-kubeconfig\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" type="*v1.Secret"
Jul 07 14:00:07.254579 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:00:07.253052    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 07 14:00:07.254579 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:00:07.253130    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"open-cluster-management-image-pull-credentials\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" type="*v1.Secret"
Jul 07 14:00:07.254579 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:00:07.253239    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"cluster-proxy-proxy-agent-5d4c7b47c-lbsgt\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" podUID="ce09d1ce-46a4-4b1b-805c-176e8e97f560" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4c7b47c-lbsgt"
Jul 07 14:00:07.254579 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:00:07.253496    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"cluster-proxy-ca\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" type="*v1.Secret"
Jul 07 14:00:07.254579 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:00:07.253562    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 07 14:00:07.255001 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:00:07.254602    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"work-manager-hub-kubeconfig\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" type="*v1.Secret"
Jul 07 14:00:07.255001 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:00:07.254701    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" type="*v1.Secret"
Jul 07 14:00:07.256566 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.256527    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-czxm5\""
Jul 07 14:00:07.256667 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.256656    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 07 14:00:07.272538 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.272481    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4c7b47c-lbsgt"]
Jul 07 14:00:07.274278 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.274236    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-787464cbcd-9v7hg"]
Jul 07 14:00:07.291072 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.290696    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-95b68b754-hlgqb"]
Jul 07 14:00:07.322781 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.322752    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-vn9td"]
Jul 07 14:00:07.326055 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.325999    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-vn9td"
Jul 07 14:00:07.329483 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.329357    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-lchh8\""
Jul 07 14:00:07.329601 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.329561    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 07 14:00:07.329674 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.329658    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 07 14:00:07.341963 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.341907    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-vn9td"]
Jul 07 14:00:07.382902 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.382862    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c34e03c-fb66-45a1-8480-e47798dfd42a-tmp\") pod \"klusterlet-addon-workmgr-95b68b754-hlgqb\" (UID: \"7c34e03c-fb66-45a1-8480-e47798dfd42a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-95b68b754-hlgqb"
Jul 07 14:00:07.383105 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.382912    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr4x6\" (UniqueName: \"kubernetes.io/projected/7c34e03c-fb66-45a1-8480-e47798dfd42a-kube-api-access-vr4x6\") pod \"klusterlet-addon-workmgr-95b68b754-hlgqb\" (UID: \"7c34e03c-fb66-45a1-8480-e47798dfd42a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-95b68b754-hlgqb"
Jul 07 14:00:07.383105 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.382978    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7c34e03c-fb66-45a1-8480-e47798dfd42a-klusterlet-config\") pod \"klusterlet-addon-workmgr-95b68b754-hlgqb\" (UID: \"7c34e03c-fb66-45a1-8480-e47798dfd42a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-95b68b754-hlgqb"
Jul 07 14:00:07.383105 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.383009    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5slz8\" (UniqueName: \"kubernetes.io/projected/97e0f4f4-a122-47d4-960f-588add20b2d8-kube-api-access-5slz8\") pod \"managed-serviceaccount-addon-agent-787464cbcd-9v7hg\" (UID: \"97e0f4f4-a122-47d4-960f-588add20b2d8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-787464cbcd-9v7hg"
Jul 07 14:00:07.383105 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.383045    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ce09d1ce-46a4-4b1b-805c-176e8e97f560-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d4c7b47c-lbsgt\" (UID: \"ce09d1ce-46a4-4b1b-805c-176e8e97f560\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4c7b47c-lbsgt"
Jul 07 14:00:07.383105 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.383085    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/97e0f4f4-a122-47d4-960f-588add20b2d8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-787464cbcd-9v7hg\" (UID: \"97e0f4f4-a122-47d4-960f-588add20b2d8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-787464cbcd-9v7hg"
Jul 07 14:00:07.383362 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.383125    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ce09d1ce-46a4-4b1b-805c-176e8e97f560-ca\") pod \"cluster-proxy-proxy-agent-5d4c7b47c-lbsgt\" (UID: \"ce09d1ce-46a4-4b1b-805c-176e8e97f560\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4c7b47c-lbsgt"
Jul 07 14:00:07.383362 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.383179    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ce09d1ce-46a4-4b1b-805c-176e8e97f560-hub\") pod \"cluster-proxy-proxy-agent-5d4c7b47c-lbsgt\" (UID: \"ce09d1ce-46a4-4b1b-805c-176e8e97f560\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4c7b47c-lbsgt"
Jul 07 14:00:07.383362 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.383204    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z2h2\" (UniqueName: \"kubernetes.io/projected/ce09d1ce-46a4-4b1b-805c-176e8e97f560-kube-api-access-6z2h2\") pod \"cluster-proxy-proxy-agent-5d4c7b47c-lbsgt\" (UID: \"ce09d1ce-46a4-4b1b-805c-176e8e97f560\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4c7b47c-lbsgt"
Jul 07 14:00:07.383362 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.383254    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce09d1ce-46a4-4b1b-805c-176e8e97f560-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d4c7b47c-lbsgt\" (UID: \"ce09d1ce-46a4-4b1b-805c-176e8e97f560\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4c7b47c-lbsgt"
Jul 07 14:00:07.383362 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.383284    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ce09d1ce-46a4-4b1b-805c-176e8e97f560-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d4c7b47c-lbsgt\" (UID: \"ce09d1ce-46a4-4b1b-805c-176e8e97f560\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4c7b47c-lbsgt"
Jul 07 14:00:07.397724 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.397638    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:07.484667 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.484589    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce09d1ce-46a4-4b1b-805c-176e8e97f560-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d4c7b47c-lbsgt\" (UID: \"ce09d1ce-46a4-4b1b-805c-176e8e97f560\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4c7b47c-lbsgt"
Jul 07 14:00:07.484667 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.484633    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ce09d1ce-46a4-4b1b-805c-176e8e97f560-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d4c7b47c-lbsgt\" (UID: \"ce09d1ce-46a4-4b1b-805c-176e8e97f560\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4c7b47c-lbsgt"
Jul 07 14:00:07.484667 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.484659    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c34e03c-fb66-45a1-8480-e47798dfd42a-tmp\") pod \"klusterlet-addon-workmgr-95b68b754-hlgqb\" (UID: \"7c34e03c-fb66-45a1-8480-e47798dfd42a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-95b68b754-hlgqb"
Jul 07 14:00:07.484962 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.484684    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr4x6\" (UniqueName: \"kubernetes.io/projected/7c34e03c-fb66-45a1-8480-e47798dfd42a-kube-api-access-vr4x6\") pod \"klusterlet-addon-workmgr-95b68b754-hlgqb\" (UID: \"7c34e03c-fb66-45a1-8480-e47798dfd42a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-95b68b754-hlgqb"
Jul 07 14:00:07.484962 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.484718    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7c34e03c-fb66-45a1-8480-e47798dfd42a-klusterlet-config\") pod \"klusterlet-addon-workmgr-95b68b754-hlgqb\" (UID: \"7c34e03c-fb66-45a1-8480-e47798dfd42a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-95b68b754-hlgqb"
Jul 07 14:00:07.484962 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.484748    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5slz8\" (UniqueName: \"kubernetes.io/projected/97e0f4f4-a122-47d4-960f-588add20b2d8-kube-api-access-5slz8\") pod \"managed-serviceaccount-addon-agent-787464cbcd-9v7hg\" (UID: \"97e0f4f4-a122-47d4-960f-588add20b2d8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-787464cbcd-9v7hg"
Jul 07 14:00:07.484962 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.484782    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ce09d1ce-46a4-4b1b-805c-176e8e97f560-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d4c7b47c-lbsgt\" (UID: \"ce09d1ce-46a4-4b1b-805c-176e8e97f560\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4c7b47c-lbsgt"
Jul 07 14:00:07.484962 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.484819    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/97e0f4f4-a122-47d4-960f-588add20b2d8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-787464cbcd-9v7hg\" (UID: \"97e0f4f4-a122-47d4-960f-588add20b2d8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-787464cbcd-9v7hg"
Jul 07 14:00:07.484962 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.484857    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ce09d1ce-46a4-4b1b-805c-176e8e97f560-ca\") pod \"cluster-proxy-proxy-agent-5d4c7b47c-lbsgt\" (UID: \"ce09d1ce-46a4-4b1b-805c-176e8e97f560\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4c7b47c-lbsgt"
Jul 07 14:00:07.484962 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.484892    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2pdl\" (UniqueName: \"kubernetes.io/projected/bc2e85d9-6ad0-4ff2-9533-7d3d0108ace5-kube-api-access-k2pdl\") pod \"downloads-685bfb5f64-vn9td\" (UID: \"bc2e85d9-6ad0-4ff2-9533-7d3d0108ace5\") " pod="openshift-console/downloads-685bfb5f64-vn9td"
Jul 07 14:00:07.484962 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.484927    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ce09d1ce-46a4-4b1b-805c-176e8e97f560-hub\") pod \"cluster-proxy-proxy-agent-5d4c7b47c-lbsgt\" (UID: \"ce09d1ce-46a4-4b1b-805c-176e8e97f560\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4c7b47c-lbsgt"
Jul 07 14:00:07.485371 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.484977    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z2h2\" (UniqueName: \"kubernetes.io/projected/ce09d1ce-46a4-4b1b-805c-176e8e97f560-kube-api-access-6z2h2\") pod \"cluster-proxy-proxy-agent-5d4c7b47c-lbsgt\" (UID: \"ce09d1ce-46a4-4b1b-805c-176e8e97f560\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4c7b47c-lbsgt"
Jul 07 14:00:07.485371 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.485139    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c34e03c-fb66-45a1-8480-e47798dfd42a-tmp\") pod \"klusterlet-addon-workmgr-95b68b754-hlgqb\" (UID: \"7c34e03c-fb66-45a1-8480-e47798dfd42a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-95b68b754-hlgqb"
Jul 07 14:00:07.488010 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.487983    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/97e0f4f4-a122-47d4-960f-588add20b2d8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-787464cbcd-9v7hg\" (UID: \"97e0f4f4-a122-47d4-960f-588add20b2d8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-787464cbcd-9v7hg"
Jul 07 14:00:07.527386 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.527334    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:07.585629 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.585584    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2pdl\" (UniqueName: \"kubernetes.io/projected/bc2e85d9-6ad0-4ff2-9533-7d3d0108ace5-kube-api-access-k2pdl\") pod \"downloads-685bfb5f64-vn9td\" (UID: \"bc2e85d9-6ad0-4ff2-9533-7d3d0108ace5\") " pod="openshift-console/downloads-685bfb5f64-vn9td"
Jul 07 14:00:07.596866 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.596841    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2pdl\" (UniqueName: \"kubernetes.io/projected/bc2e85d9-6ad0-4ff2-9533-7d3d0108ace5-kube-api-access-k2pdl\") pod \"downloads-685bfb5f64-vn9td\" (UID: \"bc2e85d9-6ad0-4ff2-9533-7d3d0108ace5\") " pod="openshift-console/downloads-685bfb5f64-vn9td"
Jul 07 14:00:07.648875 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.648841    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-vn9td"
Jul 07 14:00:07.717728 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.717693    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:07.821412 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.821316    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:07.919856 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.919822    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:07.980411 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:07.980374    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:08.061193 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:08.061163    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 07 14:00:08.077869 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:08.077801    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 07 14:00:08.083728 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:08.083703    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:08.088113 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:08.088093    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7c34e03c-fb66-45a1-8480-e47798dfd42a-klusterlet-config\") pod \"klusterlet-addon-workmgr-95b68b754-hlgqb\" (UID: \"7c34e03c-fb66-45a1-8480-e47798dfd42a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-95b68b754-hlgqb"
Jul 07 14:00:08.174554 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:08.174521    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 07 14:00:08.178974 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:08.178928    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ce09d1ce-46a4-4b1b-805c-176e8e97f560-hub\") pod \"cluster-proxy-proxy-agent-5d4c7b47c-lbsgt\" (UID: \"ce09d1ce-46a4-4b1b-805c-176e8e97f560\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4c7b47c-lbsgt"
Jul 07 14:00:08.202139 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:08.202115    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 07 14:00:08.205765 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:08.205735    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce09d1ce-46a4-4b1b-805c-176e8e97f560-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d4c7b47c-lbsgt\" (UID: \"ce09d1ce-46a4-4b1b-805c-176e8e97f560\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4c7b47c-lbsgt"
Jul 07 14:00:08.208099 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:08.208075    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5slz8\" (UniqueName: \"kubernetes.io/projected/97e0f4f4-a122-47d4-960f-588add20b2d8-kube-api-access-5slz8\") pod \"managed-serviceaccount-addon-agent-787464cbcd-9v7hg\" (UID: \"97e0f4f4-a122-47d4-960f-588add20b2d8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-787464cbcd-9v7hg"
Jul 07 14:00:08.214410 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:08.214386    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr4x6\" (UniqueName: \"kubernetes.io/projected/7c34e03c-fb66-45a1-8480-e47798dfd42a-kube-api-access-vr4x6\") pod \"klusterlet-addon-workmgr-95b68b754-hlgqb\" (UID: \"7c34e03c-fb66-45a1-8480-e47798dfd42a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-95b68b754-hlgqb"
Jul 07 14:00:08.214590 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:08.214571    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z2h2\" (UniqueName: \"kubernetes.io/projected/ce09d1ce-46a4-4b1b-805c-176e8e97f560-kube-api-access-6z2h2\") pod \"cluster-proxy-proxy-agent-5d4c7b47c-lbsgt\" (UID: \"ce09d1ce-46a4-4b1b-805c-176e8e97f560\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4c7b47c-lbsgt"
Jul 07 14:00:08.294255 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:08.294224    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:08.393717 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:08.393624    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:08.401024 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:08.400989    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 07 14:00:08.408508 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:08.408480    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ce09d1ce-46a4-4b1b-805c-176e8e97f560-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d4c7b47c-lbsgt\" (UID: \"ce09d1ce-46a4-4b1b-805c-176e8e97f560\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4c7b47c-lbsgt"
Jul 07 14:00:08.485668 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:00:08.485564    2576 secret.go:189] Couldn't get secret open-cluster-management-agent-addon/cluster-proxy-ca: failed to sync secret cache: timed out waiting for the condition
Jul 07 14:00:08.485668 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:00:08.485571    2576 secret.go:189] Couldn't get secret open-cluster-management-agent-addon/cluster-proxy-hub-kubeconfig: failed to sync secret cache: timed out waiting for the condition
Jul 07 14:00:08.485668 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:00:08.485652    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce09d1ce-46a4-4b1b-805c-176e8e97f560-ca podName:ce09d1ce-46a4-4b1b-805c-176e8e97f560 nodeName:}" failed. No retries permitted until 2026-07-07 14:00:08.985632748 +0000 UTC m=+74.597911702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ca" (UniqueName: "kubernetes.io/secret/ce09d1ce-46a4-4b1b-805c-176e8e97f560-ca") pod "cluster-proxy-proxy-agent-5d4c7b47c-lbsgt" (UID: "ce09d1ce-46a4-4b1b-805c-176e8e97f560") : failed to sync secret cache: timed out waiting for the condition
Jul 07 14:00:08.485988 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:00:08.485714    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce09d1ce-46a4-4b1b-805c-176e8e97f560-hub-kubeconfig podName:ce09d1ce-46a4-4b1b-805c-176e8e97f560 nodeName:}" failed. No retries permitted until 2026-07-07 14:00:08.985696992 +0000 UTC m=+74.597975955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "hub-kubeconfig" (UniqueName: "kubernetes.io/secret/ce09d1ce-46a4-4b1b-805c-176e8e97f560-hub-kubeconfig") pod "cluster-proxy-proxy-agent-5d4c7b47c-lbsgt" (UID: "ce09d1ce-46a4-4b1b-805c-176e8e97f560") : failed to sync secret cache: timed out waiting for the condition
Jul 07 14:00:08.506374 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:08.506342    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:08.519751 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:08.519705    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 07 14:00:08.555867 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:08.555832    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 07 14:00:08.560276 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:08.560247    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-787464cbcd-9v7hg"
Jul 07 14:00:08.562532 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:08.562510    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-95b68b754-hlgqb"
Jul 07 14:00:08.733761 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:08.733729    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 07 14:00:08.999165 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:08.999081    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ce09d1ce-46a4-4b1b-805c-176e8e97f560-ca\") pod \"cluster-proxy-proxy-agent-5d4c7b47c-lbsgt\" (UID: \"ce09d1ce-46a4-4b1b-805c-176e8e97f560\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4c7b47c-lbsgt"
Jul 07 14:00:08.999165 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:08.999157    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ce09d1ce-46a4-4b1b-805c-176e8e97f560-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d4c7b47c-lbsgt\" (UID: \"ce09d1ce-46a4-4b1b-805c-176e8e97f560\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4c7b47c-lbsgt"
Jul 07 14:00:09.001642 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:09.001621    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ce09d1ce-46a4-4b1b-805c-176e8e97f560-ca\") pod \"cluster-proxy-proxy-agent-5d4c7b47c-lbsgt\" (UID: \"ce09d1ce-46a4-4b1b-805c-176e8e97f560\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4c7b47c-lbsgt"
Jul 07 14:00:09.001829 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:09.001809    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ce09d1ce-46a4-4b1b-805c-176e8e97f560-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d4c7b47c-lbsgt\" (UID: \"ce09d1ce-46a4-4b1b-805c-176e8e97f560\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4c7b47c-lbsgt"
Jul 07 14:00:09.065794 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:09.065755    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4c7b47c-lbsgt"
Jul 07 14:00:09.487119 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:09.487068    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:09.556910 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:09.556875    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:10.140672 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:10.140486    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-95b68b754-hlgqb"]
Jul 07 14:00:10.165324 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:10.163893    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-787464cbcd-9v7hg"]
Jul 07 14:00:10.183772 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:10.183056    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-vn9td"]
Jul 07 14:00:10.184365 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:00:10.184331    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc2e85d9_6ad0_4ff2_9533_7d3d0108ace5.slice/crio-3697388a6bbfa45bed890f62a12497ac9ce7ab3eb48f798301519f52e688b1df WatchSource:0}: Error finding container 3697388a6bbfa45bed890f62a12497ac9ce7ab3eb48f798301519f52e688b1df: Status 404 returned error can't find the container with id 3697388a6bbfa45bed890f62a12497ac9ce7ab3eb48f798301519f52e688b1df
Jul 07 14:00:10.206453 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:10.205961    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4c7b47c-lbsgt"]
Jul 07 14:00:10.211227 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:00:10.211200    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce09d1ce_46a4_4b1b_805c_176e8e97f560.slice/crio-bb49fed9f9f1423f7d3f86b61badb6bad8501bd1276fbf95780c51fbc3cd77d0 WatchSource:0}: Error finding container bb49fed9f9f1423f7d3f86b61badb6bad8501bd1276fbf95780c51fbc3cd77d0: Status 404 returned error can't find the container with id bb49fed9f9f1423f7d3f86b61badb6bad8501bd1276fbf95780c51fbc3cd77d0
Jul 07 14:00:10.436845 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:10.436758    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:10.523352 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:10.523319    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-95b68b754-hlgqb" event={"ID":"7c34e03c-fb66-45a1-8480-e47798dfd42a","Type":"ContainerStarted","Data":"a4c17ec9bf9e9fd9986a62d5d48d3faf1df5b9375152c3d770e84a9feb800a6f"}
Jul 07 14:00:10.524503 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:10.524472    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4c7b47c-lbsgt" event={"ID":"ce09d1ce-46a4-4b1b-805c-176e8e97f560","Type":"ContainerStarted","Data":"bb49fed9f9f1423f7d3f86b61badb6bad8501bd1276fbf95780c51fbc3cd77d0"}
Jul 07 14:00:10.526497 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:10.526477    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fj8vh" event={"ID":"b8654fdc-761b-4a1a-964e-4ed6584e9132","Type":"ContainerStarted","Data":"e445d0b1a89cc9202437bba9a19e934ab6b552a1ebd61e39584082cf22a76331"}
Jul 07 14:00:10.527860 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:10.527838    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jcfdk" event={"ID":"57cf19e7-ca31-4cc2-bb09-5ca82de4355b","Type":"ContainerStarted","Data":"52149be1216b6f2364109052b8f18c2b7efe550fb1a9b8d10caf0e8a19533cdf"}
Jul 07 14:00:10.529551 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:10.529530    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f76h8" event={"ID":"f87880be-2cb0-4728-b0e4-7f9dfe55d961","Type":"ContainerStarted","Data":"eb07d7a770653e2a4dbfe0a71d9ff4468a512baa31594ba34a34da486805b00d"}
Jul 07 14:00:10.529633 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:10.529567    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f76h8" event={"ID":"f87880be-2cb0-4728-b0e4-7f9dfe55d961","Type":"ContainerStarted","Data":"c4fd4a3436633eeb319af30714af8901eac82a9a70045e022af225951698a424"}
Jul 07 14:00:10.529633 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:10.529590    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-f76h8"
Jul 07 14:00:10.531324 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:10.531304    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rb7b4" event={"ID":"de7dff6f-6402-4f2a-b8fc-a93a6af0819d","Type":"ContainerStarted","Data":"0dac0fe8047b6e6818544b4ae73509cc770ff156d0950efdcdec0559446ad41a"}
Jul 07 14:00:10.531416 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:10.531351    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rb7b4" event={"ID":"de7dff6f-6402-4f2a-b8fc-a93a6af0819d","Type":"ContainerStarted","Data":"1f74b8beddc9bcc78efb51aecb51b7347cc09d37be0feb71ab42469486b783d7"}
Jul 07 14:00:10.532411 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:10.532392    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-vn9td" event={"ID":"bc2e85d9-6ad0-4ff2-9533-7d3d0108ace5","Type":"ContainerStarted","Data":"3697388a6bbfa45bed890f62a12497ac9ce7ab3eb48f798301519f52e688b1df"}
Jul 07 14:00:10.533495 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:10.533476    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-787464cbcd-9v7hg" event={"ID":"97e0f4f4-a122-47d4-960f-588add20b2d8","Type":"ContainerStarted","Data":"0926c3eef91f388821d603e52cccab93223e55960b584cefe2f5071425b2d5ae"}
Jul 07 14:00:10.534907 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:10.534885    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fr2kp" event={"ID":"8b1219f1-d3d3-4533-8b55-546c7c1a4bc6","Type":"ContainerStarted","Data":"4a01558ffb06dc4e289b70f7bfdc2eeb8e33de5350a8a2585e919a202c7dbf12"}
Jul 07 14:00:10.537034 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:10.537015    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:10.550379 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:10.550332    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fj8vh" podStartSLOduration=17.039054711 podStartE2EDuration="27.550321177s" totalImagesPullingTime="10.511266466s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:59:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:10.549651678 +0000 UTC m=+76.161930651" watchObservedRunningTime="2026-07-07 14:00:10.550321177 +0000 UTC m=+76.162600148"
Jul 07 14:00:10.570922 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:10.570875    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jcfdk" podStartSLOduration=66.648657747 podStartE2EDuration="1m14.570862715s" totalImagesPullingTime="7.922204968s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 13:58:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:10.569804744 +0000 UTC m=+76.182083719" watchObservedRunningTime="2026-07-07 14:00:10.570862715 +0000 UTC m=+76.183141664"
Jul 07 14:00:10.590116 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:10.590063    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rb7b4" podStartSLOduration=55.260350289 podStartE2EDuration="1m1.590049697s" totalImagesPullingTime="6.329699408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:59:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:10.589822225 +0000 UTC m=+76.202101195" watchObservedRunningTime="2026-07-07 14:00:10.590049697 +0000 UTC m=+76.202328670"
Jul 07 14:00:10.613824 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:10.613763    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-fr2kp" podStartSLOduration=55.203262089 podStartE2EDuration="1m1.613745334s" totalImagesPullingTime="6.410483245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:59:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:10.612172431 +0000 UTC m=+76.224451406" watchObservedRunningTime="2026-07-07 14:00:10.613745334 +0000 UTC m=+76.226024308"
Jul 07 14:00:10.628871 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:10.628840    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-46p7h"]
Jul 07 14:00:10.631273 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:10.631252    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-46p7h"
Jul 07 14:00:10.632309 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:10.632266    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-f76h8" podStartSLOduration=33.312440322 podStartE2EDuration="39.632248769s" totalImagesPullingTime="6.319808447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 13:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:10.631097584 +0000 UTC m=+76.243376558" watchObservedRunningTime="2026-07-07 14:00:10.632248769 +0000 UTC m=+76.244527743"
Jul 07 14:00:10.633835 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:10.633819    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-rcxdn\""
Jul 07 14:00:10.634048 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:10.634021    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 07 14:00:10.635553 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:10.635529    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:10.641076 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:10.641057    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-46p7h"]
Jul 07 14:00:10.818600 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:10.818537    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/769dced6-2a5e-4a60-9b2f-5067cf1fa139-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-46p7h\" (UID: \"769dced6-2a5e-4a60-9b2f-5067cf1fa139\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-46p7h"
Jul 07 14:00:10.864848 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:10.864816    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:10.919621 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:10.919592    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/769dced6-2a5e-4a60-9b2f-5067cf1fa139-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-46p7h\" (UID: \"769dced6-2a5e-4a60-9b2f-5067cf1fa139\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-46p7h"
Jul 07 14:00:10.922071 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:10.922049    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/769dced6-2a5e-4a60-9b2f-5067cf1fa139-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-46p7h\" (UID: \"769dced6-2a5e-4a60-9b2f-5067cf1fa139\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-46p7h"
Jul 07 14:00:10.941118 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:10.941093    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-46p7h"
Jul 07 14:00:11.074091 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:00:11.074060    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod769dced6_2a5e_4a60_9b2f_5067cf1fa139.slice/crio-408e29a2afc08d9210cb29b9364d6627f438c0ecb9cf54bde36892be706477ba WatchSource:0}: Error finding container 408e29a2afc08d9210cb29b9364d6627f438c0ecb9cf54bde36892be706477ba: Status 404 returned error can't find the container with id 408e29a2afc08d9210cb29b9364d6627f438c0ecb9cf54bde36892be706477ba
Jul 07 14:00:11.074616 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:11.074575    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-46p7h"]
Jul 07 14:00:11.541495 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:11.541407    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-46p7h" event={"ID":"769dced6-2a5e-4a60-9b2f-5067cf1fa139","Type":"ContainerStarted","Data":"408e29a2afc08d9210cb29b9364d6627f438c0ecb9cf54bde36892be706477ba"}
Jul 07 14:00:12.021896 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:12.021810    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:12.123468 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:12.123428    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:13.550364 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:13.550227    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:13.858864 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:13.858773    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:13.966367 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:13.966251    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:15.566377 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:15.566336    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-46p7h" event={"ID":"769dced6-2a5e-4a60-9b2f-5067cf1fa139","Type":"ContainerStarted","Data":"4268edf843f896200e6031a12bb9134b9001198d1c2b80e0fa54af3848c0ca35"}
Jul 07 14:00:15.567438 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:15.567384    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-46p7h"
Jul 07 14:00:15.574862 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:15.574815    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-46p7h"
Jul 07 14:00:15.588275 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:15.588212    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-46p7h" podStartSLOduration=2.035214452 podStartE2EDuration="5.588194759s" totalImagesPullingTime="3.552980307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:00:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:15.588014543 +0000 UTC m=+81.200293517" watchObservedRunningTime="2026-07-07 14:00:15.588194759 +0000 UTC m=+81.200473729"
Jul 07 14:00:15.905496 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:15.905402    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:16.006349 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:16.006311    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:16.664351 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:16.664323    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:16.968707 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:16.968659    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:17.068694 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:17.068660    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:17.578052 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:17.578014    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-787464cbcd-9v7hg" event={"ID":"97e0f4f4-a122-47d4-960f-588add20b2d8","Type":"ContainerStarted","Data":"d449d9ad8fce8f79b22821da9cacb663b1a04429addd28fa5fd8a94acf20dc92"}
Jul 07 14:00:17.605788 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:17.605734    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-787464cbcd-9v7hg" podStartSLOduration=3.9474172960000002 podStartE2EDuration="10.605715092s" totalImagesPullingTime="6.658297796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:00:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:17.604719595 +0000 UTC m=+83.216998570" watchObservedRunningTime="2026-07-07 14:00:17.605715092 +0000 UTC m=+83.217994058"
Jul 07 14:00:19.595127 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:19.595083    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4c7b47c-lbsgt" event={"ID":"ce09d1ce-46a4-4b1b-805c-176e8e97f560","Type":"ContainerStarted","Data":"be6eb96388ed93fbb2b58c01894dd2e9137c12475e555b41b3adf6a647fd6e32"}
Jul 07 14:00:19.595127 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:19.595134    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4c7b47c-lbsgt" event={"ID":"ce09d1ce-46a4-4b1b-805c-176e8e97f560","Type":"ContainerStarted","Data":"5622a5d3c6ae33afcfc6e60c56b168e05ea9e150ad4ce3c6e6564a119cc569dd"}
Jul 07 14:00:19.595715 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:19.595147    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4c7b47c-lbsgt" event={"ID":"ce09d1ce-46a4-4b1b-805c-176e8e97f560","Type":"ContainerStarted","Data":"faab4387c8bb07e5d21753a83fdd8cb4693c83861aef8a0eb0bcd96c49886b13"}
Jul 07 14:00:19.597245 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:19.597220    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-95b68b754-hlgqb" event={"ID":"7c34e03c-fb66-45a1-8480-e47798dfd42a","Type":"ContainerStarted","Data":"97a38fa1cae26457984b55007835575dc7d1aa260aa71bb8cbbb077b4c232d70"}
Jul 07 14:00:19.597461 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:19.597443    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-95b68b754-hlgqb"
Jul 07 14:00:19.599307 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:19.599281    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-95b68b754-hlgqb"
Jul 07 14:00:19.615886 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:19.615831    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d4c7b47c-lbsgt" podStartSLOduration=4.258984692 podStartE2EDuration="12.615811581s" totalImagesPullingTime="8.356826889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:00:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:19.613697394 +0000 UTC m=+85.225976390" watchObservedRunningTime="2026-07-07 14:00:19.615811581 +0000 UTC m=+85.228090553"
Jul 07 14:00:19.633087 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:19.632921    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-95b68b754-hlgqb" podStartSLOduration=4.229501263 podStartE2EDuration="12.632904576s" totalImagesPullingTime="8.403403313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:00:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:19.632309341 +0000 UTC m=+85.244588312" watchObservedRunningTime="2026-07-07 14:00:19.632904576 +0000 UTC m=+85.245183551"
Jul 07 14:00:20.040110 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:20.040058    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:20.142259 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:20.142222    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:20.544423 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:20.544393    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-f76h8"
Jul 07 14:00:22.345710 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:22.345674    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:22.446673 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:22.446627    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:22.502375 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:22.502337    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:23.037449 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:23.037410    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:23.134503 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:23.134468    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:23.303843 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:23.303752    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:23.312030 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:23.312003    2576 patch_prober.go:28] interesting pod/image-registry-7f89f8bd56-rpsql container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 07 14:00:23.312155 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:23.312053    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql" podUID="722f8cec-0fcc-4d5d-992b-baf7533b6a04" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 14:00:23.404747 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:23.404712    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:23.484156 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:23.484087    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:23.884785 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:23.884731    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:23.946301 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:23.946267    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:24.805569 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:24.805480    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:25.028902 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.028817    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:25.079266 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.079188    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lwg2c"]
Jul 07 14:00:25.120388 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.120340    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:25.186024 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.185971    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:25.230875 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.230849    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lwg2c"
Jul 07 14:00:25.234775 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.234590    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 14:00:25.234923 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.234782    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 14:00:25.235216 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.235192    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4zbsd\""
Jul 07 14:00:25.235216 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.235210    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 14:00:25.235453 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.235425    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 14:00:25.263722 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.263634    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:25.348914 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.348825    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2bee1c70-fe31-4b05-aec2-da9d0f4d3776-node-exporter-tls\") pod \"node-exporter-lwg2c\" (UID: \"2bee1c70-fe31-4b05-aec2-da9d0f4d3776\") " pod="openshift-monitoring/node-exporter-lwg2c"
Jul 07 14:00:25.348914 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.348876    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2bee1c70-fe31-4b05-aec2-da9d0f4d3776-node-exporter-wtmp\") pod \"node-exporter-lwg2c\" (UID: \"2bee1c70-fe31-4b05-aec2-da9d0f4d3776\") " pod="openshift-monitoring/node-exporter-lwg2c"
Jul 07 14:00:25.348914 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.348912    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bee1c70-fe31-4b05-aec2-da9d0f4d3776-metrics-client-ca\") pod \"node-exporter-lwg2c\" (UID: \"2bee1c70-fe31-4b05-aec2-da9d0f4d3776\") " pod="openshift-monitoring/node-exporter-lwg2c"
Jul 07 14:00:25.349183 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.349033    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bee1c70-fe31-4b05-aec2-da9d0f4d3776-sys\") pod \"node-exporter-lwg2c\" (UID: \"2bee1c70-fe31-4b05-aec2-da9d0f4d3776\") " pod="openshift-monitoring/node-exporter-lwg2c"
Jul 07 14:00:25.349183 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.349058    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2bee1c70-fe31-4b05-aec2-da9d0f4d3776-node-exporter-textfile\") pod \"node-exporter-lwg2c\" (UID: \"2bee1c70-fe31-4b05-aec2-da9d0f4d3776\") " pod="openshift-monitoring/node-exporter-lwg2c"
Jul 07 14:00:25.349183 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.349076    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2bee1c70-fe31-4b05-aec2-da9d0f4d3776-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lwg2c\" (UID: \"2bee1c70-fe31-4b05-aec2-da9d0f4d3776\") " pod="openshift-monitoring/node-exporter-lwg2c"
Jul 07 14:00:25.349183 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.349155    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2bee1c70-fe31-4b05-aec2-da9d0f4d3776-root\") pod \"node-exporter-lwg2c\" (UID: \"2bee1c70-fe31-4b05-aec2-da9d0f4d3776\") " pod="openshift-monitoring/node-exporter-lwg2c"
Jul 07 14:00:25.349392 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.349187    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92f5q\" (UniqueName: \"kubernetes.io/projected/2bee1c70-fe31-4b05-aec2-da9d0f4d3776-kube-api-access-92f5q\") pod \"node-exporter-lwg2c\" (UID: \"2bee1c70-fe31-4b05-aec2-da9d0f4d3776\") " pod="openshift-monitoring/node-exporter-lwg2c"
Jul 07 14:00:25.349392 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.349217    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2bee1c70-fe31-4b05-aec2-da9d0f4d3776-node-exporter-accelerators-collector-config\") pod \"node-exporter-lwg2c\" (UID: \"2bee1c70-fe31-4b05-aec2-da9d0f4d3776\") " pod="openshift-monitoring/node-exporter-lwg2c"
Jul 07 14:00:25.378595 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.378560    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:25.450224 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.450184    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2bee1c70-fe31-4b05-aec2-da9d0f4d3776-node-exporter-tls\") pod \"node-exporter-lwg2c\" (UID: \"2bee1c70-fe31-4b05-aec2-da9d0f4d3776\") " pod="openshift-monitoring/node-exporter-lwg2c"
Jul 07 14:00:25.450401 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.450242    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2bee1c70-fe31-4b05-aec2-da9d0f4d3776-node-exporter-wtmp\") pod \"node-exporter-lwg2c\" (UID: \"2bee1c70-fe31-4b05-aec2-da9d0f4d3776\") " pod="openshift-monitoring/node-exporter-lwg2c"
Jul 07 14:00:25.450401 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.450273    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bee1c70-fe31-4b05-aec2-da9d0f4d3776-metrics-client-ca\") pod \"node-exporter-lwg2c\" (UID: \"2bee1c70-fe31-4b05-aec2-da9d0f4d3776\") " pod="openshift-monitoring/node-exporter-lwg2c"
Jul 07 14:00:25.450401 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.450322    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bee1c70-fe31-4b05-aec2-da9d0f4d3776-sys\") pod \"node-exporter-lwg2c\" (UID: \"2bee1c70-fe31-4b05-aec2-da9d0f4d3776\") " pod="openshift-monitoring/node-exporter-lwg2c"
Jul 07 14:00:25.450401 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.450338    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2bee1c70-fe31-4b05-aec2-da9d0f4d3776-node-exporter-textfile\") pod \"node-exporter-lwg2c\" (UID: \"2bee1c70-fe31-4b05-aec2-da9d0f4d3776\") " pod="openshift-monitoring/node-exporter-lwg2c"
Jul 07 14:00:25.450401 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.450360    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2bee1c70-fe31-4b05-aec2-da9d0f4d3776-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lwg2c\" (UID: \"2bee1c70-fe31-4b05-aec2-da9d0f4d3776\") " pod="openshift-monitoring/node-exporter-lwg2c"
Jul 07 14:00:25.450401 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.450384    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2bee1c70-fe31-4b05-aec2-da9d0f4d3776-root\") pod \"node-exporter-lwg2c\" (UID: \"2bee1c70-fe31-4b05-aec2-da9d0f4d3776\") " pod="openshift-monitoring/node-exporter-lwg2c"
Jul 07 14:00:25.450401 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.450400    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92f5q\" (UniqueName: \"kubernetes.io/projected/2bee1c70-fe31-4b05-aec2-da9d0f4d3776-kube-api-access-92f5q\") pod \"node-exporter-lwg2c\" (UID: \"2bee1c70-fe31-4b05-aec2-da9d0f4d3776\") " pod="openshift-monitoring/node-exporter-lwg2c"
Jul 07 14:00:25.450720 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.450408    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2bee1c70-fe31-4b05-aec2-da9d0f4d3776-node-exporter-wtmp\") pod \"node-exporter-lwg2c\" (UID: \"2bee1c70-fe31-4b05-aec2-da9d0f4d3776\") " pod="openshift-monitoring/node-exporter-lwg2c"
Jul 07 14:00:25.450720 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.450418    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2bee1c70-fe31-4b05-aec2-da9d0f4d3776-node-exporter-accelerators-collector-config\") pod \"node-exporter-lwg2c\" (UID: \"2bee1c70-fe31-4b05-aec2-da9d0f4d3776\") " pod="openshift-monitoring/node-exporter-lwg2c"
Jul 07 14:00:25.450720 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.450675    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2bee1c70-fe31-4b05-aec2-da9d0f4d3776-node-exporter-textfile\") pod \"node-exporter-lwg2c\" (UID: \"2bee1c70-fe31-4b05-aec2-da9d0f4d3776\") " pod="openshift-monitoring/node-exporter-lwg2c"
Jul 07 14:00:25.450955 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.450915    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2bee1c70-fe31-4b05-aec2-da9d0f4d3776-root\") pod \"node-exporter-lwg2c\" (UID: \"2bee1c70-fe31-4b05-aec2-da9d0f4d3776\") " pod="openshift-monitoring/node-exporter-lwg2c"
Jul 07 14:00:25.451034 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.451011    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2bee1c70-fe31-4b05-aec2-da9d0f4d3776-sys\") pod \"node-exporter-lwg2c\" (UID: \"2bee1c70-fe31-4b05-aec2-da9d0f4d3776\") " pod="openshift-monitoring/node-exporter-lwg2c"
Jul 07 14:00:25.451331 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.451314    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2bee1c70-fe31-4b05-aec2-da9d0f4d3776-node-exporter-accelerators-collector-config\") pod \"node-exporter-lwg2c\" (UID: \"2bee1c70-fe31-4b05-aec2-da9d0f4d3776\") " pod="openshift-monitoring/node-exporter-lwg2c"
Jul 07 14:00:25.451552 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.451537    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bee1c70-fe31-4b05-aec2-da9d0f4d3776-metrics-client-ca\") pod \"node-exporter-lwg2c\" (UID: \"2bee1c70-fe31-4b05-aec2-da9d0f4d3776\") " pod="openshift-monitoring/node-exporter-lwg2c"
Jul 07 14:00:25.452857 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.452839    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2bee1c70-fe31-4b05-aec2-da9d0f4d3776-node-exporter-tls\") pod \"node-exporter-lwg2c\" (UID: \"2bee1c70-fe31-4b05-aec2-da9d0f4d3776\") " pod="openshift-monitoring/node-exporter-lwg2c"
Jul 07 14:00:25.453016 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.452994    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2bee1c70-fe31-4b05-aec2-da9d0f4d3776-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lwg2c\" (UID: \"2bee1c70-fe31-4b05-aec2-da9d0f4d3776\") " pod="openshift-monitoring/node-exporter-lwg2c"
Jul 07 14:00:25.458915 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.458893    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92f5q\" (UniqueName: \"kubernetes.io/projected/2bee1c70-fe31-4b05-aec2-da9d0f4d3776-kube-api-access-92f5q\") pod \"node-exporter-lwg2c\" (UID: \"2bee1c70-fe31-4b05-aec2-da9d0f4d3776\") " pod="openshift-monitoring/node-exporter-lwg2c"
Jul 07 14:00:25.477379 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.477355    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:25.505248 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.505222    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 14:00:25.544058 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.544030    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lwg2c"
Jul 07 14:00:25.578206 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:25.578181    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:26.765670 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:26.765583    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:26.860253 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:26.860213    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:27.063391 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:27.063308    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:27.159543 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:27.159507    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:27.993201 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:27.993173    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:28.093489 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:28.093426    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:28.182352 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:28.182318    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:28.368103 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:28.368005    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:28.592050 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:28.592005    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:28.687873 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:28.687754    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:28.794042 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:28.793995    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:28.868755 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:28.868695    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:28.978971 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:00:28.978923    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bee1c70_fe31_4b05_aec2_da9d0f4d3776.slice/crio-9d7521901008bad65fc16b25660cc24b06dba69e76aac8f9838a4c18f6ee0d27 WatchSource:0}: Error finding container 9d7521901008bad65fc16b25660cc24b06dba69e76aac8f9838a4c18f6ee0d27: Status 404 returned error can't find the container with id 9d7521901008bad65fc16b25660cc24b06dba69e76aac8f9838a4c18f6ee0d27
Jul 07 14:00:29.648619 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:29.648527    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-vn9td" event={"ID":"bc2e85d9-6ad0-4ff2-9533-7d3d0108ace5","Type":"ContainerStarted","Data":"9efe87233fc419324db0ba9af879ca722549df03672467e00a3009a1c5659ad9"}
Jul 07 14:00:29.649600 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:29.649579    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-vn9td"
Jul 07 14:00:29.652186 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:29.652161    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lwg2c" event={"ID":"2bee1c70-fe31-4b05-aec2-da9d0f4d3776","Type":"ContainerStarted","Data":"9d7521901008bad65fc16b25660cc24b06dba69e76aac8f9838a4c18f6ee0d27"}
Jul 07 14:00:29.660289 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:29.660264    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-vn9td"
Jul 07 14:00:29.673502 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:29.673243    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-vn9td" podStartSLOduration=3.642150318 podStartE2EDuration="22.673224632s" totalImagesPullingTime="19.031074314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:00:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:29.670387672 +0000 UTC m=+95.282666645" watchObservedRunningTime="2026-07-07 14:00:29.673224632 +0000 UTC m=+95.285503605"
Jul 07 14:00:29.718595 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:29.717921    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:29.824884 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:29.824837    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:29.918209 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:29.917921    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:30.017537 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:30.017489    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:30.659698 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:30.659663    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lwg2c" event={"ID":"2bee1c70-fe31-4b05-aec2-da9d0f4d3776","Type":"ContainerStarted","Data":"abeddd6ac785fc0c97cf68de2bb8d9927df2ac7243e2ca387ebb739918771887"}
Jul 07 14:00:30.957913 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:30.957876    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:31.057655 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:31.057551    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:31.278212 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:31.278168    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:31.556229 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:31.556188    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:31.621638 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:31.621581    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:31.666113 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:31.666075    2576 generic.go:356] "Generic (PLEG): container finished" podID="2bee1c70-fe31-4b05-aec2-da9d0f4d3776" containerID="abeddd6ac785fc0c97cf68de2bb8d9927df2ac7243e2ca387ebb739918771887" exitCode=0
Jul 07 14:00:31.666614 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:31.666161    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lwg2c" event={"ID":"2bee1c70-fe31-4b05-aec2-da9d0f4d3776","Type":"ContainerDied","Data":"abeddd6ac785fc0c97cf68de2bb8d9927df2ac7243e2ca387ebb739918771887"}
Jul 07 14:00:32.673401 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:32.673360    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lwg2c" event={"ID":"2bee1c70-fe31-4b05-aec2-da9d0f4d3776","Type":"ContainerStarted","Data":"4d6e5f5668f4c9eb50a99bb6b429a8d74fdbb502d319c45b5b4e8c3c1c1e009f"}
Jul 07 14:00:32.673878 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:32.673433    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lwg2c" event={"ID":"2bee1c70-fe31-4b05-aec2-da9d0f4d3776","Type":"ContainerStarted","Data":"297fae3fbe167fbeda5ddf740e8dcd502b341ef82d1cb2b0fdb9525378eeceda"}
Jul 07 14:00:32.695644 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:32.695594    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lwg2c" podStartSLOduration=6.096483407 podStartE2EDuration="7.695579677s" totalImagesPullingTime="1.479862022s" totalInitContainerRuntime="119.234248ms" isStatefulPod=true podCreationTimestamp="2026-07-07 14:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:00:32.694606987 +0000 UTC m=+98.306885959" watchObservedRunningTime="2026-07-07 14:00:32.695579677 +0000 UTC m=+98.307858649"
Jul 07 14:00:33.511994 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:33.511956    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:33.571759 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:33.571724    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:34.491071 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:34.491041    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ts9k4"
Jul 07 14:00:35.029447 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:35.029413    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:35.130231 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:35.130197    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:35.230721 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:35.230684    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:35.652709 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:35.652669    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:35.690385 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:35.690351    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f89f8bd56-rpsql"]
Jul 07 14:00:35.819107 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:35.819068    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:35.919293 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:35.919189    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:36.759173 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:36.759143    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:36.857782 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:36.857742    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:37.865389 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:37.865348    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:37.966785 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:37.966749    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:38.067204 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:38.067169    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:39.896167 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:39.896131    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:39.996521 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:39.996486    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:41.189878 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:41.189841    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:41.289546 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:41.289509    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:42.601958 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:42.601899    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:42.710218 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:42.710181    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:45.965500 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:45.965459    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:46.062116 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:46.062079    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:46.120382 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:46.120344    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:48.804481 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:48.804442    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:48.863295 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:48.863263    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:57.022860 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:57.022823    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:00:57.086082 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:00:57.086035    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:01:00.717364 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:00.717318    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql" podUID="722f8cec-0fcc-4d5d-992b-baf7533b6a04" containerName="registry" containerID="cri-o://2d1a62376d90b6e54495bb161614c67e20b29ce287b9e073deaabed50fb6b01a" gracePeriod=30
Jul 07 14:01:01.002115 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.002046    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 14:01:01.066397 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.066363    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-registry-tls\") pod \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") "
Jul 07 14:01:01.066559 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.066413    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xj8xg\" (UniqueName: \"kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-kube-api-access-xj8xg\") pod \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") "
Jul 07 14:01:01.066559 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.066443    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/722f8cec-0fcc-4d5d-992b-baf7533b6a04-registry-certificates\") pod \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") "
Jul 07 14:01:01.066676 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.066555    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/722f8cec-0fcc-4d5d-992b-baf7533b6a04-installation-pull-secrets\") pod \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") "
Jul 07 14:01:01.066676 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.066592    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-bound-sa-token\") pod \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") "
Jul 07 14:01:01.066676 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.066628    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/722f8cec-0fcc-4d5d-992b-baf7533b6a04-trusted-ca\") pod \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") "
Jul 07 14:01:01.066676 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.066656    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/722f8cec-0fcc-4d5d-992b-baf7533b6a04-ca-trust-extracted\") pod \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") "
Jul 07 14:01:01.066860 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.066736    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/722f8cec-0fcc-4d5d-992b-baf7533b6a04-image-registry-private-configuration\") pod \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\" (UID: \"722f8cec-0fcc-4d5d-992b-baf7533b6a04\") "
Jul 07 14:01:01.066860 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.066838    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/722f8cec-0fcc-4d5d-992b-baf7533b6a04-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "722f8cec-0fcc-4d5d-992b-baf7533b6a04" (UID: "722f8cec-0fcc-4d5d-992b-baf7533b6a04"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:01:01.067167 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.067141    2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/722f8cec-0fcc-4d5d-992b-baf7533b6a04-registry-certificates\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:01:01.067648 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.067618    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/722f8cec-0fcc-4d5d-992b-baf7533b6a04-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "722f8cec-0fcc-4d5d-992b-baf7533b6a04" (UID: "722f8cec-0fcc-4d5d-992b-baf7533b6a04"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:01:01.069112 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.069084    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/722f8cec-0fcc-4d5d-992b-baf7533b6a04-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "722f8cec-0fcc-4d5d-992b-baf7533b6a04" (UID: "722f8cec-0fcc-4d5d-992b-baf7533b6a04"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:01:01.069304 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.069284    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "722f8cec-0fcc-4d5d-992b-baf7533b6a04" (UID: "722f8cec-0fcc-4d5d-992b-baf7533b6a04"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:01:01.069401 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.069378    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/722f8cec-0fcc-4d5d-992b-baf7533b6a04-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "722f8cec-0fcc-4d5d-992b-baf7533b6a04" (UID: "722f8cec-0fcc-4d5d-992b-baf7533b6a04"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:01:01.069461 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.069431    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-kube-api-access-xj8xg" (OuterVolumeSpecName: "kube-api-access-xj8xg") pod "722f8cec-0fcc-4d5d-992b-baf7533b6a04" (UID: "722f8cec-0fcc-4d5d-992b-baf7533b6a04"). InnerVolumeSpecName "kube-api-access-xj8xg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:01:01.069500 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.069484    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "722f8cec-0fcc-4d5d-992b-baf7533b6a04" (UID: "722f8cec-0fcc-4d5d-992b-baf7533b6a04"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:01:01.075826 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.075799    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/722f8cec-0fcc-4d5d-992b-baf7533b6a04-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "722f8cec-0fcc-4d5d-992b-baf7533b6a04" (UID: "722f8cec-0fcc-4d5d-992b-baf7533b6a04"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:01:01.167857 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.167818    2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/722f8cec-0fcc-4d5d-992b-baf7533b6a04-installation-pull-secrets\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:01:01.167857 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.167846    2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-bound-sa-token\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:01:01.167857 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.167856    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/722f8cec-0fcc-4d5d-992b-baf7533b6a04-trusted-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:01:01.167857 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.167864    2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/722f8cec-0fcc-4d5d-992b-baf7533b6a04-ca-trust-extracted\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:01:01.168115 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.167875    2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/722f8cec-0fcc-4d5d-992b-baf7533b6a04-image-registry-private-configuration\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:01:01.168115 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.167884    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-registry-tls\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:01:01.168115 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.167895    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xj8xg\" (UniqueName: \"kubernetes.io/projected/722f8cec-0fcc-4d5d-992b-baf7533b6a04-kube-api-access-xj8xg\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:01:01.801500 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.801467    2576 generic.go:356] "Generic (PLEG): container finished" podID="722f8cec-0fcc-4d5d-992b-baf7533b6a04" containerID="2d1a62376d90b6e54495bb161614c67e20b29ce287b9e073deaabed50fb6b01a" exitCode=0
Jul 07 14:01:01.801928 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.801523    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql"
Jul 07 14:01:01.801928 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.801549    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql" event={"ID":"722f8cec-0fcc-4d5d-992b-baf7533b6a04","Type":"ContainerDied","Data":"2d1a62376d90b6e54495bb161614c67e20b29ce287b9e073deaabed50fb6b01a"}
Jul 07 14:01:01.801928 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.801598    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f89f8bd56-rpsql" event={"ID":"722f8cec-0fcc-4d5d-992b-baf7533b6a04","Type":"ContainerDied","Data":"dc8220b21d612264f105a54b95a362eb4101427826c863453cd341dc5e8e5b2c"}
Jul 07 14:01:01.801928 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.801623    2576 scope.go:117] "RemoveContainer" containerID="2d1a62376d90b6e54495bb161614c67e20b29ce287b9e073deaabed50fb6b01a"
Jul 07 14:01:01.803421 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.803400    2576 generic.go:356] "Generic (PLEG): container finished" podID="449662d7-d129-4774-bc10-7b32dc658f15" containerID="e689e2d525fbce0153e08dcaa66f2a740e28436d8431176929251720ec5f8a81" exitCode=0
Jul 07 14:01:01.803546 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.803475    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-76dfd" event={"ID":"449662d7-d129-4774-bc10-7b32dc658f15","Type":"ContainerDied","Data":"e689e2d525fbce0153e08dcaa66f2a740e28436d8431176929251720ec5f8a81"}
Jul 07 14:01:01.803800 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.803785    2576 scope.go:117] "RemoveContainer" containerID="e689e2d525fbce0153e08dcaa66f2a740e28436d8431176929251720ec5f8a81"
Jul 07 14:01:01.813730 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.813715    2576 scope.go:117] "RemoveContainer" containerID="2d1a62376d90b6e54495bb161614c67e20b29ce287b9e073deaabed50fb6b01a"
Jul 07 14:01:01.814044 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:01:01.814024    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d1a62376d90b6e54495bb161614c67e20b29ce287b9e073deaabed50fb6b01a\": container with ID starting with 2d1a62376d90b6e54495bb161614c67e20b29ce287b9e073deaabed50fb6b01a not found: ID does not exist" containerID="2d1a62376d90b6e54495bb161614c67e20b29ce287b9e073deaabed50fb6b01a"
Jul 07 14:01:01.814101 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.814054    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d1a62376d90b6e54495bb161614c67e20b29ce287b9e073deaabed50fb6b01a"} err="failed to get container status \"2d1a62376d90b6e54495bb161614c67e20b29ce287b9e073deaabed50fb6b01a\": rpc error: code = NotFound desc = could not find container \"2d1a62376d90b6e54495bb161614c67e20b29ce287b9e073deaabed50fb6b01a\": container with ID starting with 2d1a62376d90b6e54495bb161614c67e20b29ce287b9e073deaabed50fb6b01a not found: ID does not exist"
Jul 07 14:01:01.838099 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.838069    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f89f8bd56-rpsql"]
Jul 07 14:01:01.844642 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:01.844617    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7f89f8bd56-rpsql"]
Jul 07 14:01:02.809007 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:02.808970    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-76dfd" event={"ID":"449662d7-d129-4774-bc10-7b32dc658f15","Type":"ContainerStarted","Data":"e431ea6830716e52e27b7f3a500cb1a929d4546bf9650462909696e80cf2b74f"}
Jul 07 14:01:03.074300 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:03.074221    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="722f8cec-0fcc-4d5d-992b-baf7533b6a04" path="/var/lib/kubelet/pods/722f8cec-0fcc-4d5d-992b-baf7533b6a04/volumes"
Jul 07 14:01:06.831542 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:06.831510    2576 generic.go:356] "Generic (PLEG): container finished" podID="02ae2607-7b1c-4fcf-9528-5379c3534073" containerID="9e19d1bdc6c405a217da28e840fd677f1490864922de272703c0b2b3c8d17038" exitCode=0
Jul 07 14:01:06.831923 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:06.831593    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-2r2k8" event={"ID":"02ae2607-7b1c-4fcf-9528-5379c3534073","Type":"ContainerDied","Data":"9e19d1bdc6c405a217da28e840fd677f1490864922de272703c0b2b3c8d17038"}
Jul 07 14:01:06.831923 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:06.831917    2576 scope.go:117] "RemoveContainer" containerID="9e19d1bdc6c405a217da28e840fd677f1490864922de272703c0b2b3c8d17038"
Jul 07 14:01:07.838053 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:07.838018    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-2r2k8" event={"ID":"02ae2607-7b1c-4fcf-9528-5379c3534073","Type":"ContainerStarted","Data":"27a50e05bbaf007bebb2eafba5f93d30cab7e6fd1e6917c9df905ebbdd5368d8"}
Jul 07 14:01:07.839588 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:07.839557    2576 generic.go:356] "Generic (PLEG): container finished" podID="c932b4f6-5a4a-45f4-aa12-03bc4845857d" containerID="ca11ef881b109e509370a6b9179a3912601ca3e2b2fd33325b7613a4614f499c" exitCode=0
Jul 07 14:01:07.839717 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:07.839638    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-qtl92" event={"ID":"c932b4f6-5a4a-45f4-aa12-03bc4845857d","Type":"ContainerDied","Data":"ca11ef881b109e509370a6b9179a3912601ca3e2b2fd33325b7613a4614f499c"}
Jul 07 14:01:07.839988 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:07.839974    2576 scope.go:117] "RemoveContainer" containerID="ca11ef881b109e509370a6b9179a3912601ca3e2b2fd33325b7613a4614f499c"
Jul 07 14:01:08.845448 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:08.845414    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-qtl92" event={"ID":"c932b4f6-5a4a-45f4-aa12-03bc4845857d","Type":"ContainerStarted","Data":"a960ddc8f23e9f5b99b755dd2fabdbe7bc1c00e7edc81ab1701cc4a61aa467d4"}
Jul 07 14:01:41.152123 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:41.152088    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:01:41.251774 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:41.251736    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:01:53.067491 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:53.067381    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:01:53.125243 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:53.125205    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:01:57.037933 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:57.037887    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:01:57.135888 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:57.135854    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:01:57.236652 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:57.236610    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:01:59.275176 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:59.275137    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:01:59.344416 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:59.344381    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:01:59.413720 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:59.413686    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:02:00.000004 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:01:59.999969    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:02:00.064004 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:02:00.063972    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:02:10.257995 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:02:10.257962    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:02:10.358981 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:02:10.358933    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:02:10.460051 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:02:10.460017    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:02:12.694756 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:02:12.694721    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:02:18.341629 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:02:18.341595    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:02:41.707346 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:02:41.707311    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:02:41.775261 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:02:41.775229    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:03:17.556085 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:03:17.556002    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:03:17.657766 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:03:17.657719    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:03:18.978557 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:03:18.978523    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:03:20.403820 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:03:20.403784    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:03:46.048955 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:03:46.048900    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:03:46.995932 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:03:46.995896    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:03:50.059155 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:03:50.059116    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:03:50.158411 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:03:50.158383    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:03:50.983591 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:03:50.983558    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:03:51.126308 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:03:51.126276    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:03:51.848569 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:03:51.848526    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:03:51.971216 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:03:51.971177    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:03:54.249101 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:03:54.249068    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:03:54.519043 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:03:54.518930    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:03:54.843443 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:03:54.843358    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bglbr_d36dada3-7ddc-4de9-a1d5-62ff1f867dd9/console-operator/1.log"
Jul 07 14:03:54.848237 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:03:54.848212    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zdfvw_9bcfc7b3-a523-42e2-add9-c7f0f1e187ce/ovn-acl-logging/0.log"
Jul 07 14:03:54.853013 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:03:54.852986    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bglbr_d36dada3-7ddc-4de9-a1d5-62ff1f867dd9/console-operator/1.log"
Jul 07 14:03:54.856188 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:03:54.856170    2576 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 14:03:54.858573 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:03:54.858553    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zdfvw_9bcfc7b3-a523-42e2-add9-c7f0f1e187ce/ovn-acl-logging/0.log"
Jul 07 14:03:56.438170 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:03:56.438135    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:03:56.536893 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:03:56.536857    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:01.176756 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:01.176720    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:02.770596 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:02.770564    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:07.361075 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:07.361036    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:07.462440 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:07.462397    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:09.817299 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:09.817262    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:22.448340 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:22.448298    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:22.547519 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:22.547486    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:23.065207 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:23.065174    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:23.340995 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:23.340886    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:23.456040 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:23.455998    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:23.540325 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:23.540295    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66d498b796-szhx6"]
Jul 07 14:04:23.540627 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:23.540613    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="722f8cec-0fcc-4d5d-992b-baf7533b6a04" containerName="registry"
Jul 07 14:04:23.540676 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:23.540629    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="722f8cec-0fcc-4d5d-992b-baf7533b6a04" containerName="registry"
Jul 07 14:04:23.540710 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:23.540688    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="722f8cec-0fcc-4d5d-992b-baf7533b6a04" containerName="registry"
Jul 07 14:04:23.542884 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:23.542864    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-szhx6"
Jul 07 14:04:23.546020 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:23.546000    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 14:04:23.546510 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:23.546496    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 14:04:23.546575 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:23.546555    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 14:04:23.546860 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:23.546843    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 14:04:23.547913 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:23.547897    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6r6n2\""
Jul 07 14:04:23.569369 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:23.569329    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66d498b796-szhx6"]
Jul 07 14:04:23.575171 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:23.575144    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ccfb2894-91a4-41c5-88f9-5113f427a92e-manifests\") pod \"opendatahub-operator-controller-manager-66d498b796-szhx6\" (UID: \"ccfb2894-91a4-41c5-88f9-5113f427a92e\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-szhx6"
Jul 07 14:04:23.575339 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:23.575180    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ccfb2894-91a4-41c5-88f9-5113f427a92e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66d498b796-szhx6\" (UID: \"ccfb2894-91a4-41c5-88f9-5113f427a92e\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-szhx6"
Jul 07 14:04:23.575339 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:23.575246    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnrnv\" (UniqueName: \"kubernetes.io/projected/ccfb2894-91a4-41c5-88f9-5113f427a92e-kube-api-access-wnrnv\") pod \"opendatahub-operator-controller-manager-66d498b796-szhx6\" (UID: \"ccfb2894-91a4-41c5-88f9-5113f427a92e\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-szhx6"
Jul 07 14:04:23.575455 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:23.575348    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccfb2894-91a4-41c5-88f9-5113f427a92e-tmp\") pod \"opendatahub-operator-controller-manager-66d498b796-szhx6\" (UID: \"ccfb2894-91a4-41c5-88f9-5113f427a92e\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-szhx6"
Jul 07 14:04:23.575455 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:23.575385    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ccfb2894-91a4-41c5-88f9-5113f427a92e-webhook-cert\") pod \"opendatahub-operator-controller-manager-66d498b796-szhx6\" (UID: \"ccfb2894-91a4-41c5-88f9-5113f427a92e\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-szhx6"
Jul 07 14:04:23.676553 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:23.676461    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ccfb2894-91a4-41c5-88f9-5113f427a92e-webhook-cert\") pod \"opendatahub-operator-controller-manager-66d498b796-szhx6\" (UID: \"ccfb2894-91a4-41c5-88f9-5113f427a92e\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-szhx6"
Jul 07 14:04:23.676553 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:23.676525    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ccfb2894-91a4-41c5-88f9-5113f427a92e-manifests\") pod \"opendatahub-operator-controller-manager-66d498b796-szhx6\" (UID: \"ccfb2894-91a4-41c5-88f9-5113f427a92e\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-szhx6"
Jul 07 14:04:23.676739 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:23.676560    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ccfb2894-91a4-41c5-88f9-5113f427a92e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66d498b796-szhx6\" (UID: \"ccfb2894-91a4-41c5-88f9-5113f427a92e\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-szhx6"
Jul 07 14:04:23.676739 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:23.676697    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnrnv\" (UniqueName: \"kubernetes.io/projected/ccfb2894-91a4-41c5-88f9-5113f427a92e-kube-api-access-wnrnv\") pod \"opendatahub-operator-controller-manager-66d498b796-szhx6\" (UID: \"ccfb2894-91a4-41c5-88f9-5113f427a92e\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-szhx6"
Jul 07 14:04:23.676823 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:23.676760    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccfb2894-91a4-41c5-88f9-5113f427a92e-tmp\") pod \"opendatahub-operator-controller-manager-66d498b796-szhx6\" (UID: \"ccfb2894-91a4-41c5-88f9-5113f427a92e\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-szhx6"
Jul 07 14:04:23.677007 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:23.676933    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ccfb2894-91a4-41c5-88f9-5113f427a92e-manifests\") pod \"opendatahub-operator-controller-manager-66d498b796-szhx6\" (UID: \"ccfb2894-91a4-41c5-88f9-5113f427a92e\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-szhx6"
Jul 07 14:04:23.678923 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:23.678891    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccfb2894-91a4-41c5-88f9-5113f427a92e-tmp\") pod \"opendatahub-operator-controller-manager-66d498b796-szhx6\" (UID: \"ccfb2894-91a4-41c5-88f9-5113f427a92e\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-szhx6"
Jul 07 14:04:23.679212 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:23.679193    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ccfb2894-91a4-41c5-88f9-5113f427a92e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-66d498b796-szhx6\" (UID: \"ccfb2894-91a4-41c5-88f9-5113f427a92e\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-szhx6"
Jul 07 14:04:23.679277 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:23.679222    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ccfb2894-91a4-41c5-88f9-5113f427a92e-webhook-cert\") pod \"opendatahub-operator-controller-manager-66d498b796-szhx6\" (UID: \"ccfb2894-91a4-41c5-88f9-5113f427a92e\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-szhx6"
Jul 07 14:04:23.686440 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:23.686412    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnrnv\" (UniqueName: \"kubernetes.io/projected/ccfb2894-91a4-41c5-88f9-5113f427a92e-kube-api-access-wnrnv\") pod \"opendatahub-operator-controller-manager-66d498b796-szhx6\" (UID: \"ccfb2894-91a4-41c5-88f9-5113f427a92e\") " pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-szhx6"
Jul 07 14:04:23.692193 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:23.692156    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:23.794087 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:23.794036    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:23.854073 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:23.854029    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-szhx6"
Jul 07 14:04:23.894918 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:23.894872    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:23.980306 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:23.980261    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:24.001478 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:24.001457    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-66d498b796-szhx6"]
Jul 07 14:04:24.003712 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:04:24.003681    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccfb2894_91a4_41c5_88f9_5113f427a92e.slice/crio-d6f6d497de4d99ab51cecce1ffa59fe014b0ead32f6d7c4e4386c6e8226be528 WatchSource:0}: Error finding container d6f6d497de4d99ab51cecce1ffa59fe014b0ead32f6d7c4e4386c6e8226be528: Status 404 returned error can't find the container with id d6f6d497de4d99ab51cecce1ffa59fe014b0ead32f6d7c4e4386c6e8226be528
Jul 07 14:04:24.005481 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:24.005463    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 14:04:24.074538 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:24.074507    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:24.217363 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:24.217321    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:24.609036 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:24.608959    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-szhx6" event={"ID":"ccfb2894-91a4-41c5-88f9-5113f427a92e","Type":"ContainerStarted","Data":"d6f6d497de4d99ab51cecce1ffa59fe014b0ead32f6d7c4e4386c6e8226be528"}
Jul 07 14:04:27.624956 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:27.624863    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-szhx6" event={"ID":"ccfb2894-91a4-41c5-88f9-5113f427a92e","Type":"ContainerStarted","Data":"6a66d40f607e1eb7f44b50f379d031c7a35e138cd5a5bb6a95a224f0ade67aad"}
Jul 07 14:04:28.630216 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:28.630181    2576 generic.go:356] "Generic (PLEG): container finished" podID="ccfb2894-91a4-41c5-88f9-5113f427a92e" containerID="6a66d40f607e1eb7f44b50f379d031c7a35e138cd5a5bb6a95a224f0ade67aad" exitCode=0
Jul 07 14:04:28.630646 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:28.630265    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-szhx6" event={"ID":"ccfb2894-91a4-41c5-88f9-5113f427a92e","Type":"ContainerDied","Data":"6a66d40f607e1eb7f44b50f379d031c7a35e138cd5a5bb6a95a224f0ade67aad"}
Jul 07 14:04:29.637257 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:29.637210    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-szhx6" event={"ID":"ccfb2894-91a4-41c5-88f9-5113f427a92e","Type":"ContainerStarted","Data":"eec0ba85aa6de456e04c8f329523c7589ef8edd6a682c8cd3afd701b7de6852d"}
Jul 07 14:04:29.637742 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:29.637334    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-szhx6"
Jul 07 14:04:29.681400 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:29.681336    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-szhx6" podStartSLOduration=1.9666715959999999 podStartE2EDuration="6.681311845s" totalImagesPullingTime="3.663717845s" totalInitContainerRuntime="1.050922404s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:04:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:04:29.678743263 +0000 UTC m=+335.291022238" watchObservedRunningTime="2026-07-07 14:04:29.681311845 +0000 UTC m=+335.293590817"
Jul 07 14:04:32.154962 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:32.154898    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:32.255750 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:32.255703    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:34.603887 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:34.603856    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:34.704261 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:34.704210    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:34.814898 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:34.814862    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:40.644362 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:40.644332    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-66d498b796-szhx6"
Jul 07 14:04:45.326543 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:45.326502    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:45.682489 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:45.682380    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:45.938846 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:45.938806    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:45.972681 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:45.972646    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8459dd97f9-ttpl8"]
Jul 07 14:04:45.983499 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:45.983467    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8459dd97f9-ttpl8"
Jul 07 14:04:45.988922 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:45.988898    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 07 14:04:45.989067 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:45.988985    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 07 14:04:46.017010 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:46.016981    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8459dd97f9-ttpl8"]
Jul 07 14:04:46.071047 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:46.071016    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pvh8\" (UniqueName: \"kubernetes.io/projected/601f4ca6-623e-43a4-93b0-8b7d64e028f9-kube-api-access-4pvh8\") pod \"kube-auth-proxy-8459dd97f9-ttpl8\" (UID: \"601f4ca6-623e-43a4-93b0-8b7d64e028f9\") " pod="openshift-ingress/kube-auth-proxy-8459dd97f9-ttpl8"
Jul 07 14:04:46.071239 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:46.071120    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/601f4ca6-623e-43a4-93b0-8b7d64e028f9-tls-certs\") pod \"kube-auth-proxy-8459dd97f9-ttpl8\" (UID: \"601f4ca6-623e-43a4-93b0-8b7d64e028f9\") " pod="openshift-ingress/kube-auth-proxy-8459dd97f9-ttpl8"
Jul 07 14:04:46.071239 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:46.071178    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/601f4ca6-623e-43a4-93b0-8b7d64e028f9-tmp\") pod \"kube-auth-proxy-8459dd97f9-ttpl8\" (UID: \"601f4ca6-623e-43a4-93b0-8b7d64e028f9\") " pod="openshift-ingress/kube-auth-proxy-8459dd97f9-ttpl8"
Jul 07 14:04:46.171683 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:46.171641    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/601f4ca6-623e-43a4-93b0-8b7d64e028f9-tls-certs\") pod \"kube-auth-proxy-8459dd97f9-ttpl8\" (UID: \"601f4ca6-623e-43a4-93b0-8b7d64e028f9\") " pod="openshift-ingress/kube-auth-proxy-8459dd97f9-ttpl8"
Jul 07 14:04:46.171863 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:46.171732    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/601f4ca6-623e-43a4-93b0-8b7d64e028f9-tmp\") pod \"kube-auth-proxy-8459dd97f9-ttpl8\" (UID: \"601f4ca6-623e-43a4-93b0-8b7d64e028f9\") " pod="openshift-ingress/kube-auth-proxy-8459dd97f9-ttpl8"
Jul 07 14:04:46.171863 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:46.171800    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pvh8\" (UniqueName: \"kubernetes.io/projected/601f4ca6-623e-43a4-93b0-8b7d64e028f9-kube-api-access-4pvh8\") pod \"kube-auth-proxy-8459dd97f9-ttpl8\" (UID: \"601f4ca6-623e-43a4-93b0-8b7d64e028f9\") " pod="openshift-ingress/kube-auth-proxy-8459dd97f9-ttpl8"
Jul 07 14:04:46.174174 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:46.174147    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/601f4ca6-623e-43a4-93b0-8b7d64e028f9-tmp\") pod \"kube-auth-proxy-8459dd97f9-ttpl8\" (UID: \"601f4ca6-623e-43a4-93b0-8b7d64e028f9\") " pod="openshift-ingress/kube-auth-proxy-8459dd97f9-ttpl8"
Jul 07 14:04:46.174285 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:46.174175    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/601f4ca6-623e-43a4-93b0-8b7d64e028f9-tls-certs\") pod \"kube-auth-proxy-8459dd97f9-ttpl8\" (UID: \"601f4ca6-623e-43a4-93b0-8b7d64e028f9\") " pod="openshift-ingress/kube-auth-proxy-8459dd97f9-ttpl8"
Jul 07 14:04:46.196551 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:46.196493    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pvh8\" (UniqueName: \"kubernetes.io/projected/601f4ca6-623e-43a4-93b0-8b7d64e028f9-kube-api-access-4pvh8\") pod \"kube-auth-proxy-8459dd97f9-ttpl8\" (UID: \"601f4ca6-623e-43a4-93b0-8b7d64e028f9\") " pod="openshift-ingress/kube-auth-proxy-8459dd97f9-ttpl8"
Jul 07 14:04:46.209458 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:46.209413    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:46.294029 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:46.293987    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8459dd97f9-ttpl8"
Jul 07 14:04:46.365030 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:46.365003    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jkw2d"]
Jul 07 14:04:46.367573 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:46.367552    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-jkw2d"
Jul 07 14:04:46.372760 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:46.372737    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-fpnx4\""
Jul 07 14:04:46.373049 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:46.373030    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 07 14:04:46.388455 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:46.388431    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jkw2d"]
Jul 07 14:04:46.446719 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:46.446654    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8459dd97f9-ttpl8"]
Jul 07 14:04:46.448253 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:04:46.448230    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod601f4ca6_623e_43a4_93b0_8b7d64e028f9.slice/crio-aa7dc91230d9ab8b3366cae72f3711436ceb7c013068e9feafee1c3a57d60892 WatchSource:0}: Error finding container aa7dc91230d9ab8b3366cae72f3711436ceb7c013068e9feafee1c3a57d60892: Status 404 returned error can't find the container with id aa7dc91230d9ab8b3366cae72f3711436ceb7c013068e9feafee1c3a57d60892
Jul 07 14:04:46.460959 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:46.460919    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:46.474787 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:46.474750    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f20482f-e21f-461c-860b-1eddc97aa724-cert\") pod \"odh-model-controller-7998c67dc4-jkw2d\" (UID: \"5f20482f-e21f-461c-860b-1eddc97aa724\") " pod="opendatahub/odh-model-controller-7998c67dc4-jkw2d"
Jul 07 14:04:46.474989 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:46.474823    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgxfp\" (UniqueName: \"kubernetes.io/projected/5f20482f-e21f-461c-860b-1eddc97aa724-kube-api-access-vgxfp\") pod \"odh-model-controller-7998c67dc4-jkw2d\" (UID: \"5f20482f-e21f-461c-860b-1eddc97aa724\") " pod="opendatahub/odh-model-controller-7998c67dc4-jkw2d"
Jul 07 14:04:46.549889 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:46.549853    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:46.575741 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:46.575710    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f20482f-e21f-461c-860b-1eddc97aa724-cert\") pod \"odh-model-controller-7998c67dc4-jkw2d\" (UID: \"5f20482f-e21f-461c-860b-1eddc97aa724\") " pod="opendatahub/odh-model-controller-7998c67dc4-jkw2d"
Jul 07 14:04:46.575930 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:46.575764    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgxfp\" (UniqueName: \"kubernetes.io/projected/5f20482f-e21f-461c-860b-1eddc97aa724-kube-api-access-vgxfp\") pod \"odh-model-controller-7998c67dc4-jkw2d\" (UID: \"5f20482f-e21f-461c-860b-1eddc97aa724\") " pod="opendatahub/odh-model-controller-7998c67dc4-jkw2d"
Jul 07 14:04:46.575930 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:04:46.575884    2576 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 07 14:04:46.576081 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:04:46.575974    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f20482f-e21f-461c-860b-1eddc97aa724-cert podName:5f20482f-e21f-461c-860b-1eddc97aa724 nodeName:}" failed. No retries permitted until 2026-07-07 14:04:47.075952135 +0000 UTC m=+352.688231099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5f20482f-e21f-461c-860b-1eddc97aa724-cert") pod "odh-model-controller-7998c67dc4-jkw2d" (UID: "5f20482f-e21f-461c-860b-1eddc97aa724") : secret "odh-model-controller-webhook-cert" not found
Jul 07 14:04:46.593864 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:46.593830    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgxfp\" (UniqueName: \"kubernetes.io/projected/5f20482f-e21f-461c-860b-1eddc97aa724-kube-api-access-vgxfp\") pod \"odh-model-controller-7998c67dc4-jkw2d\" (UID: \"5f20482f-e21f-461c-860b-1eddc97aa724\") " pod="opendatahub/odh-model-controller-7998c67dc4-jkw2d"
Jul 07 14:04:46.657868 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:46.657818    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:46.711819 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:46.711735    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8459dd97f9-ttpl8" event={"ID":"601f4ca6-623e-43a4-93b0-8b7d64e028f9","Type":"ContainerStarted","Data":"aa7dc91230d9ab8b3366cae72f3711436ceb7c013068e9feafee1c3a57d60892"}
Jul 07 14:04:46.947511 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:46.947479    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:47.080643 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:47.080554    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f20482f-e21f-461c-860b-1eddc97aa724-cert\") pod \"odh-model-controller-7998c67dc4-jkw2d\" (UID: \"5f20482f-e21f-461c-860b-1eddc97aa724\") " pod="opendatahub/odh-model-controller-7998c67dc4-jkw2d"
Jul 07 14:04:47.083042 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:47.083018    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f20482f-e21f-461c-860b-1eddc97aa724-cert\") pod \"odh-model-controller-7998c67dc4-jkw2d\" (UID: \"5f20482f-e21f-461c-860b-1eddc97aa724\") " pod="opendatahub/odh-model-controller-7998c67dc4-jkw2d"
Jul 07 14:04:47.281092 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:47.281055    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-jkw2d"
Jul 07 14:04:47.285137 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:47.285111    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wj2dh"]
Jul 07 14:04:47.288796 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:47.288773    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-wj2dh"
Jul 07 14:04:47.292624 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:47.292489    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 07 14:04:47.292741 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:47.292729    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-vf2d5\""
Jul 07 14:04:47.326326 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:47.326259    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wj2dh"]
Jul 07 14:04:47.338151 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:47.338031    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:47.383187 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:47.383156    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebbde3be-28ff-4a6e-b663-a335f306d6bb-tls-certs\") pod \"model-serving-api-54d89bd5fc-wj2dh\" (UID: \"ebbde3be-28ff-4a6e-b663-a335f306d6bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-wj2dh"
Jul 07 14:04:47.383595 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:47.383200    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjz47\" (UniqueName: \"kubernetes.io/projected/ebbde3be-28ff-4a6e-b663-a335f306d6bb-kube-api-access-qjz47\") pod \"model-serving-api-54d89bd5fc-wj2dh\" (UID: \"ebbde3be-28ff-4a6e-b663-a335f306d6bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-wj2dh"
Jul 07 14:04:47.477092 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:47.477051    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jkw2d"]
Jul 07 14:04:47.486851 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:47.484705    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebbde3be-28ff-4a6e-b663-a335f306d6bb-tls-certs\") pod \"model-serving-api-54d89bd5fc-wj2dh\" (UID: \"ebbde3be-28ff-4a6e-b663-a335f306d6bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-wj2dh"
Jul 07 14:04:47.486851 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:47.484755    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjz47\" (UniqueName: \"kubernetes.io/projected/ebbde3be-28ff-4a6e-b663-a335f306d6bb-kube-api-access-qjz47\") pod \"model-serving-api-54d89bd5fc-wj2dh\" (UID: \"ebbde3be-28ff-4a6e-b663-a335f306d6bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-wj2dh"
Jul 07 14:04:47.486851 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:04:47.485216    2576 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 07 14:04:47.486851 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:04:47.485292    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebbde3be-28ff-4a6e-b663-a335f306d6bb-tls-certs podName:ebbde3be-28ff-4a6e-b663-a335f306d6bb nodeName:}" failed. No retries permitted until 2026-07-07 14:04:47.985270987 +0000 UTC m=+353.597549950 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/ebbde3be-28ff-4a6e-b663-a335f306d6bb-tls-certs") pod "model-serving-api-54d89bd5fc-wj2dh" (UID: "ebbde3be-28ff-4a6e-b663-a335f306d6bb") : secret "model-serving-api-tls" not found
Jul 07 14:04:47.486851 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:04:47.485853    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f20482f_e21f_461c_860b_1eddc97aa724.slice/crio-dc02127eda14089969b482a02cb49c7bb849b50b883dc5a214beaa1432f885df WatchSource:0}: Error finding container dc02127eda14089969b482a02cb49c7bb849b50b883dc5a214beaa1432f885df: Status 404 returned error can't find the container with id dc02127eda14089969b482a02cb49c7bb849b50b883dc5a214beaa1432f885df
Jul 07 14:04:47.502859 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:47.502771    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjz47\" (UniqueName: \"kubernetes.io/projected/ebbde3be-28ff-4a6e-b663-a335f306d6bb-kube-api-access-qjz47\") pod \"model-serving-api-54d89bd5fc-wj2dh\" (UID: \"ebbde3be-28ff-4a6e-b663-a335f306d6bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-wj2dh"
Jul 07 14:04:47.718087 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:47.718051    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-jkw2d" event={"ID":"5f20482f-e21f-461c-860b-1eddc97aa724","Type":"ContainerStarted","Data":"dc02127eda14089969b482a02cb49c7bb849b50b883dc5a214beaa1432f885df"}
Jul 07 14:04:47.824827 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:47.824791    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:47.989826 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:47.989740    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebbde3be-28ff-4a6e-b663-a335f306d6bb-tls-certs\") pod \"model-serving-api-54d89bd5fc-wj2dh\" (UID: \"ebbde3be-28ff-4a6e-b663-a335f306d6bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-wj2dh"
Jul 07 14:04:47.992377 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:47.992354    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebbde3be-28ff-4a6e-b663-a335f306d6bb-tls-certs\") pod \"model-serving-api-54d89bd5fc-wj2dh\" (UID: \"ebbde3be-28ff-4a6e-b663-a335f306d6bb\") " pod="opendatahub/model-serving-api-54d89bd5fc-wj2dh"
Jul 07 14:04:48.122187 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.122148    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:48.139281 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.139249    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-j2js8"]
Jul 07 14:04:48.143728 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.143710    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j2js8"
Jul 07 14:04:48.148988 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.148750    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 14:04:48.148988 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.148799    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 07 14:04:48.148988 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.148827    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 07 14:04:48.148988 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.148877    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 07 14:04:48.148988 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.148961    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-84xkh\""
Jul 07 14:04:48.163222 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.163195    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-j2js8"]
Jul 07 14:04:48.213056 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.213025    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:48.218861 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.218836    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-wj2dh"
Jul 07 14:04:48.296077 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.296043    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/230fcb55-1253-48a0-8cb2-71a8854f579a-cacerts\") pod \"istiod-openshift-gateway-7574459656-j2js8\" (UID: \"230fcb55-1253-48a0-8cb2-71a8854f579a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j2js8"
Jul 07 14:04:48.296230 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.296097    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/230fcb55-1253-48a0-8cb2-71a8854f579a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-j2js8\" (UID: \"230fcb55-1253-48a0-8cb2-71a8854f579a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j2js8"
Jul 07 14:04:48.296230 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.296137    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/230fcb55-1253-48a0-8cb2-71a8854f579a-istio-token\") pod \"istiod-openshift-gateway-7574459656-j2js8\" (UID: \"230fcb55-1253-48a0-8cb2-71a8854f579a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j2js8"
Jul 07 14:04:48.296230 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.296211    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/230fcb55-1253-48a0-8cb2-71a8854f579a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-j2js8\" (UID: \"230fcb55-1253-48a0-8cb2-71a8854f579a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j2js8"
Jul 07 14:04:48.296378 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.296252    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/230fcb55-1253-48a0-8cb2-71a8854f579a-local-certs\") pod \"istiod-openshift-gateway-7574459656-j2js8\" (UID: \"230fcb55-1253-48a0-8cb2-71a8854f579a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j2js8"
Jul 07 14:04:48.296460 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.296373    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/230fcb55-1253-48a0-8cb2-71a8854f579a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-j2js8\" (UID: \"230fcb55-1253-48a0-8cb2-71a8854f579a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j2js8"
Jul 07 14:04:48.296460 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.296449    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ff9z\" (UniqueName: \"kubernetes.io/projected/230fcb55-1253-48a0-8cb2-71a8854f579a-kube-api-access-9ff9z\") pod \"istiod-openshift-gateway-7574459656-j2js8\" (UID: \"230fcb55-1253-48a0-8cb2-71a8854f579a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j2js8"
Jul 07 14:04:48.373923 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.373888    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wj2dh"]
Jul 07 14:04:48.397295 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.397256    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/230fcb55-1253-48a0-8cb2-71a8854f579a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-j2js8\" (UID: \"230fcb55-1253-48a0-8cb2-71a8854f579a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j2js8"
Jul 07 14:04:48.397727 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.397317    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ff9z\" (UniqueName: \"kubernetes.io/projected/230fcb55-1253-48a0-8cb2-71a8854f579a-kube-api-access-9ff9z\") pod \"istiod-openshift-gateway-7574459656-j2js8\" (UID: \"230fcb55-1253-48a0-8cb2-71a8854f579a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j2js8"
Jul 07 14:04:48.397727 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.397341    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/230fcb55-1253-48a0-8cb2-71a8854f579a-cacerts\") pod \"istiod-openshift-gateway-7574459656-j2js8\" (UID: \"230fcb55-1253-48a0-8cb2-71a8854f579a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j2js8"
Jul 07 14:04:48.397727 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.397360    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/230fcb55-1253-48a0-8cb2-71a8854f579a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-j2js8\" (UID: \"230fcb55-1253-48a0-8cb2-71a8854f579a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j2js8"
Jul 07 14:04:48.397727 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.397564    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/230fcb55-1253-48a0-8cb2-71a8854f579a-istio-token\") pod \"istiod-openshift-gateway-7574459656-j2js8\" (UID: \"230fcb55-1253-48a0-8cb2-71a8854f579a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j2js8"
Jul 07 14:04:48.397727 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.397639    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/230fcb55-1253-48a0-8cb2-71a8854f579a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-j2js8\" (UID: \"230fcb55-1253-48a0-8cb2-71a8854f579a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j2js8"
Jul 07 14:04:48.397727 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.397693    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/230fcb55-1253-48a0-8cb2-71a8854f579a-local-certs\") pod \"istiod-openshift-gateway-7574459656-j2js8\" (UID: \"230fcb55-1253-48a0-8cb2-71a8854f579a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j2js8"
Jul 07 14:04:48.398351 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.398321    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/230fcb55-1253-48a0-8cb2-71a8854f579a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-j2js8\" (UID: \"230fcb55-1253-48a0-8cb2-71a8854f579a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j2js8"
Jul 07 14:04:48.399709 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.399690    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/230fcb55-1253-48a0-8cb2-71a8854f579a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-j2js8\" (UID: \"230fcb55-1253-48a0-8cb2-71a8854f579a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j2js8"
Jul 07 14:04:48.399816 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.399770    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/230fcb55-1253-48a0-8cb2-71a8854f579a-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-j2js8\" (UID: \"230fcb55-1253-48a0-8cb2-71a8854f579a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j2js8"
Jul 07 14:04:48.400130 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.400114    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/230fcb55-1253-48a0-8cb2-71a8854f579a-local-certs\") pod \"istiod-openshift-gateway-7574459656-j2js8\" (UID: \"230fcb55-1253-48a0-8cb2-71a8854f579a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j2js8"
Jul 07 14:04:48.400432 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.400413    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/230fcb55-1253-48a0-8cb2-71a8854f579a-cacerts\") pod \"istiod-openshift-gateway-7574459656-j2js8\" (UID: \"230fcb55-1253-48a0-8cb2-71a8854f579a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j2js8"
Jul 07 14:04:48.406494 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.406470    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ff9z\" (UniqueName: \"kubernetes.io/projected/230fcb55-1253-48a0-8cb2-71a8854f579a-kube-api-access-9ff9z\") pod \"istiod-openshift-gateway-7574459656-j2js8\" (UID: \"230fcb55-1253-48a0-8cb2-71a8854f579a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j2js8"
Jul 07 14:04:48.406569 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.406511    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/230fcb55-1253-48a0-8cb2-71a8854f579a-istio-token\") pod \"istiod-openshift-gateway-7574459656-j2js8\" (UID: \"230fcb55-1253-48a0-8cb2-71a8854f579a\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-j2js8"
Jul 07 14:04:48.453751 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.453718    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j2js8"
Jul 07 14:04:48.619708 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.619671    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-j2js8"]
Jul 07 14:04:48.621751 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:04:48.621722    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod230fcb55_1253_48a0_8cb2_71a8854f579a.slice/crio-b926e983d8abba074486a2ea225bfa631cfbce454c3a066011208c6ab7970453 WatchSource:0}: Error finding container b926e983d8abba074486a2ea225bfa631cfbce454c3a066011208c6ab7970453: Status 404 returned error can't find the container with id b926e983d8abba074486a2ea225bfa631cfbce454c3a066011208c6ab7970453
Jul 07 14:04:48.726319 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.726240    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j2js8" event={"ID":"230fcb55-1253-48a0-8cb2-71a8854f579a","Type":"ContainerStarted","Data":"b926e983d8abba074486a2ea225bfa631cfbce454c3a066011208c6ab7970453"}
Jul 07 14:04:48.727622 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:48.727588    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-wj2dh" event={"ID":"ebbde3be-28ff-4a6e-b663-a335f306d6bb","Type":"ContainerStarted","Data":"2f4dbbdbe4b0c39f56badd374642c691544000c45713a50a0a0428ee67ed948d"}
Jul 07 14:04:49.459519 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:49.459477    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:52.754203 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:52.754124    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8459dd97f9-ttpl8" event={"ID":"601f4ca6-623e-43a4-93b0-8b7d64e028f9","Type":"ContainerStarted","Data":"48e01c2b58e456221fa2f6126a7737b1755795246942f3bc7652b3eb028e22f1"}
Jul 07 14:04:52.756663 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:52.756597    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-jkw2d" event={"ID":"5f20482f-e21f-461c-860b-1eddc97aa724","Type":"ContainerStarted","Data":"f186fa8088063768a06a869f4d096fefa8a03c1386a1ff1cf191fcd92b1f581e"}
Jul 07 14:04:52.756810 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:52.756688    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-jkw2d"
Jul 07 14:04:52.758512 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:52.758395    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-wj2dh" event={"ID":"ebbde3be-28ff-4a6e-b663-a335f306d6bb","Type":"ContainerStarted","Data":"99077a7154d743f89349fc291dd43ab12ec01ee7e6283de911b96d43ae5403ca"}
Jul 07 14:04:52.758512 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:52.758463    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-wj2dh"
Jul 07 14:04:52.774970 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:52.774901    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8459dd97f9-ttpl8" podStartSLOduration=2.322649466 podStartE2EDuration="7.774882493s" totalImagesPullingTime="5.452233027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:04:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:04:52.772898284 +0000 UTC m=+358.385177256" watchObservedRunningTime="2026-07-07 14:04:52.774882493 +0000 UTC m=+358.387161466"
Jul 07 14:04:52.794366 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:52.794301    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-jkw2d" podStartSLOduration=2.360311945 podStartE2EDuration="6.794280269s" totalImagesPullingTime="4.433968324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:04:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:04:52.793244363 +0000 UTC m=+358.405523372" watchObservedRunningTime="2026-07-07 14:04:52.794280269 +0000 UTC m=+358.406559242"
Jul 07 14:04:52.812608 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:52.812550    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-wj2dh" podStartSLOduration=2.282802061 podStartE2EDuration="5.812526907s" totalImagesPullingTime="3.529724846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:04:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:04:52.811273985 +0000 UTC m=+358.423552978" watchObservedRunningTime="2026-07-07 14:04:52.812526907 +0000 UTC m=+358.424805879"
Jul 07 14:04:53.183627 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:53.183590    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 14:04:53.183730 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:53.183663    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 14:04:53.765116 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:53.765079    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j2js8" event={"ID":"230fcb55-1253-48a0-8cb2-71a8854f579a","Type":"ContainerStarted","Data":"e50fc893cbee77e1f106675ef38665adb8c0cec9625414b24c53f7faea379ab2"}
Jul 07 14:04:53.765618 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:53.765458    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j2js8"
Jul 07 14:04:53.808964 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:53.808886    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j2js8" podStartSLOduration=1.250019314 podStartE2EDuration="5.808863844s" totalImagesPullingTime="4.55884453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:04:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:04:53.806734842 +0000 UTC m=+359.419013833" watchObservedRunningTime="2026-07-07 14:04:53.808863844 +0000 UTC m=+359.421142827"
Jul 07 14:04:53.817165 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:53.817130    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:53.908143 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:53.908107    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:54.772017 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:54.771988    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j2js8"
Jul 07 14:04:54.909392 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:54.909358    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:55.043252 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:55.043149    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:55.260682 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:55.260646    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:58.533116 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:58.531432    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:58.617620 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:58.617581    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-cfqnv"]
Jul 07 14:04:58.623105 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:58.623082    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cfqnv"
Jul 07 14:04:58.626317 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:58.626297    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 07 14:04:58.626771 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:58.626748    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-wnftb\""
Jul 07 14:04:58.643170 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:58.643147    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-cfqnv"]
Jul 07 14:04:58.675493 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:58.675440    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:58.762781 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:58.762751    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:58.803157 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:58.803076    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn9hj\" (UniqueName: \"kubernetes.io/projected/94335d50-943c-46df-a509-a5a3f98a5c83-kube-api-access-cn9hj\") pod \"llmisvc-controller-manager-777c6bd7d5-cfqnv\" (UID: \"94335d50-943c-46df-a509-a5a3f98a5c83\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cfqnv"
Jul 07 14:04:58.803157 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:58.803126    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94335d50-943c-46df-a509-a5a3f98a5c83-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cfqnv\" (UID: \"94335d50-943c-46df-a509-a5a3f98a5c83\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cfqnv"
Jul 07 14:04:58.904488 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:58.904452    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn9hj\" (UniqueName: \"kubernetes.io/projected/94335d50-943c-46df-a509-a5a3f98a5c83-kube-api-access-cn9hj\") pod \"llmisvc-controller-manager-777c6bd7d5-cfqnv\" (UID: \"94335d50-943c-46df-a509-a5a3f98a5c83\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cfqnv"
Jul 07 14:04:58.904652 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:58.904510    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94335d50-943c-46df-a509-a5a3f98a5c83-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cfqnv\" (UID: \"94335d50-943c-46df-a509-a5a3f98a5c83\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cfqnv"
Jul 07 14:04:58.904652 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:04:58.904630    2576 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 07 14:04:58.904727 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:04:58.904687    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94335d50-943c-46df-a509-a5a3f98a5c83-cert podName:94335d50-943c-46df-a509-a5a3f98a5c83 nodeName:}" failed. No retries permitted until 2026-07-07 14:04:59.404669098 +0000 UTC m=+365.016948067 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/94335d50-943c-46df-a509-a5a3f98a5c83-cert") pod "llmisvc-controller-manager-777c6bd7d5-cfqnv" (UID: "94335d50-943c-46df-a509-a5a3f98a5c83") : secret "llmisvc-webhook-server-cert" not found
Jul 07 14:04:58.928090 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:58.928039    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn9hj\" (UniqueName: \"kubernetes.io/projected/94335d50-943c-46df-a509-a5a3f98a5c83-kube-api-access-cn9hj\") pod \"llmisvc-controller-manager-777c6bd7d5-cfqnv\" (UID: \"94335d50-943c-46df-a509-a5a3f98a5c83\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cfqnv"
Jul 07 14:04:58.945904 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:58.945868    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:59.103647 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:59.103543    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:59.251707 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:59.251668    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:04:59.409534 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:59.409440    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94335d50-943c-46df-a509-a5a3f98a5c83-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cfqnv\" (UID: \"94335d50-943c-46df-a509-a5a3f98a5c83\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cfqnv"
Jul 07 14:04:59.411769 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:59.411744    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94335d50-943c-46df-a509-a5a3f98a5c83-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cfqnv\" (UID: \"94335d50-943c-46df-a509-a5a3f98a5c83\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cfqnv"
Jul 07 14:04:59.535241 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:59.535210    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cfqnv"
Jul 07 14:04:59.671536 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:59.671511    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-cfqnv"]
Jul 07 14:04:59.674012 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:04:59.673989    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod94335d50_943c_46df_a509_a5a3f98a5c83.slice/crio-128e498742d997e8f25010cfc99288de08b4306885e7e7e24110f50c50be3076 WatchSource:0}: Error finding container 128e498742d997e8f25010cfc99288de08b4306885e7e7e24110f50c50be3076: Status 404 returned error can't find the container with id 128e498742d997e8f25010cfc99288de08b4306885e7e7e24110f50c50be3076
Jul 07 14:04:59.794788 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:04:59.794751    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cfqnv" event={"ID":"94335d50-943c-46df-a509-a5a3f98a5c83","Type":"ContainerStarted","Data":"128e498742d997e8f25010cfc99288de08b4306885e7e7e24110f50c50be3076"}
Jul 07 14:05:00.904147 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:00.904112    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-j2js8"]
Jul 07 14:05:00.904572 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:00.904345    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j2js8" podUID="230fcb55-1253-48a0-8cb2-71a8854f579a" containerName="discovery" containerID="cri-o://e50fc893cbee77e1f106675ef38665adb8c0cec9625414b24c53f7faea379ab2" gracePeriod=30
Jul 07 14:05:01.291838 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:01.291811    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j2js8"
Jul 07 14:05:01.327586 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:01.327554    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/230fcb55-1253-48a0-8cb2-71a8854f579a-local-certs\") pod \"230fcb55-1253-48a0-8cb2-71a8854f579a\" (UID: \"230fcb55-1253-48a0-8cb2-71a8854f579a\") "
Jul 07 14:05:01.327753 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:01.327603    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/230fcb55-1253-48a0-8cb2-71a8854f579a-istio-kubeconfig\") pod \"230fcb55-1253-48a0-8cb2-71a8854f579a\" (UID: \"230fcb55-1253-48a0-8cb2-71a8854f579a\") "
Jul 07 14:05:01.327753 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:01.327654    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/230fcb55-1253-48a0-8cb2-71a8854f579a-istio-csr-ca-configmap\") pod \"230fcb55-1253-48a0-8cb2-71a8854f579a\" (UID: \"230fcb55-1253-48a0-8cb2-71a8854f579a\") "
Jul 07 14:05:01.327753 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:01.327700    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/230fcb55-1253-48a0-8cb2-71a8854f579a-istio-csr-dns-cert\") pod \"230fcb55-1253-48a0-8cb2-71a8854f579a\" (UID: \"230fcb55-1253-48a0-8cb2-71a8854f579a\") "
Jul 07 14:05:01.327753 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:01.327750    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/230fcb55-1253-48a0-8cb2-71a8854f579a-cacerts\") pod \"230fcb55-1253-48a0-8cb2-71a8854f579a\" (UID: \"230fcb55-1253-48a0-8cb2-71a8854f579a\") "
Jul 07 14:05:01.328018 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:01.327779    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ff9z\" (UniqueName: \"kubernetes.io/projected/230fcb55-1253-48a0-8cb2-71a8854f579a-kube-api-access-9ff9z\") pod \"230fcb55-1253-48a0-8cb2-71a8854f579a\" (UID: \"230fcb55-1253-48a0-8cb2-71a8854f579a\") "
Jul 07 14:05:01.328018 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:01.327814    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/230fcb55-1253-48a0-8cb2-71a8854f579a-istio-token\") pod \"230fcb55-1253-48a0-8cb2-71a8854f579a\" (UID: \"230fcb55-1253-48a0-8cb2-71a8854f579a\") "
Jul 07 14:05:01.328568 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:01.328505    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/230fcb55-1253-48a0-8cb2-71a8854f579a-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "230fcb55-1253-48a0-8cb2-71a8854f579a" (UID: "230fcb55-1253-48a0-8cb2-71a8854f579a"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:05:01.330821 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:01.330737    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/230fcb55-1253-48a0-8cb2-71a8854f579a-istio-token" (OuterVolumeSpecName: "istio-token") pod "230fcb55-1253-48a0-8cb2-71a8854f579a" (UID: "230fcb55-1253-48a0-8cb2-71a8854f579a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:05:01.331375 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:01.331333    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/230fcb55-1253-48a0-8cb2-71a8854f579a-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "230fcb55-1253-48a0-8cb2-71a8854f579a" (UID: "230fcb55-1253-48a0-8cb2-71a8854f579a"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:05:01.331563 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:01.331537    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/230fcb55-1253-48a0-8cb2-71a8854f579a-cacerts" (OuterVolumeSpecName: "cacerts") pod "230fcb55-1253-48a0-8cb2-71a8854f579a" (UID: "230fcb55-1253-48a0-8cb2-71a8854f579a"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:05:01.331932 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:01.331890    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/230fcb55-1253-48a0-8cb2-71a8854f579a-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "230fcb55-1253-48a0-8cb2-71a8854f579a" (UID: "230fcb55-1253-48a0-8cb2-71a8854f579a"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:05:01.331932 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:01.331905    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/230fcb55-1253-48a0-8cb2-71a8854f579a-kube-api-access-9ff9z" (OuterVolumeSpecName: "kube-api-access-9ff9z") pod "230fcb55-1253-48a0-8cb2-71a8854f579a" (UID: "230fcb55-1253-48a0-8cb2-71a8854f579a"). InnerVolumeSpecName "kube-api-access-9ff9z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:05:01.332701 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:01.332675    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/230fcb55-1253-48a0-8cb2-71a8854f579a-local-certs" (OuterVolumeSpecName: "local-certs") pod "230fcb55-1253-48a0-8cb2-71a8854f579a" (UID: "230fcb55-1253-48a0-8cb2-71a8854f579a"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:05:01.429389 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:01.429358    2576 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/230fcb55-1253-48a0-8cb2-71a8854f579a-local-certs\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:05:01.429389 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:01.429385    2576 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/230fcb55-1253-48a0-8cb2-71a8854f579a-istio-kubeconfig\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:05:01.429389 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:01.429396    2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/230fcb55-1253-48a0-8cb2-71a8854f579a-istio-csr-ca-configmap\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:05:01.429609 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:01.429406    2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/230fcb55-1253-48a0-8cb2-71a8854f579a-istio-csr-dns-cert\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:05:01.429609 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:01.429415    2576 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/230fcb55-1253-48a0-8cb2-71a8854f579a-cacerts\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:05:01.429609 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:01.429423    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ff9z\" (UniqueName: \"kubernetes.io/projected/230fcb55-1253-48a0-8cb2-71a8854f579a-kube-api-access-9ff9z\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:05:01.429609 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:01.429432    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/230fcb55-1253-48a0-8cb2-71a8854f579a-istio-token\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:05:01.806739 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:01.806702    2576 generic.go:356] "Generic (PLEG): container finished" podID="230fcb55-1253-48a0-8cb2-71a8854f579a" containerID="e50fc893cbee77e1f106675ef38665adb8c0cec9625414b24c53f7faea379ab2" exitCode=0
Jul 07 14:05:01.806917 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:01.806751    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j2js8"
Jul 07 14:05:01.806917 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:01.806791    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j2js8" event={"ID":"230fcb55-1253-48a0-8cb2-71a8854f579a","Type":"ContainerDied","Data":"e50fc893cbee77e1f106675ef38665adb8c0cec9625414b24c53f7faea379ab2"}
Jul 07 14:05:01.806917 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:01.806854    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-j2js8" event={"ID":"230fcb55-1253-48a0-8cb2-71a8854f579a","Type":"ContainerDied","Data":"b926e983d8abba074486a2ea225bfa631cfbce454c3a066011208c6ab7970453"}
Jul 07 14:05:01.806917 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:01.806878    2576 scope.go:117] "RemoveContainer" containerID="e50fc893cbee77e1f106675ef38665adb8c0cec9625414b24c53f7faea379ab2"
Jul 07 14:05:01.815709 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:01.815690    2576 scope.go:117] "RemoveContainer" containerID="e50fc893cbee77e1f106675ef38665adb8c0cec9625414b24c53f7faea379ab2"
Jul 07 14:05:01.816014 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:05:01.815992    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e50fc893cbee77e1f106675ef38665adb8c0cec9625414b24c53f7faea379ab2\": container with ID starting with e50fc893cbee77e1f106675ef38665adb8c0cec9625414b24c53f7faea379ab2 not found: ID does not exist" containerID="e50fc893cbee77e1f106675ef38665adb8c0cec9625414b24c53f7faea379ab2"
Jul 07 14:05:01.816076 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:01.816023    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e50fc893cbee77e1f106675ef38665adb8c0cec9625414b24c53f7faea379ab2"} err="failed to get container status \"e50fc893cbee77e1f106675ef38665adb8c0cec9625414b24c53f7faea379ab2\": rpc error: code = NotFound desc = could not find container \"e50fc893cbee77e1f106675ef38665adb8c0cec9625414b24c53f7faea379ab2\": container with ID starting with e50fc893cbee77e1f106675ef38665adb8c0cec9625414b24c53f7faea379ab2 not found: ID does not exist"
Jul 07 14:05:01.839603 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:01.839567    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-j2js8"]
Jul 07 14:05:01.852176 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:01.852151    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-j2js8"]
Jul 07 14:05:03.074591 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:03.074557    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="230fcb55-1253-48a0-8cb2-71a8854f579a" path="/var/lib/kubelet/pods/230fcb55-1253-48a0-8cb2-71a8854f579a/volumes"
Jul 07 14:05:03.767980 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:03.767931    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-jkw2d"
Jul 07 14:05:03.776261 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:03.776231    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-wj2dh"
Jul 07 14:05:03.821230 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:03.821185    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cfqnv" event={"ID":"94335d50-943c-46df-a509-a5a3f98a5c83","Type":"ContainerStarted","Data":"f248f2d42f16833a4eebcc6ee65b2436e12c5a592d2ec6d48b463daf49c73d46"}
Jul 07 14:05:03.821424 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:03.821265    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cfqnv"
Jul 07 14:05:03.856447 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:03.856386    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cfqnv" podStartSLOduration=2.420289922 podStartE2EDuration="5.856366224s" totalImagesPullingTime="3.436076302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:04:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:05:03.854012115 +0000 UTC m=+369.466291085" watchObservedRunningTime="2026-07-07 14:05:03.856366224 +0000 UTC m=+369.468645199"
Jul 07 14:05:32.452668 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:32.452621    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:05:32.513405 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:32.513360    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:05:34.201023 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:34.200990    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:05:34.263329 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:34.263301    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:05:34.827557 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:34.827527    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cfqnv"
Jul 07 14:05:36.013160 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:36.013121    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:05:36.090278 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:36.090238    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:05:47.004436 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:47.004390    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:05:47.110984 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:47.110921    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:05:47.236071 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:47.236042    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:05:47.352552 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:47.352465    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:05:47.363622 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:47.363589    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4w2gg"]
Jul 07 14:05:47.363973 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:47.363952    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="230fcb55-1253-48a0-8cb2-71a8854f579a" containerName="discovery"
Jul 07 14:05:47.363973 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:47.363971    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="230fcb55-1253-48a0-8cb2-71a8854f579a" containerName="discovery"
Jul 07 14:05:47.364177 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:47.364075    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="230fcb55-1253-48a0-8cb2-71a8854f579a" containerName="discovery"
Jul 07 14:05:47.372787 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:47.372763    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4w2gg"
Jul 07 14:05:47.376319 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:47.376297    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 14:05:47.377535 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:47.377513    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 14:05:47.377627 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:47.377513    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-g7wss\""
Jul 07 14:05:47.382293 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:47.381815    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4w2gg"]
Jul 07 14:05:47.434761 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:47.434730    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w468m\" (UniqueName: \"kubernetes.io/projected/ea1c121f-8316-4668-8107-f61f454a73bb-kube-api-access-w468m\") pod \"kuadrant-operator-catalog-4w2gg\" (UID: \"ea1c121f-8316-4668-8107-f61f454a73bb\") " pod="kuadrant-system/kuadrant-operator-catalog-4w2gg"
Jul 07 14:05:47.476826 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:47.476798    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:05:47.535378 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:47.535346    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w468m\" (UniqueName: \"kubernetes.io/projected/ea1c121f-8316-4668-8107-f61f454a73bb-kube-api-access-w468m\") pod \"kuadrant-operator-catalog-4w2gg\" (UID: \"ea1c121f-8316-4668-8107-f61f454a73bb\") " pod="kuadrant-system/kuadrant-operator-catalog-4w2gg"
Jul 07 14:05:47.546148 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:47.546121    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w468m\" (UniqueName: \"kubernetes.io/projected/ea1c121f-8316-4668-8107-f61f454a73bb-kube-api-access-w468m\") pod \"kuadrant-operator-catalog-4w2gg\" (UID: \"ea1c121f-8316-4668-8107-f61f454a73bb\") " pod="kuadrant-system/kuadrant-operator-catalog-4w2gg"
Jul 07 14:05:47.686254 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:47.686169    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4w2gg"
Jul 07 14:05:47.821539 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:47.821515    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4w2gg"]
Jul 07 14:05:47.823557 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:05:47.823529    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea1c121f_8316_4668_8107_f61f454a73bb.slice/crio-c238124fcac7ebe428025a026974e8091c8f6bf3c8a92f1934dc17aae66bcad6 WatchSource:0}: Error finding container c238124fcac7ebe428025a026974e8091c8f6bf3c8a92f1934dc17aae66bcad6: Status 404 returned error can't find the container with id c238124fcac7ebe428025a026974e8091c8f6bf3c8a92f1934dc17aae66bcad6
Jul 07 14:05:48.017850 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:48.017818    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4w2gg" event={"ID":"ea1c121f-8316-4668-8107-f61f454a73bb","Type":"ContainerStarted","Data":"c238124fcac7ebe428025a026974e8091c8f6bf3c8a92f1934dc17aae66bcad6"}
Jul 07 14:05:50.030696 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:50.030659    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4w2gg" event={"ID":"ea1c121f-8316-4668-8107-f61f454a73bb","Type":"ContainerStarted","Data":"7f1834ec1589d1173ea43fcead0d8fc045b75fc86a85c5ec74b3acb2e52b09b6"}
Jul 07 14:05:50.049360 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:50.049237    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4w2gg" podStartSLOduration=1.081016907 podStartE2EDuration="3.049221321s" totalImagesPullingTime="1.968204414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:05:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:05:50.047515498 +0000 UTC m=+415.659794486" watchObservedRunningTime="2026-07-07 14:05:50.049221321 +0000 UTC m=+415.661500318"
Jul 07 14:05:57.686894 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:57.686858    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-4w2gg"
Jul 07 14:05:57.687428 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:57.686924    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-4w2gg"
Jul 07 14:05:57.709242 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:57.709217    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-4w2gg"
Jul 07 14:05:58.087305 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:05:58.087279    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-4w2gg"
Jul 07 14:06:14.592747 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:14.592713    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:06:18.046409 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:18.046318    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:06:19.503606 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:19.503572    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thfjl"]
Jul 07 14:06:19.509023 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:19.509001    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thfjl"
Jul 07 14:06:19.513629 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:19.513610    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qggx2\""
Jul 07 14:06:19.529547 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:19.529515    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thfjl"]
Jul 07 14:06:19.591415 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:19.591377    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:06:19.611999 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:19.611971    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89e132a6-c9cb-4168-8d21-8f86b07ee0a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-thfjl\" (UID: \"89e132a6-c9cb-4168-8d21-8f86b07ee0a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thfjl"
Jul 07 14:06:19.612162 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:19.612014    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxnff\" (UniqueName: \"kubernetes.io/projected/89e132a6-c9cb-4168-8d21-8f86b07ee0a3-kube-api-access-sxnff\") pod \"kuadrant-operator-controller-manager-8684c9ff49-thfjl\" (UID: \"89e132a6-c9cb-4168-8d21-8f86b07ee0a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thfjl"
Jul 07 14:06:19.712745 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:19.712711    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89e132a6-c9cb-4168-8d21-8f86b07ee0a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-thfjl\" (UID: \"89e132a6-c9cb-4168-8d21-8f86b07ee0a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thfjl"
Jul 07 14:06:19.712985 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:19.712747    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxnff\" (UniqueName: \"kubernetes.io/projected/89e132a6-c9cb-4168-8d21-8f86b07ee0a3-kube-api-access-sxnff\") pod \"kuadrant-operator-controller-manager-8684c9ff49-thfjl\" (UID: \"89e132a6-c9cb-4168-8d21-8f86b07ee0a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thfjl"
Jul 07 14:06:19.713185 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:19.713160    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89e132a6-c9cb-4168-8d21-8f86b07ee0a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-thfjl\" (UID: \"89e132a6-c9cb-4168-8d21-8f86b07ee0a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thfjl"
Jul 07 14:06:19.728750 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:19.728721    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxnff\" (UniqueName: \"kubernetes.io/projected/89e132a6-c9cb-4168-8d21-8f86b07ee0a3-kube-api-access-sxnff\") pod \"kuadrant-operator-controller-manager-8684c9ff49-thfjl\" (UID: \"89e132a6-c9cb-4168-8d21-8f86b07ee0a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thfjl"
Jul 07 14:06:19.819244 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:19.819139    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thfjl"
Jul 07 14:06:19.964453 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:19.963507    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thfjl"]
Jul 07 14:06:20.025831 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:20.025798    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:06:20.168149 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:20.168058    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thfjl" event={"ID":"89e132a6-c9cb-4168-8d21-8f86b07ee0a3","Type":"ContainerStarted","Data":"6ac989b052d5e734473e01d817dbaf0b65861358fc4ee07fcb438bfdf53f91e4"}
Jul 07 14:06:21.108411 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:21.108370    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:06:21.214002 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:21.213965    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:06:21.271383 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:21.271353    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-xb657"]
Jul 07 14:06:21.275051 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:21.275031    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xb657"
Jul 07 14:06:21.279078 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:21.279057    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 07 14:06:21.279202 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:21.279120    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-d9rm5\""
Jul 07 14:06:21.288653 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:21.288634    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-xb657"]
Jul 07 14:06:21.425524 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:21.425448    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6whr\" (UniqueName: \"kubernetes.io/projected/ba61b42f-2710-4fe0-9e0d-70816e16fa40-kube-api-access-f6whr\") pod \"dns-operator-controller-manager-864dd78c4c-xb657\" (UID: \"ba61b42f-2710-4fe0-9e0d-70816e16fa40\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xb657"
Jul 07 14:06:21.526360 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:21.526331    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6whr\" (UniqueName: \"kubernetes.io/projected/ba61b42f-2710-4fe0-9e0d-70816e16fa40-kube-api-access-f6whr\") pod \"dns-operator-controller-manager-864dd78c4c-xb657\" (UID: \"ba61b42f-2710-4fe0-9e0d-70816e16fa40\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xb657"
Jul 07 14:06:21.547472 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:21.547448    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6whr\" (UniqueName: \"kubernetes.io/projected/ba61b42f-2710-4fe0-9e0d-70816e16fa40-kube-api-access-f6whr\") pod \"dns-operator-controller-manager-864dd78c4c-xb657\" (UID: \"ba61b42f-2710-4fe0-9e0d-70816e16fa40\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xb657"
Jul 07 14:06:21.585666 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:21.585631    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xb657"
Jul 07 14:06:21.614335 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:21.614291    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:06:21.716840 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:21.716814    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-xb657"]
Jul 07 14:06:21.720250 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:06:21.720226    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba61b42f_2710_4fe0_9e0d_70816e16fa40.slice/crio-4f5e699e229e53ec42a450dc8723888cc3ad5892563f42c9c6b80976f7322146 WatchSource:0}: Error finding container 4f5e699e229e53ec42a450dc8723888cc3ad5892563f42c9c6b80976f7322146: Status 404 returned error can't find the container with id 4f5e699e229e53ec42a450dc8723888cc3ad5892563f42c9c6b80976f7322146
Jul 07 14:06:21.838954 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:21.838905    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:06:22.026015 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:22.025907    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:06:22.180493 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:22.180459    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xb657" event={"ID":"ba61b42f-2710-4fe0-9e0d-70816e16fa40","Type":"ContainerStarted","Data":"4f5e699e229e53ec42a450dc8723888cc3ad5892563f42c9c6b80976f7322146"}
Jul 07 14:06:24.623134 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:24.623100    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4vkkt"]
Jul 07 14:06:24.626556 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:24.626513    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4vkkt"
Jul 07 14:06:24.630328 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:24.630304    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-nprwc\""
Jul 07 14:06:24.638629 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:24.638602    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4vkkt"]
Jul 07 14:06:24.757640 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:24.757548    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r29d7\" (UniqueName: \"kubernetes.io/projected/1613c131-6c4c-4094-a1ed-2c9d0ff18751-kube-api-access-r29d7\") pod \"authorino-operator-75cc8d5cb7-4vkkt\" (UID: \"1613c131-6c4c-4094-a1ed-2c9d0ff18751\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4vkkt"
Jul 07 14:06:24.859070 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:24.859035    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r29d7\" (UniqueName: \"kubernetes.io/projected/1613c131-6c4c-4094-a1ed-2c9d0ff18751-kube-api-access-r29d7\") pod \"authorino-operator-75cc8d5cb7-4vkkt\" (UID: \"1613c131-6c4c-4094-a1ed-2c9d0ff18751\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4vkkt"
Jul 07 14:06:24.877824 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:24.877791    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r29d7\" (UniqueName: \"kubernetes.io/projected/1613c131-6c4c-4094-a1ed-2c9d0ff18751-kube-api-access-r29d7\") pod \"authorino-operator-75cc8d5cb7-4vkkt\" (UID: \"1613c131-6c4c-4094-a1ed-2c9d0ff18751\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4vkkt"
Jul 07 14:06:24.936662 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:24.936625    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4vkkt"
Jul 07 14:06:25.092366 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:25.092340    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4vkkt"]
Jul 07 14:06:25.094828 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:06:25.094802    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1613c131_6c4c_4094_a1ed_2c9d0ff18751.slice/crio-812a7accfaa08921a3dcb76c9500738d3ad75d8f872e15f16ed476e4dd076d4f WatchSource:0}: Error finding container 812a7accfaa08921a3dcb76c9500738d3ad75d8f872e15f16ed476e4dd076d4f: Status 404 returned error can't find the container with id 812a7accfaa08921a3dcb76c9500738d3ad75d8f872e15f16ed476e4dd076d4f
Jul 07 14:06:25.200973 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:25.200919    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4vkkt" event={"ID":"1613c131-6c4c-4094-a1ed-2c9d0ff18751","Type":"ContainerStarted","Data":"812a7accfaa08921a3dcb76c9500738d3ad75d8f872e15f16ed476e4dd076d4f"}
Jul 07 14:06:25.202523 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:25.202496    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xb657" event={"ID":"ba61b42f-2710-4fe0-9e0d-70816e16fa40","Type":"ContainerStarted","Data":"8ca3cc33b518d8d210e409036768e78a89ce1882629706c5c9449cae5c729d02"}
Jul 07 14:06:25.202667 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:25.202643    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xb657"
Jul 07 14:06:25.230102 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:25.230053    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xb657" podStartSLOduration=1.4680799150000001 podStartE2EDuration="4.230036884s" totalImagesPullingTime="2.761956969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:06:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:06:25.228598342 +0000 UTC m=+450.840877313" watchObservedRunningTime="2026-07-07 14:06:25.230036884 +0000 UTC m=+450.842315855"
Jul 07 14:06:25.242442 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:25.242408    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:06:25.461702 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:25.461663    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:06:25.559266 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:25.559172    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:06:27.214671 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:27.214633    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thfjl" event={"ID":"89e132a6-c9cb-4168-8d21-8f86b07ee0a3","Type":"ContainerStarted","Data":"6d1ead95ed7da33d05fcaeec0518ec8a0412ad81daf7a1abefe72395b7b06dec"}
Jul 07 14:06:27.215158 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:27.214781    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thfjl"
Jul 07 14:06:27.233429 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:27.233397    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n82p5"]
Jul 07 14:06:27.237368 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:27.237329    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n82p5"
Jul 07 14:06:27.240120 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:27.240100    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-cs6m5\""
Jul 07 14:06:27.245256 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:27.245212    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thfjl" podStartSLOduration=1.724473518 podStartE2EDuration="8.245194573s" totalImagesPullingTime="6.520721055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:06:27.243883525 +0000 UTC m=+452.856162490" watchObservedRunningTime="2026-07-07 14:06:27.245194573 +0000 UTC m=+452.857473546"
Jul 07 14:06:27.250512 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:27.250486    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n82p5"]
Jul 07 14:06:27.383307 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:27.383275    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxmzd\" (UniqueName: \"kubernetes.io/projected/c70e57dc-a9c3-4ef4-a814-fad003ea1ba6-kube-api-access-qxmzd\") pod \"limitador-operator-controller-manager-859d7b78bd-n82p5\" (UID: \"c70e57dc-a9c3-4ef4-a814-fad003ea1ba6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n82p5"
Jul 07 14:06:27.483827 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:27.483752    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxmzd\" (UniqueName: \"kubernetes.io/projected/c70e57dc-a9c3-4ef4-a814-fad003ea1ba6-kube-api-access-qxmzd\") pod \"limitador-operator-controller-manager-859d7b78bd-n82p5\" (UID: \"c70e57dc-a9c3-4ef4-a814-fad003ea1ba6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n82p5"
Jul 07 14:06:27.496605 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:27.496575    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxmzd\" (UniqueName: \"kubernetes.io/projected/c70e57dc-a9c3-4ef4-a814-fad003ea1ba6-kube-api-access-qxmzd\") pod \"limitador-operator-controller-manager-859d7b78bd-n82p5\" (UID: \"c70e57dc-a9c3-4ef4-a814-fad003ea1ba6\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n82p5"
Jul 07 14:06:27.551357 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:27.551315    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n82p5"
Jul 07 14:06:28.405725 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:28.405703    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n82p5"]
Jul 07 14:06:28.408250 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:06:28.408226    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc70e57dc_a9c3_4ef4_a814_fad003ea1ba6.slice/crio-b433c902caa241c073508adef6a5a1f3fe64d388eb3ba94127a46c86cf1b3982 WatchSource:0}: Error finding container b433c902caa241c073508adef6a5a1f3fe64d388eb3ba94127a46c86cf1b3982: Status 404 returned error can't find the container with id b433c902caa241c073508adef6a5a1f3fe64d388eb3ba94127a46c86cf1b3982
Jul 07 14:06:28.455324 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:28.455290    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:06:29.227512 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:29.227478    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4vkkt" event={"ID":"1613c131-6c4c-4094-a1ed-2c9d0ff18751","Type":"ContainerStarted","Data":"8dc3d2f64c05ce76017d89683f6554ec39950f70d70808b1f529b0946e4885b1"}
Jul 07 14:06:29.227678 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:29.227639    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4vkkt"
Jul 07 14:06:29.228653 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:29.228625    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n82p5" event={"ID":"c70e57dc-a9c3-4ef4-a814-fad003ea1ba6","Type":"ContainerStarted","Data":"b433c902caa241c073508adef6a5a1f3fe64d388eb3ba94127a46c86cf1b3982"}
Jul 07 14:06:29.248280 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:29.248193    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4vkkt" podStartSLOduration=2.028212126 podStartE2EDuration="5.248173065s" totalImagesPullingTime="3.219960939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:06:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:06:29.246959326 +0000 UTC m=+454.859238299" watchObservedRunningTime="2026-07-07 14:06:29.248173065 +0000 UTC m=+454.860452040"
Jul 07 14:06:29.542457 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:29.542251    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:06:29.618555 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:29.618446    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:06:29.723352 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:29.723322    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:06:29.856050 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:29.855957    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:06:31.241922 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:31.241890    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n82p5" event={"ID":"c70e57dc-a9c3-4ef4-a814-fad003ea1ba6","Type":"ContainerStarted","Data":"56fcb064b1f1fc18f1b4da9e0d937d0947ea53e527fabad0196534322b96fd8d"}
Jul 07 14:06:31.242354 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:31.242050    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n82p5"
Jul 07 14:06:31.260340 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:31.260296    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n82p5" podStartSLOduration=2.3502278309999998 podStartE2EDuration="4.260282826s" totalImagesPullingTime="1.910054995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:06:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:06:31.259075704 +0000 UTC m=+456.871354674" watchObservedRunningTime="2026-07-07 14:06:31.260282826 +0000 UTC m=+456.872561796"
Jul 07 14:06:36.210119 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:36.210085    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xb657"
Jul 07 14:06:37.427686 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:37.427654    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:06:37.527417 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:37.527384    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:06:38.224017 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:38.223988    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thfjl"
Jul 07 14:06:40.000254 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.000218    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xmsnv"]
Jul 07 14:06:40.003832 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.003814    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xmsnv"
Jul 07 14:06:40.022533 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.022507    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xmsnv"]
Jul 07 14:06:40.080483 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.080429    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca66a309-bc36-4859-815a-43dc29164f02-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-xmsnv\" (UID: \"ca66a309-bc36-4859-815a-43dc29164f02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xmsnv"
Jul 07 14:06:40.080654 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.080510    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rftjc\" (UniqueName: \"kubernetes.io/projected/ca66a309-bc36-4859-815a-43dc29164f02-kube-api-access-rftjc\") pod \"kuadrant-operator-controller-manager-55467d9f7-xmsnv\" (UID: \"ca66a309-bc36-4859-815a-43dc29164f02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xmsnv"
Jul 07 14:06:40.181433 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.181397    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca66a309-bc36-4859-815a-43dc29164f02-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-xmsnv\" (UID: \"ca66a309-bc36-4859-815a-43dc29164f02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xmsnv"
Jul 07 14:06:40.181650 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.181461    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rftjc\" (UniqueName: \"kubernetes.io/projected/ca66a309-bc36-4859-815a-43dc29164f02-kube-api-access-rftjc\") pod \"kuadrant-operator-controller-manager-55467d9f7-xmsnv\" (UID: \"ca66a309-bc36-4859-815a-43dc29164f02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xmsnv"
Jul 07 14:06:40.181802 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.181783    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca66a309-bc36-4859-815a-43dc29164f02-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-xmsnv\" (UID: \"ca66a309-bc36-4859-815a-43dc29164f02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xmsnv"
Jul 07 14:06:40.196879 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.196850    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rftjc\" (UniqueName: \"kubernetes.io/projected/ca66a309-bc36-4859-815a-43dc29164f02-kube-api-access-rftjc\") pod \"kuadrant-operator-controller-manager-55467d9f7-xmsnv\" (UID: \"ca66a309-bc36-4859-815a-43dc29164f02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xmsnv"
Jul 07 14:06:40.217404 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.217375    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xmsnv"]
Jul 07 14:06:40.217676 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.217662    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xmsnv"
Jul 07 14:06:40.221212 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.221193    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xmsnv"]
Jul 07 14:06:40.233044 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.233017    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thfjl"]
Jul 07 14:06:40.233254 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.233223    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thfjl" podUID="89e132a6-c9cb-4168-8d21-8f86b07ee0a3" containerName="manager" containerID="cri-o://6d1ead95ed7da33d05fcaeec0518ec8a0412ad81daf7a1abefe72395b7b06dec" gracePeriod=2
Jul 07 14:06:40.238592 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.238561    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4vkkt"
Jul 07 14:06:40.252736 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.252668    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thfjl"]
Jul 07 14:06:40.262169 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:06:40.262134    2576 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"89e132a6-c9cb-4168-8d21-8f86b07ee0a3\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-thfjl\": pods \"kuadrant-operator-controller-manager-8684c9ff49-thfjl\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thfjl"
Jul 07 14:06:40.267707 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.267687    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n82p5"]
Jul 07 14:06:40.267886 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.267869    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n82p5" podUID="c70e57dc-a9c3-4ef4-a814-fad003ea1ba6" containerName="manager" containerID="cri-o://56fcb064b1f1fc18f1b4da9e0d937d0947ea53e527fabad0196534322b96fd8d" gracePeriod=2
Jul 07 14:06:40.269811 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.269792    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n82p5"
Jul 07 14:06:40.270288 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.270257    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lg9q9"]
Jul 07 14:06:40.270608 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.270595    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89e132a6-c9cb-4168-8d21-8f86b07ee0a3" containerName="manager"
Jul 07 14:06:40.270608 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.270609    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="89e132a6-c9cb-4168-8d21-8f86b07ee0a3" containerName="manager"
Jul 07 14:06:40.270748 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.270669    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="89e132a6-c9cb-4168-8d21-8f86b07ee0a3" containerName="manager"
Jul 07 14:06:40.273823 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.273805    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lg9q9"
Jul 07 14:06:40.280534 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.280489    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n82p5"]
Jul 07 14:06:40.283164 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.283132    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tmjvn"]
Jul 07 14:06:40.283666 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.283649    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c70e57dc-a9c3-4ef4-a814-fad003ea1ba6" containerName="manager"
Jul 07 14:06:40.283796 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.283777    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c70e57dc-a9c3-4ef4-a814-fad003ea1ba6" containerName="manager"
Jul 07 14:06:40.283909 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.283899    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c70e57dc-a9c3-4ef4-a814-fad003ea1ba6" containerName="manager"
Jul 07 14:06:40.287716 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.287356    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tmjvn"
Jul 07 14:06:40.287873 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:06:40.287806    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-thfjl\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" podUID="89e132a6-c9cb-4168-8d21-8f86b07ee0a3" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thfjl"
Jul 07 14:06:40.290412 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.290385    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lg9q9"]
Jul 07 14:06:40.310158 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.310049    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tmjvn"]
Jul 07 14:06:40.335293 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:06:40.335254    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-thfjl\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" podUID="89e132a6-c9cb-4168-8d21-8f86b07ee0a3" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thfjl"
Jul 07 14:06:40.359877 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:06:40.359839    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-n82p5\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" podUID="c70e57dc-a9c3-4ef4-a814-fad003ea1ba6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n82p5"
Jul 07 14:06:40.382997 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.382968    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e33a3351-4265-4d6e-86ad-201dfd78033b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lg9q9\" (UID: \"e33a3351-4265-4d6e-86ad-201dfd78033b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lg9q9"
Jul 07 14:06:40.383110 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.383038    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vdkn\" (UniqueName: \"kubernetes.io/projected/e33a3351-4265-4d6e-86ad-201dfd78033b-kube-api-access-6vdkn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lg9q9\" (UID: \"e33a3351-4265-4d6e-86ad-201dfd78033b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lg9q9"
Jul 07 14:06:40.484716 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.484684    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vdkn\" (UniqueName: \"kubernetes.io/projected/e33a3351-4265-4d6e-86ad-201dfd78033b-kube-api-access-6vdkn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lg9q9\" (UID: \"e33a3351-4265-4d6e-86ad-201dfd78033b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lg9q9"
Jul 07 14:06:40.484870 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.484741    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8952b3fb-61dc-42a2-a636-620785625f2d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tmjvn\" (UID: \"8952b3fb-61dc-42a2-a636-620785625f2d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tmjvn"
Jul 07 14:06:40.484870 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.484827    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e33a3351-4265-4d6e-86ad-201dfd78033b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lg9q9\" (UID: \"e33a3351-4265-4d6e-86ad-201dfd78033b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lg9q9"
Jul 07 14:06:40.484870 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.484850    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5rvz\" (UniqueName: \"kubernetes.io/projected/8952b3fb-61dc-42a2-a636-620785625f2d-kube-api-access-w5rvz\") pod \"kuadrant-operator-controller-manager-86878c769f-tmjvn\" (UID: \"8952b3fb-61dc-42a2-a636-620785625f2d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tmjvn"
Jul 07 14:06:40.485302 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.485276    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e33a3351-4265-4d6e-86ad-201dfd78033b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lg9q9\" (UID: \"e33a3351-4265-4d6e-86ad-201dfd78033b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lg9q9"
Jul 07 14:06:40.500113 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.500081    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vdkn\" (UniqueName: \"kubernetes.io/projected/e33a3351-4265-4d6e-86ad-201dfd78033b-kube-api-access-6vdkn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lg9q9\" (UID: \"e33a3351-4265-4d6e-86ad-201dfd78033b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lg9q9"
Jul 07 14:06:40.501283 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.501265    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thfjl"
Jul 07 14:06:40.503852 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:06:40.503818    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-thfjl\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" podUID="89e132a6-c9cb-4168-8d21-8f86b07ee0a3" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thfjl"
Jul 07 14:06:40.505956 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:06:40.505918    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-n82p5\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" podUID="c70e57dc-a9c3-4ef4-a814-fad003ea1ba6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n82p5"
Jul 07 14:06:40.510498 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.510482    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n82p5"
Jul 07 14:06:40.512809 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:06:40.512786    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-thfjl\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" podUID="89e132a6-c9cb-4168-8d21-8f86b07ee0a3" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thfjl"
Jul 07 14:06:40.515064 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:06:40.515045    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-n82p5\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" podUID="c70e57dc-a9c3-4ef4-a814-fad003ea1ba6" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n82p5"
Jul 07 14:06:40.585457 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.585421    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxnff\" (UniqueName: \"kubernetes.io/projected/89e132a6-c9cb-4168-8d21-8f86b07ee0a3-kube-api-access-sxnff\") pod \"89e132a6-c9cb-4168-8d21-8f86b07ee0a3\" (UID: \"89e132a6-c9cb-4168-8d21-8f86b07ee0a3\") "
Jul 07 14:06:40.585623 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.585481    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89e132a6-c9cb-4168-8d21-8f86b07ee0a3-extensions-socket-volume\") pod \"89e132a6-c9cb-4168-8d21-8f86b07ee0a3\" (UID: \"89e132a6-c9cb-4168-8d21-8f86b07ee0a3\") "
Jul 07 14:06:40.585623 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.585505    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxmzd\" (UniqueName: \"kubernetes.io/projected/c70e57dc-a9c3-4ef4-a814-fad003ea1ba6-kube-api-access-qxmzd\") pod \"c70e57dc-a9c3-4ef4-a814-fad003ea1ba6\" (UID: \"c70e57dc-a9c3-4ef4-a814-fad003ea1ba6\") "
Jul 07 14:06:40.585702 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.585639    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8952b3fb-61dc-42a2-a636-620785625f2d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tmjvn\" (UID: \"8952b3fb-61dc-42a2-a636-620785625f2d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tmjvn"
Jul 07 14:06:40.585750 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.585731    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5rvz\" (UniqueName: \"kubernetes.io/projected/8952b3fb-61dc-42a2-a636-620785625f2d-kube-api-access-w5rvz\") pod \"kuadrant-operator-controller-manager-86878c769f-tmjvn\" (UID: \"8952b3fb-61dc-42a2-a636-620785625f2d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tmjvn"
Jul 07 14:06:40.586121 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.586092    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8952b3fb-61dc-42a2-a636-620785625f2d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tmjvn\" (UID: \"8952b3fb-61dc-42a2-a636-620785625f2d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tmjvn"
Jul 07 14:06:40.586236 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.586098    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89e132a6-c9cb-4168-8d21-8f86b07ee0a3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "89e132a6-c9cb-4168-8d21-8f86b07ee0a3" (UID: "89e132a6-c9cb-4168-8d21-8f86b07ee0a3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:06:40.587720 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.587694    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c70e57dc-a9c3-4ef4-a814-fad003ea1ba6-kube-api-access-qxmzd" (OuterVolumeSpecName: "kube-api-access-qxmzd") pod "c70e57dc-a9c3-4ef4-a814-fad003ea1ba6" (UID: "c70e57dc-a9c3-4ef4-a814-fad003ea1ba6"). InnerVolumeSpecName "kube-api-access-qxmzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:06:40.587801 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.587723    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89e132a6-c9cb-4168-8d21-8f86b07ee0a3-kube-api-access-sxnff" (OuterVolumeSpecName: "kube-api-access-sxnff") pod "89e132a6-c9cb-4168-8d21-8f86b07ee0a3" (UID: "89e132a6-c9cb-4168-8d21-8f86b07ee0a3"). InnerVolumeSpecName "kube-api-access-sxnff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:06:40.595326 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.595299    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5rvz\" (UniqueName: \"kubernetes.io/projected/8952b3fb-61dc-42a2-a636-620785625f2d-kube-api-access-w5rvz\") pod \"kuadrant-operator-controller-manager-86878c769f-tmjvn\" (UID: \"8952b3fb-61dc-42a2-a636-620785625f2d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tmjvn"
Jul 07 14:06:40.680925 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.680889    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lg9q9"
Jul 07 14:06:40.686270 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.686249    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89e132a6-c9cb-4168-8d21-8f86b07ee0a3-extensions-socket-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:06:40.686351 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.686274    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxmzd\" (UniqueName: \"kubernetes.io/projected/c70e57dc-a9c3-4ef4-a814-fad003ea1ba6-kube-api-access-qxmzd\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:06:40.686351 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.686284    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxnff\" (UniqueName: \"kubernetes.io/projected/89e132a6-c9cb-4168-8d21-8f86b07ee0a3-kube-api-access-sxnff\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:06:40.688202 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.688180    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tmjvn"
Jul 07 14:06:40.849174 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.849150    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lg9q9"]
Jul 07 14:06:40.851309 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:06:40.851281    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode33a3351_4265_4d6e_86ad_201dfd78033b.slice/crio-4e8c153c0e7bb5fa89229c8fc9d2119ae04baa2048f0e98fc6a45084b9eab7de WatchSource:0}: Error finding container 4e8c153c0e7bb5fa89229c8fc9d2119ae04baa2048f0e98fc6a45084b9eab7de: Status 404 returned error can't find the container with id 4e8c153c0e7bb5fa89229c8fc9d2119ae04baa2048f0e98fc6a45084b9eab7de
Jul 07 14:06:40.865298 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:40.865276    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tmjvn"]
Jul 07 14:06:40.867477 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:06:40.867452    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8952b3fb_61dc_42a2_a636_620785625f2d.slice/crio-af53b06e317b3ece9a1c016ee043b7fcb9c73b33077e7c3decde4695e9f90810 WatchSource:0}: Error finding container af53b06e317b3ece9a1c016ee043b7fcb9c73b33077e7c3decde4695e9f90810: Status 404 returned error can't find the container with id af53b06e317b3ece9a1c016ee043b7fcb9c73b33077e7c3decde4695e9f90810
Jul 07 14:06:41.078320 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:41.078241    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89e132a6-c9cb-4168-8d21-8f86b07ee0a3" path="/var/lib/kubelet/pods/89e132a6-c9cb-4168-8d21-8f86b07ee0a3/volumes"
Jul 07 14:06:41.078690 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:41.078627    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c70e57dc-a9c3-4ef4-a814-fad003ea1ba6" path="/var/lib/kubelet/pods/c70e57dc-a9c3-4ef4-a814-fad003ea1ba6/volumes"
Jul 07 14:06:41.292675 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:41.292634    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tmjvn" event={"ID":"8952b3fb-61dc-42a2-a636-620785625f2d","Type":"ContainerStarted","Data":"848359a05bf3e2c31898c64146af3152f8657f9005c93972b8f55a718a8471c3"}
Jul 07 14:06:41.292851 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:41.292708    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tmjvn"
Jul 07 14:06:41.292851 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:41.292735    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tmjvn" event={"ID":"8952b3fb-61dc-42a2-a636-620785625f2d","Type":"ContainerStarted","Data":"af53b06e317b3ece9a1c016ee043b7fcb9c73b33077e7c3decde4695e9f90810"}
Jul 07 14:06:41.294314 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:41.294289    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lg9q9" event={"ID":"e33a3351-4265-4d6e-86ad-201dfd78033b","Type":"ContainerStarted","Data":"96fc3a1cd60dc427c02b39b51b26f7f6e6e1fe9c33b86e28711d3092b3fdc2b8"}
Jul 07 14:06:41.294451 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:41.294340    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lg9q9" event={"ID":"e33a3351-4265-4d6e-86ad-201dfd78033b","Type":"ContainerStarted","Data":"4e8c153c0e7bb5fa89229c8fc9d2119ae04baa2048f0e98fc6a45084b9eab7de"}
Jul 07 14:06:41.294451 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:41.294368    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lg9q9"
Jul 07 14:06:41.295532 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:41.295508    2576 generic.go:356] "Generic (PLEG): container finished" podID="89e132a6-c9cb-4168-8d21-8f86b07ee0a3" containerID="6d1ead95ed7da33d05fcaeec0518ec8a0412ad81daf7a1abefe72395b7b06dec" exitCode=0
Jul 07 14:06:41.295646 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:41.295541    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thfjl"
Jul 07 14:06:41.295646 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:41.295601    2576 scope.go:117] "RemoveContainer" containerID="6d1ead95ed7da33d05fcaeec0518ec8a0412ad81daf7a1abefe72395b7b06dec"
Jul 07 14:06:41.297182 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:41.297159    2576 generic.go:356] "Generic (PLEG): container finished" podID="c70e57dc-a9c3-4ef4-a814-fad003ea1ba6" containerID="56fcb064b1f1fc18f1b4da9e0d937d0947ea53e527fabad0196534322b96fd8d" exitCode=0
Jul 07 14:06:41.297294 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:41.297210    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n82p5"
Jul 07 14:06:41.304792 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:41.304767    2576 scope.go:117] "RemoveContainer" containerID="6d1ead95ed7da33d05fcaeec0518ec8a0412ad81daf7a1abefe72395b7b06dec"
Jul 07 14:06:41.305098 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:06:41.305076    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d1ead95ed7da33d05fcaeec0518ec8a0412ad81daf7a1abefe72395b7b06dec\": container with ID starting with 6d1ead95ed7da33d05fcaeec0518ec8a0412ad81daf7a1abefe72395b7b06dec not found: ID does not exist" containerID="6d1ead95ed7da33d05fcaeec0518ec8a0412ad81daf7a1abefe72395b7b06dec"
Jul 07 14:06:41.305150 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:41.305109    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d1ead95ed7da33d05fcaeec0518ec8a0412ad81daf7a1abefe72395b7b06dec"} err="failed to get container status \"6d1ead95ed7da33d05fcaeec0518ec8a0412ad81daf7a1abefe72395b7b06dec\": rpc error: code = NotFound desc = could not find container \"6d1ead95ed7da33d05fcaeec0518ec8a0412ad81daf7a1abefe72395b7b06dec\": container with ID starting with 6d1ead95ed7da33d05fcaeec0518ec8a0412ad81daf7a1abefe72395b7b06dec not found: ID does not exist"
Jul 07 14:06:41.305150 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:41.305128    2576 scope.go:117] "RemoveContainer" containerID="56fcb064b1f1fc18f1b4da9e0d937d0947ea53e527fabad0196534322b96fd8d"
Jul 07 14:06:41.312735 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:41.312717    2576 scope.go:117] "RemoveContainer" containerID="56fcb064b1f1fc18f1b4da9e0d937d0947ea53e527fabad0196534322b96fd8d"
Jul 07 14:06:41.313005 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:06:41.312987    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56fcb064b1f1fc18f1b4da9e0d937d0947ea53e527fabad0196534322b96fd8d\": container with ID starting with 56fcb064b1f1fc18f1b4da9e0d937d0947ea53e527fabad0196534322b96fd8d not found: ID does not exist" containerID="56fcb064b1f1fc18f1b4da9e0d937d0947ea53e527fabad0196534322b96fd8d"
Jul 07 14:06:41.313058 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:41.313012    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56fcb064b1f1fc18f1b4da9e0d937d0947ea53e527fabad0196534322b96fd8d"} err="failed to get container status \"56fcb064b1f1fc18f1b4da9e0d937d0947ea53e527fabad0196534322b96fd8d\": rpc error: code = NotFound desc = could not find container \"56fcb064b1f1fc18f1b4da9e0d937d0947ea53e527fabad0196534322b96fd8d\": container with ID starting with 56fcb064b1f1fc18f1b4da9e0d937d0947ea53e527fabad0196534322b96fd8d not found: ID does not exist"
Jul 07 14:06:41.319107 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:41.319069    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tmjvn" podStartSLOduration=1.319054274 podStartE2EDuration="1.319054274s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:06:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:06:41.31646749 +0000 UTC m=+466.928746474" watchObservedRunningTime="2026-07-07 14:06:41.319054274 +0000 UTC m=+466.931333247"
Jul 07 14:06:41.346045 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:41.345930    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lg9q9" podStartSLOduration=1.345913081 podStartE2EDuration="1.345913081s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:06:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:06:41.343127563 +0000 UTC m=+466.955406548" watchObservedRunningTime="2026-07-07 14:06:41.345913081 +0000 UTC m=+466.958192052"
Jul 07 14:06:42.763406 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:06:42.763366    2576 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-xmsnv_kuadrant-system_ca66a309-bc36-4859-815a-43dc29164f02_0(42a282266d76c1425817eca7941ef9659f7ac412a94f1570f0413b9290639161): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-xmsnv to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 07 14:06:42.763663 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:06:42.763435    2576 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-xmsnv_kuadrant-system_ca66a309-bc36-4859-815a-43dc29164f02_0(42a282266d76c1425817eca7941ef9659f7ac412a94f1570f0413b9290639161): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-xmsnv to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xmsnv"
Jul 07 14:06:43.262389 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:43.262356    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:06:43.309079 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:43.309050    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xmsnv"
Jul 07 14:06:43.317398 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:43.317372    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xmsnv"
Jul 07 14:06:43.320450 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:06:43.320425    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-xmsnv\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" podUID="ca66a309-bc36-4859-815a-43dc29164f02" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xmsnv"
Jul 07 14:06:43.374738 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:43.374703    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:06:43.408366 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:43.408339    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rftjc\" (UniqueName: \"kubernetes.io/projected/ca66a309-bc36-4859-815a-43dc29164f02-kube-api-access-rftjc\") pod \"ca66a309-bc36-4859-815a-43dc29164f02\" (UID: \"ca66a309-bc36-4859-815a-43dc29164f02\") "
Jul 07 14:06:43.408505 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:43.408372    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca66a309-bc36-4859-815a-43dc29164f02-extensions-socket-volume\") pod \"ca66a309-bc36-4859-815a-43dc29164f02\" (UID: \"ca66a309-bc36-4859-815a-43dc29164f02\") "
Jul 07 14:06:43.408655 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:43.408629    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca66a309-bc36-4859-815a-43dc29164f02-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ca66a309-bc36-4859-815a-43dc29164f02" (UID: "ca66a309-bc36-4859-815a-43dc29164f02"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:06:43.410478 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:43.410453    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca66a309-bc36-4859-815a-43dc29164f02-kube-api-access-rftjc" (OuterVolumeSpecName: "kube-api-access-rftjc") pod "ca66a309-bc36-4859-815a-43dc29164f02" (UID: "ca66a309-bc36-4859-815a-43dc29164f02"). InnerVolumeSpecName "kube-api-access-rftjc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:06:43.509099 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:43.509063    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rftjc\" (UniqueName: \"kubernetes.io/projected/ca66a309-bc36-4859-815a-43dc29164f02-kube-api-access-rftjc\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:06:43.509099 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:43.509094    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca66a309-bc36-4859-815a-43dc29164f02-extensions-socket-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:06:44.314141 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:44.314110    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xmsnv"
Jul 07 14:06:44.316959 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:06:44.316921    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-xmsnv\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" podUID="ca66a309-bc36-4859-815a-43dc29164f02" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xmsnv"
Jul 07 14:06:44.322660 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:06:44.322635    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-xmsnv\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" podUID="ca66a309-bc36-4859-815a-43dc29164f02" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xmsnv"
Jul 07 14:06:45.074130 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:06:45.074084    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-xmsnv\" is forbidden: User \"system:node:ip-10-0-140-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-192.ec2.internal' and this object" podUID="ca66a309-bc36-4859-815a-43dc29164f02" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xmsnv"
Jul 07 14:06:45.076093 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:45.076067    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca66a309-bc36-4859-815a-43dc29164f02" path="/var/lib/kubelet/pods/ca66a309-bc36-4859-815a-43dc29164f02/volumes"
Jul 07 14:06:46.841039 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:46.841006    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:06:47.264620 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:47.264583    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:06:50.033453 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:50.033408    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:06:50.133330 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:50.133272    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:06:52.306538 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:52.306499    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tmjvn"
Jul 07 14:06:52.306933 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:52.306678    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lg9q9"
Jul 07 14:06:52.402627 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:52.402590    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lg9q9"]
Jul 07 14:06:52.402859 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:52.402810    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lg9q9" podUID="e33a3351-4265-4d6e-86ad-201dfd78033b" containerName="manager" containerID="cri-o://96fc3a1cd60dc427c02b39b51b26f7f6e6e1fe9c33b86e28711d3092b3fdc2b8" gracePeriod=10
Jul 07 14:06:52.664033 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:52.664007    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lg9q9"
Jul 07 14:06:52.687814 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:52.687783    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e33a3351-4265-4d6e-86ad-201dfd78033b-extensions-socket-volume\") pod \"e33a3351-4265-4d6e-86ad-201dfd78033b\" (UID: \"e33a3351-4265-4d6e-86ad-201dfd78033b\") "
Jul 07 14:06:52.688018 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:52.687872    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vdkn\" (UniqueName: \"kubernetes.io/projected/e33a3351-4265-4d6e-86ad-201dfd78033b-kube-api-access-6vdkn\") pod \"e33a3351-4265-4d6e-86ad-201dfd78033b\" (UID: \"e33a3351-4265-4d6e-86ad-201dfd78033b\") "
Jul 07 14:06:52.688235 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:52.688211    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e33a3351-4265-4d6e-86ad-201dfd78033b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e33a3351-4265-4d6e-86ad-201dfd78033b" (UID: "e33a3351-4265-4d6e-86ad-201dfd78033b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:06:52.690060 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:52.690035    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e33a3351-4265-4d6e-86ad-201dfd78033b-kube-api-access-6vdkn" (OuterVolumeSpecName: "kube-api-access-6vdkn") pod "e33a3351-4265-4d6e-86ad-201dfd78033b" (UID: "e33a3351-4265-4d6e-86ad-201dfd78033b"). InnerVolumeSpecName "kube-api-access-6vdkn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:06:52.788468 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:52.788435    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e33a3351-4265-4d6e-86ad-201dfd78033b-extensions-socket-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:06:52.788468 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:52.788460    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vdkn\" (UniqueName: \"kubernetes.io/projected/e33a3351-4265-4d6e-86ad-201dfd78033b-kube-api-access-6vdkn\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:06:53.359907 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:53.359824    2576 generic.go:356] "Generic (PLEG): container finished" podID="e33a3351-4265-4d6e-86ad-201dfd78033b" containerID="96fc3a1cd60dc427c02b39b51b26f7f6e6e1fe9c33b86e28711d3092b3fdc2b8" exitCode=0
Jul 07 14:06:53.359907 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:53.359865    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lg9q9"
Jul 07 14:06:53.360362 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:53.359906    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lg9q9" event={"ID":"e33a3351-4265-4d6e-86ad-201dfd78033b","Type":"ContainerDied","Data":"96fc3a1cd60dc427c02b39b51b26f7f6e6e1fe9c33b86e28711d3092b3fdc2b8"}
Jul 07 14:06:53.360362 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:53.359975    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lg9q9" event={"ID":"e33a3351-4265-4d6e-86ad-201dfd78033b","Type":"ContainerDied","Data":"4e8c153c0e7bb5fa89229c8fc9d2119ae04baa2048f0e98fc6a45084b9eab7de"}
Jul 07 14:06:53.360362 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:53.359999    2576 scope.go:117] "RemoveContainer" containerID="96fc3a1cd60dc427c02b39b51b26f7f6e6e1fe9c33b86e28711d3092b3fdc2b8"
Jul 07 14:06:53.368769 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:53.368752    2576 scope.go:117] "RemoveContainer" containerID="96fc3a1cd60dc427c02b39b51b26f7f6e6e1fe9c33b86e28711d3092b3fdc2b8"
Jul 07 14:06:53.369083 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:06:53.369064    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96fc3a1cd60dc427c02b39b51b26f7f6e6e1fe9c33b86e28711d3092b3fdc2b8\": container with ID starting with 96fc3a1cd60dc427c02b39b51b26f7f6e6e1fe9c33b86e28711d3092b3fdc2b8 not found: ID does not exist" containerID="96fc3a1cd60dc427c02b39b51b26f7f6e6e1fe9c33b86e28711d3092b3fdc2b8"
Jul 07 14:06:53.369148 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:53.369094    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96fc3a1cd60dc427c02b39b51b26f7f6e6e1fe9c33b86e28711d3092b3fdc2b8"} err="failed to get container status \"96fc3a1cd60dc427c02b39b51b26f7f6e6e1fe9c33b86e28711d3092b3fdc2b8\": rpc error: code = NotFound desc = could not find container \"96fc3a1cd60dc427c02b39b51b26f7f6e6e1fe9c33b86e28711d3092b3fdc2b8\": container with ID starting with 96fc3a1cd60dc427c02b39b51b26f7f6e6e1fe9c33b86e28711d3092b3fdc2b8 not found: ID does not exist"
Jul 07 14:06:53.385372 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:53.385346    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lg9q9"]
Jul 07 14:06:53.386921 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:53.386903    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lg9q9"]
Jul 07 14:06:55.078396 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:55.078363    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e33a3351-4265-4d6e-86ad-201dfd78033b" path="/var/lib/kubelet/pods/e33a3351-4265-4d6e-86ad-201dfd78033b/volumes"
Jul 07 14:06:56.491198 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:56.491159    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:06:56.592221 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:06:56.592185    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:03.048259 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:03.048215    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:03.146584 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:03.146543    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:06.046855 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:06.046825    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:06.147648 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:06.147592    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:06.246026 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:06.245987    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:08.882496 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:08.882461    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"]
Jul 07 14:07:08.883034 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:08.883018    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e33a3351-4265-4d6e-86ad-201dfd78033b" containerName="manager"
Jul 07 14:07:08.883085 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:08.883037    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e33a3351-4265-4d6e-86ad-201dfd78033b" containerName="manager"
Jul 07 14:07:08.883150 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:08.883140    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e33a3351-4265-4d6e-86ad-201dfd78033b" containerName="manager"
Jul 07 14:07:08.889161 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:08.889139    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:07:08.892854 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:08.892832    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 14:07:08.892980 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:08.892832    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-865v6\""
Jul 07 14:07:08.904230 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:08.904203    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"]
Jul 07 14:07:08.922432 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:08.922399    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:09.021891 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:09.021856    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:09.036369 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:09.036340    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2977k\" (UniqueName: \"kubernetes.io/projected/f6cdffb1-f341-4a0a-9898-aff39af84ac7-kube-api-access-2977k\") pod \"maas-default-gateway-openshift-default-5896d4dd49-b7gsj\" (UID: \"f6cdffb1-f341-4a0a-9898-aff39af84ac7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:07:09.036539 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:09.036378    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6cdffb1-f341-4a0a-9898-aff39af84ac7-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-b7gsj\" (UID: \"f6cdffb1-f341-4a0a-9898-aff39af84ac7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:07:09.036539 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:09.036403    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6cdffb1-f341-4a0a-9898-aff39af84ac7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-b7gsj\" (UID: \"f6cdffb1-f341-4a0a-9898-aff39af84ac7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:07:09.036539 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:09.036467    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6cdffb1-f341-4a0a-9898-aff39af84ac7-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-b7gsj\" (UID: \"f6cdffb1-f341-4a0a-9898-aff39af84ac7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:07:09.036684 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:09.036533    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6cdffb1-f341-4a0a-9898-aff39af84ac7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-b7gsj\" (UID: \"f6cdffb1-f341-4a0a-9898-aff39af84ac7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:07:09.036684 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:09.036592    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6cdffb1-f341-4a0a-9898-aff39af84ac7-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-b7gsj\" (UID: \"f6cdffb1-f341-4a0a-9898-aff39af84ac7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:07:09.036684 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:09.036642    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6cdffb1-f341-4a0a-9898-aff39af84ac7-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-b7gsj\" (UID: \"f6cdffb1-f341-4a0a-9898-aff39af84ac7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:07:09.036684 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:09.036666    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6cdffb1-f341-4a0a-9898-aff39af84ac7-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-b7gsj\" (UID: \"f6cdffb1-f341-4a0a-9898-aff39af84ac7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:07:09.036873 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:09.036701    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6cdffb1-f341-4a0a-9898-aff39af84ac7-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-b7gsj\" (UID: \"f6cdffb1-f341-4a0a-9898-aff39af84ac7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:07:09.137924 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:09.137834    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2977k\" (UniqueName: \"kubernetes.io/projected/f6cdffb1-f341-4a0a-9898-aff39af84ac7-kube-api-access-2977k\") pod \"maas-default-gateway-openshift-default-5896d4dd49-b7gsj\" (UID: \"f6cdffb1-f341-4a0a-9898-aff39af84ac7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:07:09.137924 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:09.137883    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6cdffb1-f341-4a0a-9898-aff39af84ac7-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-b7gsj\" (UID: \"f6cdffb1-f341-4a0a-9898-aff39af84ac7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:07:09.137924 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:09.137908    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6cdffb1-f341-4a0a-9898-aff39af84ac7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-b7gsj\" (UID: \"f6cdffb1-f341-4a0a-9898-aff39af84ac7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:07:09.138219 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:09.137959    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6cdffb1-f341-4a0a-9898-aff39af84ac7-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-b7gsj\" (UID: \"f6cdffb1-f341-4a0a-9898-aff39af84ac7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:07:09.138219 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:09.137983    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6cdffb1-f341-4a0a-9898-aff39af84ac7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-b7gsj\" (UID: \"f6cdffb1-f341-4a0a-9898-aff39af84ac7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:07:09.138219 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:09.138039    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6cdffb1-f341-4a0a-9898-aff39af84ac7-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-b7gsj\" (UID: \"f6cdffb1-f341-4a0a-9898-aff39af84ac7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:07:09.138219 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:09.138122    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6cdffb1-f341-4a0a-9898-aff39af84ac7-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-b7gsj\" (UID: \"f6cdffb1-f341-4a0a-9898-aff39af84ac7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:07:09.138219 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:09.138153    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6cdffb1-f341-4a0a-9898-aff39af84ac7-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-b7gsj\" (UID: \"f6cdffb1-f341-4a0a-9898-aff39af84ac7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:07:09.138219 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:09.138188    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6cdffb1-f341-4a0a-9898-aff39af84ac7-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-b7gsj\" (UID: \"f6cdffb1-f341-4a0a-9898-aff39af84ac7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:07:09.138524 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:09.138351    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6cdffb1-f341-4a0a-9898-aff39af84ac7-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-b7gsj\" (UID: \"f6cdffb1-f341-4a0a-9898-aff39af84ac7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:07:09.138524 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:09.138387    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6cdffb1-f341-4a0a-9898-aff39af84ac7-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-b7gsj\" (UID: \"f6cdffb1-f341-4a0a-9898-aff39af84ac7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:07:09.138664 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:09.138643    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6cdffb1-f341-4a0a-9898-aff39af84ac7-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-b7gsj\" (UID: \"f6cdffb1-f341-4a0a-9898-aff39af84ac7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:07:09.138707 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:09.138677    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6cdffb1-f341-4a0a-9898-aff39af84ac7-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-b7gsj\" (UID: \"f6cdffb1-f341-4a0a-9898-aff39af84ac7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:07:09.138765 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:09.138743    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6cdffb1-f341-4a0a-9898-aff39af84ac7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-b7gsj\" (UID: \"f6cdffb1-f341-4a0a-9898-aff39af84ac7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:07:09.140631 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:09.140610    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6cdffb1-f341-4a0a-9898-aff39af84ac7-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-b7gsj\" (UID: \"f6cdffb1-f341-4a0a-9898-aff39af84ac7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:07:09.140726 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:09.140698    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6cdffb1-f341-4a0a-9898-aff39af84ac7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-b7gsj\" (UID: \"f6cdffb1-f341-4a0a-9898-aff39af84ac7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:07:09.146401 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:09.146376    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6cdffb1-f341-4a0a-9898-aff39af84ac7-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-b7gsj\" (UID: \"f6cdffb1-f341-4a0a-9898-aff39af84ac7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:07:09.146504 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:09.146399    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2977k\" (UniqueName: \"kubernetes.io/projected/f6cdffb1-f341-4a0a-9898-aff39af84ac7-kube-api-access-2977k\") pod \"maas-default-gateway-openshift-default-5896d4dd49-b7gsj\" (UID: \"f6cdffb1-f341-4a0a-9898-aff39af84ac7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:07:09.199631 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:09.199594    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:07:09.347884 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:09.347857    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"]
Jul 07 14:07:09.349693 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:07:09.349666    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6cdffb1_f341_4a0a_9898_aff39af84ac7.slice/crio-e9e2d4ba0c1a4acdfa7c72c70599bf4f797d7e618c95d362162892be223979e3 WatchSource:0}: Error finding container e9e2d4ba0c1a4acdfa7c72c70599bf4f797d7e618c95d362162892be223979e3: Status 404 returned error can't find the container with id e9e2d4ba0c1a4acdfa7c72c70599bf4f797d7e618c95d362162892be223979e3
Jul 07 14:07:09.436021 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:09.435911    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj" event={"ID":"f6cdffb1-f341-4a0a-9898-aff39af84ac7","Type":"ContainerStarted","Data":"e9e2d4ba0c1a4acdfa7c72c70599bf4f797d7e618c95d362162892be223979e3"}
Jul 07 14:07:10.261567 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:10.261531    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:10.331440 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:10.331402    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:11.726288 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:11.726249    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 14:07:11.726586 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:11.726325    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 14:07:11.726586 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:11.726374    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 14:07:12.334256 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:12.334225    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:12.454145 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:12.454112    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj" event={"ID":"f6cdffb1-f341-4a0a-9898-aff39af84ac7","Type":"ContainerStarted","Data":"f89d8dfd1c09df5a762efa48866fdb8d1a622b2f16c088475de21e07d6915015"}
Jul 07 14:07:12.476971 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:12.476899    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj" podStartSLOduration=2.102576635 podStartE2EDuration="4.476879689s" totalImagesPullingTime="2.374303054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:07:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:12.475755042 +0000 UTC m=+498.088034033" watchObservedRunningTime="2026-07-07 14:07:12.476879689 +0000 UTC m=+498.089158726"
Jul 07 14:07:12.566235 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:12.566198    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:13.199988 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:13.199950    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:07:13.205199 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:13.205169    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:07:13.459683 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:13.459607    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:07:13.460648 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:13.460629    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:07:13.652119 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:13.652085    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:13.749666 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:13.749574    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:14.350981 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:14.350932    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-gk4sv"]
Jul 07 14:07:14.353859 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:14.353843    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-gk4sv"
Jul 07 14:07:14.357251 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:14.357221    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-297xd\""
Jul 07 14:07:14.363013 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:14.362990    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-gk4sv"]
Jul 07 14:07:14.387810 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:14.387771    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:14.489304 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:14.489264    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckc6z\" (UniqueName: \"kubernetes.io/projected/46b9b3a2-b2f4-4f28-aa4f-27d77abd2e28-kube-api-access-ckc6z\") pod \"authorino-58cd955675-gk4sv\" (UID: \"46b9b3a2-b2f4-4f28-aa4f-27d77abd2e28\") " pod="kuadrant-system/authorino-58cd955675-gk4sv"
Jul 07 14:07:14.508347 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:14.508319    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:14.554983 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:14.554951    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-92mht"]
Jul 07 14:07:14.557338 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:14.557321    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-92mht"
Jul 07 14:07:14.572687 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:14.572658    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-92mht"]
Jul 07 14:07:14.590371 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:14.590317    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckc6z\" (UniqueName: \"kubernetes.io/projected/46b9b3a2-b2f4-4f28-aa4f-27d77abd2e28-kube-api-access-ckc6z\") pod \"authorino-58cd955675-gk4sv\" (UID: \"46b9b3a2-b2f4-4f28-aa4f-27d77abd2e28\") " pod="kuadrant-system/authorino-58cd955675-gk4sv"
Jul 07 14:07:14.601423 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:14.601336    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckc6z\" (UniqueName: \"kubernetes.io/projected/46b9b3a2-b2f4-4f28-aa4f-27d77abd2e28-kube-api-access-ckc6z\") pod \"authorino-58cd955675-gk4sv\" (UID: \"46b9b3a2-b2f4-4f28-aa4f-27d77abd2e28\") " pod="kuadrant-system/authorino-58cd955675-gk4sv"
Jul 07 14:07:14.663949 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:14.663894    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-gk4sv"
Jul 07 14:07:14.691254 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:14.691208    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjp5n\" (UniqueName: \"kubernetes.io/projected/19ec21b0-562f-46d6-b91b-e018737f9e64-kube-api-access-zjp5n\") pod \"authorino-75d556bd77-92mht\" (UID: \"19ec21b0-562f-46d6-b91b-e018737f9e64\") " pod="kuadrant-system/authorino-75d556bd77-92mht"
Jul 07 14:07:14.792420 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:14.792380    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjp5n\" (UniqueName: \"kubernetes.io/projected/19ec21b0-562f-46d6-b91b-e018737f9e64-kube-api-access-zjp5n\") pod \"authorino-75d556bd77-92mht\" (UID: \"19ec21b0-562f-46d6-b91b-e018737f9e64\") " pod="kuadrant-system/authorino-75d556bd77-92mht"
Jul 07 14:07:14.801968 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:14.801907    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjp5n\" (UniqueName: \"kubernetes.io/projected/19ec21b0-562f-46d6-b91b-e018737f9e64-kube-api-access-zjp5n\") pod \"authorino-75d556bd77-92mht\" (UID: \"19ec21b0-562f-46d6-b91b-e018737f9e64\") " pod="kuadrant-system/authorino-75d556bd77-92mht"
Jul 07 14:07:14.812536 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:14.812510    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-gk4sv"]
Jul 07 14:07:14.815157 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:07:14.815128    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46b9b3a2_b2f4_4f28_aa4f_27d77abd2e28.slice/crio-9b9d5a80851df9c74e3dd5c095d3a1e9591a7d409d13315be3cb0a11c5b41a2b WatchSource:0}: Error finding container 9b9d5a80851df9c74e3dd5c095d3a1e9591a7d409d13315be3cb0a11c5b41a2b: Status 404 returned error can't find the container with id 9b9d5a80851df9c74e3dd5c095d3a1e9591a7d409d13315be3cb0a11c5b41a2b
Jul 07 14:07:14.866019 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:14.865887    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-92mht"
Jul 07 14:07:15.006569 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:15.004982    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-92mht"]
Jul 07 14:07:15.007598 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:07:15.007566    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19ec21b0_562f_46d6_b91b_e018737f9e64.slice/crio-72ef0507cd4bb7648c533ef0fb3fcfd28c1382a25f21973a7e530f242713792b WatchSource:0}: Error finding container 72ef0507cd4bb7648c533ef0fb3fcfd28c1382a25f21973a7e530f242713792b: Status 404 returned error can't find the container with id 72ef0507cd4bb7648c533ef0fb3fcfd28c1382a25f21973a7e530f242713792b
Jul 07 14:07:15.470286 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:15.470238    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-92mht" event={"ID":"19ec21b0-562f-46d6-b91b-e018737f9e64","Type":"ContainerStarted","Data":"72ef0507cd4bb7648c533ef0fb3fcfd28c1382a25f21973a7e530f242713792b"}
Jul 07 14:07:15.471438 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:15.471414    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-gk4sv" event={"ID":"46b9b3a2-b2f4-4f28-aa4f-27d77abd2e28","Type":"ContainerStarted","Data":"9b9d5a80851df9c74e3dd5c095d3a1e9591a7d409d13315be3cb0a11c5b41a2b"}
Jul 07 14:07:16.345652 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:16.345552    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:16.349746 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:16.347886    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n5859"]
Jul 07 14:07:16.351129 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:16.351108    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n5859"
Jul 07 14:07:16.354896 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:16.354706    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fzwnx\""
Jul 07 14:07:16.355974 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:16.355899    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 07 14:07:16.368722 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:16.368326    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n5859"]
Jul 07 14:07:16.444096 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:16.443986    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n5859"]
Jul 07 14:07:16.512619 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:16.511805    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqr2s\" (UniqueName: \"kubernetes.io/projected/f1812c9d-c246-4a65-8e98-658385e65532-kube-api-access-wqr2s\") pod \"limitador-limitador-64c94fd64f-n5859\" (UID: \"f1812c9d-c246-4a65-8e98-658385e65532\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n5859"
Jul 07 14:07:16.512619 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:16.511887    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f1812c9d-c246-4a65-8e98-658385e65532-config-file\") pod \"limitador-limitador-64c94fd64f-n5859\" (UID: \"f1812c9d-c246-4a65-8e98-658385e65532\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n5859"
Jul 07 14:07:16.613410 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:16.612877    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f1812c9d-c246-4a65-8e98-658385e65532-config-file\") pod \"limitador-limitador-64c94fd64f-n5859\" (UID: \"f1812c9d-c246-4a65-8e98-658385e65532\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n5859"
Jul 07 14:07:16.613410 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:16.613031    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqr2s\" (UniqueName: \"kubernetes.io/projected/f1812c9d-c246-4a65-8e98-658385e65532-kube-api-access-wqr2s\") pod \"limitador-limitador-64c94fd64f-n5859\" (UID: \"f1812c9d-c246-4a65-8e98-658385e65532\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n5859"
Jul 07 14:07:16.614018 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:16.613989    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f1812c9d-c246-4a65-8e98-658385e65532-config-file\") pod \"limitador-limitador-64c94fd64f-n5859\" (UID: \"f1812c9d-c246-4a65-8e98-658385e65532\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n5859"
Jul 07 14:07:16.626646 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:16.626617    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqr2s\" (UniqueName: \"kubernetes.io/projected/f1812c9d-c246-4a65-8e98-658385e65532-kube-api-access-wqr2s\") pod \"limitador-limitador-64c94fd64f-n5859\" (UID: \"f1812c9d-c246-4a65-8e98-658385e65532\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n5859"
Jul 07 14:07:16.670677 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:16.670638    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n5859"
Jul 07 14:07:16.880840 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:16.880808    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n5859"]
Jul 07 14:07:16.885858 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:07:16.885825    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1812c9d_c246_4a65_8e98_658385e65532.slice/crio-15d0972fb879768926e89beb7db0d959db5f7de66ccc84ad694992d0941623ad WatchSource:0}: Error finding container 15d0972fb879768926e89beb7db0d959db5f7de66ccc84ad694992d0941623ad: Status 404 returned error can't find the container with id 15d0972fb879768926e89beb7db0d959db5f7de66ccc84ad694992d0941623ad
Jul 07 14:07:17.445334 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:17.445301    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:17.493609 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:17.493570    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n5859" event={"ID":"f1812c9d-c246-4a65-8e98-658385e65532","Type":"ContainerStarted","Data":"15d0972fb879768926e89beb7db0d959db5f7de66ccc84ad694992d0941623ad"}
Jul 07 14:07:17.518793 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:17.518744    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:19.507250 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:19.507212    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-92mht" event={"ID":"19ec21b0-562f-46d6-b91b-e018737f9e64","Type":"ContainerStarted","Data":"b54eec93af4ce2058699f40b010768486101cb0de804b051a065c14c9c84d10a"}
Jul 07 14:07:19.508724 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:19.508700    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-gk4sv" event={"ID":"46b9b3a2-b2f4-4f28-aa4f-27d77abd2e28","Type":"ContainerStarted","Data":"105b8b6c8b6ef9f856dd4e5c1835b91439bca653da2162426b97c4d930ef180d"}
Jul 07 14:07:19.527268 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:19.527216    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-92mht" podStartSLOduration=1.981569769 podStartE2EDuration="5.527197666s" totalImagesPullingTime="3.545627897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:07:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:19.525193251 +0000 UTC m=+505.137472222" watchObservedRunningTime="2026-07-07 14:07:19.527197666 +0000 UTC m=+505.139476660"
Jul 07 14:07:19.541484 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:19.541421    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-gk4sv" podStartSLOduration=1.81444636 podStartE2EDuration="5.541398191s" totalImagesPullingTime="3.726951831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:07:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:19.541035043 +0000 UTC m=+505.153314016" watchObservedRunningTime="2026-07-07 14:07:19.541398191 +0000 UTC m=+505.153677163"
Jul 07 14:07:19.564560 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:19.564520    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-gk4sv"]
Jul 07 14:07:21.520408 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:21.520369    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n5859" event={"ID":"f1812c9d-c246-4a65-8e98-658385e65532","Type":"ContainerStarted","Data":"ee46cd43c5a34585896e0f6989d5decdeabc77613656931eb9192633e965e6a6"}
Jul 07 14:07:21.520912 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:21.520430    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-gk4sv" podUID="46b9b3a2-b2f4-4f28-aa4f-27d77abd2e28" containerName="authorino" containerID="cri-o://105b8b6c8b6ef9f856dd4e5c1835b91439bca653da2162426b97c4d930ef180d" gracePeriod=30
Jul 07 14:07:21.542265 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:21.542215    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-n5859" podStartSLOduration=1.487530558 podStartE2EDuration="5.542198507s" totalImagesPullingTime="4.054667949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:07:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:21.541478952 +0000 UTC m=+507.153757927" watchObservedRunningTime="2026-07-07 14:07:21.542198507 +0000 UTC m=+507.154477478"
Jul 07 14:07:21.771119 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:21.771055    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-gk4sv"
Jul 07 14:07:21.867200 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:21.867163    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckc6z\" (UniqueName: \"kubernetes.io/projected/46b9b3a2-b2f4-4f28-aa4f-27d77abd2e28-kube-api-access-ckc6z\") pod \"46b9b3a2-b2f4-4f28-aa4f-27d77abd2e28\" (UID: \"46b9b3a2-b2f4-4f28-aa4f-27d77abd2e28\") "
Jul 07 14:07:21.869212 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:21.869182    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46b9b3a2-b2f4-4f28-aa4f-27d77abd2e28-kube-api-access-ckc6z" (OuterVolumeSpecName: "kube-api-access-ckc6z") pod "46b9b3a2-b2f4-4f28-aa4f-27d77abd2e28" (UID: "46b9b3a2-b2f4-4f28-aa4f-27d77abd2e28"). InnerVolumeSpecName "kube-api-access-ckc6z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:07:21.968826 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:21.968787    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckc6z\" (UniqueName: \"kubernetes.io/projected/46b9b3a2-b2f4-4f28-aa4f-27d77abd2e28-kube-api-access-ckc6z\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:07:22.525796 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:22.525762    2576 generic.go:356] "Generic (PLEG): container finished" podID="46b9b3a2-b2f4-4f28-aa4f-27d77abd2e28" containerID="105b8b6c8b6ef9f856dd4e5c1835b91439bca653da2162426b97c4d930ef180d" exitCode=0
Jul 07 14:07:22.526306 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:22.525808    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-gk4sv"
Jul 07 14:07:22.526306 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:22.525847    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-gk4sv" event={"ID":"46b9b3a2-b2f4-4f28-aa4f-27d77abd2e28","Type":"ContainerDied","Data":"105b8b6c8b6ef9f856dd4e5c1835b91439bca653da2162426b97c4d930ef180d"}
Jul 07 14:07:22.526306 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:22.525891    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-gk4sv" event={"ID":"46b9b3a2-b2f4-4f28-aa4f-27d77abd2e28","Type":"ContainerDied","Data":"9b9d5a80851df9c74e3dd5c095d3a1e9591a7d409d13315be3cb0a11c5b41a2b"}
Jul 07 14:07:22.526306 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:22.525911    2576 scope.go:117] "RemoveContainer" containerID="105b8b6c8b6ef9f856dd4e5c1835b91439bca653da2162426b97c4d930ef180d"
Jul 07 14:07:22.526306 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:22.526205    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-n5859"
Jul 07 14:07:22.534708 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:22.534688    2576 scope.go:117] "RemoveContainer" containerID="105b8b6c8b6ef9f856dd4e5c1835b91439bca653da2162426b97c4d930ef180d"
Jul 07 14:07:22.535002 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:07:22.534985    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"105b8b6c8b6ef9f856dd4e5c1835b91439bca653da2162426b97c4d930ef180d\": container with ID starting with 105b8b6c8b6ef9f856dd4e5c1835b91439bca653da2162426b97c4d930ef180d not found: ID does not exist" containerID="105b8b6c8b6ef9f856dd4e5c1835b91439bca653da2162426b97c4d930ef180d"
Jul 07 14:07:22.535062 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:22.535012    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"105b8b6c8b6ef9f856dd4e5c1835b91439bca653da2162426b97c4d930ef180d"} err="failed to get container status \"105b8b6c8b6ef9f856dd4e5c1835b91439bca653da2162426b97c4d930ef180d\": rpc error: code = NotFound desc = could not find container \"105b8b6c8b6ef9f856dd4e5c1835b91439bca653da2162426b97c4d930ef180d\": container with ID starting with 105b8b6c8b6ef9f856dd4e5c1835b91439bca653da2162426b97c4d930ef180d not found: ID does not exist"
Jul 07 14:07:22.548697 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:22.548669    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-gk4sv"]
Jul 07 14:07:22.554175 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:22.554154    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-gk4sv"]
Jul 07 14:07:23.074550 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:23.074520    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46b9b3a2-b2f4-4f28-aa4f-27d77abd2e28" path="/var/lib/kubelet/pods/46b9b3a2-b2f4-4f28-aa4f-27d77abd2e28/volumes"
Jul 07 14:07:23.456866 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:23.456830    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:23.558396 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:23.558358    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:26.459430 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:26.459394    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:26.560615 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:26.560581    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:31.610560 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:31.610528    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n5859"]
Jul 07 14:07:31.611036 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:31.610749    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-n5859" podUID="f1812c9d-c246-4a65-8e98-658385e65532" containerName="limitador" containerID="cri-o://ee46cd43c5a34585896e0f6989d5decdeabc77613656931eb9192633e965e6a6" gracePeriod=30
Jul 07 14:07:31.611483 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:31.611464    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-n5859"
Jul 07 14:07:32.173779 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:32.173708    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n5859"
Jul 07 14:07:32.250795 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:32.250758    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f1812c9d-c246-4a65-8e98-658385e65532-config-file\") pod \"f1812c9d-c246-4a65-8e98-658385e65532\" (UID: \"f1812c9d-c246-4a65-8e98-658385e65532\") "
Jul 07 14:07:32.250795 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:32.250811    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqr2s\" (UniqueName: \"kubernetes.io/projected/f1812c9d-c246-4a65-8e98-658385e65532-kube-api-access-wqr2s\") pod \"f1812c9d-c246-4a65-8e98-658385e65532\" (UID: \"f1812c9d-c246-4a65-8e98-658385e65532\") "
Jul 07 14:07:32.251241 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:32.251206    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1812c9d-c246-4a65-8e98-658385e65532-config-file" (OuterVolumeSpecName: "config-file") pod "f1812c9d-c246-4a65-8e98-658385e65532" (UID: "f1812c9d-c246-4a65-8e98-658385e65532"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:07:32.252993 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:32.252961    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1812c9d-c246-4a65-8e98-658385e65532-kube-api-access-wqr2s" (OuterVolumeSpecName: "kube-api-access-wqr2s") pod "f1812c9d-c246-4a65-8e98-658385e65532" (UID: "f1812c9d-c246-4a65-8e98-658385e65532"). InnerVolumeSpecName "kube-api-access-wqr2s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:07:32.351827 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:32.351789    2576 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f1812c9d-c246-4a65-8e98-658385e65532-config-file\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:07:32.351827 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:32.351819    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqr2s\" (UniqueName: \"kubernetes.io/projected/f1812c9d-c246-4a65-8e98-658385e65532-kube-api-access-wqr2s\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:07:32.582905 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:32.582872    2576 generic.go:356] "Generic (PLEG): container finished" podID="f1812c9d-c246-4a65-8e98-658385e65532" containerID="ee46cd43c5a34585896e0f6989d5decdeabc77613656931eb9192633e965e6a6" exitCode=0
Jul 07 14:07:32.583093 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:32.582919    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n5859"
Jul 07 14:07:32.583093 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:32.582961    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n5859" event={"ID":"f1812c9d-c246-4a65-8e98-658385e65532","Type":"ContainerDied","Data":"ee46cd43c5a34585896e0f6989d5decdeabc77613656931eb9192633e965e6a6"}
Jul 07 14:07:32.583093 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:32.583017    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n5859" event={"ID":"f1812c9d-c246-4a65-8e98-658385e65532","Type":"ContainerDied","Data":"15d0972fb879768926e89beb7db0d959db5f7de66ccc84ad694992d0941623ad"}
Jul 07 14:07:32.583093 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:32.583048    2576 scope.go:117] "RemoveContainer" containerID="ee46cd43c5a34585896e0f6989d5decdeabc77613656931eb9192633e965e6a6"
Jul 07 14:07:32.591792 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:32.591771    2576 scope.go:117] "RemoveContainer" containerID="ee46cd43c5a34585896e0f6989d5decdeabc77613656931eb9192633e965e6a6"
Jul 07 14:07:32.592093 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:07:32.592073    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee46cd43c5a34585896e0f6989d5decdeabc77613656931eb9192633e965e6a6\": container with ID starting with ee46cd43c5a34585896e0f6989d5decdeabc77613656931eb9192633e965e6a6 not found: ID does not exist" containerID="ee46cd43c5a34585896e0f6989d5decdeabc77613656931eb9192633e965e6a6"
Jul 07 14:07:32.592201 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:32.592102    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee46cd43c5a34585896e0f6989d5decdeabc77613656931eb9192633e965e6a6"} err="failed to get container status \"ee46cd43c5a34585896e0f6989d5decdeabc77613656931eb9192633e965e6a6\": rpc error: code = NotFound desc = could not find container \"ee46cd43c5a34585896e0f6989d5decdeabc77613656931eb9192633e965e6a6\": container with ID starting with ee46cd43c5a34585896e0f6989d5decdeabc77613656931eb9192633e965e6a6 not found: ID does not exist"
Jul 07 14:07:32.604845 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:32.604818    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n5859"]
Jul 07 14:07:32.608795 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:32.608770    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n5859"]
Jul 07 14:07:33.075339 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:33.075293    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1812c9d-c246-4a65-8e98-658385e65532" path="/var/lib/kubelet/pods/f1812c9d-c246-4a65-8e98-658385e65532/volumes"
Jul 07 14:07:35.189688 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:35.189660    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-chkfb"]
Jul 07 14:07:35.190258 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:35.190239    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46b9b3a2-b2f4-4f28-aa4f-27d77abd2e28" containerName="authorino"
Jul 07 14:07:35.190335 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:35.190261    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="46b9b3a2-b2f4-4f28-aa4f-27d77abd2e28" containerName="authorino"
Jul 07 14:07:35.190335 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:35.190287    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1812c9d-c246-4a65-8e98-658385e65532" containerName="limitador"
Jul 07 14:07:35.190335 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:35.190297    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1812c9d-c246-4a65-8e98-658385e65532" containerName="limitador"
Jul 07 14:07:35.190494 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:35.190394    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="46b9b3a2-b2f4-4f28-aa4f-27d77abd2e28" containerName="authorino"
Jul 07 14:07:35.190494 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:35.190408    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1812c9d-c246-4a65-8e98-658385e65532" containerName="limitador"
Jul 07 14:07:35.193770 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:35.193750    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-chkfb"
Jul 07 14:07:35.196808 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:35.196790    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-62h6h\""
Jul 07 14:07:35.196916 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:35.196831    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 07 14:07:35.203761 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:35.203735    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-chkfb"]
Jul 07 14:07:35.227111 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:35.227077    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:35.271750 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:35.271719    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-894tk\" (UniqueName: \"kubernetes.io/projected/d5f6ef5f-5978-4f73-895f-018e9f5b9207-kube-api-access-894tk\") pod \"postgres-69fb4594cf-chkfb\" (UID: \"d5f6ef5f-5978-4f73-895f-018e9f5b9207\") " pod="opendatahub/postgres-69fb4594cf-chkfb"
Jul 07 14:07:35.271892 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:35.271792    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d5f6ef5f-5978-4f73-895f-018e9f5b9207-data\") pod \"postgres-69fb4594cf-chkfb\" (UID: \"d5f6ef5f-5978-4f73-895f-018e9f5b9207\") " pod="opendatahub/postgres-69fb4594cf-chkfb"
Jul 07 14:07:35.373287 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:35.373254    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d5f6ef5f-5978-4f73-895f-018e9f5b9207-data\") pod \"postgres-69fb4594cf-chkfb\" (UID: \"d5f6ef5f-5978-4f73-895f-018e9f5b9207\") " pod="opendatahub/postgres-69fb4594cf-chkfb"
Jul 07 14:07:35.373467 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:35.373317    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-894tk\" (UniqueName: \"kubernetes.io/projected/d5f6ef5f-5978-4f73-895f-018e9f5b9207-kube-api-access-894tk\") pod \"postgres-69fb4594cf-chkfb\" (UID: \"d5f6ef5f-5978-4f73-895f-018e9f5b9207\") " pod="opendatahub/postgres-69fb4594cf-chkfb"
Jul 07 14:07:35.373660 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:35.373640    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d5f6ef5f-5978-4f73-895f-018e9f5b9207-data\") pod \"postgres-69fb4594cf-chkfb\" (UID: \"d5f6ef5f-5978-4f73-895f-018e9f5b9207\") " pod="opendatahub/postgres-69fb4594cf-chkfb"
Jul 07 14:07:35.383371 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:35.383335    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-894tk\" (UniqueName: \"kubernetes.io/projected/d5f6ef5f-5978-4f73-895f-018e9f5b9207-kube-api-access-894tk\") pod \"postgres-69fb4594cf-chkfb\" (UID: \"d5f6ef5f-5978-4f73-895f-018e9f5b9207\") " pod="opendatahub/postgres-69fb4594cf-chkfb"
Jul 07 14:07:35.505918 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:35.505838    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-chkfb"
Jul 07 14:07:35.641614 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:35.641589    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-chkfb"]
Jul 07 14:07:35.644182 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:07:35.644152    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5f6ef5f_5978_4f73_895f_018e9f5b9207.slice/crio-5b1a4996f5c25bdc39186c09b003725e7f2994a556b275ed619eaf167ce081cf WatchSource:0}: Error finding container 5b1a4996f5c25bdc39186c09b003725e7f2994a556b275ed619eaf167ce081cf: Status 404 returned error can't find the container with id 5b1a4996f5c25bdc39186c09b003725e7f2994a556b275ed619eaf167ce081cf
Jul 07 14:07:36.607399 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:36.607362    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-chkfb" event={"ID":"d5f6ef5f-5978-4f73-895f-018e9f5b9207","Type":"ContainerStarted","Data":"5b1a4996f5c25bdc39186c09b003725e7f2994a556b275ed619eaf167ce081cf"}
Jul 07 14:07:41.636640 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:41.636530    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-chkfb" event={"ID":"d5f6ef5f-5978-4f73-895f-018e9f5b9207","Type":"ContainerStarted","Data":"fc4049d04f696dd16d39e3fee605dc5ed3e1eaf6910b10fff588a4c041a2b0db"}
Jul 07 14:07:41.636640 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:41.636598    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-chkfb"
Jul 07 14:07:41.659416 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:41.659358    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-chkfb" podStartSLOduration=1.059107666 podStartE2EDuration="6.659340915s" totalImagesPullingTime="5.600233249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:07:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:41.657865139 +0000 UTC m=+527.270144111" watchObservedRunningTime="2026-07-07 14:07:41.659340915 +0000 UTC m=+527.271619888"
Jul 07 14:07:47.673038 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:47.672911    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-chkfb"
Jul 07 14:07:48.031229 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:48.031189    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:48.267163 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:48.267133    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r4wj8"]
Jul 07 14:07:48.269995 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:48.269976    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-r4wj8"
Jul 07 14:07:48.270542 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:48.270516    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxzxh\" (UniqueName: \"kubernetes.io/projected/a43d6eaa-1f75-44e0-a1c2-955f373ef471-kube-api-access-xxzxh\") pod \"authorino-5d4b67c446-r4wj8\" (UID: \"a43d6eaa-1f75-44e0-a1c2-955f373ef471\") " pod="kuadrant-system/authorino-5d4b67c446-r4wj8"
Jul 07 14:07:48.278778 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:48.278753    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r4wj8"]
Jul 07 14:07:48.371658 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:48.371570    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxzxh\" (UniqueName: \"kubernetes.io/projected/a43d6eaa-1f75-44e0-a1c2-955f373ef471-kube-api-access-xxzxh\") pod \"authorino-5d4b67c446-r4wj8\" (UID: \"a43d6eaa-1f75-44e0-a1c2-955f373ef471\") " pod="kuadrant-system/authorino-5d4b67c446-r4wj8"
Jul 07 14:07:48.383366 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:48.383338    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxzxh\" (UniqueName: \"kubernetes.io/projected/a43d6eaa-1f75-44e0-a1c2-955f373ef471-kube-api-access-xxzxh\") pod \"authorino-5d4b67c446-r4wj8\" (UID: \"a43d6eaa-1f75-44e0-a1c2-955f373ef471\") " pod="kuadrant-system/authorino-5d4b67c446-r4wj8"
Jul 07 14:07:48.427577 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:48.427543    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:48.527004 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:48.526972    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r4wj8"]
Jul 07 14:07:48.527285 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:48.527270    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-r4wj8"
Jul 07 14:07:48.555698 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:48.555667    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f6f797c7-n9jlk"]
Jul 07 14:07:48.559913 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:48.559890    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f6f797c7-n9jlk"
Jul 07 14:07:48.566256 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:48.566233    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f6f797c7-n9jlk"]
Jul 07 14:07:48.572503 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:48.572478    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mggb\" (UniqueName: \"kubernetes.io/projected/996a38e8-fa52-40f0-9b25-2b57fffe0af0-kube-api-access-6mggb\") pod \"authorino-f6f797c7-n9jlk\" (UID: \"996a38e8-fa52-40f0-9b25-2b57fffe0af0\") " pod="kuadrant-system/authorino-f6f797c7-n9jlk"
Jul 07 14:07:48.668101 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:48.668078    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r4wj8"]
Jul 07 14:07:48.670347 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:07:48.670293    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda43d6eaa_1f75_44e0_a1c2_955f373ef471.slice/crio-a70494dacd2506d5db0a89699cfc218aa5cde1ebe8fd6bf3b9f48e9d852676b9 WatchSource:0}: Error finding container a70494dacd2506d5db0a89699cfc218aa5cde1ebe8fd6bf3b9f48e9d852676b9: Status 404 returned error can't find the container with id a70494dacd2506d5db0a89699cfc218aa5cde1ebe8fd6bf3b9f48e9d852676b9
Jul 07 14:07:48.673064 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:48.673041    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mggb\" (UniqueName: \"kubernetes.io/projected/996a38e8-fa52-40f0-9b25-2b57fffe0af0-kube-api-access-6mggb\") pod \"authorino-f6f797c7-n9jlk\" (UID: \"996a38e8-fa52-40f0-9b25-2b57fffe0af0\") " pod="kuadrant-system/authorino-f6f797c7-n9jlk"
Jul 07 14:07:48.682564 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:48.682524    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mggb\" (UniqueName: \"kubernetes.io/projected/996a38e8-fa52-40f0-9b25-2b57fffe0af0-kube-api-access-6mggb\") pod \"authorino-f6f797c7-n9jlk\" (UID: \"996a38e8-fa52-40f0-9b25-2b57fffe0af0\") " pod="kuadrant-system/authorino-f6f797c7-n9jlk"
Jul 07 14:07:48.767133 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:48.767100    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f6f797c7-n9jlk"]
Jul 07 14:07:48.767366 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:48.767355    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f6f797c7-n9jlk"
Jul 07 14:07:48.795186 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:48.795157    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-68cddfdddf-lvq8d"]
Jul 07 14:07:48.798804 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:48.798781    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68cddfdddf-lvq8d"
Jul 07 14:07:48.801247 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:48.801225    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 07 14:07:48.808484 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:48.808461    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68cddfdddf-lvq8d"]
Jul 07 14:07:48.874929 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:48.874875    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ea796347-5d97-4e69-baa4-6f4f12f69d90-tls-cert\") pod \"authorino-68cddfdddf-lvq8d\" (UID: \"ea796347-5d97-4e69-baa4-6f4f12f69d90\") " pod="kuadrant-system/authorino-68cddfdddf-lvq8d"
Jul 07 14:07:48.875115 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:48.874956    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv4dj\" (UniqueName: \"kubernetes.io/projected/ea796347-5d97-4e69-baa4-6f4f12f69d90-kube-api-access-zv4dj\") pod \"authorino-68cddfdddf-lvq8d\" (UID: \"ea796347-5d97-4e69-baa4-6f4f12f69d90\") " pod="kuadrant-system/authorino-68cddfdddf-lvq8d"
Jul 07 14:07:48.911571 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:48.911543    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f6f797c7-n9jlk"]
Jul 07 14:07:48.913136 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:07:48.913111    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod996a38e8_fa52_40f0_9b25_2b57fffe0af0.slice/crio-5cc6be3b137415fdc0a4620045af4607a923c332ca6fcff86c73b1af0b606f57 WatchSource:0}: Error finding container 5cc6be3b137415fdc0a4620045af4607a923c332ca6fcff86c73b1af0b606f57: Status 404 returned error can't find the container with id 5cc6be3b137415fdc0a4620045af4607a923c332ca6fcff86c73b1af0b606f57
Jul 07 14:07:48.975511 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:48.975485    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ea796347-5d97-4e69-baa4-6f4f12f69d90-tls-cert\") pod \"authorino-68cddfdddf-lvq8d\" (UID: \"ea796347-5d97-4e69-baa4-6f4f12f69d90\") " pod="kuadrant-system/authorino-68cddfdddf-lvq8d"
Jul 07 14:07:48.975695 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:48.975526    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv4dj\" (UniqueName: \"kubernetes.io/projected/ea796347-5d97-4e69-baa4-6f4f12f69d90-kube-api-access-zv4dj\") pod \"authorino-68cddfdddf-lvq8d\" (UID: \"ea796347-5d97-4e69-baa4-6f4f12f69d90\") " pod="kuadrant-system/authorino-68cddfdddf-lvq8d"
Jul 07 14:07:48.977884 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:48.977859    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ea796347-5d97-4e69-baa4-6f4f12f69d90-tls-cert\") pod \"authorino-68cddfdddf-lvq8d\" (UID: \"ea796347-5d97-4e69-baa4-6f4f12f69d90\") " pod="kuadrant-system/authorino-68cddfdddf-lvq8d"
Jul 07 14:07:48.983835 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:48.983811    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv4dj\" (UniqueName: \"kubernetes.io/projected/ea796347-5d97-4e69-baa4-6f4f12f69d90-kube-api-access-zv4dj\") pod \"authorino-68cddfdddf-lvq8d\" (UID: \"ea796347-5d97-4e69-baa4-6f4f12f69d90\") " pod="kuadrant-system/authorino-68cddfdddf-lvq8d"
Jul 07 14:07:49.109752 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:49.109728    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68cddfdddf-lvq8d"
Jul 07 14:07:49.255424 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:49.255395    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68cddfdddf-lvq8d"]
Jul 07 14:07:49.257059 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:07:49.257035    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea796347_5d97_4e69_baa4_6f4f12f69d90.slice/crio-39fc0a66379c6c12a096f52aa824d7c2ae114a44616e81b07cec464a2b8d6884 WatchSource:0}: Error finding container 39fc0a66379c6c12a096f52aa824d7c2ae114a44616e81b07cec464a2b8d6884: Status 404 returned error can't find the container with id 39fc0a66379c6c12a096f52aa824d7c2ae114a44616e81b07cec464a2b8d6884
Jul 07 14:07:49.681321 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:49.681233    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-r4wj8" event={"ID":"a43d6eaa-1f75-44e0-a1c2-955f373ef471","Type":"ContainerStarted","Data":"1a6a06d1fe0f202f23aaeb206543e543842b3d7227edbbb302d6972dc3c0019d"}
Jul 07 14:07:49.681321 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:49.681272    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-r4wj8" event={"ID":"a43d6eaa-1f75-44e0-a1c2-955f373ef471","Type":"ContainerStarted","Data":"a70494dacd2506d5db0a89699cfc218aa5cde1ebe8fd6bf3b9f48e9d852676b9"}
Jul 07 14:07:49.681321 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:49.681274    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-r4wj8" podUID="a43d6eaa-1f75-44e0-a1c2-955f373ef471" containerName="authorino" containerID="cri-o://1a6a06d1fe0f202f23aaeb206543e543842b3d7227edbbb302d6972dc3c0019d" gracePeriod=30
Jul 07 14:07:49.682616 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:49.682583    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68cddfdddf-lvq8d" event={"ID":"ea796347-5d97-4e69-baa4-6f4f12f69d90","Type":"ContainerStarted","Data":"39fc0a66379c6c12a096f52aa824d7c2ae114a44616e81b07cec464a2b8d6884"}
Jul 07 14:07:49.683992 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:49.683968    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f6f797c7-n9jlk" event={"ID":"996a38e8-fa52-40f0-9b25-2b57fffe0af0","Type":"ContainerStarted","Data":"5cc6be3b137415fdc0a4620045af4607a923c332ca6fcff86c73b1af0b606f57"}
Jul 07 14:07:49.700364 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:49.700313    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-r4wj8" podStartSLOduration=1.311466987 podStartE2EDuration="1.700293881s" totalImagesPullingTime="388.826894ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:07:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:49.697643463 +0000 UTC m=+535.309922436" watchObservedRunningTime="2026-07-07 14:07:49.700293881 +0000 UTC m=+535.312572854"
Jul 07 14:07:49.944538 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:49.944511    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-r4wj8"
Jul 07 14:07:49.982129 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:49.982096    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxzxh\" (UniqueName: \"kubernetes.io/projected/a43d6eaa-1f75-44e0-a1c2-955f373ef471-kube-api-access-xxzxh\") pod \"a43d6eaa-1f75-44e0-a1c2-955f373ef471\" (UID: \"a43d6eaa-1f75-44e0-a1c2-955f373ef471\") "
Jul 07 14:07:49.984081 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:49.984056    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a43d6eaa-1f75-44e0-a1c2-955f373ef471-kube-api-access-xxzxh" (OuterVolumeSpecName: "kube-api-access-xxzxh") pod "a43d6eaa-1f75-44e0-a1c2-955f373ef471" (UID: "a43d6eaa-1f75-44e0-a1c2-955f373ef471"). InnerVolumeSpecName "kube-api-access-xxzxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:07:50.082849 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:50.082817    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxzxh\" (UniqueName: \"kubernetes.io/projected/a43d6eaa-1f75-44e0-a1c2-955f373ef471-kube-api-access-xxzxh\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:07:50.690965 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:50.690911    2576 generic.go:356] "Generic (PLEG): container finished" podID="a43d6eaa-1f75-44e0-a1c2-955f373ef471" containerID="1a6a06d1fe0f202f23aaeb206543e543842b3d7227edbbb302d6972dc3c0019d" exitCode=0
Jul 07 14:07:50.691407 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:50.690973    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-r4wj8"
Jul 07 14:07:50.691407 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:50.690999    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-r4wj8" event={"ID":"a43d6eaa-1f75-44e0-a1c2-955f373ef471","Type":"ContainerDied","Data":"1a6a06d1fe0f202f23aaeb206543e543842b3d7227edbbb302d6972dc3c0019d"}
Jul 07 14:07:50.691407 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:50.691042    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-r4wj8" event={"ID":"a43d6eaa-1f75-44e0-a1c2-955f373ef471","Type":"ContainerDied","Data":"a70494dacd2506d5db0a89699cfc218aa5cde1ebe8fd6bf3b9f48e9d852676b9"}
Jul 07 14:07:50.691407 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:50.691064    2576 scope.go:117] "RemoveContainer" containerID="1a6a06d1fe0f202f23aaeb206543e543842b3d7227edbbb302d6972dc3c0019d"
Jul 07 14:07:50.692668 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:50.692636    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68cddfdddf-lvq8d" event={"ID":"ea796347-5d97-4e69-baa4-6f4f12f69d90","Type":"ContainerStarted","Data":"3ab9ee0b443efe85309eb851c48cf5515877c3bfa06dfe98f1703028aa555db7"}
Jul 07 14:07:50.694220 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:50.694196    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f6f797c7-n9jlk" event={"ID":"996a38e8-fa52-40f0-9b25-2b57fffe0af0","Type":"ContainerStarted","Data":"dc7adb5333cb8a76b781a4c88bb09ea7482007e688ff94a40ce08927d921c338"}
Jul 07 14:07:50.694321 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:50.694284    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-f6f797c7-n9jlk" podUID="996a38e8-fa52-40f0-9b25-2b57fffe0af0" containerName="authorino" containerID="cri-o://dc7adb5333cb8a76b781a4c88bb09ea7482007e688ff94a40ce08927d921c338" gracePeriod=30
Jul 07 14:07:50.700858 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:50.700838    2576 scope.go:117] "RemoveContainer" containerID="1a6a06d1fe0f202f23aaeb206543e543842b3d7227edbbb302d6972dc3c0019d"
Jul 07 14:07:50.701127 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:07:50.701108    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a6a06d1fe0f202f23aaeb206543e543842b3d7227edbbb302d6972dc3c0019d\": container with ID starting with 1a6a06d1fe0f202f23aaeb206543e543842b3d7227edbbb302d6972dc3c0019d not found: ID does not exist" containerID="1a6a06d1fe0f202f23aaeb206543e543842b3d7227edbbb302d6972dc3c0019d"
Jul 07 14:07:50.701188 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:50.701135    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a6a06d1fe0f202f23aaeb206543e543842b3d7227edbbb302d6972dc3c0019d"} err="failed to get container status \"1a6a06d1fe0f202f23aaeb206543e543842b3d7227edbbb302d6972dc3c0019d\": rpc error: code = NotFound desc = could not find container \"1a6a06d1fe0f202f23aaeb206543e543842b3d7227edbbb302d6972dc3c0019d\": container with ID starting with 1a6a06d1fe0f202f23aaeb206543e543842b3d7227edbbb302d6972dc3c0019d not found: ID does not exist"
Jul 07 14:07:50.711429 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:50.711390    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-68cddfdddf-lvq8d" podStartSLOduration=2.286697233 podStartE2EDuration="2.711378559s" totalImagesPullingTime="424.681326ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:07:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:50.711039579 +0000 UTC m=+536.323318579" watchObservedRunningTime="2026-07-07 14:07:50.711378559 +0000 UTC m=+536.323657530"
Jul 07 14:07:50.729052 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:50.729000    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-f6f797c7-n9jlk" podStartSLOduration=1.6580292650000001 podStartE2EDuration="2.728984536s" totalImagesPullingTime="1.070955271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:07:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:50.727538913 +0000 UTC m=+536.339817885" watchObservedRunningTime="2026-07-07 14:07:50.728984536 +0000 UTC m=+536.341263507"
Jul 07 14:07:50.742559 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:50.742528    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-92mht"]
Jul 07 14:07:50.742729 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:50.742710    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-92mht" podUID="19ec21b0-562f-46d6-b91b-e018737f9e64" containerName="authorino" containerID="cri-o://b54eec93af4ce2058699f40b010768486101cb0de804b051a065c14c9c84d10a" gracePeriod=30
Jul 07 14:07:50.746400 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:50.746370    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r4wj8"]
Jul 07 14:07:50.753528 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:50.753501    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r4wj8"]
Jul 07 14:07:50.998714 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:50.998688    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f6f797c7-n9jlk"
Jul 07 14:07:51.022614 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:51.022585    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-92mht"
Jul 07 14:07:51.075388 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:51.075353    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a43d6eaa-1f75-44e0-a1c2-955f373ef471" path="/var/lib/kubelet/pods/a43d6eaa-1f75-44e0-a1c2-955f373ef471/volumes"
Jul 07 14:07:51.192551 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:51.192518    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjp5n\" (UniqueName: \"kubernetes.io/projected/19ec21b0-562f-46d6-b91b-e018737f9e64-kube-api-access-zjp5n\") pod \"19ec21b0-562f-46d6-b91b-e018737f9e64\" (UID: \"19ec21b0-562f-46d6-b91b-e018737f9e64\") "
Jul 07 14:07:51.192754 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:51.192572    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mggb\" (UniqueName: \"kubernetes.io/projected/996a38e8-fa52-40f0-9b25-2b57fffe0af0-kube-api-access-6mggb\") pod \"996a38e8-fa52-40f0-9b25-2b57fffe0af0\" (UID: \"996a38e8-fa52-40f0-9b25-2b57fffe0af0\") "
Jul 07 14:07:51.194703 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:51.194672    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19ec21b0-562f-46d6-b91b-e018737f9e64-kube-api-access-zjp5n" (OuterVolumeSpecName: "kube-api-access-zjp5n") pod "19ec21b0-562f-46d6-b91b-e018737f9e64" (UID: "19ec21b0-562f-46d6-b91b-e018737f9e64"). InnerVolumeSpecName "kube-api-access-zjp5n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:07:51.194703 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:51.194691    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/996a38e8-fa52-40f0-9b25-2b57fffe0af0-kube-api-access-6mggb" (OuterVolumeSpecName: "kube-api-access-6mggb") pod "996a38e8-fa52-40f0-9b25-2b57fffe0af0" (UID: "996a38e8-fa52-40f0-9b25-2b57fffe0af0"). InnerVolumeSpecName "kube-api-access-6mggb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:07:51.293508 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:51.293432    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjp5n\" (UniqueName: \"kubernetes.io/projected/19ec21b0-562f-46d6-b91b-e018737f9e64-kube-api-access-zjp5n\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:07:51.293508 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:51.293459    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mggb\" (UniqueName: \"kubernetes.io/projected/996a38e8-fa52-40f0-9b25-2b57fffe0af0-kube-api-access-6mggb\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:07:51.700745 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:51.700708    2576 generic.go:356] "Generic (PLEG): container finished" podID="19ec21b0-562f-46d6-b91b-e018737f9e64" containerID="b54eec93af4ce2058699f40b010768486101cb0de804b051a065c14c9c84d10a" exitCode=0
Jul 07 14:07:51.701270 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:51.700754    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-92mht"
Jul 07 14:07:51.701270 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:51.700796    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-92mht" event={"ID":"19ec21b0-562f-46d6-b91b-e018737f9e64","Type":"ContainerDied","Data":"b54eec93af4ce2058699f40b010768486101cb0de804b051a065c14c9c84d10a"}
Jul 07 14:07:51.701270 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:51.700848    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-92mht" event={"ID":"19ec21b0-562f-46d6-b91b-e018737f9e64","Type":"ContainerDied","Data":"72ef0507cd4bb7648c533ef0fb3fcfd28c1382a25f21973a7e530f242713792b"}
Jul 07 14:07:51.701270 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:51.700874    2576 scope.go:117] "RemoveContainer" containerID="b54eec93af4ce2058699f40b010768486101cb0de804b051a065c14c9c84d10a"
Jul 07 14:07:51.703119 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:51.703095    2576 generic.go:356] "Generic (PLEG): container finished" podID="996a38e8-fa52-40f0-9b25-2b57fffe0af0" containerID="dc7adb5333cb8a76b781a4c88bb09ea7482007e688ff94a40ce08927d921c338" exitCode=0
Jul 07 14:07:51.703237 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:51.703135    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f6f797c7-n9jlk"
Jul 07 14:07:51.703237 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:51.703142    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f6f797c7-n9jlk" event={"ID":"996a38e8-fa52-40f0-9b25-2b57fffe0af0","Type":"ContainerDied","Data":"dc7adb5333cb8a76b781a4c88bb09ea7482007e688ff94a40ce08927d921c338"}
Jul 07 14:07:51.703237 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:51.703183    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f6f797c7-n9jlk" event={"ID":"996a38e8-fa52-40f0-9b25-2b57fffe0af0","Type":"ContainerDied","Data":"5cc6be3b137415fdc0a4620045af4607a923c332ca6fcff86c73b1af0b606f57"}
Jul 07 14:07:51.710980 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:51.710925    2576 scope.go:117] "RemoveContainer" containerID="b54eec93af4ce2058699f40b010768486101cb0de804b051a065c14c9c84d10a"
Jul 07 14:07:51.711259 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:07:51.711239    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b54eec93af4ce2058699f40b010768486101cb0de804b051a065c14c9c84d10a\": container with ID starting with b54eec93af4ce2058699f40b010768486101cb0de804b051a065c14c9c84d10a not found: ID does not exist" containerID="b54eec93af4ce2058699f40b010768486101cb0de804b051a065c14c9c84d10a"
Jul 07 14:07:51.711313 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:51.711268    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b54eec93af4ce2058699f40b010768486101cb0de804b051a065c14c9c84d10a"} err="failed to get container status \"b54eec93af4ce2058699f40b010768486101cb0de804b051a065c14c9c84d10a\": rpc error: code = NotFound desc = could not find container \"b54eec93af4ce2058699f40b010768486101cb0de804b051a065c14c9c84d10a\": container with ID starting with b54eec93af4ce2058699f40b010768486101cb0de804b051a065c14c9c84d10a not found: ID does not exist"
Jul 07 14:07:51.711313 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:51.711284    2576 scope.go:117] "RemoveContainer" containerID="dc7adb5333cb8a76b781a4c88bb09ea7482007e688ff94a40ce08927d921c338"
Jul 07 14:07:51.719322 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:51.719306    2576 scope.go:117] "RemoveContainer" containerID="dc7adb5333cb8a76b781a4c88bb09ea7482007e688ff94a40ce08927d921c338"
Jul 07 14:07:51.719581 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:07:51.719563    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc7adb5333cb8a76b781a4c88bb09ea7482007e688ff94a40ce08927d921c338\": container with ID starting with dc7adb5333cb8a76b781a4c88bb09ea7482007e688ff94a40ce08927d921c338 not found: ID does not exist" containerID="dc7adb5333cb8a76b781a4c88bb09ea7482007e688ff94a40ce08927d921c338"
Jul 07 14:07:51.719637 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:51.719588    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc7adb5333cb8a76b781a4c88bb09ea7482007e688ff94a40ce08927d921c338"} err="failed to get container status \"dc7adb5333cb8a76b781a4c88bb09ea7482007e688ff94a40ce08927d921c338\": rpc error: code = NotFound desc = could not find container \"dc7adb5333cb8a76b781a4c88bb09ea7482007e688ff94a40ce08927d921c338\": container with ID starting with dc7adb5333cb8a76b781a4c88bb09ea7482007e688ff94a40ce08927d921c338 not found: ID does not exist"
Jul 07 14:07:51.723810 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:51.723785    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-92mht"]
Jul 07 14:07:51.727526 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:51.727508    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-92mht"]
Jul 07 14:07:51.737486 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:51.737467    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f6f797c7-n9jlk"]
Jul 07 14:07:51.743563 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:51.743541    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f6f797c7-n9jlk"]
Jul 07 14:07:53.075004 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:53.074971    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19ec21b0-562f-46d6-b91b-e018737f9e64" path="/var/lib/kubelet/pods/19ec21b0-562f-46d6-b91b-e018737f9e64/volumes"
Jul 07 14:07:53.075389 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:53.075305    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="996a38e8-fa52-40f0-9b25-2b57fffe0af0" path="/var/lib/kubelet/pods/996a38e8-fa52-40f0-9b25-2b57fffe0af0/volumes"
Jul 07 14:07:55.398448 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.398417    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:55.407544 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.407515    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6bf55ccc9d-vzczm"]
Jul 07 14:07:55.408039 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.408021    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19ec21b0-562f-46d6-b91b-e018737f9e64" containerName="authorino"
Jul 07 14:07:55.408039 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.408041    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="19ec21b0-562f-46d6-b91b-e018737f9e64" containerName="authorino"
Jul 07 14:07:55.408204 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.408053    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a43d6eaa-1f75-44e0-a1c2-955f373ef471" containerName="authorino"
Jul 07 14:07:55.408204 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.408062    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a43d6eaa-1f75-44e0-a1c2-955f373ef471" containerName="authorino"
Jul 07 14:07:55.408204 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.408080    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="996a38e8-fa52-40f0-9b25-2b57fffe0af0" containerName="authorino"
Jul 07 14:07:55.408204 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.408088    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="996a38e8-fa52-40f0-9b25-2b57fffe0af0" containerName="authorino"
Jul 07 14:07:55.408204 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.408198    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="19ec21b0-562f-46d6-b91b-e018737f9e64" containerName="authorino"
Jul 07 14:07:55.408377 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.408212    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a43d6eaa-1f75-44e0-a1c2-955f373ef471" containerName="authorino"
Jul 07 14:07:55.408377 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.408222    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="996a38e8-fa52-40f0-9b25-2b57fffe0af0" containerName="authorino"
Jul 07 14:07:55.413469 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.413450    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bf55ccc9d-vzczm"
Jul 07 14:07:55.417482 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.417462    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6gms6\""
Jul 07 14:07:55.417710 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.417695    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 14:07:55.417807 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.417759    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 14:07:55.422580 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.422559    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bdsq\" (UniqueName: \"kubernetes.io/projected/81858e66-0cb7-4888-a4e3-2506149b03a1-kube-api-access-7bdsq\") pod \"maas-controller-6bf55ccc9d-vzczm\" (UID: \"81858e66-0cb7-4888-a4e3-2506149b03a1\") " pod="opendatahub/maas-controller-6bf55ccc9d-vzczm"
Jul 07 14:07:55.422670 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.422605    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81858e66-0cb7-4888-a4e3-2506149b03a1-webhook-cert\") pod \"maas-controller-6bf55ccc9d-vzczm\" (UID: \"81858e66-0cb7-4888-a4e3-2506149b03a1\") " pod="opendatahub/maas-controller-6bf55ccc9d-vzczm"
Jul 07 14:07:55.429526 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.429508    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bf55ccc9d-vzczm"]
Jul 07 14:07:55.523743 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.523707    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bdsq\" (UniqueName: \"kubernetes.io/projected/81858e66-0cb7-4888-a4e3-2506149b03a1-kube-api-access-7bdsq\") pod \"maas-controller-6bf55ccc9d-vzczm\" (UID: \"81858e66-0cb7-4888-a4e3-2506149b03a1\") " pod="opendatahub/maas-controller-6bf55ccc9d-vzczm"
Jul 07 14:07:55.523971 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.523759    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81858e66-0cb7-4888-a4e3-2506149b03a1-webhook-cert\") pod \"maas-controller-6bf55ccc9d-vzczm\" (UID: \"81858e66-0cb7-4888-a4e3-2506149b03a1\") " pod="opendatahub/maas-controller-6bf55ccc9d-vzczm"
Jul 07 14:07:55.526275 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.526250    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81858e66-0cb7-4888-a4e3-2506149b03a1-webhook-cert\") pod \"maas-controller-6bf55ccc9d-vzczm\" (UID: \"81858e66-0cb7-4888-a4e3-2506149b03a1\") " pod="opendatahub/maas-controller-6bf55ccc9d-vzczm"
Jul 07 14:07:55.532239 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.532218    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bdsq\" (UniqueName: \"kubernetes.io/projected/81858e66-0cb7-4888-a4e3-2506149b03a1-kube-api-access-7bdsq\") pod \"maas-controller-6bf55ccc9d-vzczm\" (UID: \"81858e66-0cb7-4888-a4e3-2506149b03a1\") " pod="opendatahub/maas-controller-6bf55ccc9d-vzczm"
Jul 07 14:07:55.591462 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.591431    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-fbf7fb6dc-7jrjq"]
Jul 07 14:07:55.594860 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.594816    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fbf7fb6dc-7jrjq"
Jul 07 14:07:55.605297 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.605261    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-fbf7fb6dc-7jrjq"]
Jul 07 14:07:55.724069 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.724036    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bf55ccc9d-vzczm"
Jul 07 14:07:55.733741 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.733709    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4vlv\" (UniqueName: \"kubernetes.io/projected/c3ddbee5-0d6c-4028-89c7-7dda9ce946d5-kube-api-access-j4vlv\") pod \"maas-controller-fbf7fb6dc-7jrjq\" (UID: \"c3ddbee5-0d6c-4028-89c7-7dda9ce946d5\") " pod="opendatahub/maas-controller-fbf7fb6dc-7jrjq"
Jul 07 14:07:55.733875 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.733758    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c3ddbee5-0d6c-4028-89c7-7dda9ce946d5-webhook-cert\") pod \"maas-controller-fbf7fb6dc-7jrjq\" (UID: \"c3ddbee5-0d6c-4028-89c7-7dda9ce946d5\") " pod="opendatahub/maas-controller-fbf7fb6dc-7jrjq"
Jul 07 14:07:55.835201 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.835166    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4vlv\" (UniqueName: \"kubernetes.io/projected/c3ddbee5-0d6c-4028-89c7-7dda9ce946d5-kube-api-access-j4vlv\") pod \"maas-controller-fbf7fb6dc-7jrjq\" (UID: \"c3ddbee5-0d6c-4028-89c7-7dda9ce946d5\") " pod="opendatahub/maas-controller-fbf7fb6dc-7jrjq"
Jul 07 14:07:55.835384 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.835225    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c3ddbee5-0d6c-4028-89c7-7dda9ce946d5-webhook-cert\") pod \"maas-controller-fbf7fb6dc-7jrjq\" (UID: \"c3ddbee5-0d6c-4028-89c7-7dda9ce946d5\") " pod="opendatahub/maas-controller-fbf7fb6dc-7jrjq"
Jul 07 14:07:55.838357 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.838330    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c3ddbee5-0d6c-4028-89c7-7dda9ce946d5-webhook-cert\") pod \"maas-controller-fbf7fb6dc-7jrjq\" (UID: \"c3ddbee5-0d6c-4028-89c7-7dda9ce946d5\") " pod="opendatahub/maas-controller-fbf7fb6dc-7jrjq"
Jul 07 14:07:55.847323 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.847294    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4vlv\" (UniqueName: \"kubernetes.io/projected/c3ddbee5-0d6c-4028-89c7-7dda9ce946d5-kube-api-access-j4vlv\") pod \"maas-controller-fbf7fb6dc-7jrjq\" (UID: \"c3ddbee5-0d6c-4028-89c7-7dda9ce946d5\") " pod="opendatahub/maas-controller-fbf7fb6dc-7jrjq"
Jul 07 14:07:55.865081 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.865059    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bf55ccc9d-vzczm"]
Jul 07 14:07:55.867267 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:07:55.867241    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81858e66_0cb7_4888_a4e3_2506149b03a1.slice/crio-9748aa8326cb078bce6cc691494479b9af95bc8f6aa3d31beaf1d43588a81740 WatchSource:0}: Error finding container 9748aa8326cb078bce6cc691494479b9af95bc8f6aa3d31beaf1d43588a81740: Status 404 returned error can't find the container with id 9748aa8326cb078bce6cc691494479b9af95bc8f6aa3d31beaf1d43588a81740
Jul 07 14:07:55.873848 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.873821    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:55.906372 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.906346    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fbf7fb6dc-7jrjq"
Jul 07 14:07:55.941974 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:55.941915    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:56.042565 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:56.042541    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-fbf7fb6dc-7jrjq"]
Jul 07 14:07:56.044646 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:07:56.044620    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3ddbee5_0d6c_4028_89c7_7dda9ce946d5.slice/crio-87df7fd5e458c0c617072f14f567ffef011503a5c4474030ee75ab7530303361 WatchSource:0}: Error finding container 87df7fd5e458c0c617072f14f567ffef011503a5c4474030ee75ab7530303361: Status 404 returned error can't find the container with id 87df7fd5e458c0c617072f14f567ffef011503a5c4474030ee75ab7530303361
Jul 07 14:07:56.738488 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:56.738389    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fbf7fb6dc-7jrjq" event={"ID":"c3ddbee5-0d6c-4028-89c7-7dda9ce946d5","Type":"ContainerStarted","Data":"87df7fd5e458c0c617072f14f567ffef011503a5c4474030ee75ab7530303361"}
Jul 07 14:07:56.740923 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:56.740883    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bf55ccc9d-vzczm" event={"ID":"81858e66-0cb7-4888-a4e3-2506149b03a1","Type":"ContainerStarted","Data":"9748aa8326cb078bce6cc691494479b9af95bc8f6aa3d31beaf1d43588a81740"}
Jul 07 14:07:58.755543 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:58.755494    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fbf7fb6dc-7jrjq" event={"ID":"c3ddbee5-0d6c-4028-89c7-7dda9ce946d5","Type":"ContainerStarted","Data":"50c70ca3dc3e715aa06392c460a2ee6ed2d96e96d4fa4d1f9bbafdf103fce272"}
Jul 07 14:07:58.755981 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:58.755590    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-fbf7fb6dc-7jrjq"
Jul 07 14:07:58.757035 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:58.757010    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bf55ccc9d-vzczm" event={"ID":"81858e66-0cb7-4888-a4e3-2506149b03a1","Type":"ContainerStarted","Data":"2188e26dfbcf5a0437ca2e5dd4bf35b598339782a0fb9402fa3fa15d525eeb7e"}
Jul 07 14:07:58.757263 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:58.757242    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6bf55ccc9d-vzczm"
Jul 07 14:07:58.780529 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:58.780472    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-fbf7fb6dc-7jrjq" podStartSLOduration=1.197108051 podStartE2EDuration="3.780454756s" totalImagesPullingTime="2.583346705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:07:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:58.778963998 +0000 UTC m=+544.391242992" watchObservedRunningTime="2026-07-07 14:07:58.780454756 +0000 UTC m=+544.392733729"
Jul 07 14:07:58.812101 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:58.812045    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6bf55ccc9d-vzczm" podStartSLOduration=1.040002896 podStartE2EDuration="3.812025356s" totalImagesPullingTime="2.77202246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:07:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:07:58.810812198 +0000 UTC m=+544.423091183" watchObservedRunningTime="2026-07-07 14:07:58.812025356 +0000 UTC m=+544.424304329"
Jul 07 14:07:58.864158 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:58.864120    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:07:58.960188 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:07:58.960141    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:08:09.767531 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:09.767494    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6bf55ccc9d-vzczm"
Jul 07 14:08:09.768006 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:09.767581    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-fbf7fb6dc-7jrjq"
Jul 07 14:08:09.831861 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:09.831827    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bf55ccc9d-vzczm"]
Jul 07 14:08:09.832153 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:09.832099    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6bf55ccc9d-vzczm" podUID="81858e66-0cb7-4888-a4e3-2506149b03a1" containerName="manager" containerID="cri-o://2188e26dfbcf5a0437ca2e5dd4bf35b598339782a0fb9402fa3fa15d525eeb7e" gracePeriod=30
Jul 07 14:08:10.084453 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:10.084430    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bf55ccc9d-vzczm"
Jul 07 14:08:10.158515 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:10.158485    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bdsq\" (UniqueName: \"kubernetes.io/projected/81858e66-0cb7-4888-a4e3-2506149b03a1-kube-api-access-7bdsq\") pod \"81858e66-0cb7-4888-a4e3-2506149b03a1\" (UID: \"81858e66-0cb7-4888-a4e3-2506149b03a1\") "
Jul 07 14:08:10.158692 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:10.158675    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81858e66-0cb7-4888-a4e3-2506149b03a1-webhook-cert\") pod \"81858e66-0cb7-4888-a4e3-2506149b03a1\" (UID: \"81858e66-0cb7-4888-a4e3-2506149b03a1\") "
Jul 07 14:08:10.160648 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:10.160620    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81858e66-0cb7-4888-a4e3-2506149b03a1-kube-api-access-7bdsq" (OuterVolumeSpecName: "kube-api-access-7bdsq") pod "81858e66-0cb7-4888-a4e3-2506149b03a1" (UID: "81858e66-0cb7-4888-a4e3-2506149b03a1"). InnerVolumeSpecName "kube-api-access-7bdsq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:08:10.160760 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:10.160648    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81858e66-0cb7-4888-a4e3-2506149b03a1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "81858e66-0cb7-4888-a4e3-2506149b03a1" (UID: "81858e66-0cb7-4888-a4e3-2506149b03a1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:08:10.259960 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:10.259906    2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81858e66-0cb7-4888-a4e3-2506149b03a1-webhook-cert\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:08:10.259960 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:10.259948    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bdsq\" (UniqueName: \"kubernetes.io/projected/81858e66-0cb7-4888-a4e3-2506149b03a1-kube-api-access-7bdsq\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:08:10.815488 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:10.815454    2576 generic.go:356] "Generic (PLEG): container finished" podID="81858e66-0cb7-4888-a4e3-2506149b03a1" containerID="2188e26dfbcf5a0437ca2e5dd4bf35b598339782a0fb9402fa3fa15d525eeb7e" exitCode=0
Jul 07 14:08:10.815901 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:10.815498    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bf55ccc9d-vzczm"
Jul 07 14:08:10.815901 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:10.815542    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bf55ccc9d-vzczm" event={"ID":"81858e66-0cb7-4888-a4e3-2506149b03a1","Type":"ContainerDied","Data":"2188e26dfbcf5a0437ca2e5dd4bf35b598339782a0fb9402fa3fa15d525eeb7e"}
Jul 07 14:08:10.815901 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:10.815592    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bf55ccc9d-vzczm" event={"ID":"81858e66-0cb7-4888-a4e3-2506149b03a1","Type":"ContainerDied","Data":"9748aa8326cb078bce6cc691494479b9af95bc8f6aa3d31beaf1d43588a81740"}
Jul 07 14:08:10.815901 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:10.815613    2576 scope.go:117] "RemoveContainer" containerID="2188e26dfbcf5a0437ca2e5dd4bf35b598339782a0fb9402fa3fa15d525eeb7e"
Jul 07 14:08:10.825039 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:10.825019    2576 scope.go:117] "RemoveContainer" containerID="2188e26dfbcf5a0437ca2e5dd4bf35b598339782a0fb9402fa3fa15d525eeb7e"
Jul 07 14:08:10.825302 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:08:10.825271    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2188e26dfbcf5a0437ca2e5dd4bf35b598339782a0fb9402fa3fa15d525eeb7e\": container with ID starting with 2188e26dfbcf5a0437ca2e5dd4bf35b598339782a0fb9402fa3fa15d525eeb7e not found: ID does not exist" containerID="2188e26dfbcf5a0437ca2e5dd4bf35b598339782a0fb9402fa3fa15d525eeb7e"
Jul 07 14:08:10.825370 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:10.825315    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2188e26dfbcf5a0437ca2e5dd4bf35b598339782a0fb9402fa3fa15d525eeb7e"} err="failed to get container status \"2188e26dfbcf5a0437ca2e5dd4bf35b598339782a0fb9402fa3fa15d525eeb7e\": rpc error: code = NotFound desc = could not find container \"2188e26dfbcf5a0437ca2e5dd4bf35b598339782a0fb9402fa3fa15d525eeb7e\": container with ID starting with 2188e26dfbcf5a0437ca2e5dd4bf35b598339782a0fb9402fa3fa15d525eeb7e not found: ID does not exist"
Jul 07 14:08:10.840397 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:10.840371    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bf55ccc9d-vzczm"]
Jul 07 14:08:10.844453 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:10.844431    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6bf55ccc9d-vzczm"]
Jul 07 14:08:11.074672 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:11.074582    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81858e66-0cb7-4888-a4e3-2506149b03a1" path="/var/lib/kubelet/pods/81858e66-0cb7-4888-a4e3-2506149b03a1/volumes"
Jul 07 14:08:31.133430 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:31.133397    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:08:31.538770 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:31.538726    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:08:31.597234 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:31.597202    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-765bbcc486-6b2pd"]
Jul 07 14:08:31.597592 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:31.597578    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81858e66-0cb7-4888-a4e3-2506149b03a1" containerName="manager"
Jul 07 14:08:31.597636 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:31.597593    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="81858e66-0cb7-4888-a4e3-2506149b03a1" containerName="manager"
Jul 07 14:08:31.597679 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:31.597668    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="81858e66-0cb7-4888-a4e3-2506149b03a1" containerName="manager"
Jul 07 14:08:31.602718 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:31.602702    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-765bbcc486-6b2pd"
Jul 07 14:08:31.606577 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:31.606558    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 07 14:08:31.606975 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:31.606954    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-h8tk9\""
Jul 07 14:08:31.616509 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:31.616488    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-765bbcc486-6b2pd"]
Jul 07 14:08:31.753466 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:31.753432    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pg8q\" (UniqueName: \"kubernetes.io/projected/638eda70-51b4-4a9d-99e7-968ffe9bff09-kube-api-access-9pg8q\") pod \"maas-api-765bbcc486-6b2pd\" (UID: \"638eda70-51b4-4a9d-99e7-968ffe9bff09\") " pod="opendatahub/maas-api-765bbcc486-6b2pd"
Jul 07 14:08:31.753655 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:31.753484    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/638eda70-51b4-4a9d-99e7-968ffe9bff09-openshift-service-ca\") pod \"maas-api-765bbcc486-6b2pd\" (UID: \"638eda70-51b4-4a9d-99e7-968ffe9bff09\") " pod="opendatahub/maas-api-765bbcc486-6b2pd"
Jul 07 14:08:31.753655 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:31.753509    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/638eda70-51b4-4a9d-99e7-968ffe9bff09-maas-api-tls\") pod \"maas-api-765bbcc486-6b2pd\" (UID: \"638eda70-51b4-4a9d-99e7-968ffe9bff09\") " pod="opendatahub/maas-api-765bbcc486-6b2pd"
Jul 07 14:08:31.854604 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:31.854524    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pg8q\" (UniqueName: \"kubernetes.io/projected/638eda70-51b4-4a9d-99e7-968ffe9bff09-kube-api-access-9pg8q\") pod \"maas-api-765bbcc486-6b2pd\" (UID: \"638eda70-51b4-4a9d-99e7-968ffe9bff09\") " pod="opendatahub/maas-api-765bbcc486-6b2pd"
Jul 07 14:08:31.854604 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:31.854572    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/638eda70-51b4-4a9d-99e7-968ffe9bff09-openshift-service-ca\") pod \"maas-api-765bbcc486-6b2pd\" (UID: \"638eda70-51b4-4a9d-99e7-968ffe9bff09\") " pod="opendatahub/maas-api-765bbcc486-6b2pd"
Jul 07 14:08:31.854604 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:31.854595    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/638eda70-51b4-4a9d-99e7-968ffe9bff09-maas-api-tls\") pod \"maas-api-765bbcc486-6b2pd\" (UID: \"638eda70-51b4-4a9d-99e7-968ffe9bff09\") " pod="opendatahub/maas-api-765bbcc486-6b2pd"
Jul 07 14:08:31.854883 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:08:31.854708    2576 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 07 14:08:31.854883 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:08:31.854765    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/638eda70-51b4-4a9d-99e7-968ffe9bff09-maas-api-tls podName:638eda70-51b4-4a9d-99e7-968ffe9bff09 nodeName:}" failed. No retries permitted until 2026-07-07 14:08:32.354746842 +0000 UTC m=+577.967025809 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/638eda70-51b4-4a9d-99e7-968ffe9bff09-maas-api-tls") pod "maas-api-765bbcc486-6b2pd" (UID: "638eda70-51b4-4a9d-99e7-968ffe9bff09") : secret "maas-api-serving-cert" not found
Jul 07 14:08:31.855306 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:31.855285    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/638eda70-51b4-4a9d-99e7-968ffe9bff09-openshift-service-ca\") pod \"maas-api-765bbcc486-6b2pd\" (UID: \"638eda70-51b4-4a9d-99e7-968ffe9bff09\") " pod="opendatahub/maas-api-765bbcc486-6b2pd"
Jul 07 14:08:31.864321 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:31.864294    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pg8q\" (UniqueName: \"kubernetes.io/projected/638eda70-51b4-4a9d-99e7-968ffe9bff09-kube-api-access-9pg8q\") pod \"maas-api-765bbcc486-6b2pd\" (UID: \"638eda70-51b4-4a9d-99e7-968ffe9bff09\") " pod="opendatahub/maas-api-765bbcc486-6b2pd"
Jul 07 14:08:32.050110 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:32.050071    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:08:32.104043 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:32.104008    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-pkr25"]
Jul 07 14:08:32.106857 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:32.106816    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-pkr25"
Jul 07 14:08:32.109980 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:32.109957    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-4f9pz\""
Jul 07 14:08:32.110290 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:32.110272    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 07 14:08:32.121189 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:32.121156    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-pkr25"]
Jul 07 14:08:32.123362 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:32.123335    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-2mv7v"]
Jul 07 14:08:32.126256 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:32.126237    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-2mv7v"
Jul 07 14:08:32.143157 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:32.143130    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-2mv7v"]
Jul 07 14:08:32.163599 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:32.163556    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:08:32.259062 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:32.259025    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzp9f\" (UniqueName: \"kubernetes.io/projected/54a8ada3-11f8-4bfc-af03-aaa3fd075f31-kube-api-access-tzp9f\") pod \"payload-pre-processing-7964457696-pkr25\" (UID: \"54a8ada3-11f8-4bfc-af03-aaa3fd075f31\") " pod="openshift-ingress/payload-pre-processing-7964457696-pkr25"
Jul 07 14:08:32.259232 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:32.259073    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54a8ada3-11f8-4bfc-af03-aaa3fd075f31-plugins-config-volume\") pod \"payload-pre-processing-7964457696-pkr25\" (UID: \"54a8ada3-11f8-4bfc-af03-aaa3fd075f31\") " pod="openshift-ingress/payload-pre-processing-7964457696-pkr25"
Jul 07 14:08:32.259232 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:32.259162    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqhq5\" (UniqueName: \"kubernetes.io/projected/79f3fbe1-c5e0-44ca-9c45-af881220eedc-kube-api-access-sqhq5\") pod \"payload-processing-58f86c7798-2mv7v\" (UID: \"79f3fbe1-c5e0-44ca-9c45-af881220eedc\") " pod="openshift-ingress/payload-processing-58f86c7798-2mv7v"
Jul 07 14:08:32.259316 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:32.259260    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79f3fbe1-c5e0-44ca-9c45-af881220eedc-plugins-config-volume\") pod \"payload-processing-58f86c7798-2mv7v\" (UID: \"79f3fbe1-c5e0-44ca-9c45-af881220eedc\") " pod="openshift-ingress/payload-processing-58f86c7798-2mv7v"
Jul 07 14:08:32.266494 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:32.266465    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:08:32.360494 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:32.360369    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79f3fbe1-c5e0-44ca-9c45-af881220eedc-plugins-config-volume\") pod \"payload-processing-58f86c7798-2mv7v\" (UID: \"79f3fbe1-c5e0-44ca-9c45-af881220eedc\") " pod="openshift-ingress/payload-processing-58f86c7798-2mv7v"
Jul 07 14:08:32.360494 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:32.360428    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/638eda70-51b4-4a9d-99e7-968ffe9bff09-maas-api-tls\") pod \"maas-api-765bbcc486-6b2pd\" (UID: \"638eda70-51b4-4a9d-99e7-968ffe9bff09\") " pod="opendatahub/maas-api-765bbcc486-6b2pd"
Jul 07 14:08:32.360494 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:32.360461    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzp9f\" (UniqueName: \"kubernetes.io/projected/54a8ada3-11f8-4bfc-af03-aaa3fd075f31-kube-api-access-tzp9f\") pod \"payload-pre-processing-7964457696-pkr25\" (UID: \"54a8ada3-11f8-4bfc-af03-aaa3fd075f31\") " pod="openshift-ingress/payload-pre-processing-7964457696-pkr25"
Jul 07 14:08:32.360494 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:32.360485    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54a8ada3-11f8-4bfc-af03-aaa3fd075f31-plugins-config-volume\") pod \"payload-pre-processing-7964457696-pkr25\" (UID: \"54a8ada3-11f8-4bfc-af03-aaa3fd075f31\") " pod="openshift-ingress/payload-pre-processing-7964457696-pkr25"
Jul 07 14:08:32.360848 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:32.360521    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqhq5\" (UniqueName: \"kubernetes.io/projected/79f3fbe1-c5e0-44ca-9c45-af881220eedc-kube-api-access-sqhq5\") pod \"payload-processing-58f86c7798-2mv7v\" (UID: \"79f3fbe1-c5e0-44ca-9c45-af881220eedc\") " pod="openshift-ingress/payload-processing-58f86c7798-2mv7v"
Jul 07 14:08:32.361391 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:32.361356    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/79f3fbe1-c5e0-44ca-9c45-af881220eedc-plugins-config-volume\") pod \"payload-processing-58f86c7798-2mv7v\" (UID: \"79f3fbe1-c5e0-44ca-9c45-af881220eedc\") " pod="openshift-ingress/payload-processing-58f86c7798-2mv7v"
Jul 07 14:08:32.361642 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:32.361623    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54a8ada3-11f8-4bfc-af03-aaa3fd075f31-plugins-config-volume\") pod \"payload-pre-processing-7964457696-pkr25\" (UID: \"54a8ada3-11f8-4bfc-af03-aaa3fd075f31\") " pod="openshift-ingress/payload-pre-processing-7964457696-pkr25"
Jul 07 14:08:32.363629 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:32.363610    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/638eda70-51b4-4a9d-99e7-968ffe9bff09-maas-api-tls\") pod \"maas-api-765bbcc486-6b2pd\" (UID: \"638eda70-51b4-4a9d-99e7-968ffe9bff09\") " pod="opendatahub/maas-api-765bbcc486-6b2pd"
Jul 07 14:08:32.369362 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:32.369340    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqhq5\" (UniqueName: \"kubernetes.io/projected/79f3fbe1-c5e0-44ca-9c45-af881220eedc-kube-api-access-sqhq5\") pod \"payload-processing-58f86c7798-2mv7v\" (UID: \"79f3fbe1-c5e0-44ca-9c45-af881220eedc\") " pod="openshift-ingress/payload-processing-58f86c7798-2mv7v"
Jul 07 14:08:32.369471 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:32.369452    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzp9f\" (UniqueName: \"kubernetes.io/projected/54a8ada3-11f8-4bfc-af03-aaa3fd075f31-kube-api-access-tzp9f\") pod \"payload-pre-processing-7964457696-pkr25\" (UID: \"54a8ada3-11f8-4bfc-af03-aaa3fd075f31\") " pod="openshift-ingress/payload-pre-processing-7964457696-pkr25"
Jul 07 14:08:32.420785 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:32.420755    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-pkr25"
Jul 07 14:08:32.437313 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:32.437020    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-2mv7v"
Jul 07 14:08:32.513653 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:32.513418    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-765bbcc486-6b2pd"
Jul 07 14:08:32.587275 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:32.587173    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-pkr25"]
Jul 07 14:08:32.621828 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:32.621562    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-2mv7v"]
Jul 07 14:08:32.623871 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:08:32.623847    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79f3fbe1_c5e0_44ca_9c45_af881220eedc.slice/crio-6bfd68159aa4383094c9a4db8144eefe2f5786cbc003c94c2accdec127a51c0e WatchSource:0}: Error finding container 6bfd68159aa4383094c9a4db8144eefe2f5786cbc003c94c2accdec127a51c0e: Status 404 returned error can't find the container with id 6bfd68159aa4383094c9a4db8144eefe2f5786cbc003c94c2accdec127a51c0e
Jul 07 14:08:32.676726 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:32.676702    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-765bbcc486-6b2pd"]
Jul 07 14:08:32.678285 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:08:32.678251    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod638eda70_51b4_4a9d_99e7_968ffe9bff09.slice/crio-209ce47ab9ae7f8b606a32b64ee2ea98b8f6ee353a966ee39a9eae7f9049aa3b WatchSource:0}: Error finding container 209ce47ab9ae7f8b606a32b64ee2ea98b8f6ee353a966ee39a9eae7f9049aa3b: Status 404 returned error can't find the container with id 209ce47ab9ae7f8b606a32b64ee2ea98b8f6ee353a966ee39a9eae7f9049aa3b
Jul 07 14:08:32.924897 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:32.924800    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-765bbcc486-6b2pd" event={"ID":"638eda70-51b4-4a9d-99e7-968ffe9bff09","Type":"ContainerStarted","Data":"209ce47ab9ae7f8b606a32b64ee2ea98b8f6ee353a966ee39a9eae7f9049aa3b"}
Jul 07 14:08:32.930737 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:32.930655    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-pkr25" event={"ID":"54a8ada3-11f8-4bfc-af03-aaa3fd075f31","Type":"ContainerStarted","Data":"65af062cb5c0e3cf123c958863131401dd6f6005358eca588a002296aa39fed8"}
Jul 07 14:08:32.932590 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:32.932470    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-2mv7v" event={"ID":"79f3fbe1-c5e0-44ca-9c45-af881220eedc","Type":"ContainerStarted","Data":"6bfd68159aa4383094c9a4db8144eefe2f5786cbc003c94c2accdec127a51c0e"}
Jul 07 14:08:35.972912 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:35.972872    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-765bbcc486-6b2pd" event={"ID":"638eda70-51b4-4a9d-99e7-968ffe9bff09","Type":"ContainerStarted","Data":"924bc3947f54430ccc2e49a780cd67dac53274c2e1e36421d80188ceb1972837"}
Jul 07 14:08:35.973380 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:35.972934    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-765bbcc486-6b2pd"
Jul 07 14:08:35.974414 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:35.974393    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-pkr25" event={"ID":"54a8ada3-11f8-4bfc-af03-aaa3fd075f31","Type":"ContainerStarted","Data":"9e82573059c51b8ed201334a9c912774dc14007b68e4d6a277c0c927e4e81741"}
Jul 07 14:08:35.974503 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:35.974450    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-pkr25"
Jul 07 14:08:35.975731 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:35.975707    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-2mv7v" event={"ID":"79f3fbe1-c5e0-44ca-9c45-af881220eedc","Type":"ContainerStarted","Data":"259891c4f381fb94d5bea22fef8508e65136e8e1c447b44ceb7947050a00f64f"}
Jul 07 14:08:35.975846 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:35.975832    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-2mv7v"
Jul 07 14:08:35.991683 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:35.991642    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-765bbcc486-6b2pd" podStartSLOduration=2.548710777 podStartE2EDuration="4.991630786s" totalImagesPullingTime="2.442920009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:08:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:08:35.990698045 +0000 UTC m=+581.602977017" watchObservedRunningTime="2026-07-07 14:08:35.991630786 +0000 UTC m=+581.603909796"
Jul 07 14:08:36.007312 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:36.007268    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-pkr25" podStartSLOduration=1.5404033780000002 podStartE2EDuration="4.007252255s" totalImagesPullingTime="2.466848877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:08:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:08:36.006616707 +0000 UTC m=+581.618895693" watchObservedRunningTime="2026-07-07 14:08:36.007252255 +0000 UTC m=+581.619531227"
Jul 07 14:08:36.023679 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:36.023634    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-2mv7v" podStartSLOduration=1.586104808 podStartE2EDuration="4.023620654s" totalImagesPullingTime="2.437515846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:08:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:08:36.021770258 +0000 UTC m=+581.634049250" watchObservedRunningTime="2026-07-07 14:08:36.023620654 +0000 UTC m=+581.635899625"
Jul 07 14:08:39.996337 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:39.996303    2576 generic.go:356] "Generic (PLEG): container finished" podID="f6cdffb1-f341-4a0a-9898-aff39af84ac7" containerID="f89d8dfd1c09df5a762efa48866fdb8d1a622b2f16c088475de21e07d6915015" exitCode=0
Jul 07 14:08:39.996749 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:39.996375    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj" event={"ID":"f6cdffb1-f341-4a0a-9898-aff39af84ac7","Type":"ContainerDied","Data":"f89d8dfd1c09df5a762efa48866fdb8d1a622b2f16c088475de21e07d6915015"}
Jul 07 14:08:39.996791 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:39.996751    2576 scope.go:117] "RemoveContainer" containerID="f89d8dfd1c09df5a762efa48866fdb8d1a622b2f16c088475de21e07d6915015"
Jul 07 14:08:39.997797 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:39.997771    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 14:08:39.997863 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:39.997837    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 14:08:39.997902 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:39.997867    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 14:08:40.749645 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:40.749570    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:08:41.002953 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:41.002861    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj" event={"ID":"f6cdffb1-f341-4a0a-9898-aff39af84ac7","Type":"ContainerStarted","Data":"b020edeb747ddf1e0bfb48e789dc48b5b6f517f3768a31ffbc0f1d41dc0a389b"}
Jul 07 14:08:41.199782 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:41.199744    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:08:41.200977 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:41.200953    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-b7gsj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 07 14:08:41.201039 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:41.201021    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj" podUID="f6cdffb1-f341-4a0a-9898-aff39af84ac7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 07 14:08:41.986088 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:41.986062    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-765bbcc486-6b2pd"
Jul 07 14:08:42.200724 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:42.200688    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-b7gsj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 07 14:08:42.201128 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:42.200746    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj" podUID="f6cdffb1-f341-4a0a-9898-aff39af84ac7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 07 14:08:42.979154 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:42.979120    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:08:43.078771 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:43.078731    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:08:43.201006 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:43.200973    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-b7gsj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 07 14:08:43.201396 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:43.201050    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj" podUID="f6cdffb1-f341-4a0a-9898-aff39af84ac7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 07 14:08:43.459868 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:43.459817    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:08:44.200832 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:44.200796    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-b7gsj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 07 14:08:44.201049 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:44.200850    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj" podUID="f6cdffb1-f341-4a0a-9898-aff39af84ac7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 07 14:08:45.203981 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:45.203949    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:08:45.204791 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:45.204771    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-b7gsj"
Jul 07 14:08:46.982773 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:46.982745    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-2mv7v"
Jul 07 14:08:46.983294 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:46.982825    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-pkr25"
Jul 07 14:08:54.662191 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:54.662151    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:08:54.727717 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:54.727684    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:08:54.881304 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:54.881281    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bglbr_d36dada3-7ddc-4de9-a1d5-62ff1f867dd9/console-operator/1.log"
Jul 07 14:08:54.886028 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:54.886001    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zdfvw_9bcfc7b3-a523-42e2-add9-c7f0f1e187ce/ovn-acl-logging/0.log"
Jul 07 14:08:54.892960 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:54.887072    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bglbr_d36dada3-7ddc-4de9-a1d5-62ff1f867dd9/console-operator/1.log"
Jul 07 14:08:54.896900 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:08:54.896881    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zdfvw_9bcfc7b3-a523-42e2-add9-c7f0f1e187ce/ovn-acl-logging/0.log"
Jul 07 14:09:04.800365 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:04.800329    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7"]
Jul 07 14:09:04.805519 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:04.805501    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7"
Jul 07 14:09:04.808556 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:04.808531    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 14:09:04.808704 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:04.808691    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 07 14:09:04.809653 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:04.809635    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fx6bc\""
Jul 07 14:09:04.809763 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:04.809712    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 14:09:04.814347 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:04.814321    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7"]
Jul 07 14:09:04.835399 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:04.835372    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:09:04.854147 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:04.854115    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d4fce53-3129-4d36-a2a9-d942a3dba631-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7\" (UID: \"6d4fce53-3129-4d36-a2a9-d942a3dba631\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7"
Jul 07 14:09:04.854312 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:04.854158    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvlmn\" (UniqueName: \"kubernetes.io/projected/6d4fce53-3129-4d36-a2a9-d942a3dba631-kube-api-access-kvlmn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7\" (UID: \"6d4fce53-3129-4d36-a2a9-d942a3dba631\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7"
Jul 07 14:09:04.854312 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:04.854214    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d4fce53-3129-4d36-a2a9-d942a3dba631-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7\" (UID: \"6d4fce53-3129-4d36-a2a9-d942a3dba631\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7"
Jul 07 14:09:04.854312 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:04.854238    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d4fce53-3129-4d36-a2a9-d942a3dba631-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7\" (UID: \"6d4fce53-3129-4d36-a2a9-d942a3dba631\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7"
Jul 07 14:09:04.854312 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:04.854308    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d4fce53-3129-4d36-a2a9-d942a3dba631-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7\" (UID: \"6d4fce53-3129-4d36-a2a9-d942a3dba631\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7"
Jul 07 14:09:04.854530 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:04.854342    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d4fce53-3129-4d36-a2a9-d942a3dba631-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7\" (UID: \"6d4fce53-3129-4d36-a2a9-d942a3dba631\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7"
Jul 07 14:09:04.955224 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:04.955188    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d4fce53-3129-4d36-a2a9-d942a3dba631-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7\" (UID: \"6d4fce53-3129-4d36-a2a9-d942a3dba631\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7"
Jul 07 14:09:04.955224 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:04.955226    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d4fce53-3129-4d36-a2a9-d942a3dba631-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7\" (UID: \"6d4fce53-3129-4d36-a2a9-d942a3dba631\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7"
Jul 07 14:09:04.955464 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:04.955278    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d4fce53-3129-4d36-a2a9-d942a3dba631-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7\" (UID: \"6d4fce53-3129-4d36-a2a9-d942a3dba631\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7"
Jul 07 14:09:04.955464 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:04.955299    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvlmn\" (UniqueName: \"kubernetes.io/projected/6d4fce53-3129-4d36-a2a9-d942a3dba631-kube-api-access-kvlmn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7\" (UID: \"6d4fce53-3129-4d36-a2a9-d942a3dba631\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7"
Jul 07 14:09:04.955464 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:04.955338    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d4fce53-3129-4d36-a2a9-d942a3dba631-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7\" (UID: \"6d4fce53-3129-4d36-a2a9-d942a3dba631\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7"
Jul 07 14:09:04.955464 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:04.955353    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d4fce53-3129-4d36-a2a9-d942a3dba631-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7\" (UID: \"6d4fce53-3129-4d36-a2a9-d942a3dba631\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7"
Jul 07 14:09:04.955696 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:04.955673    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d4fce53-3129-4d36-a2a9-d942a3dba631-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7\" (UID: \"6d4fce53-3129-4d36-a2a9-d942a3dba631\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7"
Jul 07 14:09:04.955786 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:04.955708    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d4fce53-3129-4d36-a2a9-d942a3dba631-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7\" (UID: \"6d4fce53-3129-4d36-a2a9-d942a3dba631\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7"
Jul 07 14:09:04.955786 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:04.955749    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d4fce53-3129-4d36-a2a9-d942a3dba631-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7\" (UID: \"6d4fce53-3129-4d36-a2a9-d942a3dba631\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7"
Jul 07 14:09:04.957778 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:04.957748    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d4fce53-3129-4d36-a2a9-d942a3dba631-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7\" (UID: \"6d4fce53-3129-4d36-a2a9-d942a3dba631\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7"
Jul 07 14:09:04.957905 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:04.957884    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d4fce53-3129-4d36-a2a9-d942a3dba631-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7\" (UID: \"6d4fce53-3129-4d36-a2a9-d942a3dba631\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7"
Jul 07 14:09:04.965330 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:04.965301    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvlmn\" (UniqueName: \"kubernetes.io/projected/6d4fce53-3129-4d36-a2a9-d942a3dba631-kube-api-access-kvlmn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7\" (UID: \"6d4fce53-3129-4d36-a2a9-d942a3dba631\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7"
Jul 07 14:09:05.117055 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:05.116931    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7"
Jul 07 14:09:05.263128 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:05.263091    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7"]
Jul 07 14:09:05.266621 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:09:05.266592    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d4fce53_3129_4d36_a2a9_d942a3dba631.slice/crio-2c4738a535fcb65cf98c699e5314125ceb46bfa046298137df49bf324c1b77e6 WatchSource:0}: Error finding container 2c4738a535fcb65cf98c699e5314125ceb46bfa046298137df49bf324c1b77e6: Status 404 returned error can't find the container with id 2c4738a535fcb65cf98c699e5314125ceb46bfa046298137df49bf324c1b77e6
Jul 07 14:09:06.133525 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:06.133457    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7" event={"ID":"6d4fce53-3129-4d36-a2a9-d942a3dba631","Type":"ContainerStarted","Data":"2c4738a535fcb65cf98c699e5314125ceb46bfa046298137df49bf324c1b77e6"}
Jul 07 14:09:07.141392 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:07.141353    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7" event={"ID":"6d4fce53-3129-4d36-a2a9-d942a3dba631","Type":"ContainerStarted","Data":"0c815e7d2a74bf5825c9b0e437bd36bd39b078975dd226624baf45b9b5aefd7e"}
Jul 07 14:09:07.161533 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:07.161478    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7" podStartSLOduration=1.78555925 podStartE2EDuration="3.161462917s" totalImagesPullingTime="1.375903667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:09:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:09:07.159616221 +0000 UTC m=+612.771895193" watchObservedRunningTime="2026-07-07 14:09:07.161462917 +0000 UTC m=+612.773741889"
Jul 07 14:09:11.984902 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:11.984866    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:09:15.117086 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:15.117053    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7"
Jul 07 14:09:15.117573 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:15.117114    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7"
Jul 07 14:09:15.130622 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:15.130595    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7"
Jul 07 14:09:15.194045 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:15.194010    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7"
Jul 07 14:09:28.680865 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:28.680778    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:09:49.190114 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:49.190073    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:09:49.488461 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:49.488375    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:09:54.814292 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:54.814255    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9"]
Jul 07 14:09:54.817688 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:54.817668    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9"
Jul 07 14:09:54.820772 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:54.820750    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 07 14:09:54.831668 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:54.831641    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9"]
Jul 07 14:09:54.885627 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:54.885583    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:09:54.885627 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:54.885625    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acb5b927-f50e-4124-9b1d-b7d9603c0dcf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9\" (UID: \"acb5b927-f50e-4124-9b1d-b7d9603c0dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9"
Jul 07 14:09:54.885854 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:54.885657    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acb5b927-f50e-4124-9b1d-b7d9603c0dcf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9\" (UID: \"acb5b927-f50e-4124-9b1d-b7d9603c0dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9"
Jul 07 14:09:54.885854 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:54.885693    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czksk\" (UniqueName: \"kubernetes.io/projected/acb5b927-f50e-4124-9b1d-b7d9603c0dcf-kube-api-access-czksk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9\" (UID: \"acb5b927-f50e-4124-9b1d-b7d9603c0dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9"
Jul 07 14:09:54.885854 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:54.885759    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acb5b927-f50e-4124-9b1d-b7d9603c0dcf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9\" (UID: \"acb5b927-f50e-4124-9b1d-b7d9603c0dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9"
Jul 07 14:09:54.885854 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:54.885829    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acb5b927-f50e-4124-9b1d-b7d9603c0dcf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9\" (UID: \"acb5b927-f50e-4124-9b1d-b7d9603c0dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9"
Jul 07 14:09:54.886108 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:54.885894    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acb5b927-f50e-4124-9b1d-b7d9603c0dcf-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9\" (UID: \"acb5b927-f50e-4124-9b1d-b7d9603c0dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9"
Jul 07 14:09:54.987219 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:54.987183    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acb5b927-f50e-4124-9b1d-b7d9603c0dcf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9\" (UID: \"acb5b927-f50e-4124-9b1d-b7d9603c0dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9"
Jul 07 14:09:54.987430 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:54.987227    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acb5b927-f50e-4124-9b1d-b7d9603c0dcf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9\" (UID: \"acb5b927-f50e-4124-9b1d-b7d9603c0dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9"
Jul 07 14:09:54.987430 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:54.987264    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czksk\" (UniqueName: \"kubernetes.io/projected/acb5b927-f50e-4124-9b1d-b7d9603c0dcf-kube-api-access-czksk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9\" (UID: \"acb5b927-f50e-4124-9b1d-b7d9603c0dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9"
Jul 07 14:09:54.987430 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:54.987294    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acb5b927-f50e-4124-9b1d-b7d9603c0dcf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9\" (UID: \"acb5b927-f50e-4124-9b1d-b7d9603c0dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9"
Jul 07 14:09:54.987430 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:54.987345    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acb5b927-f50e-4124-9b1d-b7d9603c0dcf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9\" (UID: \"acb5b927-f50e-4124-9b1d-b7d9603c0dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9"
Jul 07 14:09:54.987430 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:54.987373    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acb5b927-f50e-4124-9b1d-b7d9603c0dcf-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9\" (UID: \"acb5b927-f50e-4124-9b1d-b7d9603c0dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9"
Jul 07 14:09:54.987762 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:54.987732    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acb5b927-f50e-4124-9b1d-b7d9603c0dcf-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9\" (UID: \"acb5b927-f50e-4124-9b1d-b7d9603c0dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9"
Jul 07 14:09:54.987815 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:54.987797    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acb5b927-f50e-4124-9b1d-b7d9603c0dcf-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9\" (UID: \"acb5b927-f50e-4124-9b1d-b7d9603c0dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9"
Jul 07 14:09:54.988090 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:54.988065    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acb5b927-f50e-4124-9b1d-b7d9603c0dcf-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9\" (UID: \"acb5b927-f50e-4124-9b1d-b7d9603c0dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9"
Jul 07 14:09:54.989710 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:54.989682    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acb5b927-f50e-4124-9b1d-b7d9603c0dcf-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9\" (UID: \"acb5b927-f50e-4124-9b1d-b7d9603c0dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9"
Jul 07 14:09:54.989980 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:54.989928    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acb5b927-f50e-4124-9b1d-b7d9603c0dcf-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9\" (UID: \"acb5b927-f50e-4124-9b1d-b7d9603c0dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9"
Jul 07 14:09:54.996200 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:54.996170    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czksk\" (UniqueName: \"kubernetes.io/projected/acb5b927-f50e-4124-9b1d-b7d9603c0dcf-kube-api-access-czksk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9\" (UID: \"acb5b927-f50e-4124-9b1d-b7d9603c0dcf\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9"
Jul 07 14:09:55.127859 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:55.127776    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9"
Jul 07 14:09:55.275004 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:55.274932    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9"]
Jul 07 14:09:55.277351 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:09:55.277325    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacb5b927_f50e_4124_9b1d_b7d9603c0dcf.slice/crio-135774c1bba0b5ae063372dc081b717304374a3c93f98b656558eb4609c55c03 WatchSource:0}: Error finding container 135774c1bba0b5ae063372dc081b717304374a3c93f98b656558eb4609c55c03: Status 404 returned error can't find the container with id 135774c1bba0b5ae063372dc081b717304374a3c93f98b656558eb4609c55c03
Jul 07 14:09:55.278725 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:55.278708    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 14:09:55.385052 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:55.384966    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9" event={"ID":"acb5b927-f50e-4124-9b1d-b7d9603c0dcf","Type":"ContainerStarted","Data":"135774c1bba0b5ae063372dc081b717304374a3c93f98b656558eb4609c55c03"}
Jul 07 14:09:56.392176 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:56.392135    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9" event={"ID":"acb5b927-f50e-4124-9b1d-b7d9603c0dcf","Type":"ContainerStarted","Data":"12de2e01a26d98de859abd4c5ac668322cd43e9a274a15d0bf2fab5066737084"}
Jul 07 14:09:56.417979 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:09:56.417907    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9" podStartSLOduration=2.147394733 podStartE2EDuration="2.417890427s" totalImagesPullingTime="270.495694ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:09:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:09:56.416889272 +0000 UTC m=+662.029168263" watchObservedRunningTime="2026-07-07 14:09:56.417890427 +0000 UTC m=+662.030169419"
Jul 07 14:10:00.643343 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:10:00.643309    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:10:04.615865 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:10:04.615828    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:10:05.127915 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:10:05.127887    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9"
Jul 07 14:10:05.128137 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:10:05.127991    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9"
Jul 07 14:10:05.142511 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:10:05.142475    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9"
Jul 07 14:10:05.453393 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:10:05.453360    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9"
Jul 07 14:10:19.917003 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:10:19.916894    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:10:22.542978 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:10:22.542928    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:10:22.704343 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:10:22.704309    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:10:24.240931 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:10:24.240892    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:11:29.137417 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:29.137380    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8db94bcf6-78qbg"]
Jul 07 14:11:29.141059 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:29.141030    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8db94bcf6-78qbg"
Jul 07 14:11:29.154749 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:29.154725    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8db94bcf6-78qbg"]
Jul 07 14:11:29.264007 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:29.263931    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn8l4\" (UniqueName: \"kubernetes.io/projected/44a0943e-5263-4fb7-8ad2-b4032311420d-kube-api-access-sn8l4\") pod \"authorino-8db94bcf6-78qbg\" (UID: \"44a0943e-5263-4fb7-8ad2-b4032311420d\") " pod="kuadrant-system/authorino-8db94bcf6-78qbg"
Jul 07 14:11:29.264208 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:29.264126    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/44a0943e-5263-4fb7-8ad2-b4032311420d-tls-cert\") pod \"authorino-8db94bcf6-78qbg\" (UID: \"44a0943e-5263-4fb7-8ad2-b4032311420d\") " pod="kuadrant-system/authorino-8db94bcf6-78qbg"
Jul 07 14:11:29.365323 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:29.365284    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/44a0943e-5263-4fb7-8ad2-b4032311420d-tls-cert\") pod \"authorino-8db94bcf6-78qbg\" (UID: \"44a0943e-5263-4fb7-8ad2-b4032311420d\") " pod="kuadrant-system/authorino-8db94bcf6-78qbg"
Jul 07 14:11:29.365498 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:29.365428    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn8l4\" (UniqueName: \"kubernetes.io/projected/44a0943e-5263-4fb7-8ad2-b4032311420d-kube-api-access-sn8l4\") pod \"authorino-8db94bcf6-78qbg\" (UID: \"44a0943e-5263-4fb7-8ad2-b4032311420d\") " pod="kuadrant-system/authorino-8db94bcf6-78qbg"
Jul 07 14:11:29.367752 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:29.367732    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/44a0943e-5263-4fb7-8ad2-b4032311420d-tls-cert\") pod \"authorino-8db94bcf6-78qbg\" (UID: \"44a0943e-5263-4fb7-8ad2-b4032311420d\") " pod="kuadrant-system/authorino-8db94bcf6-78qbg"
Jul 07 14:11:29.375007 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:29.374982    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn8l4\" (UniqueName: \"kubernetes.io/projected/44a0943e-5263-4fb7-8ad2-b4032311420d-kube-api-access-sn8l4\") pod \"authorino-8db94bcf6-78qbg\" (UID: \"44a0943e-5263-4fb7-8ad2-b4032311420d\") " pod="kuadrant-system/authorino-8db94bcf6-78qbg"
Jul 07 14:11:29.450701 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:29.450667    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8db94bcf6-78qbg"
Jul 07 14:11:29.599020 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:29.598960    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8db94bcf6-78qbg"]
Jul 07 14:11:29.601358 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:11:29.601333    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44a0943e_5263_4fb7_8ad2_b4032311420d.slice/crio-65bd3b42a0172f819317f77f2821037ad550f6bedbbf652795646588733b1b96 WatchSource:0}: Error finding container 65bd3b42a0172f819317f77f2821037ad550f6bedbbf652795646588733b1b96: Status 404 returned error can't find the container with id 65bd3b42a0172f819317f77f2821037ad550f6bedbbf652795646588733b1b96
Jul 07 14:11:29.628757 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:29.628713    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:11:29.726362 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:29.726263    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:11:29.891562 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:29.891525    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8db94bcf6-78qbg" event={"ID":"44a0943e-5263-4fb7-8ad2-b4032311420d","Type":"ContainerStarted","Data":"65bd3b42a0172f819317f77f2821037ad550f6bedbbf652795646588733b1b96"}
Jul 07 14:11:30.901556 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:30.901513    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8db94bcf6-78qbg" event={"ID":"44a0943e-5263-4fb7-8ad2-b4032311420d","Type":"ContainerStarted","Data":"b9dda7a7fb74879999f07ec5fb198ba030cbdf81d118a7e8ef28ea7faadb2874"}
Jul 07 14:11:30.987334 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:30.987275    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8db94bcf6-78qbg" podStartSLOduration=1.42092087 podStartE2EDuration="1.98725644s" totalImagesPullingTime="566.33557ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:11:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:11:30.986034457 +0000 UTC m=+756.598313440" watchObservedRunningTime="2026-07-07 14:11:30.98725644 +0000 UTC m=+756.599535413"
Jul 07 14:11:31.016759 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:31.016717    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:11:31.085794 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:31.085759    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68cddfdddf-lvq8d"]
Jul 07 14:11:31.086015 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:31.085989    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-68cddfdddf-lvq8d" podUID="ea796347-5d97-4e69-baa4-6f4f12f69d90" containerName="authorino" containerID="cri-o://3ab9ee0b443efe85309eb851c48cf5515877c3bfa06dfe98f1703028aa555db7" gracePeriod=30
Jul 07 14:11:31.242881 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:31.242835    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:11:31.360374 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:31.360345    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68cddfdddf-lvq8d"
Jul 07 14:11:31.486368 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:31.486252    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zv4dj\" (UniqueName: \"kubernetes.io/projected/ea796347-5d97-4e69-baa4-6f4f12f69d90-kube-api-access-zv4dj\") pod \"ea796347-5d97-4e69-baa4-6f4f12f69d90\" (UID: \"ea796347-5d97-4e69-baa4-6f4f12f69d90\") "
Jul 07 14:11:31.486368 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:31.486299    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ea796347-5d97-4e69-baa4-6f4f12f69d90-tls-cert\") pod \"ea796347-5d97-4e69-baa4-6f4f12f69d90\" (UID: \"ea796347-5d97-4e69-baa4-6f4f12f69d90\") "
Jul 07 14:11:31.489056 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:31.489020    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea796347-5d97-4e69-baa4-6f4f12f69d90-kube-api-access-zv4dj" (OuterVolumeSpecName: "kube-api-access-zv4dj") pod "ea796347-5d97-4e69-baa4-6f4f12f69d90" (UID: "ea796347-5d97-4e69-baa4-6f4f12f69d90"). InnerVolumeSpecName "kube-api-access-zv4dj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:11:31.498713 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:31.498676    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea796347-5d97-4e69-baa4-6f4f12f69d90-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "ea796347-5d97-4e69-baa4-6f4f12f69d90" (UID: "ea796347-5d97-4e69-baa4-6f4f12f69d90"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:11:31.587355 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:31.587318    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zv4dj\" (UniqueName: \"kubernetes.io/projected/ea796347-5d97-4e69-baa4-6f4f12f69d90-kube-api-access-zv4dj\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:11:31.587355 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:31.587352    2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ea796347-5d97-4e69-baa4-6f4f12f69d90-tls-cert\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:11:31.909087 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:31.908984    2576 generic.go:356] "Generic (PLEG): container finished" podID="ea796347-5d97-4e69-baa4-6f4f12f69d90" containerID="3ab9ee0b443efe85309eb851c48cf5515877c3bfa06dfe98f1703028aa555db7" exitCode=0
Jul 07 14:11:31.909087 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:31.909045    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68cddfdddf-lvq8d"
Jul 07 14:11:31.909087 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:31.909077    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68cddfdddf-lvq8d" event={"ID":"ea796347-5d97-4e69-baa4-6f4f12f69d90","Type":"ContainerDied","Data":"3ab9ee0b443efe85309eb851c48cf5515877c3bfa06dfe98f1703028aa555db7"}
Jul 07 14:11:31.909680 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:31.909119    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68cddfdddf-lvq8d" event={"ID":"ea796347-5d97-4e69-baa4-6f4f12f69d90","Type":"ContainerDied","Data":"39fc0a66379c6c12a096f52aa824d7c2ae114a44616e81b07cec464a2b8d6884"}
Jul 07 14:11:31.909680 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:31.909137    2576 scope.go:117] "RemoveContainer" containerID="3ab9ee0b443efe85309eb851c48cf5515877c3bfa06dfe98f1703028aa555db7"
Jul 07 14:11:31.919763 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:31.919745    2576 scope.go:117] "RemoveContainer" containerID="3ab9ee0b443efe85309eb851c48cf5515877c3bfa06dfe98f1703028aa555db7"
Jul 07 14:11:31.920131 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:11:31.920111    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ab9ee0b443efe85309eb851c48cf5515877c3bfa06dfe98f1703028aa555db7\": container with ID starting with 3ab9ee0b443efe85309eb851c48cf5515877c3bfa06dfe98f1703028aa555db7 not found: ID does not exist" containerID="3ab9ee0b443efe85309eb851c48cf5515877c3bfa06dfe98f1703028aa555db7"
Jul 07 14:11:31.920215 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:31.920146    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ab9ee0b443efe85309eb851c48cf5515877c3bfa06dfe98f1703028aa555db7"} err="failed to get container status \"3ab9ee0b443efe85309eb851c48cf5515877c3bfa06dfe98f1703028aa555db7\": rpc error: code = NotFound desc = could not find container \"3ab9ee0b443efe85309eb851c48cf5515877c3bfa06dfe98f1703028aa555db7\": container with ID starting with 3ab9ee0b443efe85309eb851c48cf5515877c3bfa06dfe98f1703028aa555db7 not found: ID does not exist"
Jul 07 14:11:31.958315 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:31.958275    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68cddfdddf-lvq8d"]
Jul 07 14:11:31.967917 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:31.967885    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-68cddfdddf-lvq8d"]
Jul 07 14:11:33.075716 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:11:33.075683    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea796347-5d97-4e69-baa4-6f4f12f69d90" path="/var/lib/kubelet/pods/ea796347-5d97-4e69-baa4-6f4f12f69d90/volumes"
Jul 07 14:12:53.829043 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:53.829003    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:12:53.948139 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:53.948103    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-fbf7fb6dc-7jrjq"]
Jul 07 14:12:53.948343 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:53.948301    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-fbf7fb6dc-7jrjq" podUID="c3ddbee5-0d6c-4028-89c7-7dda9ce946d5" containerName="manager" containerID="cri-o://50c70ca3dc3e715aa06392c460a2ee6ed2d96e96d4fa4d1f9bbafdf103fce272" gracePeriod=30
Jul 07 14:12:54.207216 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:54.207192    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fbf7fb6dc-7jrjq"
Jul 07 14:12:54.239207 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:54.239172    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4vlv\" (UniqueName: \"kubernetes.io/projected/c3ddbee5-0d6c-4028-89c7-7dda9ce946d5-kube-api-access-j4vlv\") pod \"c3ddbee5-0d6c-4028-89c7-7dda9ce946d5\" (UID: \"c3ddbee5-0d6c-4028-89c7-7dda9ce946d5\") "
Jul 07 14:12:54.239582 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:54.239558    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c3ddbee5-0d6c-4028-89c7-7dda9ce946d5-webhook-cert\") pod \"c3ddbee5-0d6c-4028-89c7-7dda9ce946d5\" (UID: \"c3ddbee5-0d6c-4028-89c7-7dda9ce946d5\") "
Jul 07 14:12:54.242062 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:54.241964    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3ddbee5-0d6c-4028-89c7-7dda9ce946d5-kube-api-access-j4vlv" (OuterVolumeSpecName: "kube-api-access-j4vlv") pod "c3ddbee5-0d6c-4028-89c7-7dda9ce946d5" (UID: "c3ddbee5-0d6c-4028-89c7-7dda9ce946d5"). InnerVolumeSpecName "kube-api-access-j4vlv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:12:54.242537 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:54.242421    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3ddbee5-0d6c-4028-89c7-7dda9ce946d5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c3ddbee5-0d6c-4028-89c7-7dda9ce946d5" (UID: "c3ddbee5-0d6c-4028-89c7-7dda9ce946d5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:12:54.340548 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:54.340516    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4vlv\" (UniqueName: \"kubernetes.io/projected/c3ddbee5-0d6c-4028-89c7-7dda9ce946d5-kube-api-access-j4vlv\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:12:54.340548 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:54.340543    2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c3ddbee5-0d6c-4028-89c7-7dda9ce946d5-webhook-cert\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:12:54.345893 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:54.345858    2576 generic.go:356] "Generic (PLEG): container finished" podID="c3ddbee5-0d6c-4028-89c7-7dda9ce946d5" containerID="50c70ca3dc3e715aa06392c460a2ee6ed2d96e96d4fa4d1f9bbafdf103fce272" exitCode=0
Jul 07 14:12:54.346051 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:54.345917    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fbf7fb6dc-7jrjq"
Jul 07 14:12:54.346051 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:54.345957    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fbf7fb6dc-7jrjq" event={"ID":"c3ddbee5-0d6c-4028-89c7-7dda9ce946d5","Type":"ContainerDied","Data":"50c70ca3dc3e715aa06392c460a2ee6ed2d96e96d4fa4d1f9bbafdf103fce272"}
Jul 07 14:12:54.346051 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:54.346028    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fbf7fb6dc-7jrjq" event={"ID":"c3ddbee5-0d6c-4028-89c7-7dda9ce946d5","Type":"ContainerDied","Data":"87df7fd5e458c0c617072f14f567ffef011503a5c4474030ee75ab7530303361"}
Jul 07 14:12:54.346163 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:54.346052    2576 scope.go:117] "RemoveContainer" containerID="50c70ca3dc3e715aa06392c460a2ee6ed2d96e96d4fa4d1f9bbafdf103fce272"
Jul 07 14:12:54.360184 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:54.360157    2576 scope.go:117] "RemoveContainer" containerID="50c70ca3dc3e715aa06392c460a2ee6ed2d96e96d4fa4d1f9bbafdf103fce272"
Jul 07 14:12:54.360556 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:12:54.360523    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50c70ca3dc3e715aa06392c460a2ee6ed2d96e96d4fa4d1f9bbafdf103fce272\": container with ID starting with 50c70ca3dc3e715aa06392c460a2ee6ed2d96e96d4fa4d1f9bbafdf103fce272 not found: ID does not exist" containerID="50c70ca3dc3e715aa06392c460a2ee6ed2d96e96d4fa4d1f9bbafdf103fce272"
Jul 07 14:12:54.360629 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:54.360565    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50c70ca3dc3e715aa06392c460a2ee6ed2d96e96d4fa4d1f9bbafdf103fce272"} err="failed to get container status \"50c70ca3dc3e715aa06392c460a2ee6ed2d96e96d4fa4d1f9bbafdf103fce272\": rpc error: code = NotFound desc = could not find container \"50c70ca3dc3e715aa06392c460a2ee6ed2d96e96d4fa4d1f9bbafdf103fce272\": container with ID starting with 50c70ca3dc3e715aa06392c460a2ee6ed2d96e96d4fa4d1f9bbafdf103fce272 not found: ID does not exist"
Jul 07 14:12:54.373829 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:54.373755    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-fbf7fb6dc-7jrjq"]
Jul 07 14:12:54.377778 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:54.377752    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-fbf7fb6dc-7jrjq"]
Jul 07 14:12:55.065510 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:55.065471    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:12:55.075634 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:55.075609    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3ddbee5-0d6c-4028-89c7-7dda9ce946d5" path="/var/lib/kubelet/pods/c3ddbee5-0d6c-4028-89c7-7dda9ce946d5/volumes"
Jul 07 14:12:55.192650 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:55.192618    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-fbf7fb6dc-6kmh5"]
Jul 07 14:12:55.193231 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:55.193205    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea796347-5d97-4e69-baa4-6f4f12f69d90" containerName="authorino"
Jul 07 14:12:55.193434 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:55.193259    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea796347-5d97-4e69-baa4-6f4f12f69d90" containerName="authorino"
Jul 07 14:12:55.193434 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:55.193344    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3ddbee5-0d6c-4028-89c7-7dda9ce946d5" containerName="manager"
Jul 07 14:12:55.193434 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:55.193355    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3ddbee5-0d6c-4028-89c7-7dda9ce946d5" containerName="manager"
Jul 07 14:12:55.193608 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:55.193469    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea796347-5d97-4e69-baa4-6f4f12f69d90" containerName="authorino"
Jul 07 14:12:55.193608 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:55.193487    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3ddbee5-0d6c-4028-89c7-7dda9ce946d5" containerName="manager"
Jul 07 14:12:55.197971 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:55.197951    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fbf7fb6dc-6kmh5"
Jul 07 14:12:55.201970 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:55.201948    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 14:12:55.202062 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:55.201985    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 14:12:55.202062 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:55.201959    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6gms6\""
Jul 07 14:12:55.208510 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:55.208490    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-fbf7fb6dc-6kmh5"]
Jul 07 14:12:55.247087 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:55.247012    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99mrk\" (UniqueName: \"kubernetes.io/projected/cc57e670-b579-4d18-a411-caba587e391d-kube-api-access-99mrk\") pod \"maas-controller-fbf7fb6dc-6kmh5\" (UID: \"cc57e670-b579-4d18-a411-caba587e391d\") " pod="opendatahub/maas-controller-fbf7fb6dc-6kmh5"
Jul 07 14:12:55.247087 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:55.247048    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc57e670-b579-4d18-a411-caba587e391d-webhook-cert\") pod \"maas-controller-fbf7fb6dc-6kmh5\" (UID: \"cc57e670-b579-4d18-a411-caba587e391d\") " pod="opendatahub/maas-controller-fbf7fb6dc-6kmh5"
Jul 07 14:12:55.348200 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:55.348173    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99mrk\" (UniqueName: \"kubernetes.io/projected/cc57e670-b579-4d18-a411-caba587e391d-kube-api-access-99mrk\") pod \"maas-controller-fbf7fb6dc-6kmh5\" (UID: \"cc57e670-b579-4d18-a411-caba587e391d\") " pod="opendatahub/maas-controller-fbf7fb6dc-6kmh5"
Jul 07 14:12:55.348200 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:55.348203    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc57e670-b579-4d18-a411-caba587e391d-webhook-cert\") pod \"maas-controller-fbf7fb6dc-6kmh5\" (UID: \"cc57e670-b579-4d18-a411-caba587e391d\") " pod="opendatahub/maas-controller-fbf7fb6dc-6kmh5"
Jul 07 14:12:55.350735 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:55.350704    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc57e670-b579-4d18-a411-caba587e391d-webhook-cert\") pod \"maas-controller-fbf7fb6dc-6kmh5\" (UID: \"cc57e670-b579-4d18-a411-caba587e391d\") " pod="opendatahub/maas-controller-fbf7fb6dc-6kmh5"
Jul 07 14:12:55.357573 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:55.357552    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99mrk\" (UniqueName: \"kubernetes.io/projected/cc57e670-b579-4d18-a411-caba587e391d-kube-api-access-99mrk\") pod \"maas-controller-fbf7fb6dc-6kmh5\" (UID: \"cc57e670-b579-4d18-a411-caba587e391d\") " pod="opendatahub/maas-controller-fbf7fb6dc-6kmh5"
Jul 07 14:12:55.508536 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:55.508461    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-fbf7fb6dc-6kmh5"
Jul 07 14:12:55.649396 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:55.649365    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-fbf7fb6dc-6kmh5"]
Jul 07 14:12:55.650931 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:12:55.650905    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc57e670_b579_4d18_a411_caba587e391d.slice/crio-71167a34a2d729145959297d62f9ced224a8557084c6f99aec7a641e4d4fbc83 WatchSource:0}: Error finding container 71167a34a2d729145959297d62f9ced224a8557084c6f99aec7a641e4d4fbc83: Status 404 returned error can't find the container with id 71167a34a2d729145959297d62f9ced224a8557084c6f99aec7a641e4d4fbc83
Jul 07 14:12:56.360549 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:56.360514    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fbf7fb6dc-6kmh5" event={"ID":"cc57e670-b579-4d18-a411-caba587e391d","Type":"ContainerStarted","Data":"96825cf05062c9a63f1a92cea233a0af39c627bfa933216ad43f1cf423993999"}
Jul 07 14:12:56.360975 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:56.360578    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-fbf7fb6dc-6kmh5" event={"ID":"cc57e670-b579-4d18-a411-caba587e391d","Type":"ContainerStarted","Data":"71167a34a2d729145959297d62f9ced224a8557084c6f99aec7a641e4d4fbc83"}
Jul 07 14:12:56.360975 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:56.360611    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-fbf7fb6dc-6kmh5"
Jul 07 14:12:56.382167 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:12:56.382122    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-fbf7fb6dc-6kmh5" podStartSLOduration=0.854456673 podStartE2EDuration="1.382106983s" totalImagesPullingTime="527.65031ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:12:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:12:56.380009977 +0000 UTC m=+841.992288965" watchObservedRunningTime="2026-07-07 14:12:56.382106983 +0000 UTC m=+841.994385955"
Jul 07 14:13:07.371512 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:13:07.371480    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-fbf7fb6dc-6kmh5"
Jul 07 14:13:34.100732 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:13:34.100660    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:13:34.194385 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:13:34.194354    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:13:34.322046 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:13:34.322016    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:13:40.152682 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:13:40.152651    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:13:40.268810 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:13:40.268770    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:13:40.399698 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:13:40.399663    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:13:40.553198 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:13:40.553157    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:13:46.190572 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:13:46.190509    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:13:46.290667 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:13:46.290631    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:13:54.928313 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:13:54.928243    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bglbr_d36dada3-7ddc-4de9-a1d5-62ff1f867dd9/console-operator/1.log"
Jul 07 14:13:54.928313 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:13:54.928252    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bglbr_d36dada3-7ddc-4de9-a1d5-62ff1f867dd9/console-operator/1.log"
Jul 07 14:13:54.933450 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:13:54.933426    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zdfvw_9bcfc7b3-a523-42e2-add9-c7f0f1e187ce/ovn-acl-logging/0.log"
Jul 07 14:13:54.933591 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:13:54.933427    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zdfvw_9bcfc7b3-a523-42e2-add9-c7f0f1e187ce/ovn-acl-logging/0.log"
Jul 07 14:14:44.449069 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:14:44.449031    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:14:45.944564 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:14:45.944518    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:15:00.163956 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:15:00.163902    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29723895-vwlm9"]
Jul 07 14:15:00.167374 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:15:00.167357    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723895-vwlm9"
Jul 07 14:15:00.189642 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:15:00.189617    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723895-vwlm9"]
Jul 07 14:15:00.297005 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:15:00.296932    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbxtz\" (UniqueName: \"kubernetes.io/projected/c22b16a0-59b2-483e-9be6-5fcc72cc44e4-kube-api-access-qbxtz\") pod \"maas-api-key-cleanup-29723895-vwlm9\" (UID: \"c22b16a0-59b2-483e-9be6-5fcc72cc44e4\") " pod="opendatahub/maas-api-key-cleanup-29723895-vwlm9"
Jul 07 14:15:00.398554 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:15:00.398519    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbxtz\" (UniqueName: \"kubernetes.io/projected/c22b16a0-59b2-483e-9be6-5fcc72cc44e4-kube-api-access-qbxtz\") pod \"maas-api-key-cleanup-29723895-vwlm9\" (UID: \"c22b16a0-59b2-483e-9be6-5fcc72cc44e4\") " pod="opendatahub/maas-api-key-cleanup-29723895-vwlm9"
Jul 07 14:15:00.407853 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:15:00.407824    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbxtz\" (UniqueName: \"kubernetes.io/projected/c22b16a0-59b2-483e-9be6-5fcc72cc44e4-kube-api-access-qbxtz\") pod \"maas-api-key-cleanup-29723895-vwlm9\" (UID: \"c22b16a0-59b2-483e-9be6-5fcc72cc44e4\") " pod="opendatahub/maas-api-key-cleanup-29723895-vwlm9"
Jul 07 14:15:00.477920 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:15:00.477886    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723895-vwlm9"
Jul 07 14:15:00.623643 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:15:00.623619    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723895-vwlm9"]
Jul 07 14:15:00.625414 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:15:00.625386    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc22b16a0_59b2_483e_9be6_5fcc72cc44e4.slice/crio-aa567801434a58523b9d1d38b69cf57358ad5b4e81b97614b0425670b2228b40 WatchSource:0}: Error finding container aa567801434a58523b9d1d38b69cf57358ad5b4e81b97614b0425670b2228b40: Status 404 returned error can't find the container with id aa567801434a58523b9d1d38b69cf57358ad5b4e81b97614b0425670b2228b40
Jul 07 14:15:00.627236 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:15:00.627221    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 14:15:01.020700 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:15:01.020662    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723895-vwlm9" event={"ID":"c22b16a0-59b2-483e-9be6-5fcc72cc44e4","Type":"ContainerStarted","Data":"aa567801434a58523b9d1d38b69cf57358ad5b4e81b97614b0425670b2228b40"}
Jul 07 14:15:05.043442 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:15:05.043407    2576 generic.go:356] "Generic (PLEG): container finished" podID="c22b16a0-59b2-483e-9be6-5fcc72cc44e4" containerID="e7a06d692243ff26682780dc62970bf064fcf937d7bedcde401aef8c4dbb9d0c" exitCode=0
Jul 07 14:15:05.043844 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:15:05.043459    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723895-vwlm9" event={"ID":"c22b16a0-59b2-483e-9be6-5fcc72cc44e4","Type":"ContainerDied","Data":"e7a06d692243ff26682780dc62970bf064fcf937d7bedcde401aef8c4dbb9d0c"}
Jul 07 14:15:06.198354 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:15:06.198329    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723895-vwlm9"
Jul 07 14:15:06.351985 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:15:06.351858    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbxtz\" (UniqueName: \"kubernetes.io/projected/c22b16a0-59b2-483e-9be6-5fcc72cc44e4-kube-api-access-qbxtz\") pod \"c22b16a0-59b2-483e-9be6-5fcc72cc44e4\" (UID: \"c22b16a0-59b2-483e-9be6-5fcc72cc44e4\") "
Jul 07 14:15:06.354092 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:15:06.354065    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c22b16a0-59b2-483e-9be6-5fcc72cc44e4-kube-api-access-qbxtz" (OuterVolumeSpecName: "kube-api-access-qbxtz") pod "c22b16a0-59b2-483e-9be6-5fcc72cc44e4" (UID: "c22b16a0-59b2-483e-9be6-5fcc72cc44e4"). InnerVolumeSpecName "kube-api-access-qbxtz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:15:06.453375 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:15:06.453339    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbxtz\" (UniqueName: \"kubernetes.io/projected/c22b16a0-59b2-483e-9be6-5fcc72cc44e4-kube-api-access-qbxtz\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:15:07.054304 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:15:07.054270    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723895-vwlm9"
Jul 07 14:15:07.054495 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:15:07.054314    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723895-vwlm9" event={"ID":"c22b16a0-59b2-483e-9be6-5fcc72cc44e4","Type":"ContainerDied","Data":"aa567801434a58523b9d1d38b69cf57358ad5b4e81b97614b0425670b2228b40"}
Jul 07 14:15:07.054495 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:15:07.054373    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa567801434a58523b9d1d38b69cf57358ad5b4e81b97614b0425670b2228b40"
Jul 07 14:15:47.882323 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:15:47.882270    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:17:07.418113 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:17:07.418035    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:17:34.885347 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:17:34.885296    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tmjvn"]
Jul 07 14:17:34.885826 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:17:34.885563    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tmjvn" podUID="8952b3fb-61dc-42a2-a636-620785625f2d" containerName="manager" containerID="cri-o://848359a05bf3e2c31898c64146af3152f8657f9005c93972b8f55a718a8471c3" gracePeriod=10
Jul 07 14:17:37.552989 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:17:37.552959    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tmjvn"
Jul 07 14:17:37.714185 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:17:37.714160    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5rvz\" (UniqueName: \"kubernetes.io/projected/8952b3fb-61dc-42a2-a636-620785625f2d-kube-api-access-w5rvz\") pod \"8952b3fb-61dc-42a2-a636-620785625f2d\" (UID: \"8952b3fb-61dc-42a2-a636-620785625f2d\") "
Jul 07 14:17:37.714351 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:17:37.714266    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8952b3fb-61dc-42a2-a636-620785625f2d-extensions-socket-volume\") pod \"8952b3fb-61dc-42a2-a636-620785625f2d\" (UID: \"8952b3fb-61dc-42a2-a636-620785625f2d\") "
Jul 07 14:17:37.714600 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:17:37.714575    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8952b3fb-61dc-42a2-a636-620785625f2d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8952b3fb-61dc-42a2-a636-620785625f2d" (UID: "8952b3fb-61dc-42a2-a636-620785625f2d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:17:37.716214 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:17:37.716192    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8952b3fb-61dc-42a2-a636-620785625f2d-kube-api-access-w5rvz" (OuterVolumeSpecName: "kube-api-access-w5rvz") pod "8952b3fb-61dc-42a2-a636-620785625f2d" (UID: "8952b3fb-61dc-42a2-a636-620785625f2d"). InnerVolumeSpecName "kube-api-access-w5rvz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:17:37.815752 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:17:37.815714    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8952b3fb-61dc-42a2-a636-620785625f2d-extensions-socket-volume\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:17:37.815752 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:17:37.815745    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5rvz\" (UniqueName: \"kubernetes.io/projected/8952b3fb-61dc-42a2-a636-620785625f2d-kube-api-access-w5rvz\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:17:37.866467 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:17:37.866427    2576 generic.go:356] "Generic (PLEG): container finished" podID="8952b3fb-61dc-42a2-a636-620785625f2d" containerID="848359a05bf3e2c31898c64146af3152f8657f9005c93972b8f55a718a8471c3" exitCode=0
Jul 07 14:17:37.866467 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:17:37.866469    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tmjvn"
Jul 07 14:17:37.866672 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:17:37.866506    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tmjvn" event={"ID":"8952b3fb-61dc-42a2-a636-620785625f2d","Type":"ContainerDied","Data":"848359a05bf3e2c31898c64146af3152f8657f9005c93972b8f55a718a8471c3"}
Jul 07 14:17:37.866672 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:17:37.866558    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tmjvn" event={"ID":"8952b3fb-61dc-42a2-a636-620785625f2d","Type":"ContainerDied","Data":"af53b06e317b3ece9a1c016ee043b7fcb9c73b33077e7c3decde4695e9f90810"}
Jul 07 14:17:37.866672 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:17:37.866580    2576 scope.go:117] "RemoveContainer" containerID="848359a05bf3e2c31898c64146af3152f8657f9005c93972b8f55a718a8471c3"
Jul 07 14:17:37.878539 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:17:37.877098    2576 scope.go:117] "RemoveContainer" containerID="848359a05bf3e2c31898c64146af3152f8657f9005c93972b8f55a718a8471c3"
Jul 07 14:17:37.878539 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:17:37.878496    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"848359a05bf3e2c31898c64146af3152f8657f9005c93972b8f55a718a8471c3\": container with ID starting with 848359a05bf3e2c31898c64146af3152f8657f9005c93972b8f55a718a8471c3 not found: ID does not exist" containerID="848359a05bf3e2c31898c64146af3152f8657f9005c93972b8f55a718a8471c3"
Jul 07 14:17:37.878539 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:17:37.878523    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"848359a05bf3e2c31898c64146af3152f8657f9005c93972b8f55a718a8471c3"} err="failed to get container status \"848359a05bf3e2c31898c64146af3152f8657f9005c93972b8f55a718a8471c3\": rpc error: code = NotFound desc = could not find container \"848359a05bf3e2c31898c64146af3152f8657f9005c93972b8f55a718a8471c3\": container with ID starting with 848359a05bf3e2c31898c64146af3152f8657f9005c93972b8f55a718a8471c3 not found: ID does not exist"
Jul 07 14:17:37.890068 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:17:37.890047    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tmjvn"]
Jul 07 14:17:37.896008 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:17:37.895989    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tmjvn"]
Jul 07 14:17:39.075570 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:17:39.075538    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8952b3fb-61dc-42a2-a636-620785625f2d" path="/var/lib/kubelet/pods/8952b3fb-61dc-42a2-a636-620785625f2d/volumes"
Jul 07 14:18:36.059860 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:18:36.059820    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h4lsw"]
Jul 07 14:18:36.060339 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:18:36.060238    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8952b3fb-61dc-42a2-a636-620785625f2d" containerName="manager"
Jul 07 14:18:36.060339 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:18:36.060249    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8952b3fb-61dc-42a2-a636-620785625f2d" containerName="manager"
Jul 07 14:18:36.060339 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:18:36.060263    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c22b16a0-59b2-483e-9be6-5fcc72cc44e4" containerName="cleanup"
Jul 07 14:18:36.060339 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:18:36.060269    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c22b16a0-59b2-483e-9be6-5fcc72cc44e4" containerName="cleanup"
Jul 07 14:18:36.060478 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:18:36.060344    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c22b16a0-59b2-483e-9be6-5fcc72cc44e4" containerName="cleanup"
Jul 07 14:18:36.060478 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:18:36.060354    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8952b3fb-61dc-42a2-a636-620785625f2d" containerName="manager"
Jul 07 14:18:36.062549 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:18:36.062533    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h4lsw"
Jul 07 14:18:36.065963 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:18:36.065929    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qggx2\""
Jul 07 14:18:36.076374 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:18:36.076356    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h4lsw"]
Jul 07 14:18:36.216238 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:18:36.216194    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4bf3d736-f238-49a5-85e5-a4ba0f69b134-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h4lsw\" (UID: \"4bf3d736-f238-49a5-85e5-a4ba0f69b134\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h4lsw"
Jul 07 14:18:36.216438 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:18:36.216324    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmfg7\" (UniqueName: \"kubernetes.io/projected/4bf3d736-f238-49a5-85e5-a4ba0f69b134-kube-api-access-zmfg7\") pod \"kuadrant-operator-controller-manager-86878c769f-h4lsw\" (UID: \"4bf3d736-f238-49a5-85e5-a4ba0f69b134\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h4lsw"
Jul 07 14:18:36.317848 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:18:36.317765    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmfg7\" (UniqueName: \"kubernetes.io/projected/4bf3d736-f238-49a5-85e5-a4ba0f69b134-kube-api-access-zmfg7\") pod \"kuadrant-operator-controller-manager-86878c769f-h4lsw\" (UID: \"4bf3d736-f238-49a5-85e5-a4ba0f69b134\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h4lsw"
Jul 07 14:18:36.317848 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:18:36.317822    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4bf3d736-f238-49a5-85e5-a4ba0f69b134-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h4lsw\" (UID: \"4bf3d736-f238-49a5-85e5-a4ba0f69b134\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h4lsw"
Jul 07 14:18:36.318208 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:18:36.318191    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4bf3d736-f238-49a5-85e5-a4ba0f69b134-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h4lsw\" (UID: \"4bf3d736-f238-49a5-85e5-a4ba0f69b134\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h4lsw"
Jul 07 14:18:36.327533 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:18:36.327510    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmfg7\" (UniqueName: \"kubernetes.io/projected/4bf3d736-f238-49a5-85e5-a4ba0f69b134-kube-api-access-zmfg7\") pod \"kuadrant-operator-controller-manager-86878c769f-h4lsw\" (UID: \"4bf3d736-f238-49a5-85e5-a4ba0f69b134\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h4lsw"
Jul 07 14:18:36.372417 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:18:36.372389    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h4lsw"
Jul 07 14:18:36.520544 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:18:36.520516    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h4lsw"]
Jul 07 14:18:36.521745 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:18:36.521721    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bf3d736_f238_49a5_85e5_a4ba0f69b134.slice/crio-24a31a56c08349a8aa8a762caa3ff1331c86cd21c72ed2967090ee089034dff9 WatchSource:0}: Error finding container 24a31a56c08349a8aa8a762caa3ff1331c86cd21c72ed2967090ee089034dff9: Status 404 returned error can't find the container with id 24a31a56c08349a8aa8a762caa3ff1331c86cd21c72ed2967090ee089034dff9
Jul 07 14:18:37.165217 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:18:37.165180    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h4lsw" event={"ID":"4bf3d736-f238-49a5-85e5-a4ba0f69b134","Type":"ContainerStarted","Data":"4c03c3458278674080c529ed5a2a908af1607e9e992426945a9037937d4e83bd"}
Jul 07 14:18:37.165612 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:18:37.165237    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h4lsw" event={"ID":"4bf3d736-f238-49a5-85e5-a4ba0f69b134","Type":"ContainerStarted","Data":"24a31a56c08349a8aa8a762caa3ff1331c86cd21c72ed2967090ee089034dff9"}
Jul 07 14:18:37.165612 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:18:37.165313    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h4lsw"
Jul 07 14:18:37.192185 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:18:37.192139    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h4lsw" podStartSLOduration=1.192124805 podStartE2EDuration="1.192124805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:18:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:18:37.18997924 +0000 UTC m=+1182.802258225" watchObservedRunningTime="2026-07-07 14:18:37.192124805 +0000 UTC m=+1182.804403776"
Jul 07 14:18:48.172917 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:18:48.172883    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h4lsw"
Jul 07 14:18:54.965328 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:18:54.965296    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bglbr_d36dada3-7ddc-4de9-a1d5-62ff1f867dd9/console-operator/1.log"
Jul 07 14:18:54.967246 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:18:54.967223    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bglbr_d36dada3-7ddc-4de9-a1d5-62ff1f867dd9/console-operator/1.log"
Jul 07 14:18:54.970400 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:18:54.970381    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zdfvw_9bcfc7b3-a523-42e2-add9-c7f0f1e187ce/ovn-acl-logging/0.log"
Jul 07 14:18:54.971929 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:18:54.971913    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zdfvw_9bcfc7b3-a523-42e2-add9-c7f0f1e187ce/ovn-acl-logging/0.log"
Jul 07 14:19:49.199616 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:19:49.199581    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:22:32.288932 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:22:32.288894    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:22:32.369902 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:22:32.369866    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:23:54.998043 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:23:54.998016    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bglbr_d36dada3-7ddc-4de9-a1d5-62ff1f867dd9/console-operator/1.log"
Jul 07 14:23:55.000855 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:23:55.000833    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bglbr_d36dada3-7ddc-4de9-a1d5-62ff1f867dd9/console-operator/1.log"
Jul 07 14:23:55.002966 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:23:55.002932    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zdfvw_9bcfc7b3-a523-42e2-add9-c7f0f1e187ce/ovn-acl-logging/0.log"
Jul 07 14:23:55.005674 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:23:55.005656    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zdfvw_9bcfc7b3-a523-42e2-add9-c7f0f1e187ce/ovn-acl-logging/0.log"
Jul 07 14:24:31.080749 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:31.080668    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:31.167171 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:31.167137    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:36.644892 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:36.644820    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:36.726180 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:36.726144    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:36.969277 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:36.969227    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:37.059147 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:37.059111    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:38.081298 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:38.081270    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:38.183369 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:38.183335    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:38.257498 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:38.257455    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-a5687120-5b8588698f-6f8qp"]
Jul 07 14:24:38.261805 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:38.261782    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a5687120-5b8588698f-6f8qp"
Jul 07 14:24:38.265029 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:38.265004    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-a5687120-serving-cert\""
Jul 07 14:24:38.274869 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:38.274842    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-a5687120-5b8588698f-6f8qp"]
Jul 07 14:24:38.294039 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:38.294005    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:38.359540 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:38.359435    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87b5k\" (UniqueName: \"kubernetes.io/projected/527b2459-cd6e-4699-9551-116ed51f3495-kube-api-access-87b5k\") pod \"maas-api-e2e-ait-a5687120-5b8588698f-6f8qp\" (UID: \"527b2459-cd6e-4699-9551-116ed51f3495\") " pod="opendatahub/maas-api-e2e-ait-a5687120-5b8588698f-6f8qp"
Jul 07 14:24:38.359540 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:38.359502    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/527b2459-cd6e-4699-9551-116ed51f3495-maas-api-tls\") pod \"maas-api-e2e-ait-a5687120-5b8588698f-6f8qp\" (UID: \"527b2459-cd6e-4699-9551-116ed51f3495\") " pod="opendatahub/maas-api-e2e-ait-a5687120-5b8588698f-6f8qp"
Jul 07 14:24:38.359792 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:38.359601    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/527b2459-cd6e-4699-9551-116ed51f3495-openshift-service-ca\") pod \"maas-api-e2e-ait-a5687120-5b8588698f-6f8qp\" (UID: \"527b2459-cd6e-4699-9551-116ed51f3495\") " pod="opendatahub/maas-api-e2e-ait-a5687120-5b8588698f-6f8qp"
Jul 07 14:24:38.460900 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:38.460866    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87b5k\" (UniqueName: \"kubernetes.io/projected/527b2459-cd6e-4699-9551-116ed51f3495-kube-api-access-87b5k\") pod \"maas-api-e2e-ait-a5687120-5b8588698f-6f8qp\" (UID: \"527b2459-cd6e-4699-9551-116ed51f3495\") " pod="opendatahub/maas-api-e2e-ait-a5687120-5b8588698f-6f8qp"
Jul 07 14:24:38.461093 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:38.460910    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/527b2459-cd6e-4699-9551-116ed51f3495-maas-api-tls\") pod \"maas-api-e2e-ait-a5687120-5b8588698f-6f8qp\" (UID: \"527b2459-cd6e-4699-9551-116ed51f3495\") " pod="opendatahub/maas-api-e2e-ait-a5687120-5b8588698f-6f8qp"
Jul 07 14:24:38.461093 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:38.460988    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/527b2459-cd6e-4699-9551-116ed51f3495-openshift-service-ca\") pod \"maas-api-e2e-ait-a5687120-5b8588698f-6f8qp\" (UID: \"527b2459-cd6e-4699-9551-116ed51f3495\") " pod="opendatahub/maas-api-e2e-ait-a5687120-5b8588698f-6f8qp"
Jul 07 14:24:38.461171 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:24:38.461103    2576 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-a5687120-serving-cert: secret "maas-api-e2e-ait-a5687120-serving-cert" not found
Jul 07 14:24:38.461206 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:24:38.461175    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/527b2459-cd6e-4699-9551-116ed51f3495-maas-api-tls podName:527b2459-cd6e-4699-9551-116ed51f3495 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:38.961157575 +0000 UTC m=+1544.573436532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/527b2459-cd6e-4699-9551-116ed51f3495-maas-api-tls") pod "maas-api-e2e-ait-a5687120-5b8588698f-6f8qp" (UID: "527b2459-cd6e-4699-9551-116ed51f3495") : secret "maas-api-e2e-ait-a5687120-serving-cert" not found
Jul 07 14:24:38.461625 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:38.461605    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/527b2459-cd6e-4699-9551-116ed51f3495-openshift-service-ca\") pod \"maas-api-e2e-ait-a5687120-5b8588698f-6f8qp\" (UID: \"527b2459-cd6e-4699-9551-116ed51f3495\") " pod="opendatahub/maas-api-e2e-ait-a5687120-5b8588698f-6f8qp"
Jul 07 14:24:38.473187 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:38.473159    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87b5k\" (UniqueName: \"kubernetes.io/projected/527b2459-cd6e-4699-9551-116ed51f3495-kube-api-access-87b5k\") pod \"maas-api-e2e-ait-a5687120-5b8588698f-6f8qp\" (UID: \"527b2459-cd6e-4699-9551-116ed51f3495\") " pod="opendatahub/maas-api-e2e-ait-a5687120-5b8588698f-6f8qp"
Jul 07 14:24:38.695641 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:38.695607    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:38.792056 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:38.791995    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:38.891458 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:38.891419    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:38.966202 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:38.966111    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/527b2459-cd6e-4699-9551-116ed51f3495-maas-api-tls\") pod \"maas-api-e2e-ait-a5687120-5b8588698f-6f8qp\" (UID: \"527b2459-cd6e-4699-9551-116ed51f3495\") " pod="opendatahub/maas-api-e2e-ait-a5687120-5b8588698f-6f8qp"
Jul 07 14:24:38.968717 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:38.968695    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/527b2459-cd6e-4699-9551-116ed51f3495-maas-api-tls\") pod \"maas-api-e2e-ait-a5687120-5b8588698f-6f8qp\" (UID: \"527b2459-cd6e-4699-9551-116ed51f3495\") " pod="opendatahub/maas-api-e2e-ait-a5687120-5b8588698f-6f8qp"
Jul 07 14:24:39.174104 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:39.174071    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a5687120-5b8588698f-6f8qp"
Jul 07 14:24:39.319191 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:39.319154    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-a5687120-5b8588698f-6f8qp"]
Jul 07 14:24:39.319975 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:24:39.319921    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod527b2459_cd6e_4699_9551_116ed51f3495.slice/crio-f3b3ca5511d3768f121b78b107ee0132785cc229d7574c9ac2ff0da1a0f3e122 WatchSource:0}: Error finding container f3b3ca5511d3768f121b78b107ee0132785cc229d7574c9ac2ff0da1a0f3e122: Status 404 returned error can't find the container with id f3b3ca5511d3768f121b78b107ee0132785cc229d7574c9ac2ff0da1a0f3e122
Jul 07 14:24:39.321506 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:39.321485    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 14:24:40.158750 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:40.158658    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a5687120-5b8588698f-6f8qp" event={"ID":"527b2459-cd6e-4699-9551-116ed51f3495","Type":"ContainerStarted","Data":"877271a6d3397cab0369d01f6ea2ca58ece20ba77d2e25ce4c4ee41bfe4383f0"}
Jul 07 14:24:40.158750 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:40.158741    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a5687120-5b8588698f-6f8qp" event={"ID":"527b2459-cd6e-4699-9551-116ed51f3495","Type":"ContainerStarted","Data":"f3b3ca5511d3768f121b78b107ee0132785cc229d7574c9ac2ff0da1a0f3e122"}
Jul 07 14:24:40.158929 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:40.158771    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-a5687120-5b8588698f-6f8qp"
Jul 07 14:24:40.178831 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:40.178787    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-a5687120-5b8588698f-6f8qp" podStartSLOduration=1.79997403 podStartE2EDuration="2.178772282s" totalImagesPullingTime="378.798252ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:24:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:24:40.177316588 +0000 UTC m=+1545.789595559" watchObservedRunningTime="2026-07-07 14:24:40.178772282 +0000 UTC m=+1545.791051291"
Jul 07 14:24:40.919993 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:40.919959    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:43.190339 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:43.190308    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:43.395003 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:43.394967    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:43.482489 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:43.482404    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:43.492676 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:43.492641    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-a5687120-5b8588698f-6f8qp"]
Jul 07 14:24:43.493278 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:43.493128    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-a5687120-5b8588698f-6f8qp" podUID="527b2459-cd6e-4699-9551-116ed51f3495" containerName="maas-api" containerID="cri-o://877271a6d3397cab0369d01f6ea2ca58ece20ba77d2e25ce4c4ee41bfe4383f0" gracePeriod=30
Jul 07 14:24:43.545719 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:43.545687    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:43.749229 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:43.749164    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a5687120-5b8588698f-6f8qp"
Jul 07 14:24:43.813720 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:43.813678    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/527b2459-cd6e-4699-9551-116ed51f3495-maas-api-tls\") pod \"527b2459-cd6e-4699-9551-116ed51f3495\" (UID: \"527b2459-cd6e-4699-9551-116ed51f3495\") "
Jul 07 14:24:43.813893 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:43.813735    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/527b2459-cd6e-4699-9551-116ed51f3495-openshift-service-ca\") pod \"527b2459-cd6e-4699-9551-116ed51f3495\" (UID: \"527b2459-cd6e-4699-9551-116ed51f3495\") "
Jul 07 14:24:43.813893 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:43.813779    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87b5k\" (UniqueName: \"kubernetes.io/projected/527b2459-cd6e-4699-9551-116ed51f3495-kube-api-access-87b5k\") pod \"527b2459-cd6e-4699-9551-116ed51f3495\" (UID: \"527b2459-cd6e-4699-9551-116ed51f3495\") "
Jul 07 14:24:43.814128 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:43.814102    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/527b2459-cd6e-4699-9551-116ed51f3495-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "527b2459-cd6e-4699-9551-116ed51f3495" (UID: "527b2459-cd6e-4699-9551-116ed51f3495"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:24:43.815890 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:43.815863    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/527b2459-cd6e-4699-9551-116ed51f3495-kube-api-access-87b5k" (OuterVolumeSpecName: "kube-api-access-87b5k") pod "527b2459-cd6e-4699-9551-116ed51f3495" (UID: "527b2459-cd6e-4699-9551-116ed51f3495"). InnerVolumeSpecName "kube-api-access-87b5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:24:43.816028 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:43.815864    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/527b2459-cd6e-4699-9551-116ed51f3495-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "527b2459-cd6e-4699-9551-116ed51f3495" (UID: "527b2459-cd6e-4699-9551-116ed51f3495"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:24:43.914553 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:43.914513    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/527b2459-cd6e-4699-9551-116ed51f3495-maas-api-tls\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:24:43.914553 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:43.914548    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/527b2459-cd6e-4699-9551-116ed51f3495-openshift-service-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:24:43.914553 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:43.914559    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87b5k\" (UniqueName: \"kubernetes.io/projected/527b2459-cd6e-4699-9551-116ed51f3495-kube-api-access-87b5k\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:24:44.180442 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:44.180344    2576 generic.go:356] "Generic (PLEG): container finished" podID="527b2459-cd6e-4699-9551-116ed51f3495" containerID="877271a6d3397cab0369d01f6ea2ca58ece20ba77d2e25ce4c4ee41bfe4383f0" exitCode=0
Jul 07 14:24:44.180442 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:44.180386    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a5687120-5b8588698f-6f8qp"
Jul 07 14:24:44.180675 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:44.180391    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a5687120-5b8588698f-6f8qp" event={"ID":"527b2459-cd6e-4699-9551-116ed51f3495","Type":"ContainerDied","Data":"877271a6d3397cab0369d01f6ea2ca58ece20ba77d2e25ce4c4ee41bfe4383f0"}
Jul 07 14:24:44.180675 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:44.180511    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a5687120-5b8588698f-6f8qp" event={"ID":"527b2459-cd6e-4699-9551-116ed51f3495","Type":"ContainerDied","Data":"f3b3ca5511d3768f121b78b107ee0132785cc229d7574c9ac2ff0da1a0f3e122"}
Jul 07 14:24:44.180675 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:44.180538    2576 scope.go:117] "RemoveContainer" containerID="877271a6d3397cab0369d01f6ea2ca58ece20ba77d2e25ce4c4ee41bfe4383f0"
Jul 07 14:24:44.190198 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:44.190182    2576 scope.go:117] "RemoveContainer" containerID="877271a6d3397cab0369d01f6ea2ca58ece20ba77d2e25ce4c4ee41bfe4383f0"
Jul 07 14:24:44.190496 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:24:44.190477    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"877271a6d3397cab0369d01f6ea2ca58ece20ba77d2e25ce4c4ee41bfe4383f0\": container with ID starting with 877271a6d3397cab0369d01f6ea2ca58ece20ba77d2e25ce4c4ee41bfe4383f0 not found: ID does not exist" containerID="877271a6d3397cab0369d01f6ea2ca58ece20ba77d2e25ce4c4ee41bfe4383f0"
Jul 07 14:24:44.190765 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:44.190508    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"877271a6d3397cab0369d01f6ea2ca58ece20ba77d2e25ce4c4ee41bfe4383f0"} err="failed to get container status \"877271a6d3397cab0369d01f6ea2ca58ece20ba77d2e25ce4c4ee41bfe4383f0\": rpc error: code = NotFound desc = could not find container \"877271a6d3397cab0369d01f6ea2ca58ece20ba77d2e25ce4c4ee41bfe4383f0\": container with ID starting with 877271a6d3397cab0369d01f6ea2ca58ece20ba77d2e25ce4c4ee41bfe4383f0 not found: ID does not exist"
Jul 07 14:24:44.213632 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:44.213594    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-a5687120-5b8588698f-6f8qp"]
Jul 07 14:24:44.224682 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:44.224655    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-a5687120-5b8588698f-6f8qp"]
Jul 07 14:24:44.864037 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:44.864000    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:45.082499 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:45.082464    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="527b2459-cd6e-4699-9551-116ed51f3495" path="/var/lib/kubelet/pods/527b2459-cd6e-4699-9551-116ed51f3495/volumes"
Jul 07 14:24:45.316523 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:45.316491    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:49.830741 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:49.830706    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:49.933553 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:49.933515    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:50.069293 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:50.069249    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:50.171838 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:50.171754    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:51.155104 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:51.155060    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:51.256768 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:51.256734    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:51.269405 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:51.269371    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-ec5470d4-677c498697-442vb"]
Jul 07 14:24:51.270101 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:51.270075    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="527b2459-cd6e-4699-9551-116ed51f3495" containerName="maas-api"
Jul 07 14:24:51.270101 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:51.270098    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="527b2459-cd6e-4699-9551-116ed51f3495" containerName="maas-api"
Jul 07 14:24:51.270230 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:51.270201    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="527b2459-cd6e-4699-9551-116ed51f3495" containerName="maas-api"
Jul 07 14:24:51.280302 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:51.280278    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-ec5470d4-677c498697-442vb"
Jul 07 14:24:51.284181 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:51.284155    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-ec5470d4-677c498697-442vb"]
Jul 07 14:24:51.285243 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:51.285182    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-ec5470d4-serving-cert\""
Jul 07 14:24:51.352534 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:51.352498    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:51.384714 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:51.384680    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fd685afe-b618-4a32-9907-37e152cdd6a6-maas-api-tls\") pod \"maas-api-e2e-ait-ec5470d4-677c498697-442vb\" (UID: \"fd685afe-b618-4a32-9907-37e152cdd6a6\") " pod="opendatahub/maas-api-e2e-ait-ec5470d4-677c498697-442vb"
Jul 07 14:24:51.384926 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:51.384722    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd685afe-b618-4a32-9907-37e152cdd6a6-openshift-service-ca\") pod \"maas-api-e2e-ait-ec5470d4-677c498697-442vb\" (UID: \"fd685afe-b618-4a32-9907-37e152cdd6a6\") " pod="opendatahub/maas-api-e2e-ait-ec5470d4-677c498697-442vb"
Jul 07 14:24:51.384926 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:51.384764    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p5m7\" (UniqueName: \"kubernetes.io/projected/fd685afe-b618-4a32-9907-37e152cdd6a6-kube-api-access-6p5m7\") pod \"maas-api-e2e-ait-ec5470d4-677c498697-442vb\" (UID: \"fd685afe-b618-4a32-9907-37e152cdd6a6\") " pod="opendatahub/maas-api-e2e-ait-ec5470d4-677c498697-442vb"
Jul 07 14:24:51.485331 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:51.485299    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p5m7\" (UniqueName: \"kubernetes.io/projected/fd685afe-b618-4a32-9907-37e152cdd6a6-kube-api-access-6p5m7\") pod \"maas-api-e2e-ait-ec5470d4-677c498697-442vb\" (UID: \"fd685afe-b618-4a32-9907-37e152cdd6a6\") " pod="opendatahub/maas-api-e2e-ait-ec5470d4-677c498697-442vb"
Jul 07 14:24:51.485546 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:51.485392    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fd685afe-b618-4a32-9907-37e152cdd6a6-maas-api-tls\") pod \"maas-api-e2e-ait-ec5470d4-677c498697-442vb\" (UID: \"fd685afe-b618-4a32-9907-37e152cdd6a6\") " pod="opendatahub/maas-api-e2e-ait-ec5470d4-677c498697-442vb"
Jul 07 14:24:51.485546 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:51.485418    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd685afe-b618-4a32-9907-37e152cdd6a6-openshift-service-ca\") pod \"maas-api-e2e-ait-ec5470d4-677c498697-442vb\" (UID: \"fd685afe-b618-4a32-9907-37e152cdd6a6\") " pod="opendatahub/maas-api-e2e-ait-ec5470d4-677c498697-442vb"
Jul 07 14:24:51.486117 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:51.486098    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd685afe-b618-4a32-9907-37e152cdd6a6-openshift-service-ca\") pod \"maas-api-e2e-ait-ec5470d4-677c498697-442vb\" (UID: \"fd685afe-b618-4a32-9907-37e152cdd6a6\") " pod="opendatahub/maas-api-e2e-ait-ec5470d4-677c498697-442vb"
Jul 07 14:24:51.487877 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:51.487844    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fd685afe-b618-4a32-9907-37e152cdd6a6-maas-api-tls\") pod \"maas-api-e2e-ait-ec5470d4-677c498697-442vb\" (UID: \"fd685afe-b618-4a32-9907-37e152cdd6a6\") " pod="opendatahub/maas-api-e2e-ait-ec5470d4-677c498697-442vb"
Jul 07 14:24:51.497287 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:51.497261    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p5m7\" (UniqueName: \"kubernetes.io/projected/fd685afe-b618-4a32-9907-37e152cdd6a6-kube-api-access-6p5m7\") pod \"maas-api-e2e-ait-ec5470d4-677c498697-442vb\" (UID: \"fd685afe-b618-4a32-9907-37e152cdd6a6\") " pod="opendatahub/maas-api-e2e-ait-ec5470d4-677c498697-442vb"
Jul 07 14:24:51.595234 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:51.595198    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-ec5470d4-677c498697-442vb"
Jul 07 14:24:51.750717 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:51.750690    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-ec5470d4-677c498697-442vb"]
Jul 07 14:24:51.752807 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:24:51.752783    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd685afe_b618_4a32_9907_37e152cdd6a6.slice/crio-62cc1a42f3bf4e12f89e6f14cfc3043f0ad4a911f845675ee4fe4104e7b866ee WatchSource:0}: Error finding container 62cc1a42f3bf4e12f89e6f14cfc3043f0ad4a911f845675ee4fe4104e7b866ee: Status 404 returned error can't find the container with id 62cc1a42f3bf4e12f89e6f14cfc3043f0ad4a911f845675ee4fe4104e7b866ee
Jul 07 14:24:52.224355 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:52.224322    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-ec5470d4-677c498697-442vb" event={"ID":"fd685afe-b618-4a32-9907-37e152cdd6a6","Type":"ContainerStarted","Data":"7d109b3043db86b49bca13a391005dde9e3f540bf199e8ea6dc150cb25b156ce"}
Jul 07 14:24:52.224818 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:52.224377    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-ec5470d4-677c498697-442vb" event={"ID":"fd685afe-b618-4a32-9907-37e152cdd6a6","Type":"ContainerStarted","Data":"62cc1a42f3bf4e12f89e6f14cfc3043f0ad4a911f845675ee4fe4104e7b866ee"}
Jul 07 14:24:52.224818 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:52.224453    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-ec5470d4-677c498697-442vb"
Jul 07 14:24:52.243344 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:52.243281    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-ec5470d4-677c498697-442vb" podStartSLOduration=0.906949951 podStartE2EDuration="1.243258732s" totalImagesPullingTime="336.308781ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:24:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:24:52.242919407 +0000 UTC m=+1557.855198379" watchObservedRunningTime="2026-07-07 14:24:52.243258732 +0000 UTC m=+1557.855537706"
Jul 07 14:24:52.486390 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:52.486356    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:53.718694 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:53.718656    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:56.357019 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:56.356988    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:56.622473 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:56.622394    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-ec5470d4-677c498697-442vb"]
Jul 07 14:24:56.622681 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:56.622656    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-ec5470d4-677c498697-442vb" podUID="fd685afe-b618-4a32-9907-37e152cdd6a6" containerName="maas-api" containerID="cri-o://7d109b3043db86b49bca13a391005dde9e3f540bf199e8ea6dc150cb25b156ce" gracePeriod=30
Jul 07 14:24:56.654706 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:56.654678    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:56.873872 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:56.873812    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-ec5470d4-677c498697-442vb"
Jul 07 14:24:57.038127 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:57.038089    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd685afe-b618-4a32-9907-37e152cdd6a6-openshift-service-ca\") pod \"fd685afe-b618-4a32-9907-37e152cdd6a6\" (UID: \"fd685afe-b618-4a32-9907-37e152cdd6a6\") "
Jul 07 14:24:57.038319 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:57.038171    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6p5m7\" (UniqueName: \"kubernetes.io/projected/fd685afe-b618-4a32-9907-37e152cdd6a6-kube-api-access-6p5m7\") pod \"fd685afe-b618-4a32-9907-37e152cdd6a6\" (UID: \"fd685afe-b618-4a32-9907-37e152cdd6a6\") "
Jul 07 14:24:57.038319 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:57.038254    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fd685afe-b618-4a32-9907-37e152cdd6a6-maas-api-tls\") pod \"fd685afe-b618-4a32-9907-37e152cdd6a6\" (UID: \"fd685afe-b618-4a32-9907-37e152cdd6a6\") "
Jul 07 14:24:57.038508 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:57.038471    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd685afe-b618-4a32-9907-37e152cdd6a6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fd685afe-b618-4a32-9907-37e152cdd6a6" (UID: "fd685afe-b618-4a32-9907-37e152cdd6a6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:24:57.040745 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:57.040713    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd685afe-b618-4a32-9907-37e152cdd6a6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fd685afe-b618-4a32-9907-37e152cdd6a6" (UID: "fd685afe-b618-4a32-9907-37e152cdd6a6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:24:57.040745 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:57.040728    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd685afe-b618-4a32-9907-37e152cdd6a6-kube-api-access-6p5m7" (OuterVolumeSpecName: "kube-api-access-6p5m7") pod "fd685afe-b618-4a32-9907-37e152cdd6a6" (UID: "fd685afe-b618-4a32-9907-37e152cdd6a6"). InnerVolumeSpecName "kube-api-access-6p5m7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:24:57.139874 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:57.139787    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6p5m7\" (UniqueName: \"kubernetes.io/projected/fd685afe-b618-4a32-9907-37e152cdd6a6-kube-api-access-6p5m7\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:24:57.139874 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:57.139811    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fd685afe-b618-4a32-9907-37e152cdd6a6-maas-api-tls\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:24:57.139874 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:57.139821    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd685afe-b618-4a32-9907-37e152cdd6a6-openshift-service-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:24:57.251454 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:57.251420    2576 generic.go:356] "Generic (PLEG): container finished" podID="fd685afe-b618-4a32-9907-37e152cdd6a6" containerID="7d109b3043db86b49bca13a391005dde9e3f540bf199e8ea6dc150cb25b156ce" exitCode=0
Jul 07 14:24:57.251642 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:57.251480    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-ec5470d4-677c498697-442vb"
Jul 07 14:24:57.251642 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:57.251503    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-ec5470d4-677c498697-442vb" event={"ID":"fd685afe-b618-4a32-9907-37e152cdd6a6","Type":"ContainerDied","Data":"7d109b3043db86b49bca13a391005dde9e3f540bf199e8ea6dc150cb25b156ce"}
Jul 07 14:24:57.251642 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:57.251558    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-ec5470d4-677c498697-442vb" event={"ID":"fd685afe-b618-4a32-9907-37e152cdd6a6","Type":"ContainerDied","Data":"62cc1a42f3bf4e12f89e6f14cfc3043f0ad4a911f845675ee4fe4104e7b866ee"}
Jul 07 14:24:57.251642 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:57.251579    2576 scope.go:117] "RemoveContainer" containerID="7d109b3043db86b49bca13a391005dde9e3f540bf199e8ea6dc150cb25b156ce"
Jul 07 14:24:57.260513 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:57.260494    2576 scope.go:117] "RemoveContainer" containerID="7d109b3043db86b49bca13a391005dde9e3f540bf199e8ea6dc150cb25b156ce"
Jul 07 14:24:57.260779 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:24:57.260759    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d109b3043db86b49bca13a391005dde9e3f540bf199e8ea6dc150cb25b156ce\": container with ID starting with 7d109b3043db86b49bca13a391005dde9e3f540bf199e8ea6dc150cb25b156ce not found: ID does not exist" containerID="7d109b3043db86b49bca13a391005dde9e3f540bf199e8ea6dc150cb25b156ce"
Jul 07 14:24:57.260834 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:57.260794    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d109b3043db86b49bca13a391005dde9e3f540bf199e8ea6dc150cb25b156ce"} err="failed to get container status \"7d109b3043db86b49bca13a391005dde9e3f540bf199e8ea6dc150cb25b156ce\": rpc error: code = NotFound desc = could not find container \"7d109b3043db86b49bca13a391005dde9e3f540bf199e8ea6dc150cb25b156ce\": container with ID starting with 7d109b3043db86b49bca13a391005dde9e3f540bf199e8ea6dc150cb25b156ce not found: ID does not exist"
Jul 07 14:24:57.269158 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:57.269135    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-ec5470d4-677c498697-442vb"]
Jul 07 14:24:57.273731 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:57.273711    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-ec5470d4-677c498697-442vb"]
Jul 07 14:24:59.075204 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:24:59.075175    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd685afe-b618-4a32-9907-37e152cdd6a6" path="/var/lib/kubelet/pods/fd685afe-b618-4a32-9907-37e152cdd6a6/volumes"
Jul 07 14:25:02.510476 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:02.510439    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:25:02.607745 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:02.607705    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:25:04.934045 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:04.934015    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:25:08.463471 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:08.463431    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:25:08.567667 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:08.567642    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:25:08.704765 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:08.704721    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:25:08.812363 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:08.812280    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:25:09.886733 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:09.886700    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:25:09.957302 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:09.957266    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-b908f305-678d95958f-dpbbs"]
Jul 07 14:25:09.957755 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:09.957740    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd685afe-b618-4a32-9907-37e152cdd6a6" containerName="maas-api"
Jul 07 14:25:09.957755 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:09.957755    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd685afe-b618-4a32-9907-37e152cdd6a6" containerName="maas-api"
Jul 07 14:25:09.957882 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:09.957846    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd685afe-b618-4a32-9907-37e152cdd6a6" containerName="maas-api"
Jul 07 14:25:09.962535 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:09.962516    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-b908f305-678d95958f-dpbbs"
Jul 07 14:25:09.965722 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:09.965702    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-b908f305-serving-cert\""
Jul 07 14:25:09.976375 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:09.976351    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-b908f305-678d95958f-dpbbs"]
Jul 07 14:25:09.987350 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:09.987324    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:25:10.081000 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:10.080970    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:25:10.156411 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:10.156338    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2f028fe-a8c1-45c4-ab6f-aefbcce06d23-openshift-service-ca\") pod \"maas-api-e2e-derive-b908f305-678d95958f-dpbbs\" (UID: \"a2f028fe-a8c1-45c4-ab6f-aefbcce06d23\") " pod="opendatahub/maas-api-e2e-derive-b908f305-678d95958f-dpbbs"
Jul 07 14:25:10.156411 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:10.156388    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2f028fe-a8c1-45c4-ab6f-aefbcce06d23-maas-api-tls\") pod \"maas-api-e2e-derive-b908f305-678d95958f-dpbbs\" (UID: \"a2f028fe-a8c1-45c4-ab6f-aefbcce06d23\") " pod="opendatahub/maas-api-e2e-derive-b908f305-678d95958f-dpbbs"
Jul 07 14:25:10.156411 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:10.156406    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf895\" (UniqueName: \"kubernetes.io/projected/a2f028fe-a8c1-45c4-ab6f-aefbcce06d23-kube-api-access-mf895\") pod \"maas-api-e2e-derive-b908f305-678d95958f-dpbbs\" (UID: \"a2f028fe-a8c1-45c4-ab6f-aefbcce06d23\") " pod="opendatahub/maas-api-e2e-derive-b908f305-678d95958f-dpbbs"
Jul 07 14:25:10.231651 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:10.231621    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:25:10.257924 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:10.257893    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2f028fe-a8c1-45c4-ab6f-aefbcce06d23-maas-api-tls\") pod \"maas-api-e2e-derive-b908f305-678d95958f-dpbbs\" (UID: \"a2f028fe-a8c1-45c4-ab6f-aefbcce06d23\") " pod="opendatahub/maas-api-e2e-derive-b908f305-678d95958f-dpbbs"
Jul 07 14:25:10.258117 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:10.257928    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf895\" (UniqueName: \"kubernetes.io/projected/a2f028fe-a8c1-45c4-ab6f-aefbcce06d23-kube-api-access-mf895\") pod \"maas-api-e2e-derive-b908f305-678d95958f-dpbbs\" (UID: \"a2f028fe-a8c1-45c4-ab6f-aefbcce06d23\") " pod="opendatahub/maas-api-e2e-derive-b908f305-678d95958f-dpbbs"
Jul 07 14:25:10.258355 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:10.258328    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2f028fe-a8c1-45c4-ab6f-aefbcce06d23-openshift-service-ca\") pod \"maas-api-e2e-derive-b908f305-678d95958f-dpbbs\" (UID: \"a2f028fe-a8c1-45c4-ab6f-aefbcce06d23\") " pod="opendatahub/maas-api-e2e-derive-b908f305-678d95958f-dpbbs"
Jul 07 14:25:10.258927 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:10.258903    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2f028fe-a8c1-45c4-ab6f-aefbcce06d23-openshift-service-ca\") pod \"maas-api-e2e-derive-b908f305-678d95958f-dpbbs\" (UID: \"a2f028fe-a8c1-45c4-ab6f-aefbcce06d23\") " pod="opendatahub/maas-api-e2e-derive-b908f305-678d95958f-dpbbs"
Jul 07 14:25:10.260391 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:10.260368    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2f028fe-a8c1-45c4-ab6f-aefbcce06d23-maas-api-tls\") pod \"maas-api-e2e-derive-b908f305-678d95958f-dpbbs\" (UID: \"a2f028fe-a8c1-45c4-ab6f-aefbcce06d23\") " pod="opendatahub/maas-api-e2e-derive-b908f305-678d95958f-dpbbs"
Jul 07 14:25:10.267109 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:10.267084    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf895\" (UniqueName: \"kubernetes.io/projected/a2f028fe-a8c1-45c4-ab6f-aefbcce06d23-kube-api-access-mf895\") pod \"maas-api-e2e-derive-b908f305-678d95958f-dpbbs\" (UID: \"a2f028fe-a8c1-45c4-ab6f-aefbcce06d23\") " pod="opendatahub/maas-api-e2e-derive-b908f305-678d95958f-dpbbs"
Jul 07 14:25:10.272851 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:10.272830    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-b908f305-678d95958f-dpbbs"
Jul 07 14:25:10.589533 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:10.589497    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:25:10.628824 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:10.628798    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-b908f305-678d95958f-dpbbs"]
Jul 07 14:25:10.629298 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:25:10.629277    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2f028fe_a8c1_45c4_ab6f_aefbcce06d23.slice/crio-92bb2f82f6ea7f43ce5af37af2bea93de98730780e3df94fc6183f6fd120400b WatchSource:0}: Error finding container 92bb2f82f6ea7f43ce5af37af2bea93de98730780e3df94fc6183f6fd120400b: Status 404 returned error can't find the container with id 92bb2f82f6ea7f43ce5af37af2bea93de98730780e3df94fc6183f6fd120400b
Jul 07 14:25:10.674441 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:10.674418    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:25:11.325967 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:11.325859    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-b908f305-678d95958f-dpbbs" event={"ID":"a2f028fe-a8c1-45c4-ab6f-aefbcce06d23","Type":"ContainerStarted","Data":"0b00fc0d03914b688bfbe4c2db3557221b9f7fa2a03c00092b3ac5e2e63cb18d"}
Jul 07 14:25:11.325967 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:11.325909    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-b908f305-678d95958f-dpbbs" event={"ID":"a2f028fe-a8c1-45c4-ab6f-aefbcce06d23","Type":"ContainerStarted","Data":"92bb2f82f6ea7f43ce5af37af2bea93de98730780e3df94fc6183f6fd120400b"}
Jul 07 14:25:11.326390 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:11.325997    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-b908f305-678d95958f-dpbbs"
Jul 07 14:25:11.347999 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:11.347933    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-b908f305-678d95958f-dpbbs" podStartSLOduration=1.9649926949999998 podStartE2EDuration="2.34791662s" totalImagesPullingTime="382.923925ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:25:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:25:11.345650811 +0000 UTC m=+1576.957929783" watchObservedRunningTime="2026-07-07 14:25:11.34791662 +0000 UTC m=+1576.960195611"
Jul 07 14:25:12.505427 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:12.505403    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:25:14.253648 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:14.253611    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:25:14.441912 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:14.441869    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:25:14.553214 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:14.553131    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:25:14.557898 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:14.557869    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-b908f305-678d95958f-dpbbs"]
Jul 07 14:25:14.558795 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:14.558764    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-b908f305-678d95958f-dpbbs" podUID="a2f028fe-a8c1-45c4-ab6f-aefbcce06d23" containerName="maas-api" containerID="cri-o://0b00fc0d03914b688bfbe4c2db3557221b9f7fa2a03c00092b3ac5e2e63cb18d" gracePeriod=30
Jul 07 14:25:14.634393 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:14.634357    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:25:14.814295 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:14.814235    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-b908f305-678d95958f-dpbbs"
Jul 07 14:25:14.896229 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:14.896198    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mf895\" (UniqueName: \"kubernetes.io/projected/a2f028fe-a8c1-45c4-ab6f-aefbcce06d23-kube-api-access-mf895\") pod \"a2f028fe-a8c1-45c4-ab6f-aefbcce06d23\" (UID: \"a2f028fe-a8c1-45c4-ab6f-aefbcce06d23\") "
Jul 07 14:25:14.896390 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:14.896253    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2f028fe-a8c1-45c4-ab6f-aefbcce06d23-openshift-service-ca\") pod \"a2f028fe-a8c1-45c4-ab6f-aefbcce06d23\" (UID: \"a2f028fe-a8c1-45c4-ab6f-aefbcce06d23\") "
Jul 07 14:25:14.896390 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:14.896302    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2f028fe-a8c1-45c4-ab6f-aefbcce06d23-maas-api-tls\") pod \"a2f028fe-a8c1-45c4-ab6f-aefbcce06d23\" (UID: \"a2f028fe-a8c1-45c4-ab6f-aefbcce06d23\") "
Jul 07 14:25:14.896684 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:14.896657    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2f028fe-a8c1-45c4-ab6f-aefbcce06d23-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a2f028fe-a8c1-45c4-ab6f-aefbcce06d23" (UID: "a2f028fe-a8c1-45c4-ab6f-aefbcce06d23"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:25:14.898326 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:14.898300    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2f028fe-a8c1-45c4-ab6f-aefbcce06d23-kube-api-access-mf895" (OuterVolumeSpecName: "kube-api-access-mf895") pod "a2f028fe-a8c1-45c4-ab6f-aefbcce06d23" (UID: "a2f028fe-a8c1-45c4-ab6f-aefbcce06d23"). InnerVolumeSpecName "kube-api-access-mf895". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:25:14.898441 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:14.898336    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2f028fe-a8c1-45c4-ab6f-aefbcce06d23-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a2f028fe-a8c1-45c4-ab6f-aefbcce06d23" (UID: "a2f028fe-a8c1-45c4-ab6f-aefbcce06d23"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:25:14.997535 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:14.997496    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2f028fe-a8c1-45c4-ab6f-aefbcce06d23-openshift-service-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:25:14.997535 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:14.997530    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2f028fe-a8c1-45c4-ab6f-aefbcce06d23-maas-api-tls\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:25:14.997535 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:14.997539    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mf895\" (UniqueName: \"kubernetes.io/projected/a2f028fe-a8c1-45c4-ab6f-aefbcce06d23-kube-api-access-mf895\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:25:15.351800 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:15.351702    2576 generic.go:356] "Generic (PLEG): container finished" podID="a2f028fe-a8c1-45c4-ab6f-aefbcce06d23" containerID="0b00fc0d03914b688bfbe4c2db3557221b9f7fa2a03c00092b3ac5e2e63cb18d" exitCode=0
Jul 07 14:25:15.351800 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:15.351753    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-b908f305-678d95958f-dpbbs"
Jul 07 14:25:15.351800 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:15.351789    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-b908f305-678d95958f-dpbbs" event={"ID":"a2f028fe-a8c1-45c4-ab6f-aefbcce06d23","Type":"ContainerDied","Data":"0b00fc0d03914b688bfbe4c2db3557221b9f7fa2a03c00092b3ac5e2e63cb18d"}
Jul 07 14:25:15.352380 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:15.351842    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-b908f305-678d95958f-dpbbs" event={"ID":"a2f028fe-a8c1-45c4-ab6f-aefbcce06d23","Type":"ContainerDied","Data":"92bb2f82f6ea7f43ce5af37af2bea93de98730780e3df94fc6183f6fd120400b"}
Jul 07 14:25:15.352380 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:15.351864    2576 scope.go:117] "RemoveContainer" containerID="0b00fc0d03914b688bfbe4c2db3557221b9f7fa2a03c00092b3ac5e2e63cb18d"
Jul 07 14:25:15.361537 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:15.361519    2576 scope.go:117] "RemoveContainer" containerID="0b00fc0d03914b688bfbe4c2db3557221b9f7fa2a03c00092b3ac5e2e63cb18d"
Jul 07 14:25:15.361806 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:25:15.361785    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b00fc0d03914b688bfbe4c2db3557221b9f7fa2a03c00092b3ac5e2e63cb18d\": container with ID starting with 0b00fc0d03914b688bfbe4c2db3557221b9f7fa2a03c00092b3ac5e2e63cb18d not found: ID does not exist" containerID="0b00fc0d03914b688bfbe4c2db3557221b9f7fa2a03c00092b3ac5e2e63cb18d"
Jul 07 14:25:15.361853 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:15.361816    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b00fc0d03914b688bfbe4c2db3557221b9f7fa2a03c00092b3ac5e2e63cb18d"} err="failed to get container status \"0b00fc0d03914b688bfbe4c2db3557221b9f7fa2a03c00092b3ac5e2e63cb18d\": rpc error: code = NotFound desc = could not find container \"0b00fc0d03914b688bfbe4c2db3557221b9f7fa2a03c00092b3ac5e2e63cb18d\": container with ID starting with 0b00fc0d03914b688bfbe4c2db3557221b9f7fa2a03c00092b3ac5e2e63cb18d not found: ID does not exist"
Jul 07 14:25:15.371278 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:15.371256    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-b908f305-678d95958f-dpbbs"]
Jul 07 14:25:15.376057 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:15.376035    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-b908f305-678d95958f-dpbbs"]
Jul 07 14:25:16.307088 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:16.307049    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:25:17.075677 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:17.075639    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2f028fe-a8c1-45c4-ab6f-aefbcce06d23" path="/var/lib/kubelet/pods/a2f028fe-a8c1-45c4-ab6f-aefbcce06d23/volumes"
Jul 07 14:25:20.590594 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:20.590563    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:25:20.699039 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:20.699003    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:25:21.102250 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:21.102207    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:25:21.238845 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:21.238813    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:25:21.407560 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:21.407467    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:25:22.737425 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:22.737373    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:25:28.890275 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:28.890236    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:25:28.962411 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:28.962377    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:25:29.057460 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:29.057393    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:25:29.147005 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:29.146915    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:25:29.247427 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:29.247396    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:25:29.664996 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:29.664967    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:25:29.905327 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:29.905299    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:25:55.638166 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:25:55.638122    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:26:01.468181 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:26:01.468132    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:26:01.540644 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:26:01.540615    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:26:01.637660 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:26:01.637627    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:26:01.735401 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:26:01.735311    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:26:17.639195 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:26:17.639151    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:26:23.707751 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:26:23.707697    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:26:23.774658 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:26:23.774623    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:26:23.870954 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:26:23.870911    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:26:23.979287 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:26:23.979181    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:26:34.470124 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:26:34.470088    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:26:35.316150 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:26:35.316115    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:26:41.319730 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:26:41.319691    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:26:41.427632 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:26:41.427597    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:26:41.517853 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:26:41.517814    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:26:41.618841 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:26:41.618755    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:26:42.488463 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:26:42.488429    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:26:42.587909 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:26:42.587876    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:26:42.684138 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:26:42.684104    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:26:44.361977 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:26:44.361906    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:26:50.279258 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:26:50.279214    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:26:50.371431 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:26:50.371377    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:26:50.984210 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:26:50.984170    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:26:56.774407 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:26:56.774365    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:26:56.874602 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:26:56.874566    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:26:57.005552 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:26:57.005515    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:26:57.429394 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:26:57.429352    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:26:58.425375 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:26:58.425319    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:00.417270 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:00.417232    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:00.490471 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:00.490436    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn"]
Jul 07 14:27:00.490896 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:00.490878    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2f028fe-a8c1-45c4-ab6f-aefbcce06d23" containerName="maas-api"
Jul 07 14:27:00.490995 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:00.490897    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2f028fe-a8c1-45c4-ab6f-aefbcce06d23" containerName="maas-api"
Jul 07 14:27:00.491047 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:00.490995    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2f028fe-a8c1-45c4-ab6f-aefbcce06d23" containerName="maas-api"
Jul 07 14:27:00.494215 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:00.494198    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn"
Jul 07 14:27:00.496893 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:00.496870    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-2f1f0536-serving-cert\""
Jul 07 14:27:00.506369 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:00.506346    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn"]
Jul 07 14:27:00.515905 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:00.515873    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:00.590080 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:00.590046    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvq9v\" (UniqueName: \"kubernetes.io/projected/a47f5fd0-b185-452e-884f-439722a70f92-kube-api-access-tvq9v\") pod \"maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn\" (UID: \"a47f5fd0-b185-452e-884f-439722a70f92\") " pod="opendatahub/maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn"
Jul 07 14:27:00.590262 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:00.590118    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a47f5fd0-b185-452e-884f-439722a70f92-maas-api-tls\") pod \"maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn\" (UID: \"a47f5fd0-b185-452e-884f-439722a70f92\") " pod="opendatahub/maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn"
Jul 07 14:27:00.590262 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:00.590137    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a47f5fd0-b185-452e-884f-439722a70f92-openshift-service-ca\") pod \"maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn\" (UID: \"a47f5fd0-b185-452e-884f-439722a70f92\") " pod="opendatahub/maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn"
Jul 07 14:27:00.690945 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:00.690910    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvq9v\" (UniqueName: \"kubernetes.io/projected/a47f5fd0-b185-452e-884f-439722a70f92-kube-api-access-tvq9v\") pod \"maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn\" (UID: \"a47f5fd0-b185-452e-884f-439722a70f92\") " pod="opendatahub/maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn"
Jul 07 14:27:00.691137 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:00.691035    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a47f5fd0-b185-452e-884f-439722a70f92-maas-api-tls\") pod \"maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn\" (UID: \"a47f5fd0-b185-452e-884f-439722a70f92\") " pod="opendatahub/maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn"
Jul 07 14:27:00.691137 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:00.691055    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a47f5fd0-b185-452e-884f-439722a70f92-openshift-service-ca\") pod \"maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn\" (UID: \"a47f5fd0-b185-452e-884f-439722a70f92\") " pod="opendatahub/maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn"
Jul 07 14:27:00.691255 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:27:00.691188    2576 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-2f1f0536-serving-cert: secret "maas-api-e2e-mt-2f1f0536-serving-cert" not found
Jul 07 14:27:00.691309 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:27:00.691264    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a47f5fd0-b185-452e-884f-439722a70f92-maas-api-tls podName:a47f5fd0-b185-452e-884f-439722a70f92 nodeName:}" failed. No retries permitted until 2026-07-07 14:27:01.191246173 +0000 UTC m=+1686.803525124 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a47f5fd0-b185-452e-884f-439722a70f92-maas-api-tls") pod "maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn" (UID: "a47f5fd0-b185-452e-884f-439722a70f92") : secret "maas-api-e2e-mt-2f1f0536-serving-cert" not found
Jul 07 14:27:00.691774 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:00.691752    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a47f5fd0-b185-452e-884f-439722a70f92-openshift-service-ca\") pod \"maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn\" (UID: \"a47f5fd0-b185-452e-884f-439722a70f92\") " pod="opendatahub/maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn"
Jul 07 14:27:00.704098 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:00.704073    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvq9v\" (UniqueName: \"kubernetes.io/projected/a47f5fd0-b185-452e-884f-439722a70f92-kube-api-access-tvq9v\") pod \"maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn\" (UID: \"a47f5fd0-b185-452e-884f-439722a70f92\") " pod="opendatahub/maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn"
Jul 07 14:27:00.796087 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:00.796053    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:01.037895 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:01.037806    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:01.195499 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:01.195414    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a47f5fd0-b185-452e-884f-439722a70f92-maas-api-tls\") pod \"maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn\" (UID: \"a47f5fd0-b185-452e-884f-439722a70f92\") " pod="opendatahub/maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn"
Jul 07 14:27:01.198172 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:01.198146    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a47f5fd0-b185-452e-884f-439722a70f92-maas-api-tls\") pod \"maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn\" (UID: \"a47f5fd0-b185-452e-884f-439722a70f92\") " pod="opendatahub/maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn"
Jul 07 14:27:01.210125 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:01.210103    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:01.310616 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:01.310524    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:01.405243 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:01.405211    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn"
Jul 07 14:27:01.558100 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:01.558032    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn"]
Jul 07 14:27:01.560868 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:27:01.560807    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda47f5fd0_b185_452e_884f_439722a70f92.slice/crio-f7883b1f3f6189595e98b486999d21fe559b1033620f26d06d4f6ad6a22f5c95 WatchSource:0}: Error finding container f7883b1f3f6189595e98b486999d21fe559b1033620f26d06d4f6ad6a22f5c95: Status 404 returned error can't find the container with id f7883b1f3f6189595e98b486999d21fe559b1033620f26d06d4f6ad6a22f5c95
Jul 07 14:27:01.928046 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:01.927926    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn" event={"ID":"a47f5fd0-b185-452e-884f-439722a70f92","Type":"ContainerStarted","Data":"f7883b1f3f6189595e98b486999d21fe559b1033620f26d06d4f6ad6a22f5c95"}
Jul 07 14:27:02.934910 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:02.934874    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn" event={"ID":"a47f5fd0-b185-452e-884f-439722a70f92","Type":"ContainerStarted","Data":"60830753b5339a183647ce853c6e608bd76c8fe21857c2711eb2899554ee2153"}
Jul 07 14:27:02.935336 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:02.934934    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn"
Jul 07 14:27:02.954285 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:02.954221    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn" podStartSLOduration=2.392815504 podStartE2EDuration="2.954201181s" totalImagesPullingTime="561.385677ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:27:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:27:02.953875383 +0000 UTC m=+1688.566154356" watchObservedRunningTime="2026-07-07 14:27:02.954201181 +0000 UTC m=+1688.566480154"
Jul 07 14:27:04.828925 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:04.828891    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:05.535108 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:05.535015    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:05.629486 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:05.629450    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:05.981041 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:05.981002    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:08.946873 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:08.946838    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn"
Jul 07 14:27:11.966278 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:11.966245    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:12.070471 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:12.070435    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:12.393181 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:12.393097    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:12.701960 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:12.701906    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn"]
Jul 07 14:27:12.702693 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:12.702563    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn" podUID="a47f5fd0-b185-452e-884f-439722a70f92" containerName="maas-api" containerID="cri-o://60830753b5339a183647ce853c6e608bd76c8fe21857c2711eb2899554ee2153" gracePeriod=30
Jul 07 14:27:12.729570 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:12.729535    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:12.793864 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:12.793831    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:12.973487 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:12.973455    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn"
Jul 07 14:27:12.990855 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:12.990821    2576 generic.go:356] "Generic (PLEG): container finished" podID="a47f5fd0-b185-452e-884f-439722a70f92" containerID="60830753b5339a183647ce853c6e608bd76c8fe21857c2711eb2899554ee2153" exitCode=0
Jul 07 14:27:12.991085 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:12.990884    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn" event={"ID":"a47f5fd0-b185-452e-884f-439722a70f92","Type":"ContainerDied","Data":"60830753b5339a183647ce853c6e608bd76c8fe21857c2711eb2899554ee2153"}
Jul 07 14:27:12.991085 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:12.990896    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn"
Jul 07 14:27:12.991085 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:12.990951    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn" event={"ID":"a47f5fd0-b185-452e-884f-439722a70f92","Type":"ContainerDied","Data":"f7883b1f3f6189595e98b486999d21fe559b1033620f26d06d4f6ad6a22f5c95"}
Jul 07 14:27:12.991085 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:12.990985    2576 scope.go:117] "RemoveContainer" containerID="60830753b5339a183647ce853c6e608bd76c8fe21857c2711eb2899554ee2153"
Jul 07 14:27:13.002130 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:13.002105    2576 scope.go:117] "RemoveContainer" containerID="60830753b5339a183647ce853c6e608bd76c8fe21857c2711eb2899554ee2153"
Jul 07 14:27:13.002544 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:27:13.002509    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60830753b5339a183647ce853c6e608bd76c8fe21857c2711eb2899554ee2153\": container with ID starting with 60830753b5339a183647ce853c6e608bd76c8fe21857c2711eb2899554ee2153 not found: ID does not exist" containerID="60830753b5339a183647ce853c6e608bd76c8fe21857c2711eb2899554ee2153"
Jul 07 14:27:13.002664 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:13.002553    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60830753b5339a183647ce853c6e608bd76c8fe21857c2711eb2899554ee2153"} err="failed to get container status \"60830753b5339a183647ce853c6e608bd76c8fe21857c2711eb2899554ee2153\": rpc error: code = NotFound desc = could not find container \"60830753b5339a183647ce853c6e608bd76c8fe21857c2711eb2899554ee2153\": container with ID starting with 60830753b5339a183647ce853c6e608bd76c8fe21857c2711eb2899554ee2153 not found: ID does not exist"
Jul 07 14:27:13.103531 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:13.103500    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a47f5fd0-b185-452e-884f-439722a70f92-maas-api-tls\") pod \"a47f5fd0-b185-452e-884f-439722a70f92\" (UID: \"a47f5fd0-b185-452e-884f-439722a70f92\") "
Jul 07 14:27:13.103741 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:13.103560    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a47f5fd0-b185-452e-884f-439722a70f92-openshift-service-ca\") pod \"a47f5fd0-b185-452e-884f-439722a70f92\" (UID: \"a47f5fd0-b185-452e-884f-439722a70f92\") "
Jul 07 14:27:13.103741 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:13.103604    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvq9v\" (UniqueName: \"kubernetes.io/projected/a47f5fd0-b185-452e-884f-439722a70f92-kube-api-access-tvq9v\") pod \"a47f5fd0-b185-452e-884f-439722a70f92\" (UID: \"a47f5fd0-b185-452e-884f-439722a70f92\") "
Jul 07 14:27:13.104009 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:13.103978    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a47f5fd0-b185-452e-884f-439722a70f92-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a47f5fd0-b185-452e-884f-439722a70f92" (UID: "a47f5fd0-b185-452e-884f-439722a70f92"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:27:13.105792 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:13.105761    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a47f5fd0-b185-452e-884f-439722a70f92-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a47f5fd0-b185-452e-884f-439722a70f92" (UID: "a47f5fd0-b185-452e-884f-439722a70f92"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:27:13.105889 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:13.105765    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a47f5fd0-b185-452e-884f-439722a70f92-kube-api-access-tvq9v" (OuterVolumeSpecName: "kube-api-access-tvq9v") pod "a47f5fd0-b185-452e-884f-439722a70f92" (UID: "a47f5fd0-b185-452e-884f-439722a70f92"). InnerVolumeSpecName "kube-api-access-tvq9v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:27:13.205210 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:13.205178    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a47f5fd0-b185-452e-884f-439722a70f92-maas-api-tls\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:27:13.205210 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:13.205208    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a47f5fd0-b185-452e-884f-439722a70f92-openshift-service-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:27:13.205474 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:13.205224    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvq9v\" (UniqueName: \"kubernetes.io/projected/a47f5fd0-b185-452e-884f-439722a70f92-kube-api-access-tvq9v\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:27:13.315033 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:13.314996    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn"]
Jul 07 14:27:13.318783 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:13.318755    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-2f1f0536-57b9976b4c-prhrn"]
Jul 07 14:27:15.075862 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:15.075825    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a47f5fd0-b185-452e-884f-439722a70f92" path="/var/lib/kubelet/pods/a47f5fd0-b185-452e-884f-439722a70f92/volumes"
Jul 07 14:27:19.016363 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:19.016284    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:19.113138 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:19.113099    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:19.289344 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:19.289268    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:19.530893 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:19.530863    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:19.663933 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:19.663841    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:19.762007 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:19.761979    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:19.895655 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:19.895625    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:25.763128 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:25.763098    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:25.866931 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:25.866880    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:25.983735 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:25.983698    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:26.104183 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:26.104101    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:31.931081 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:31.931047    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:32.030913 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:32.030880    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:38.848259 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:38.848225    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:39.239114 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:39.239078    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:39.598137 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:39.598029    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:42.461595 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:42.461563    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:42.549571 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:42.549536    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29"]
Jul 07 14:27:42.550010 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:42.549997    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a47f5fd0-b185-452e-884f-439722a70f92" containerName="maas-api"
Jul 07 14:27:42.550060 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:42.550011    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a47f5fd0-b185-452e-884f-439722a70f92" containerName="maas-api"
Jul 07 14:27:42.550112 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:42.550103    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a47f5fd0-b185-452e-884f-439722a70f92" containerName="maas-api"
Jul 07 14:27:42.553467 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:42.553446    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29"
Jul 07 14:27:42.556546 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:42.556525    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-9a9d5643-serving-cert\""
Jul 07 14:27:42.559481 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:42.559460    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:42.565380 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:42.565355    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29"]
Jul 07 14:27:42.655995 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:42.655957    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:42.675194 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:42.675160    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7afa5bdb-430b-4a52-bba0-3f50a3bdaa38-openshift-service-ca\") pod \"maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29\" (UID: \"7afa5bdb-430b-4a52-bba0-3f50a3bdaa38\") " pod="opendatahub/maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29"
Jul 07 14:27:42.675373 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:42.675209    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7afa5bdb-430b-4a52-bba0-3f50a3bdaa38-maas-api-tls\") pod \"maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29\" (UID: \"7afa5bdb-430b-4a52-bba0-3f50a3bdaa38\") " pod="opendatahub/maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29"
Jul 07 14:27:42.675373 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:42.675263    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ww78\" (UniqueName: \"kubernetes.io/projected/7afa5bdb-430b-4a52-bba0-3f50a3bdaa38-kube-api-access-6ww78\") pod \"maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29\" (UID: \"7afa5bdb-430b-4a52-bba0-3f50a3bdaa38\") " pod="opendatahub/maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29"
Jul 07 14:27:42.776258 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:42.776173    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7afa5bdb-430b-4a52-bba0-3f50a3bdaa38-openshift-service-ca\") pod \"maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29\" (UID: \"7afa5bdb-430b-4a52-bba0-3f50a3bdaa38\") " pod="opendatahub/maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29"
Jul 07 14:27:42.776258 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:42.776221    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7afa5bdb-430b-4a52-bba0-3f50a3bdaa38-maas-api-tls\") pod \"maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29\" (UID: \"7afa5bdb-430b-4a52-bba0-3f50a3bdaa38\") " pod="opendatahub/maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29"
Jul 07 14:27:42.776462 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:42.776266    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ww78\" (UniqueName: \"kubernetes.io/projected/7afa5bdb-430b-4a52-bba0-3f50a3bdaa38-kube-api-access-6ww78\") pod \"maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29\" (UID: \"7afa5bdb-430b-4a52-bba0-3f50a3bdaa38\") " pod="opendatahub/maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29"
Jul 07 14:27:42.776462 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:27:42.776399    2576 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-9a9d5643-serving-cert: secret "maas-api-e2e-mt-9a9d5643-serving-cert" not found
Jul 07 14:27:42.776543 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:27:42.776479    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7afa5bdb-430b-4a52-bba0-3f50a3bdaa38-maas-api-tls podName:7afa5bdb-430b-4a52-bba0-3f50a3bdaa38 nodeName:}" failed. No retries permitted until 2026-07-07 14:27:43.276458972 +0000 UTC m=+1728.888737939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7afa5bdb-430b-4a52-bba0-3f50a3bdaa38-maas-api-tls") pod "maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29" (UID: "7afa5bdb-430b-4a52-bba0-3f50a3bdaa38") : secret "maas-api-e2e-mt-9a9d5643-serving-cert" not found
Jul 07 14:27:42.776832 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:42.776812    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7afa5bdb-430b-4a52-bba0-3f50a3bdaa38-openshift-service-ca\") pod \"maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29\" (UID: \"7afa5bdb-430b-4a52-bba0-3f50a3bdaa38\") " pod="opendatahub/maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29"
Jul 07 14:27:42.786990 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:42.786959    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ww78\" (UniqueName: \"kubernetes.io/projected/7afa5bdb-430b-4a52-bba0-3f50a3bdaa38-kube-api-access-6ww78\") pod \"maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29\" (UID: \"7afa5bdb-430b-4a52-bba0-3f50a3bdaa38\") " pod="opendatahub/maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29"
Jul 07 14:27:42.838402 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:42.838360    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:43.023817 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:43.023784    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:43.124431 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:43.124344    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:43.280901 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:43.280863    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7afa5bdb-430b-4a52-bba0-3f50a3bdaa38-maas-api-tls\") pod \"maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29\" (UID: \"7afa5bdb-430b-4a52-bba0-3f50a3bdaa38\") " pod="opendatahub/maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29"
Jul 07 14:27:43.283293 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:43.283274    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7afa5bdb-430b-4a52-bba0-3f50a3bdaa38-maas-api-tls\") pod \"maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29\" (UID: \"7afa5bdb-430b-4a52-bba0-3f50a3bdaa38\") " pod="opendatahub/maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29"
Jul 07 14:27:43.463808 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:43.463761    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29"
Jul 07 14:27:43.606401 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:43.606377    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29"]
Jul 07 14:27:43.609888 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:27:43.609851    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7afa5bdb_430b_4a52_bba0_3f50a3bdaa38.slice/crio-8f33a0447f806c7e072e1689f77ef5d7527e736b35094ebf4b564205ab6057a7 WatchSource:0}: Error finding container 8f33a0447f806c7e072e1689f77ef5d7527e736b35094ebf4b564205ab6057a7: Status 404 returned error can't find the container with id 8f33a0447f806c7e072e1689f77ef5d7527e736b35094ebf4b564205ab6057a7
Jul 07 14:27:44.154484 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:44.154453    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29" event={"ID":"7afa5bdb-430b-4a52-bba0-3f50a3bdaa38","Type":"ContainerStarted","Data":"8f33a0447f806c7e072e1689f77ef5d7527e736b35094ebf4b564205ab6057a7"}
Jul 07 14:27:45.160670 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:45.160638    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29" event={"ID":"7afa5bdb-430b-4a52-bba0-3f50a3bdaa38","Type":"ContainerStarted","Data":"f0b1314fe404c8927e171eb6ead390fb863a03ba0f37e0ac4e895e790b1d91fb"}
Jul 07 14:27:45.161226 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:45.160746    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29"
Jul 07 14:27:45.182249 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:45.182195    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29" podStartSLOduration=2.582209831 podStartE2EDuration="3.182178451s" totalImagesPullingTime="599.96862ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:27:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:27:45.180628794 +0000 UTC m=+1730.792907805" watchObservedRunningTime="2026-07-07 14:27:45.182178451 +0000 UTC m=+1730.794457422"
Jul 07 14:27:47.001121 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:47.001089    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:27:51.171007 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:51.170974    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29"
Jul 07 14:27:56.295496 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:27:56.295459    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:28:16.289934 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:28:16.289896    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:28:16.394871 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:28:16.394805    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:28:19.534484 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:28:19.534446    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:28:20.076532 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:28:20.076500    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:28:20.193089 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:28:20.193059    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:28:20.314767 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:28:20.314727    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29"]
Jul 07 14:28:20.314767 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:28:20.315090    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29" podUID="7afa5bdb-430b-4a52-bba0-3f50a3bdaa38" containerName="maas-api" containerID="cri-o://f0b1314fe404c8927e171eb6ead390fb863a03ba0f37e0ac4e895e790b1d91fb" gracePeriod=30
Jul 07 14:28:20.358591 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:28:20.358555    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:28:20.576500 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:28:20.576474    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29"
Jul 07 14:28:20.624591 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:28:20.624503    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ww78\" (UniqueName: \"kubernetes.io/projected/7afa5bdb-430b-4a52-bba0-3f50a3bdaa38-kube-api-access-6ww78\") pod \"7afa5bdb-430b-4a52-bba0-3f50a3bdaa38\" (UID: \"7afa5bdb-430b-4a52-bba0-3f50a3bdaa38\") "
Jul 07 14:28:20.624591 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:28:20.624582    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7afa5bdb-430b-4a52-bba0-3f50a3bdaa38-openshift-service-ca\") pod \"7afa5bdb-430b-4a52-bba0-3f50a3bdaa38\" (UID: \"7afa5bdb-430b-4a52-bba0-3f50a3bdaa38\") "
Jul 07 14:28:20.624828 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:28:20.624616    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7afa5bdb-430b-4a52-bba0-3f50a3bdaa38-maas-api-tls\") pod \"7afa5bdb-430b-4a52-bba0-3f50a3bdaa38\" (UID: \"7afa5bdb-430b-4a52-bba0-3f50a3bdaa38\") "
Jul 07 14:28:20.625037 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:28:20.625002    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7afa5bdb-430b-4a52-bba0-3f50a3bdaa38-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7afa5bdb-430b-4a52-bba0-3f50a3bdaa38" (UID: "7afa5bdb-430b-4a52-bba0-3f50a3bdaa38"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:28:20.626730 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:28:20.626701    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7afa5bdb-430b-4a52-bba0-3f50a3bdaa38-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7afa5bdb-430b-4a52-bba0-3f50a3bdaa38" (UID: "7afa5bdb-430b-4a52-bba0-3f50a3bdaa38"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:28:20.626845 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:28:20.626819    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7afa5bdb-430b-4a52-bba0-3f50a3bdaa38-kube-api-access-6ww78" (OuterVolumeSpecName: "kube-api-access-6ww78") pod "7afa5bdb-430b-4a52-bba0-3f50a3bdaa38" (UID: "7afa5bdb-430b-4a52-bba0-3f50a3bdaa38"). InnerVolumeSpecName "kube-api-access-6ww78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:28:20.725518 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:28:20.725484    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ww78\" (UniqueName: \"kubernetes.io/projected/7afa5bdb-430b-4a52-bba0-3f50a3bdaa38-kube-api-access-6ww78\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:28:20.725518 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:28:20.725512    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7afa5bdb-430b-4a52-bba0-3f50a3bdaa38-openshift-service-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:28:20.725518 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:28:20.725522    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7afa5bdb-430b-4a52-bba0-3f50a3bdaa38-maas-api-tls\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:28:21.351111 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:28:21.351022    2576 generic.go:356] "Generic (PLEG): container finished" podID="7afa5bdb-430b-4a52-bba0-3f50a3bdaa38" containerID="f0b1314fe404c8927e171eb6ead390fb863a03ba0f37e0ac4e895e790b1d91fb" exitCode=0
Jul 07 14:28:21.351111 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:28:21.351091    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29"
Jul 07 14:28:21.351300 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:28:21.351103    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29" event={"ID":"7afa5bdb-430b-4a52-bba0-3f50a3bdaa38","Type":"ContainerDied","Data":"f0b1314fe404c8927e171eb6ead390fb863a03ba0f37e0ac4e895e790b1d91fb"}
Jul 07 14:28:21.351300 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:28:21.351179    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29" event={"ID":"7afa5bdb-430b-4a52-bba0-3f50a3bdaa38","Type":"ContainerDied","Data":"8f33a0447f806c7e072e1689f77ef5d7527e736b35094ebf4b564205ab6057a7"}
Jul 07 14:28:21.351300 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:28:21.351255    2576 scope.go:117] "RemoveContainer" containerID="f0b1314fe404c8927e171eb6ead390fb863a03ba0f37e0ac4e895e790b1d91fb"
Jul 07 14:28:21.360410 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:28:21.360381    2576 scope.go:117] "RemoveContainer" containerID="f0b1314fe404c8927e171eb6ead390fb863a03ba0f37e0ac4e895e790b1d91fb"
Jul 07 14:28:21.360672 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:28:21.360653    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0b1314fe404c8927e171eb6ead390fb863a03ba0f37e0ac4e895e790b1d91fb\": container with ID starting with f0b1314fe404c8927e171eb6ead390fb863a03ba0f37e0ac4e895e790b1d91fb not found: ID does not exist" containerID="f0b1314fe404c8927e171eb6ead390fb863a03ba0f37e0ac4e895e790b1d91fb"
Jul 07 14:28:21.360730 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:28:21.360682    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0b1314fe404c8927e171eb6ead390fb863a03ba0f37e0ac4e895e790b1d91fb"} err="failed to get container status \"f0b1314fe404c8927e171eb6ead390fb863a03ba0f37e0ac4e895e790b1d91fb\": rpc error: code = NotFound desc = could not find container \"f0b1314fe404c8927e171eb6ead390fb863a03ba0f37e0ac4e895e790b1d91fb\": container with ID starting with f0b1314fe404c8927e171eb6ead390fb863a03ba0f37e0ac4e895e790b1d91fb not found: ID does not exist"
Jul 07 14:28:21.370218 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:28:21.370195    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29"]
Jul 07 14:28:21.376894 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:28:21.376872    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-9a9d5643-75cf99b9c9-5dw29"]
Jul 07 14:28:23.075823 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:28:23.075789    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7afa5bdb-430b-4a52-bba0-3f50a3bdaa38" path="/var/lib/kubelet/pods/7afa5bdb-430b-4a52-bba0-3f50a3bdaa38/volumes"
Jul 07 14:28:25.626426 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:28:25.626397    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:28:30.700086 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:28:30.700053    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:28:55.034824 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:28:55.034694    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bglbr_d36dada3-7ddc-4de9-a1d5-62ff1f867dd9/console-operator/1.log"
Jul 07 14:28:55.041059 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:28:55.040283    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bglbr_d36dada3-7ddc-4de9-a1d5-62ff1f867dd9/console-operator/1.log"
Jul 07 14:28:55.041059 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:28:55.040969    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zdfvw_9bcfc7b3-a523-42e2-add9-c7f0f1e187ce/ovn-acl-logging/0.log"
Jul 07 14:28:55.045923 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:28:55.045902    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zdfvw_9bcfc7b3-a523-42e2-add9-c7f0f1e187ce/ovn-acl-logging/0.log"
Jul 07 14:29:07.365171 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:29:07.365121    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:29:08.043613 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:29:08.043580    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:29:13.559561 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:29:13.559500    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:29:13.663409 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:29:13.663367    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:29:13.892974 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:29:13.892868    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:29:14.142305 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:29:14.142261    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:29:15.301569 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:29:15.301527    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:29:15.390011 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:29:15.389971    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:29:15.497107 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:29:15.497063    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:29:16.333293 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:29:16.333261    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:29:16.470245 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:29:16.470215    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:29:18.048306 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:29:18.048269    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:29:24.127163 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:29:24.127128    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:29:24.225778 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:29:24.225745    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:29:24.819484 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:29:24.819450    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:29:30.864916 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:29:30.864882    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:29:30.943853 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:29:30.943816    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:29:31.059270 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:29:31.059240    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:29:41.770910 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:29:41.770862    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:29:42.016250 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:29:42.016215    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:30:03.088831 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:03.088793    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:30:09.115244 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:09.115207    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:30:09.222322 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:09.222288    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:30:09.515753 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:09.515721    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:30:09.879814 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:09.879723    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:30:10.844609 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:10.844577    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:30:11.376888 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:11.376850    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:30:11.476956 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:11.476920    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:30:13.268032 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:13.267896    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:30:13.345645 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:13.345614    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd"]
Jul 07 14:30:13.346061 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:13.346047    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7afa5bdb-430b-4a52-bba0-3f50a3bdaa38" containerName="maas-api"
Jul 07 14:30:13.346061 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:13.346062    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7afa5bdb-430b-4a52-bba0-3f50a3bdaa38" containerName="maas-api"
Jul 07 14:30:13.346161 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:13.346145    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7afa5bdb-430b-4a52-bba0-3f50a3bdaa38" containerName="maas-api"
Jul 07 14:30:13.349340 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:13.349322    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd"
Jul 07 14:30:13.352386 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:13.352365    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-8dd42e-serving-cert\""
Jul 07 14:30:13.363518 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:13.363490    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd"]
Jul 07 14:30:13.370755 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:13.370724    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:30:13.470690 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:13.470658    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4819b395-0193-4a60-abb9-41692ee84d3c-maas-api-tls\") pod \"maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd\" (UID: \"4819b395-0193-4a60-abb9-41692ee84d3c\") " pod="opendatahub/maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd"
Jul 07 14:30:13.470891 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:13.470712    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4819b395-0193-4a60-abb9-41692ee84d3c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd\" (UID: \"4819b395-0193-4a60-abb9-41692ee84d3c\") " pod="opendatahub/maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd"
Jul 07 14:30:13.470891 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:13.470745    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz26k\" (UniqueName: \"kubernetes.io/projected/4819b395-0193-4a60-abb9-41692ee84d3c-kube-api-access-nz26k\") pod \"maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd\" (UID: \"4819b395-0193-4a60-abb9-41692ee84d3c\") " pod="opendatahub/maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd"
Jul 07 14:30:13.502872 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:13.502837    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:30:13.572338 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:13.572236    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4819b395-0193-4a60-abb9-41692ee84d3c-maas-api-tls\") pod \"maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd\" (UID: \"4819b395-0193-4a60-abb9-41692ee84d3c\") " pod="opendatahub/maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd"
Jul 07 14:30:13.572569 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:30:13.572463    2576 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-a-8dd42e-serving-cert: secret "maas-api-e2e-inf-a-8dd42e-serving-cert" not found
Jul 07 14:30:13.572752 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:13.572725    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4819b395-0193-4a60-abb9-41692ee84d3c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd\" (UID: \"4819b395-0193-4a60-abb9-41692ee84d3c\") " pod="opendatahub/maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd"
Jul 07 14:30:13.572752 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:30:13.572750    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4819b395-0193-4a60-abb9-41692ee84d3c-maas-api-tls podName:4819b395-0193-4a60-abb9-41692ee84d3c nodeName:}" failed. No retries permitted until 2026-07-07 14:30:14.072726756 +0000 UTC m=+1879.685005722 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4819b395-0193-4a60-abb9-41692ee84d3c-maas-api-tls") pod "maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd" (UID: "4819b395-0193-4a60-abb9-41692ee84d3c") : secret "maas-api-e2e-inf-a-8dd42e-serving-cert" not found
Jul 07 14:30:13.572958 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:13.572788    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz26k\" (UniqueName: \"kubernetes.io/projected/4819b395-0193-4a60-abb9-41692ee84d3c-kube-api-access-nz26k\") pod \"maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd\" (UID: \"4819b395-0193-4a60-abb9-41692ee84d3c\") " pod="opendatahub/maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd"
Jul 07 14:30:13.573500 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:13.573478    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4819b395-0193-4a60-abb9-41692ee84d3c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd\" (UID: \"4819b395-0193-4a60-abb9-41692ee84d3c\") " pod="opendatahub/maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd"
Jul 07 14:30:13.590315 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:13.590291    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz26k\" (UniqueName: \"kubernetes.io/projected/4819b395-0193-4a60-abb9-41692ee84d3c-kube-api-access-nz26k\") pod \"maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd\" (UID: \"4819b395-0193-4a60-abb9-41692ee84d3c\") " pod="opendatahub/maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd"
Jul 07 14:30:13.689267 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:13.689232    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:30:14.047982 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:14.047925    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:30:14.077336 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:14.077302    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4819b395-0193-4a60-abb9-41692ee84d3c-maas-api-tls\") pod \"maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd\" (UID: \"4819b395-0193-4a60-abb9-41692ee84d3c\") " pod="opendatahub/maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd"
Jul 07 14:30:14.079671 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:14.079648    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4819b395-0193-4a60-abb9-41692ee84d3c-maas-api-tls\") pod \"maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd\" (UID: \"4819b395-0193-4a60-abb9-41692ee84d3c\") " pod="opendatahub/maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd"
Jul 07 14:30:14.158100 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:14.158064    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:30:14.260580 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:14.260543    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd"
Jul 07 14:30:14.407959 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:14.407912    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd"]
Jul 07 14:30:14.408511 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:30:14.408488    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4819b395_0193_4a60_abb9_41692ee84d3c.slice/crio-cbf3c910bf12ac3909df2f52f7c9ce4a468829d36021401fbf85bbcde669f429 WatchSource:0}: Error finding container cbf3c910bf12ac3909df2f52f7c9ce4a468829d36021401fbf85bbcde669f429: Status 404 returned error can't find the container with id cbf3c910bf12ac3909df2f52f7c9ce4a468829d36021401fbf85bbcde669f429
Jul 07 14:30:14.410011 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:14.409991    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 14:30:14.952225 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:14.952190    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd" event={"ID":"4819b395-0193-4a60-abb9-41692ee84d3c","Type":"ContainerStarted","Data":"cbf3c910bf12ac3909df2f52f7c9ce4a468829d36021401fbf85bbcde669f429"}
Jul 07 14:30:15.959004 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:15.958968    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd" event={"ID":"4819b395-0193-4a60-abb9-41692ee84d3c","Type":"ContainerStarted","Data":"1534c2073c26b00dd370f68ce1545f62f5fd4b212b4e3127fc9285ec21a5cb50"}
Jul 07 14:30:15.959452 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:15.959096    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd"
Jul 07 14:30:15.986417 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:15.986355    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd" podStartSLOduration=2.471882475 podStartE2EDuration="2.98633456s" totalImagesPullingTime="514.452085ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:30:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:30:15.985513537 +0000 UTC m=+1881.597792509" watchObservedRunningTime="2026-07-07 14:30:15.98633456 +0000 UTC m=+1881.598613534"
Jul 07 14:30:17.807201 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:17.807117    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:30:18.172484 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:18.172405    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:30:18.530907 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:18.530875    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:30:18.891253 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:18.891166    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:30:21.363002 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:21.362925    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:30:21.434170 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:21.434126    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-b9e929-5879855855-sx7qz"]
Jul 07 14:30:21.438758 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:21.438739    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-b9e929-5879855855-sx7qz"
Jul 07 14:30:21.442909 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:21.442886    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-b9e929-serving-cert\""
Jul 07 14:30:21.450056 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:21.450031    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-b9e929-5879855855-sx7qz"]
Jul 07 14:30:21.469218 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:21.469186    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:30:21.548516 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:21.548476    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcfbc\" (UniqueName: \"kubernetes.io/projected/38d5e1ed-bea1-4231-8974-dfc1c6e1b59d-kube-api-access-lcfbc\") pod \"maas-api-e2e-inf-b-b9e929-5879855855-sx7qz\" (UID: \"38d5e1ed-bea1-4231-8974-dfc1c6e1b59d\") " pod="opendatahub/maas-api-e2e-inf-b-b9e929-5879855855-sx7qz"
Jul 07 14:30:21.548719 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:21.548528    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38d5e1ed-bea1-4231-8974-dfc1c6e1b59d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-b9e929-5879855855-sx7qz\" (UID: \"38d5e1ed-bea1-4231-8974-dfc1c6e1b59d\") " pod="opendatahub/maas-api-e2e-inf-b-b9e929-5879855855-sx7qz"
Jul 07 14:30:21.548719 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:21.548657    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38d5e1ed-bea1-4231-8974-dfc1c6e1b59d-maas-api-tls\") pod \"maas-api-e2e-inf-b-b9e929-5879855855-sx7qz\" (UID: \"38d5e1ed-bea1-4231-8974-dfc1c6e1b59d\") " pod="opendatahub/maas-api-e2e-inf-b-b9e929-5879855855-sx7qz"
Jul 07 14:30:21.570337 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:21.570309    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:30:21.650050 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:21.649929    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcfbc\" (UniqueName: \"kubernetes.io/projected/38d5e1ed-bea1-4231-8974-dfc1c6e1b59d-kube-api-access-lcfbc\") pod \"maas-api-e2e-inf-b-b9e929-5879855855-sx7qz\" (UID: \"38d5e1ed-bea1-4231-8974-dfc1c6e1b59d\") " pod="opendatahub/maas-api-e2e-inf-b-b9e929-5879855855-sx7qz"
Jul 07 14:30:21.650050 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:21.650011    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38d5e1ed-bea1-4231-8974-dfc1c6e1b59d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-b9e929-5879855855-sx7qz\" (UID: \"38d5e1ed-bea1-4231-8974-dfc1c6e1b59d\") " pod="opendatahub/maas-api-e2e-inf-b-b9e929-5879855855-sx7qz"
Jul 07 14:30:21.650288 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:21.650129    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38d5e1ed-bea1-4231-8974-dfc1c6e1b59d-maas-api-tls\") pod \"maas-api-e2e-inf-b-b9e929-5879855855-sx7qz\" (UID: \"38d5e1ed-bea1-4231-8974-dfc1c6e1b59d\") " pod="opendatahub/maas-api-e2e-inf-b-b9e929-5879855855-sx7qz"
Jul 07 14:30:21.650670 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:21.650638    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38d5e1ed-bea1-4231-8974-dfc1c6e1b59d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-b9e929-5879855855-sx7qz\" (UID: \"38d5e1ed-bea1-4231-8974-dfc1c6e1b59d\") " pod="opendatahub/maas-api-e2e-inf-b-b9e929-5879855855-sx7qz"
Jul 07 14:30:21.652758 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:21.652726    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38d5e1ed-bea1-4231-8974-dfc1c6e1b59d-maas-api-tls\") pod \"maas-api-e2e-inf-b-b9e929-5879855855-sx7qz\" (UID: \"38d5e1ed-bea1-4231-8974-dfc1c6e1b59d\") " pod="opendatahub/maas-api-e2e-inf-b-b9e929-5879855855-sx7qz"
Jul 07 14:30:21.659415 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:21.659390    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcfbc\" (UniqueName: \"kubernetes.io/projected/38d5e1ed-bea1-4231-8974-dfc1c6e1b59d-kube-api-access-lcfbc\") pod \"maas-api-e2e-inf-b-b9e929-5879855855-sx7qz\" (UID: \"38d5e1ed-bea1-4231-8974-dfc1c6e1b59d\") " pod="opendatahub/maas-api-e2e-inf-b-b9e929-5879855855-sx7qz"
Jul 07 14:30:21.668948 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:21.668911    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:30:21.750279 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:21.750228    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-b9e929-5879855855-sx7qz"
Jul 07 14:30:21.897903 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:21.897872    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-b9e929-5879855855-sx7qz"]
Jul 07 14:30:21.899399 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:30:21.899374    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38d5e1ed_bea1_4231_8974_dfc1c6e1b59d.slice/crio-1d15296689e3b35f8774d30e997cd5956d1188b5aa3e784c7753cc1d80a85f94 WatchSource:0}: Error finding container 1d15296689e3b35f8774d30e997cd5956d1188b5aa3e784c7753cc1d80a85f94: Status 404 returned error can't find the container with id 1d15296689e3b35f8774d30e997cd5956d1188b5aa3e784c7753cc1d80a85f94
Jul 07 14:30:21.970344 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:21.970306    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd"
Jul 07 14:30:21.990562 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:21.990533    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-b9e929-5879855855-sx7qz" event={"ID":"38d5e1ed-bea1-4231-8974-dfc1c6e1b59d","Type":"ContainerStarted","Data":"1d15296689e3b35f8774d30e997cd5956d1188b5aa3e784c7753cc1d80a85f94"}
Jul 07 14:30:22.159523 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:22.159441    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:30:22.257443 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:22.257411    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:30:22.997085 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:22.997048    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-b9e929-5879855855-sx7qz" event={"ID":"38d5e1ed-bea1-4231-8974-dfc1c6e1b59d","Type":"ContainerStarted","Data":"8fbe38b8eb242011e0a6aeaa73d5a28de447ea9c2c4b25a50f6188dc6f33c1d3"}
Jul 07 14:30:22.997587 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:22.997114    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-b9e929-5879855855-sx7qz"
Jul 07 14:30:23.017464 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:23.017415    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-b9e929-5879855855-sx7qz" podStartSLOduration=1.581013949 podStartE2EDuration="2.017390132s" totalImagesPullingTime="436.376183ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:30:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:30:23.016249889 +0000 UTC m=+1888.628528893" watchObservedRunningTime="2026-07-07 14:30:23.017390132 +0000 UTC m=+1888.629669103"
Jul 07 14:30:25.914633 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:25.914593    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:30:29.015190 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:29.015157    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-b9e929-5879855855-sx7qz"
Jul 07 14:30:33.047853 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:33.047821    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:30:35.651461 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:35.651403    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:30:35.753115 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:35.753079    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:30:44.068114 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:44.068076    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:30:44.168777 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:30:44.168740    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:31:15.778318 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:31:15.778266    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:31:35.295281 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:31:35.295238    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:31:36.214993 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:31:36.214964    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:31:36.369722 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:31:36.369680    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:31:36.817820 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:31:36.817786    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:31:37.059965 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:31:37.059909    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:31:37.160172 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:31:37.160062    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:31:37.330871 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:31:37.330841    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd"]
Jul 07 14:31:37.331095 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:31:37.331073    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd" podUID="4819b395-0193-4a60-abb9-41692ee84d3c" containerName="maas-api" containerID="cri-o://1534c2073c26b00dd370f68ce1545f62f5fd4b212b4e3127fc9285ec21a5cb50" gracePeriod=30
Jul 07 14:31:37.350533 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:31:37.350508    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:31:37.594871 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:31:37.594849    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd"
Jul 07 14:31:37.624474 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:31:37.624445    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4819b395-0193-4a60-abb9-41692ee84d3c-maas-api-tls\") pod \"4819b395-0193-4a60-abb9-41692ee84d3c\" (UID: \"4819b395-0193-4a60-abb9-41692ee84d3c\") "
Jul 07 14:31:37.624611 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:31:37.624511    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nz26k\" (UniqueName: \"kubernetes.io/projected/4819b395-0193-4a60-abb9-41692ee84d3c-kube-api-access-nz26k\") pod \"4819b395-0193-4a60-abb9-41692ee84d3c\" (UID: \"4819b395-0193-4a60-abb9-41692ee84d3c\") "
Jul 07 14:31:37.624611 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:31:37.624534    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4819b395-0193-4a60-abb9-41692ee84d3c-openshift-service-ca\") pod \"4819b395-0193-4a60-abb9-41692ee84d3c\" (UID: \"4819b395-0193-4a60-abb9-41692ee84d3c\") "
Jul 07 14:31:37.624956 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:31:37.624920    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4819b395-0193-4a60-abb9-41692ee84d3c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4819b395-0193-4a60-abb9-41692ee84d3c" (UID: "4819b395-0193-4a60-abb9-41692ee84d3c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:31:37.626643 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:31:37.626617    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4819b395-0193-4a60-abb9-41692ee84d3c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4819b395-0193-4a60-abb9-41692ee84d3c" (UID: "4819b395-0193-4a60-abb9-41692ee84d3c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:31:37.627082 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:31:37.627054    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4819b395-0193-4a60-abb9-41692ee84d3c-kube-api-access-nz26k" (OuterVolumeSpecName: "kube-api-access-nz26k") pod "4819b395-0193-4a60-abb9-41692ee84d3c" (UID: "4819b395-0193-4a60-abb9-41692ee84d3c"). InnerVolumeSpecName "kube-api-access-nz26k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:31:37.725319 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:31:37.725228    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4819b395-0193-4a60-abb9-41692ee84d3c-maas-api-tls\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:31:37.725319 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:31:37.725259    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nz26k\" (UniqueName: \"kubernetes.io/projected/4819b395-0193-4a60-abb9-41692ee84d3c-kube-api-access-nz26k\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:31:37.725319 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:31:37.725268    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4819b395-0193-4a60-abb9-41692ee84d3c-openshift-service-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:31:38.416212 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:31:38.416175    2576 generic.go:356] "Generic (PLEG): container finished" podID="4819b395-0193-4a60-abb9-41692ee84d3c" containerID="1534c2073c26b00dd370f68ce1545f62f5fd4b212b4e3127fc9285ec21a5cb50" exitCode=0
Jul 07 14:31:38.416501 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:31:38.416240    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd"
Jul 07 14:31:38.416501 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:31:38.416259    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd" event={"ID":"4819b395-0193-4a60-abb9-41692ee84d3c","Type":"ContainerDied","Data":"1534c2073c26b00dd370f68ce1545f62f5fd4b212b4e3127fc9285ec21a5cb50"}
Jul 07 14:31:38.416501 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:31:38.416318    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd" event={"ID":"4819b395-0193-4a60-abb9-41692ee84d3c","Type":"ContainerDied","Data":"cbf3c910bf12ac3909df2f52f7c9ce4a468829d36021401fbf85bbcde669f429"}
Jul 07 14:31:38.416501 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:31:38.416341    2576 scope.go:117] "RemoveContainer" containerID="1534c2073c26b00dd370f68ce1545f62f5fd4b212b4e3127fc9285ec21a5cb50"
Jul 07 14:31:38.429455 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:31:38.429437    2576 scope.go:117] "RemoveContainer" containerID="1534c2073c26b00dd370f68ce1545f62f5fd4b212b4e3127fc9285ec21a5cb50"
Jul 07 14:31:38.429770 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:31:38.429743    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1534c2073c26b00dd370f68ce1545f62f5fd4b212b4e3127fc9285ec21a5cb50\": container with ID starting with 1534c2073c26b00dd370f68ce1545f62f5fd4b212b4e3127fc9285ec21a5cb50 not found: ID does not exist" containerID="1534c2073c26b00dd370f68ce1545f62f5fd4b212b4e3127fc9285ec21a5cb50"
Jul 07 14:31:38.429831 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:31:38.429784    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1534c2073c26b00dd370f68ce1545f62f5fd4b212b4e3127fc9285ec21a5cb50"} err="failed to get container status \"1534c2073c26b00dd370f68ce1545f62f5fd4b212b4e3127fc9285ec21a5cb50\": rpc error: code = NotFound desc = could not find container \"1534c2073c26b00dd370f68ce1545f62f5fd4b212b4e3127fc9285ec21a5cb50\": container with ID starting with 1534c2073c26b00dd370f68ce1545f62f5fd4b212b4e3127fc9285ec21a5cb50 not found: ID does not exist"
Jul 07 14:31:38.437420 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:31:38.437389    2576 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4819b395_0193_4a60_abb9_41692ee84d3c.slice/crio-cbf3c910bf12ac3909df2f52f7c9ce4a468829d36021401fbf85bbcde669f429\": RecentStats: unable to find data in memory cache]"
Jul 07 14:31:38.437548 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:31:38.437476    2576 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4819b395_0193_4a60_abb9_41692ee84d3c.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4819b395_0193_4a60_abb9_41692ee84d3c.slice/crio-cbf3c910bf12ac3909df2f52f7c9ce4a468829d36021401fbf85bbcde669f429\": RecentStats: unable to find data in memory cache]"
Jul 07 14:31:38.446509 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:31:38.446484    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd"]
Jul 07 14:31:38.452043 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:31:38.452021    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-8dd42e-c944498bc-tz8dd"]
Jul 07 14:31:39.075902 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:31:39.075867    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4819b395-0193-4a60-abb9-41692ee84d3c" path="/var/lib/kubelet/pods/4819b395-0193-4a60-abb9-41692ee84d3c/volumes"
Jul 07 14:31:41.878697 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:31:41.878666    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:06.351526 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:06.351495    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:06.451869 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:06.451840    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:19.045469 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:19.045435    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:19.399287 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:19.399200    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:19.647277 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:19.647244    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:19.812894 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:19.812858    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:20.249958 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:20.249903    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:20.351769 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:20.351733    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:20.456302 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:20.456269    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:20.532724 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:20.532647    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-b9e929-5879855855-sx7qz"]
Jul 07 14:32:20.532892 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:20.532863    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-b9e929-5879855855-sx7qz" podUID="38d5e1ed-bea1-4231-8974-dfc1c6e1b59d" containerName="maas-api" containerID="cri-o://8fbe38b8eb242011e0a6aeaa73d5a28de447ea9c2c4b25a50f6188dc6f33c1d3" gracePeriod=30
Jul 07 14:32:20.565871 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:20.565843    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:20.795302 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:20.795240    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-b9e929-5879855855-sx7qz"
Jul 07 14:32:20.826797 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:20.826767    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38d5e1ed-bea1-4231-8974-dfc1c6e1b59d-maas-api-tls\") pod \"38d5e1ed-bea1-4231-8974-dfc1c6e1b59d\" (UID: \"38d5e1ed-bea1-4231-8974-dfc1c6e1b59d\") "
Jul 07 14:32:20.826967 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:20.826877    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38d5e1ed-bea1-4231-8974-dfc1c6e1b59d-openshift-service-ca\") pod \"38d5e1ed-bea1-4231-8974-dfc1c6e1b59d\" (UID: \"38d5e1ed-bea1-4231-8974-dfc1c6e1b59d\") "
Jul 07 14:32:20.826967 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:20.826930    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lcfbc\" (UniqueName: \"kubernetes.io/projected/38d5e1ed-bea1-4231-8974-dfc1c6e1b59d-kube-api-access-lcfbc\") pod \"38d5e1ed-bea1-4231-8974-dfc1c6e1b59d\" (UID: \"38d5e1ed-bea1-4231-8974-dfc1c6e1b59d\") "
Jul 07 14:32:20.827298 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:20.827270    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38d5e1ed-bea1-4231-8974-dfc1c6e1b59d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "38d5e1ed-bea1-4231-8974-dfc1c6e1b59d" (UID: "38d5e1ed-bea1-4231-8974-dfc1c6e1b59d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:32:20.828874 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:20.828848    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38d5e1ed-bea1-4231-8974-dfc1c6e1b59d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "38d5e1ed-bea1-4231-8974-dfc1c6e1b59d" (UID: "38d5e1ed-bea1-4231-8974-dfc1c6e1b59d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:32:20.829025 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:20.829013    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38d5e1ed-bea1-4231-8974-dfc1c6e1b59d-kube-api-access-lcfbc" (OuterVolumeSpecName: "kube-api-access-lcfbc") pod "38d5e1ed-bea1-4231-8974-dfc1c6e1b59d" (UID: "38d5e1ed-bea1-4231-8974-dfc1c6e1b59d"). InnerVolumeSpecName "kube-api-access-lcfbc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:32:20.927651 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:20.927626    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38d5e1ed-bea1-4231-8974-dfc1c6e1b59d-maas-api-tls\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:32:20.927651 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:20.927647    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38d5e1ed-bea1-4231-8974-dfc1c6e1b59d-openshift-service-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:32:20.927651 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:20.927657    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcfbc\" (UniqueName: \"kubernetes.io/projected/38d5e1ed-bea1-4231-8974-dfc1c6e1b59d-kube-api-access-lcfbc\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:32:21.649233 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:21.649198    2576 generic.go:356] "Generic (PLEG): container finished" podID="38d5e1ed-bea1-4231-8974-dfc1c6e1b59d" containerID="8fbe38b8eb242011e0a6aeaa73d5a28de447ea9c2c4b25a50f6188dc6f33c1d3" exitCode=0
Jul 07 14:32:21.649664 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:21.649239    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-b9e929-5879855855-sx7qz"
Jul 07 14:32:21.649664 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:21.649284    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-b9e929-5879855855-sx7qz" event={"ID":"38d5e1ed-bea1-4231-8974-dfc1c6e1b59d","Type":"ContainerDied","Data":"8fbe38b8eb242011e0a6aeaa73d5a28de447ea9c2c4b25a50f6188dc6f33c1d3"}
Jul 07 14:32:21.649664 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:21.649335    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-b9e929-5879855855-sx7qz" event={"ID":"38d5e1ed-bea1-4231-8974-dfc1c6e1b59d","Type":"ContainerDied","Data":"1d15296689e3b35f8774d30e997cd5956d1188b5aa3e784c7753cc1d80a85f94"}
Jul 07 14:32:21.649664 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:21.649362    2576 scope.go:117] "RemoveContainer" containerID="8fbe38b8eb242011e0a6aeaa73d5a28de447ea9c2c4b25a50f6188dc6f33c1d3"
Jul 07 14:32:21.658365 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:21.658345    2576 scope.go:117] "RemoveContainer" containerID="8fbe38b8eb242011e0a6aeaa73d5a28de447ea9c2c4b25a50f6188dc6f33c1d3"
Jul 07 14:32:21.658621 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:32:21.658601    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fbe38b8eb242011e0a6aeaa73d5a28de447ea9c2c4b25a50f6188dc6f33c1d3\": container with ID starting with 8fbe38b8eb242011e0a6aeaa73d5a28de447ea9c2c4b25a50f6188dc6f33c1d3 not found: ID does not exist" containerID="8fbe38b8eb242011e0a6aeaa73d5a28de447ea9c2c4b25a50f6188dc6f33c1d3"
Jul 07 14:32:21.658684 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:21.658631    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fbe38b8eb242011e0a6aeaa73d5a28de447ea9c2c4b25a50f6188dc6f33c1d3"} err="failed to get container status \"8fbe38b8eb242011e0a6aeaa73d5a28de447ea9c2c4b25a50f6188dc6f33c1d3\": rpc error: code = NotFound desc = could not find container \"8fbe38b8eb242011e0a6aeaa73d5a28de447ea9c2c4b25a50f6188dc6f33c1d3\": container with ID starting with 8fbe38b8eb242011e0a6aeaa73d5a28de447ea9c2c4b25a50f6188dc6f33c1d3 not found: ID does not exist"
Jul 07 14:32:21.689452 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:21.689429    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-b9e929-5879855855-sx7qz"]
Jul 07 14:32:21.693954 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:21.693920    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-b9e929-5879855855-sx7qz"]
Jul 07 14:32:23.075042 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:23.075007    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38d5e1ed-bea1-4231-8974-dfc1c6e1b59d" path="/var/lib/kubelet/pods/38d5e1ed-bea1-4231-8974-dfc1c6e1b59d/volumes"
Jul 07 14:32:26.291669 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:26.291637    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:26.383074 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:26.383040    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:26.559615 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:26.559522    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:26.854522 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:26.854419    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:27.169710 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:27.169616    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:27.538790 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:27.538750    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:27.627877 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:27.627838    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:31.007809 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:31.007768    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:31.081178 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:31.081146    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685"]
Jul 07 14:32:31.081753 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:31.081738    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4819b395-0193-4a60-abb9-41692ee84d3c" containerName="maas-api"
Jul 07 14:32:31.081804 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:31.081757    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4819b395-0193-4a60-abb9-41692ee84d3c" containerName="maas-api"
Jul 07 14:32:31.081804 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:31.081773    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38d5e1ed-bea1-4231-8974-dfc1c6e1b59d" containerName="maas-api"
Jul 07 14:32:31.081804 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:31.081782    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="38d5e1ed-bea1-4231-8974-dfc1c6e1b59d" containerName="maas-api"
Jul 07 14:32:31.081908 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:31.081898    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4819b395-0193-4a60-abb9-41692ee84d3c" containerName="maas-api"
Jul 07 14:32:31.081955 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:31.081918    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="38d5e1ed-bea1-4231-8974-dfc1c6e1b59d" containerName="maas-api"
Jul 07 14:32:31.085478 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:31.085456    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685"
Jul 07 14:32:31.088465 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:31.088445    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-4fab5e-serving-cert\""
Jul 07 14:32:31.096711 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:31.096689    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685"]
Jul 07 14:32:31.120277 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:31.120238    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c108a347-2264-44bc-b680-ddddd463fb7d-maas-api-tls\") pod \"maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685\" (UID: \"c108a347-2264-44bc-b680-ddddd463fb7d\") " pod="opendatahub/maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685"
Jul 07 14:32:31.120427 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:31.120356    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5rfv\" (UniqueName: \"kubernetes.io/projected/c108a347-2264-44bc-b680-ddddd463fb7d-kube-api-access-n5rfv\") pod \"maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685\" (UID: \"c108a347-2264-44bc-b680-ddddd463fb7d\") " pod="opendatahub/maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685"
Jul 07 14:32:31.120516 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:31.120493    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c108a347-2264-44bc-b680-ddddd463fb7d-openshift-service-ca\") pod \"maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685\" (UID: \"c108a347-2264-44bc-b680-ddddd463fb7d\") " pod="opendatahub/maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685"
Jul 07 14:32:31.122208 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:31.122190    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:31.221122 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:31.221094    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5rfv\" (UniqueName: \"kubernetes.io/projected/c108a347-2264-44bc-b680-ddddd463fb7d-kube-api-access-n5rfv\") pod \"maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685\" (UID: \"c108a347-2264-44bc-b680-ddddd463fb7d\") " pod="opendatahub/maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685"
Jul 07 14:32:31.221332 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:31.221152    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c108a347-2264-44bc-b680-ddddd463fb7d-openshift-service-ca\") pod \"maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685\" (UID: \"c108a347-2264-44bc-b680-ddddd463fb7d\") " pod="opendatahub/maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685"
Jul 07 14:32:31.221332 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:31.221191    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c108a347-2264-44bc-b680-ddddd463fb7d-maas-api-tls\") pod \"maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685\" (UID: \"c108a347-2264-44bc-b680-ddddd463fb7d\") " pod="opendatahub/maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685"
Jul 07 14:32:31.221636 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:31.221610    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:31.221870 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:31.221840    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c108a347-2264-44bc-b680-ddddd463fb7d-openshift-service-ca\") pod \"maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685\" (UID: \"c108a347-2264-44bc-b680-ddddd463fb7d\") " pod="opendatahub/maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685"
Jul 07 14:32:31.223887 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:31.223868    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c108a347-2264-44bc-b680-ddddd463fb7d-maas-api-tls\") pod \"maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685\" (UID: \"c108a347-2264-44bc-b680-ddddd463fb7d\") " pod="opendatahub/maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685"
Jul 07 14:32:31.233604 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:31.233582    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5rfv\" (UniqueName: \"kubernetes.io/projected/c108a347-2264-44bc-b680-ddddd463fb7d-kube-api-access-n5rfv\") pod \"maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685\" (UID: \"c108a347-2264-44bc-b680-ddddd463fb7d\") " pod="opendatahub/maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685"
Jul 07 14:32:31.397175 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:31.397092    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685"
Jul 07 14:32:31.499503 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:31.499473    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:31.548300 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:31.548277    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685"]
Jul 07 14:32:31.550465 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:32:31.550437    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc108a347_2264_44bc_b680_ddddd463fb7d.slice/crio-45c5f08e312d7417f2a8ed42bf2efd5fb22da1759e044ad3cd6fe4dcc8aec654 WatchSource:0}: Error finding container 45c5f08e312d7417f2a8ed42bf2efd5fb22da1759e044ad3cd6fe4dcc8aec654: Status 404 returned error can't find the container with id 45c5f08e312d7417f2a8ed42bf2efd5fb22da1759e044ad3cd6fe4dcc8aec654
Jul 07 14:32:31.604724 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:31.604689    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:31.701762 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:31.701727    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:31.712205 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:31.712179    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685" event={"ID":"c108a347-2264-44bc-b680-ddddd463fb7d","Type":"ContainerStarted","Data":"45c5f08e312d7417f2a8ed42bf2efd5fb22da1759e044ad3cd6fe4dcc8aec654"}
Jul 07 14:32:32.719501 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:32.719464    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685" event={"ID":"c108a347-2264-44bc-b680-ddddd463fb7d","Type":"ContainerStarted","Data":"74171330b25b5e1ac2c99a470c7543b96ab4b2f66d53a5eaa15d84e9c0423a54"}
Jul 07 14:32:32.719907 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:32.719552    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685"
Jul 07 14:32:32.741201 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:32.741147    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685" podStartSLOduration=1.234892347 podStartE2EDuration="1.741130656s" totalImagesPullingTime="506.238309ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:32:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:32:32.738638851 +0000 UTC m=+2018.350917824" watchObservedRunningTime="2026-07-07 14:32:32.741130656 +0000 UTC m=+2018.353409627"
Jul 07 14:32:35.528455 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:35.528419    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:36.007489 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:36.007460    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:36.341402 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:36.341325    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:36.564779 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:36.564742    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:38.730614 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:38.730588    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685"
Jul 07 14:32:38.991159 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:38.991074    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:39.082872 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:39.082837    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:39.190714 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:39.190682    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm"]
Jul 07 14:32:39.194645 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:39.194623    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm"
Jul 07 14:32:39.198139 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:39.198114    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-8b95cf-serving-cert\""
Jul 07 14:32:39.207333 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:39.207268    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm"]
Jul 07 14:32:39.260853 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:39.260767    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:39.304141 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:39.304102    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78zmb\" (UniqueName: \"kubernetes.io/projected/5cbd92c2-907b-4ce5-9492-9e7f5869719a-kube-api-access-78zmb\") pod \"maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm\" (UID: \"5cbd92c2-907b-4ce5-9492-9e7f5869719a\") " pod="opendatahub/maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm"
Jul 07 14:32:39.304509 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:39.304194    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cbd92c2-907b-4ce5-9492-9e7f5869719a-openshift-service-ca\") pod \"maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm\" (UID: \"5cbd92c2-907b-4ce5-9492-9e7f5869719a\") " pod="opendatahub/maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm"
Jul 07 14:32:39.304509 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:39.304245    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cbd92c2-907b-4ce5-9492-9e7f5869719a-maas-api-tls\") pod \"maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm\" (UID: \"5cbd92c2-907b-4ce5-9492-9e7f5869719a\") " pod="opendatahub/maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm"
Jul 07 14:32:39.405843 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:39.405813    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78zmb\" (UniqueName: \"kubernetes.io/projected/5cbd92c2-907b-4ce5-9492-9e7f5869719a-kube-api-access-78zmb\") pod \"maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm\" (UID: \"5cbd92c2-907b-4ce5-9492-9e7f5869719a\") " pod="opendatahub/maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm"
Jul 07 14:32:39.406065 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:39.405858    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cbd92c2-907b-4ce5-9492-9e7f5869719a-openshift-service-ca\") pod \"maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm\" (UID: \"5cbd92c2-907b-4ce5-9492-9e7f5869719a\") " pod="opendatahub/maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm"
Jul 07 14:32:39.406065 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:39.405886    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cbd92c2-907b-4ce5-9492-9e7f5869719a-maas-api-tls\") pod \"maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm\" (UID: \"5cbd92c2-907b-4ce5-9492-9e7f5869719a\") " pod="opendatahub/maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm"
Jul 07 14:32:39.406548 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:39.406528    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cbd92c2-907b-4ce5-9492-9e7f5869719a-openshift-service-ca\") pod \"maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm\" (UID: \"5cbd92c2-907b-4ce5-9492-9e7f5869719a\") " pod="opendatahub/maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm"
Jul 07 14:32:39.408428 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:39.408406    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cbd92c2-907b-4ce5-9492-9e7f5869719a-maas-api-tls\") pod \"maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm\" (UID: \"5cbd92c2-907b-4ce5-9492-9e7f5869719a\") " pod="opendatahub/maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm"
Jul 07 14:32:39.419375 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:39.419353    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78zmb\" (UniqueName: \"kubernetes.io/projected/5cbd92c2-907b-4ce5-9492-9e7f5869719a-kube-api-access-78zmb\") pod \"maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm\" (UID: \"5cbd92c2-907b-4ce5-9492-9e7f5869719a\") " pod="opendatahub/maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm"
Jul 07 14:32:39.469561 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:39.469535    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:39.509362 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:39.509334    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm"
Jul 07 14:32:39.661676 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:39.661648    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm"]
Jul 07 14:32:39.663568 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:32:39.663536    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cbd92c2_907b_4ce5_9492_9e7f5869719a.slice/crio-68b646dd6c4c002f138f2c3891cbc03a0554528ea2ab9dd7914882aeee464fe8 WatchSource:0}: Error finding container 68b646dd6c4c002f138f2c3891cbc03a0554528ea2ab9dd7914882aeee464fe8: Status 404 returned error can't find the container with id 68b646dd6c4c002f138f2c3891cbc03a0554528ea2ab9dd7914882aeee464fe8
Jul 07 14:32:39.755589 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:39.755537    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:39.759010 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:39.758966    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm" event={"ID":"5cbd92c2-907b-4ce5-9492-9e7f5869719a","Type":"ContainerStarted","Data":"68b646dd6c4c002f138f2c3891cbc03a0554528ea2ab9dd7914882aeee464fe8"}
Jul 07 14:32:40.260468 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:40.260424    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:40.766488 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:40.766451    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm" event={"ID":"5cbd92c2-907b-4ce5-9492-9e7f5869719a","Type":"ContainerStarted","Data":"023d24ff74a1b4ab982d8d9d3d046e5d68c804eed17cac9f66a95493987edd96"}
Jul 07 14:32:40.766878 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:40.766577    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm"
Jul 07 14:32:40.796485 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:40.796428    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm" podStartSLOduration=1.323965687 podStartE2EDuration="1.796412335s" totalImagesPullingTime="472.446648ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:32:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:32:40.794582287 +0000 UTC m=+2026.406861276" watchObservedRunningTime="2026-07-07 14:32:40.796412335 +0000 UTC m=+2026.408691307"
Jul 07 14:32:43.523954 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:43.523918    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:46.777477 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:46.777439    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm"
Jul 07 14:32:51.736125 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:51.736090    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:52.241953 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:52.241909    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:52.341331 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:52.341305    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:52.444636 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:52.444602    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:52.569052 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:52.568969    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685"]
Jul 07 14:32:52.569244 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:52.569218    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685" podUID="c108a347-2264-44bc-b680-ddddd463fb7d" containerName="maas-api" containerID="cri-o://74171330b25b5e1ac2c99a470c7543b96ab4b2f66d53a5eaa15d84e9c0423a54" gracePeriod=30
Jul 07 14:32:52.598360 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:52.598331    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:52.831571 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:52.831492    2576 generic.go:356] "Generic (PLEG): container finished" podID="c108a347-2264-44bc-b680-ddddd463fb7d" containerID="74171330b25b5e1ac2c99a470c7543b96ab4b2f66d53a5eaa15d84e9c0423a54" exitCode=0
Jul 07 14:32:52.831965 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:52.831561    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685" event={"ID":"c108a347-2264-44bc-b680-ddddd463fb7d","Type":"ContainerDied","Data":"74171330b25b5e1ac2c99a470c7543b96ab4b2f66d53a5eaa15d84e9c0423a54"}
Jul 07 14:32:52.831965 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:52.831667    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685" event={"ID":"c108a347-2264-44bc-b680-ddddd463fb7d","Type":"ContainerDied","Data":"45c5f08e312d7417f2a8ed42bf2efd5fb22da1759e044ad3cd6fe4dcc8aec654"}
Jul 07 14:32:52.831965 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:52.831697    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="45c5f08e312d7417f2a8ed42bf2efd5fb22da1759e044ad3cd6fe4dcc8aec654"
Jul 07 14:32:52.836905 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:52.836880    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685"
Jul 07 14:32:52.934862 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:52.934830    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c108a347-2264-44bc-b680-ddddd463fb7d-openshift-service-ca\") pod \"c108a347-2264-44bc-b680-ddddd463fb7d\" (UID: \"c108a347-2264-44bc-b680-ddddd463fb7d\") "
Jul 07 14:32:52.935069 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:52.934885    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c108a347-2264-44bc-b680-ddddd463fb7d-maas-api-tls\") pod \"c108a347-2264-44bc-b680-ddddd463fb7d\" (UID: \"c108a347-2264-44bc-b680-ddddd463fb7d\") "
Jul 07 14:32:52.935069 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:52.935007    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5rfv\" (UniqueName: \"kubernetes.io/projected/c108a347-2264-44bc-b680-ddddd463fb7d-kube-api-access-n5rfv\") pod \"c108a347-2264-44bc-b680-ddddd463fb7d\" (UID: \"c108a347-2264-44bc-b680-ddddd463fb7d\") "
Jul 07 14:32:52.935497 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:52.935454    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c108a347-2264-44bc-b680-ddddd463fb7d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c108a347-2264-44bc-b680-ddddd463fb7d" (UID: "c108a347-2264-44bc-b680-ddddd463fb7d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:32:52.937375 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:52.937350    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c108a347-2264-44bc-b680-ddddd463fb7d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c108a347-2264-44bc-b680-ddddd463fb7d" (UID: "c108a347-2264-44bc-b680-ddddd463fb7d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:32:52.937375 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:52.937358    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c108a347-2264-44bc-b680-ddddd463fb7d-kube-api-access-n5rfv" (OuterVolumeSpecName: "kube-api-access-n5rfv") pod "c108a347-2264-44bc-b680-ddddd463fb7d" (UID: "c108a347-2264-44bc-b680-ddddd463fb7d"). InnerVolumeSpecName "kube-api-access-n5rfv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:32:53.036781 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:53.036743    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5rfv\" (UniqueName: \"kubernetes.io/projected/c108a347-2264-44bc-b680-ddddd463fb7d-kube-api-access-n5rfv\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:32:53.036781 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:53.036776    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c108a347-2264-44bc-b680-ddddd463fb7d-openshift-service-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:32:53.036781 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:53.036790    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c108a347-2264-44bc-b680-ddddd463fb7d-maas-api-tls\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:32:53.836521 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:53.836488    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685"
Jul 07 14:32:53.856826 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:53.856791    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685"]
Jul 07 14:32:53.861039 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:53.861015    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-4fab5e-7f4cdc4c5d-8m685"]
Jul 07 14:32:55.076246 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:55.076212    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c108a347-2264-44bc-b680-ddddd463fb7d" path="/var/lib/kubelet/pods/c108a347-2264-44bc-b680-ddddd463fb7d/volumes"
Jul 07 14:32:58.157813 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:58.157781    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:58.230165 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:58.230132    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:58.451124 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:58.451093    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:58.685679 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:58.685645    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:58.861979 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:58.861879    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:58.961309 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:58.961275    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:59.260330 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:59.260290    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:59.448637 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:59.448605    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:59.607711 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:59.607632    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:59.689556 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:59.689522    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm"]
Jul 07 14:32:59.689817 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:59.689790    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm" podUID="5cbd92c2-907b-4ce5-9492-9e7f5869719a" containerName="maas-api" containerID="cri-o://023d24ff74a1b4ab982d8d9d3d046e5d68c804eed17cac9f66a95493987edd96" gracePeriod=30
Jul 07 14:32:59.725665 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:59.725635    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:32:59.873419 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:59.873372    2576 generic.go:356] "Generic (PLEG): container finished" podID="5cbd92c2-907b-4ce5-9492-9e7f5869719a" containerID="023d24ff74a1b4ab982d8d9d3d046e5d68c804eed17cac9f66a95493987edd96" exitCode=0
Jul 07 14:32:59.873584 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:59.873444    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm" event={"ID":"5cbd92c2-907b-4ce5-9492-9e7f5869719a","Type":"ContainerDied","Data":"023d24ff74a1b4ab982d8d9d3d046e5d68c804eed17cac9f66a95493987edd96"}
Jul 07 14:32:59.953965 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:59.953926    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm"
Jul 07 14:32:59.994319 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:59.994291    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cbd92c2-907b-4ce5-9492-9e7f5869719a-openshift-service-ca\") pod \"5cbd92c2-907b-4ce5-9492-9e7f5869719a\" (UID: \"5cbd92c2-907b-4ce5-9492-9e7f5869719a\") "
Jul 07 14:32:59.994479 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:59.994380    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78zmb\" (UniqueName: \"kubernetes.io/projected/5cbd92c2-907b-4ce5-9492-9e7f5869719a-kube-api-access-78zmb\") pod \"5cbd92c2-907b-4ce5-9492-9e7f5869719a\" (UID: \"5cbd92c2-907b-4ce5-9492-9e7f5869719a\") "
Jul 07 14:32:59.994479 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:59.994402    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cbd92c2-907b-4ce5-9492-9e7f5869719a-maas-api-tls\") pod \"5cbd92c2-907b-4ce5-9492-9e7f5869719a\" (UID: \"5cbd92c2-907b-4ce5-9492-9e7f5869719a\") "
Jul 07 14:32:59.994790 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:59.994747    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cbd92c2-907b-4ce5-9492-9e7f5869719a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5cbd92c2-907b-4ce5-9492-9e7f5869719a" (UID: "5cbd92c2-907b-4ce5-9492-9e7f5869719a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:32:59.996507 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:59.996477    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cbd92c2-907b-4ce5-9492-9e7f5869719a-kube-api-access-78zmb" (OuterVolumeSpecName: "kube-api-access-78zmb") pod "5cbd92c2-907b-4ce5-9492-9e7f5869719a" (UID: "5cbd92c2-907b-4ce5-9492-9e7f5869719a"). InnerVolumeSpecName "kube-api-access-78zmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:32:59.996595 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:32:59.996555    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cbd92c2-907b-4ce5-9492-9e7f5869719a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5cbd92c2-907b-4ce5-9492-9e7f5869719a" (UID: "5cbd92c2-907b-4ce5-9492-9e7f5869719a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:33:00.096025 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:00.095991    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78zmb\" (UniqueName: \"kubernetes.io/projected/5cbd92c2-907b-4ce5-9492-9e7f5869719a-kube-api-access-78zmb\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:33:00.096025 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:00.096023    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cbd92c2-907b-4ce5-9492-9e7f5869719a-maas-api-tls\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:33:00.096025 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:00.096032    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cbd92c2-907b-4ce5-9492-9e7f5869719a-openshift-service-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:33:00.880130 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:00.880098    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm"
Jul 07 14:33:00.880577 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:00.880145    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm" event={"ID":"5cbd92c2-907b-4ce5-9492-9e7f5869719a","Type":"ContainerDied","Data":"68b646dd6c4c002f138f2c3891cbc03a0554528ea2ab9dd7914882aeee464fe8"}
Jul 07 14:33:00.880577 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:00.880217    2576 scope.go:117] "RemoveContainer" containerID="023d24ff74a1b4ab982d8d9d3d046e5d68c804eed17cac9f66a95493987edd96"
Jul 07 14:33:00.904436 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:00.904409    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm"]
Jul 07 14:33:00.907804 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:00.907781    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-8b95cf-68c77978b9-l92sm"]
Jul 07 14:33:01.076353 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:01.076322    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cbd92c2-907b-4ce5-9492-9e7f5869719a" path="/var/lib/kubelet/pods/5cbd92c2-907b-4ce5-9492-9e7f5869719a/volumes"
Jul 07 14:33:05.303223 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:05.303188    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:33:05.408694 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:05.408661    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:33:05.572083 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:05.571991    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:33:05.810101 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:05.810060    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:33:06.165589 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:06.165547    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:33:06.507351 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:06.507312    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:33:06.991020 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:06.990986    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:33:09.215563 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:09.215530    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:33:09.353409 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:09.353351    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh"]
Jul 07 14:33:09.354032 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:09.354014    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cbd92c2-907b-4ce5-9492-9e7f5869719a" containerName="maas-api"
Jul 07 14:33:09.354120 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:09.354034    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cbd92c2-907b-4ce5-9492-9e7f5869719a" containerName="maas-api"
Jul 07 14:33:09.354120 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:09.354075    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c108a347-2264-44bc-b680-ddddd463fb7d" containerName="maas-api"
Jul 07 14:33:09.354120 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:09.354100    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c108a347-2264-44bc-b680-ddddd463fb7d" containerName="maas-api"
Jul 07 14:33:09.354220 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:09.354196    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cbd92c2-907b-4ce5-9492-9e7f5869719a" containerName="maas-api"
Jul 07 14:33:09.354220 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:09.354207    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c108a347-2264-44bc-b680-ddddd463fb7d" containerName="maas-api"
Jul 07 14:33:09.359150 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:09.359130    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh"
Jul 07 14:33:09.363022 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:09.363002    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-0b992a-serving-cert\""
Jul 07 14:33:09.384257 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:09.384230    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh"]
Jul 07 14:33:09.429799 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:09.429768    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:33:09.491422 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:09.491328    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/114ad579-e206-42d3-904a-606d732e73ea-maas-api-tls\") pod \"maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh\" (UID: \"114ad579-e206-42d3-904a-606d732e73ea\") " pod="opendatahub/maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh"
Jul 07 14:33:09.491422 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:09.491386    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/114ad579-e206-42d3-904a-606d732e73ea-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh\" (UID: \"114ad579-e206-42d3-904a-606d732e73ea\") " pod="opendatahub/maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh"
Jul 07 14:33:09.491422 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:09.491420    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzwsv\" (UniqueName: \"kubernetes.io/projected/114ad579-e206-42d3-904a-606d732e73ea-kube-api-access-lzwsv\") pod \"maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh\" (UID: \"114ad579-e206-42d3-904a-606d732e73ea\") " pod="opendatahub/maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh"
Jul 07 14:33:09.592291 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:09.592255    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/114ad579-e206-42d3-904a-606d732e73ea-maas-api-tls\") pod \"maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh\" (UID: \"114ad579-e206-42d3-904a-606d732e73ea\") " pod="opendatahub/maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh"
Jul 07 14:33:09.592473 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:09.592300    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/114ad579-e206-42d3-904a-606d732e73ea-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh\" (UID: \"114ad579-e206-42d3-904a-606d732e73ea\") " pod="opendatahub/maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh"
Jul 07 14:33:09.592473 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:09.592320    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzwsv\" (UniqueName: \"kubernetes.io/projected/114ad579-e206-42d3-904a-606d732e73ea-kube-api-access-lzwsv\") pod \"maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh\" (UID: \"114ad579-e206-42d3-904a-606d732e73ea\") " pod="opendatahub/maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh"
Jul 07 14:33:09.592473 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:33:09.592425    2576 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-a-0b992a-serving-cert: secret "maas-api-e2e-shared-a-0b992a-serving-cert" not found
Jul 07 14:33:09.592606 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:33:09.592521    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/114ad579-e206-42d3-904a-606d732e73ea-maas-api-tls podName:114ad579-e206-42d3-904a-606d732e73ea nodeName:}" failed. No retries permitted until 2026-07-07 14:33:10.092498052 +0000 UTC m=+2055.704777006 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/114ad579-e206-42d3-904a-606d732e73ea-maas-api-tls") pod "maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh" (UID: "114ad579-e206-42d3-904a-606d732e73ea") : secret "maas-api-e2e-shared-a-0b992a-serving-cert" not found
Jul 07 14:33:09.593055 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:09.593037    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/114ad579-e206-42d3-904a-606d732e73ea-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh\" (UID: \"114ad579-e206-42d3-904a-606d732e73ea\") " pod="opendatahub/maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh"
Jul 07 14:33:09.602111 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:09.602082    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzwsv\" (UniqueName: \"kubernetes.io/projected/114ad579-e206-42d3-904a-606d732e73ea-kube-api-access-lzwsv\") pod \"maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh\" (UID: \"114ad579-e206-42d3-904a-606d732e73ea\") " pod="opendatahub/maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh"
Jul 07 14:33:09.834585 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:09.834486    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:33:09.947727 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:09.947694    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:33:10.050153 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:10.050122    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:33:10.098179 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:10.098101    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/114ad579-e206-42d3-904a-606d732e73ea-maas-api-tls\") pod \"maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh\" (UID: \"114ad579-e206-42d3-904a-606d732e73ea\") " pod="opendatahub/maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh"
Jul 07 14:33:10.100511 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:10.100483    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/114ad579-e206-42d3-904a-606d732e73ea-maas-api-tls\") pod \"maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh\" (UID: \"114ad579-e206-42d3-904a-606d732e73ea\") " pod="opendatahub/maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh"
Jul 07 14:33:10.270149 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:10.270111    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh"
Jul 07 14:33:10.619006 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:10.618971    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh"]
Jul 07 14:33:10.620633 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:33:10.620610    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod114ad579_e206_42d3_904a_606d732e73ea.slice/crio-c50972d4dc0d7ccf652ed9e23f6d4ca026a92f8383ab4f05c2b9185fef64df07 WatchSource:0}: Error finding container c50972d4dc0d7ccf652ed9e23f6d4ca026a92f8383ab4f05c2b9185fef64df07: Status 404 returned error can't find the container with id c50972d4dc0d7ccf652ed9e23f6d4ca026a92f8383ab4f05c2b9185fef64df07
Jul 07 14:33:10.938693 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:10.938655    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh" event={"ID":"114ad579-e206-42d3-904a-606d732e73ea","Type":"ContainerStarted","Data":"c50972d4dc0d7ccf652ed9e23f6d4ca026a92f8383ab4f05c2b9185fef64df07"}
Jul 07 14:33:11.945785 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:11.945744    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh" event={"ID":"114ad579-e206-42d3-904a-606d732e73ea","Type":"ContainerStarted","Data":"b67440e0dc3e7b8383986a296547859f1c8e8899e4ef64d9d709120ad515b437"}
Jul 07 14:33:11.946238 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:11.945833    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh"
Jul 07 14:33:11.979732 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:11.979651    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh" podStartSLOduration=2.5227433599999998 podStartE2EDuration="2.979630114s" totalImagesPullingTime="456.886754ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:33:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:33:11.977722754 +0000 UTC m=+2057.590001726" watchObservedRunningTime="2026-07-07 14:33:11.979630114 +0000 UTC m=+2057.591909086"
Jul 07 14:33:13.757071 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:13.757029    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:33:14.447095 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:14.447045    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:33:14.522382 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:14.522353    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:33:16.109030 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:16.108996    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:33:17.026383 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:17.026349    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:33:17.135451 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:17.135416    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:33:17.306523 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:17.306421    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:33:17.414721 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:17.414684    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:33:17.632756 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:17.632447    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8"]
Jul 07 14:33:17.637388 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:17.637357    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8"
Jul 07 14:33:17.640751 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:17.640696    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-bb9591-serving-cert\""
Jul 07 14:33:17.660508 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:17.660479    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8"]
Jul 07 14:33:17.717624 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:17.717590    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:33:17.768737 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:17.768699    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95b2862c-fa99-48bf-a54a-ab7e9aa3af1b-maas-api-tls\") pod \"maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8\" (UID: \"95b2862c-fa99-48bf-a54a-ab7e9aa3af1b\") " pod="opendatahub/maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8"
Jul 07 14:33:17.768737 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:17.768740    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svs5t\" (UniqueName: \"kubernetes.io/projected/95b2862c-fa99-48bf-a54a-ab7e9aa3af1b-kube-api-access-svs5t\") pod \"maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8\" (UID: \"95b2862c-fa99-48bf-a54a-ab7e9aa3af1b\") " pod="opendatahub/maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8"
Jul 07 14:33:17.769013 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:17.768777    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95b2862c-fa99-48bf-a54a-ab7e9aa3af1b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8\" (UID: \"95b2862c-fa99-48bf-a54a-ab7e9aa3af1b\") " pod="opendatahub/maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8"
Jul 07 14:33:17.870285 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:17.870235    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95b2862c-fa99-48bf-a54a-ab7e9aa3af1b-maas-api-tls\") pod \"maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8\" (UID: \"95b2862c-fa99-48bf-a54a-ab7e9aa3af1b\") " pod="opendatahub/maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8"
Jul 07 14:33:17.870285 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:17.870285    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svs5t\" (UniqueName: \"kubernetes.io/projected/95b2862c-fa99-48bf-a54a-ab7e9aa3af1b-kube-api-access-svs5t\") pod \"maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8\" (UID: \"95b2862c-fa99-48bf-a54a-ab7e9aa3af1b\") " pod="opendatahub/maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8"
Jul 07 14:33:17.870551 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:17.870357    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95b2862c-fa99-48bf-a54a-ab7e9aa3af1b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8\" (UID: \"95b2862c-fa99-48bf-a54a-ab7e9aa3af1b\") " pod="opendatahub/maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8"
Jul 07 14:33:17.871115 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:17.871089    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95b2862c-fa99-48bf-a54a-ab7e9aa3af1b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8\" (UID: \"95b2862c-fa99-48bf-a54a-ab7e9aa3af1b\") " pod="opendatahub/maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8"
Jul 07 14:33:17.872747 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:17.872723    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95b2862c-fa99-48bf-a54a-ab7e9aa3af1b-maas-api-tls\") pod \"maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8\" (UID: \"95b2862c-fa99-48bf-a54a-ab7e9aa3af1b\") " pod="opendatahub/maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8"
Jul 07 14:33:17.881515 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:17.881492    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svs5t\" (UniqueName: \"kubernetes.io/projected/95b2862c-fa99-48bf-a54a-ab7e9aa3af1b-kube-api-access-svs5t\") pod \"maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8\" (UID: \"95b2862c-fa99-48bf-a54a-ab7e9aa3af1b\") " pod="opendatahub/maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8"
Jul 07 14:33:17.951554 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:17.951522    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8"
Jul 07 14:33:17.956807 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:17.956783    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh"
Jul 07 14:33:18.105050 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:18.105024    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8"]
Jul 07 14:33:18.107204 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:33:18.107180    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95b2862c_fa99_48bf_a54a_ab7e9aa3af1b.slice/crio-451910bfbbdbaed663613a87f9b36b110981eeb019c9d1cd87b08c9289d50eb2 WatchSource:0}: Error finding container 451910bfbbdbaed663613a87f9b36b110981eeb019c9d1cd87b08c9289d50eb2: Status 404 returned error can't find the container with id 451910bfbbdbaed663613a87f9b36b110981eeb019c9d1cd87b08c9289d50eb2
Jul 07 14:33:18.336917 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:18.336835    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:33:18.431541 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:18.431511    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:33:18.986854 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:18.986817    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8" event={"ID":"95b2862c-fa99-48bf-a54a-ab7e9aa3af1b","Type":"ContainerStarted","Data":"e73f742b03a01ef168c2fae3cd0f6f776a5e16d03d3abe502604871bf3c19888"}
Jul 07 14:33:18.987086 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:18.986869    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8" event={"ID":"95b2862c-fa99-48bf-a54a-ab7e9aa3af1b","Type":"ContainerStarted","Data":"451910bfbbdbaed663613a87f9b36b110981eeb019c9d1cd87b08c9289d50eb2"}
Jul 07 14:33:18.987086 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:18.986904    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8"
Jul 07 14:33:19.009514 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:19.009464    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8" podStartSLOduration=1.665358653 podStartE2EDuration="2.009443652s" totalImagesPullingTime="344.084999ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:33:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:33:19.009341518 +0000 UTC m=+2064.621620512" watchObservedRunningTime="2026-07-07 14:33:19.009443652 +0000 UTC m=+2064.621722625"
Jul 07 14:33:21.859591 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:21.859552    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:33:24.998722 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:24.998694    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8"
Jul 07 14:33:30.786062 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:30.786028    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:33:30.887407 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:30.887373    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:33:34.701290 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:34.701252    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:33:38.988686 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:38.988650    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:33:39.802177 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:39.802110    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:33:55.076328 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:55.076230    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bglbr_d36dada3-7ddc-4de9-a1d5-62ff1f867dd9/console-operator/1.log"
Jul 07 14:33:55.081158 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:55.081137    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zdfvw_9bcfc7b3-a523-42e2-add9-c7f0f1e187ce/ovn-acl-logging/0.log"
Jul 07 14:33:55.084668 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:55.084651    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bglbr_d36dada3-7ddc-4de9-a1d5-62ff1f867dd9/console-operator/1.log"
Jul 07 14:33:55.089226 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:33:55.089211    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zdfvw_9bcfc7b3-a523-42e2-add9-c7f0f1e187ce/ovn-acl-logging/0.log"
Jul 07 14:34:09.100715 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:34:09.100659    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:36:16.378650 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:36:16.378604    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:36:17.981312 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:36:17.981224    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:36:21.222136 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:36:21.222096    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:36:35.570928 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:36:35.570889    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:36:35.670923 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:36:35.670890    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:36:56.541507 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:36:56.541466    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:37:40.657431 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:37:40.657380    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:37:41.286235 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:37:41.286202    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:37:41.387195 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:37:41.387160    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:37:41.632225 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:37:41.632123    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:37:59.005131 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:37:59.005052    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:38:18.181805 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:38:18.181763    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:38:18.862399 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:38:18.862367    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:38:31.582580 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:38:31.582540    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:38:31.687907 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:38:31.687874    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:38:33.266241 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:38:33.266206    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:38:33.351004 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:38:33.350962    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:38:39.762976 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:38:39.762922    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:38:39.863000 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:38:39.862932    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:38:49.523126 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:38:49.523088    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:38:55.109311 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:38:55.109201    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bglbr_d36dada3-7ddc-4de9-a1d5-62ff1f867dd9/console-operator/1.log"
Jul 07 14:38:55.114116 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:38:55.114059    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zdfvw_9bcfc7b3-a523-42e2-add9-c7f0f1e187ce/ovn-acl-logging/0.log"
Jul 07 14:38:55.118826 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:38:55.118803    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bglbr_d36dada3-7ddc-4de9-a1d5-62ff1f867dd9/console-operator/1.log"
Jul 07 14:38:55.123749 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:38:55.123728    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zdfvw_9bcfc7b3-a523-42e2-add9-c7f0f1e187ce/ovn-acl-logging/0.log"
Jul 07 14:38:55.222393 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:38:55.222356    2576 scope.go:117] "RemoveContainer" containerID="74171330b25b5e1ac2c99a470c7543b96ab4b2f66d53a5eaa15d84e9c0423a54"
Jul 07 14:39:32.334733 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:39:32.334692    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:39:33.319013 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:39:33.318976    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:39:34.599597 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:39:34.599565    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:39:35.010855 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:39:35.010822    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:39:35.115813 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:39:35.115780    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:39:35.215732 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:39:35.215696    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:39:35.361873 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:39:35.361243    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh"]
Jul 07 14:39:35.361873 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:39:35.361516    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh" podUID="114ad579-e206-42d3-904a-606d732e73ea" containerName="maas-api" containerID="cri-o://b67440e0dc3e7b8383986a296547859f1c8e8899e4ef64d9d709120ad515b437" gracePeriod=30
Jul 07 14:39:35.397069 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:39:35.397037    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:39:35.620337 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:39:35.620269    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh"
Jul 07 14:39:35.735051 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:39:35.735018    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzwsv\" (UniqueName: \"kubernetes.io/projected/114ad579-e206-42d3-904a-606d732e73ea-kube-api-access-lzwsv\") pod \"114ad579-e206-42d3-904a-606d732e73ea\" (UID: \"114ad579-e206-42d3-904a-606d732e73ea\") "
Jul 07 14:39:35.735262 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:39:35.735133    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/114ad579-e206-42d3-904a-606d732e73ea-maas-api-tls\") pod \"114ad579-e206-42d3-904a-606d732e73ea\" (UID: \"114ad579-e206-42d3-904a-606d732e73ea\") "
Jul 07 14:39:35.735262 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:39:35.735160    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/114ad579-e206-42d3-904a-606d732e73ea-openshift-service-ca\") pod \"114ad579-e206-42d3-904a-606d732e73ea\" (UID: \"114ad579-e206-42d3-904a-606d732e73ea\") "
Jul 07 14:39:35.735690 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:39:35.735661    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/114ad579-e206-42d3-904a-606d732e73ea-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "114ad579-e206-42d3-904a-606d732e73ea" (UID: "114ad579-e206-42d3-904a-606d732e73ea"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:39:35.737307 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:39:35.737280    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/114ad579-e206-42d3-904a-606d732e73ea-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "114ad579-e206-42d3-904a-606d732e73ea" (UID: "114ad579-e206-42d3-904a-606d732e73ea"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:39:35.737681 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:39:35.737659    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/114ad579-e206-42d3-904a-606d732e73ea-kube-api-access-lzwsv" (OuterVolumeSpecName: "kube-api-access-lzwsv") pod "114ad579-e206-42d3-904a-606d732e73ea" (UID: "114ad579-e206-42d3-904a-606d732e73ea"). InnerVolumeSpecName "kube-api-access-lzwsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:39:35.836860 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:39:35.836821    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/114ad579-e206-42d3-904a-606d732e73ea-maas-api-tls\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:39:35.836860 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:39:35.836857    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/114ad579-e206-42d3-904a-606d732e73ea-openshift-service-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:39:35.837168 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:39:35.836871    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzwsv\" (UniqueName: \"kubernetes.io/projected/114ad579-e206-42d3-904a-606d732e73ea-kube-api-access-lzwsv\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:39:36.016801 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:39:36.016765    2576 generic.go:356] "Generic (PLEG): container finished" podID="114ad579-e206-42d3-904a-606d732e73ea" containerID="b67440e0dc3e7b8383986a296547859f1c8e8899e4ef64d9d709120ad515b437" exitCode=0
Jul 07 14:39:36.016997 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:39:36.016826    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh"
Jul 07 14:39:36.016997 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:39:36.016858    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh" event={"ID":"114ad579-e206-42d3-904a-606d732e73ea","Type":"ContainerDied","Data":"b67440e0dc3e7b8383986a296547859f1c8e8899e4ef64d9d709120ad515b437"}
Jul 07 14:39:36.016997 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:39:36.016932    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh" event={"ID":"114ad579-e206-42d3-904a-606d732e73ea","Type":"ContainerDied","Data":"c50972d4dc0d7ccf652ed9e23f6d4ca026a92f8383ab4f05c2b9185fef64df07"}
Jul 07 14:39:36.016997 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:39:36.016985    2576 scope.go:117] "RemoveContainer" containerID="b67440e0dc3e7b8383986a296547859f1c8e8899e4ef64d9d709120ad515b437"
Jul 07 14:39:36.028915 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:39:36.028899    2576 scope.go:117] "RemoveContainer" containerID="b67440e0dc3e7b8383986a296547859f1c8e8899e4ef64d9d709120ad515b437"
Jul 07 14:39:36.029234 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:39:36.029213    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b67440e0dc3e7b8383986a296547859f1c8e8899e4ef64d9d709120ad515b437\": container with ID starting with b67440e0dc3e7b8383986a296547859f1c8e8899e4ef64d9d709120ad515b437 not found: ID does not exist" containerID="b67440e0dc3e7b8383986a296547859f1c8e8899e4ef64d9d709120ad515b437"
Jul 07 14:39:36.029309 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:39:36.029242    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b67440e0dc3e7b8383986a296547859f1c8e8899e4ef64d9d709120ad515b437"} err="failed to get container status \"b67440e0dc3e7b8383986a296547859f1c8e8899e4ef64d9d709120ad515b437\": rpc error: code = NotFound desc = could not find container \"b67440e0dc3e7b8383986a296547859f1c8e8899e4ef64d9d709120ad515b437\": container with ID starting with b67440e0dc3e7b8383986a296547859f1c8e8899e4ef64d9d709120ad515b437 not found: ID does not exist"
Jul 07 14:39:36.047808 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:39:36.047776    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh"]
Jul 07 14:39:36.052469 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:39:36.052443    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-0b992a-7c9ffbfdf-bjdnh"]
Jul 07 14:39:37.076098 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:39:37.076064    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="114ad579-e206-42d3-904a-606d732e73ea" path="/var/lib/kubelet/pods/114ad579-e206-42d3-904a-606d732e73ea/volumes"
Jul 07 14:39:40.186137 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:39:40.186102    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:39:53.180396 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:39:53.180362    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:40:13.307492 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:13.307457    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:40:13.578225 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:13.578126    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:40:13.832979 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:13.832871    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:40:13.999233 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:13.999201    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:40:14.427195 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:14.427156    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:40:14.527610 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:14.527532    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:40:14.656927 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:14.656882    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8"]
Jul 07 14:40:14.657275 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:14.657246    2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8" podUID="95b2862c-fa99-48bf-a54a-ab7e9aa3af1b" containerName="maas-api" containerID="cri-o://e73f742b03a01ef168c2fae3cd0f6f776a5e16d03d3abe502604871bf3c19888" gracePeriod=30
Jul 07 14:40:14.685423 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:14.685317    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:40:14.993809 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:14.993766    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8" podUID="95b2862c-fa99-48bf-a54a-ab7e9aa3af1b" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.70:8443/health\": dial tcp 10.132.0.70:8443: connect: connection refused"
Jul 07 14:40:15.113456 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:15.113424    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8"
Jul 07 14:40:15.207559 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:15.207466    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95b2862c-fa99-48bf-a54a-ab7e9aa3af1b-maas-api-tls\") pod \"95b2862c-fa99-48bf-a54a-ab7e9aa3af1b\" (UID: \"95b2862c-fa99-48bf-a54a-ab7e9aa3af1b\") "
Jul 07 14:40:15.207559 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:15.207552    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95b2862c-fa99-48bf-a54a-ab7e9aa3af1b-openshift-service-ca\") pod \"95b2862c-fa99-48bf-a54a-ab7e9aa3af1b\" (UID: \"95b2862c-fa99-48bf-a54a-ab7e9aa3af1b\") "
Jul 07 14:40:15.207766 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:15.207670    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svs5t\" (UniqueName: \"kubernetes.io/projected/95b2862c-fa99-48bf-a54a-ab7e9aa3af1b-kube-api-access-svs5t\") pod \"95b2862c-fa99-48bf-a54a-ab7e9aa3af1b\" (UID: \"95b2862c-fa99-48bf-a54a-ab7e9aa3af1b\") "
Jul 07 14:40:15.207874 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:15.207852    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95b2862c-fa99-48bf-a54a-ab7e9aa3af1b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "95b2862c-fa99-48bf-a54a-ab7e9aa3af1b" (UID: "95b2862c-fa99-48bf-a54a-ab7e9aa3af1b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:40:15.208026 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:15.208008    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95b2862c-fa99-48bf-a54a-ab7e9aa3af1b-openshift-service-ca\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:40:15.209548 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:15.209523    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95b2862c-fa99-48bf-a54a-ab7e9aa3af1b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "95b2862c-fa99-48bf-a54a-ab7e9aa3af1b" (UID: "95b2862c-fa99-48bf-a54a-ab7e9aa3af1b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:40:15.209672 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:15.209652    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95b2862c-fa99-48bf-a54a-ab7e9aa3af1b-kube-api-access-svs5t" (OuterVolumeSpecName: "kube-api-access-svs5t") pod "95b2862c-fa99-48bf-a54a-ab7e9aa3af1b" (UID: "95b2862c-fa99-48bf-a54a-ab7e9aa3af1b"). InnerVolumeSpecName "kube-api-access-svs5t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:40:15.228013 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:15.227988    2576 generic.go:356] "Generic (PLEG): container finished" podID="95b2862c-fa99-48bf-a54a-ab7e9aa3af1b" containerID="e73f742b03a01ef168c2fae3cd0f6f776a5e16d03d3abe502604871bf3c19888" exitCode=0
Jul 07 14:40:15.228125 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:15.228033    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8"
Jul 07 14:40:15.228125 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:15.228069    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8" event={"ID":"95b2862c-fa99-48bf-a54a-ab7e9aa3af1b","Type":"ContainerDied","Data":"e73f742b03a01ef168c2fae3cd0f6f776a5e16d03d3abe502604871bf3c19888"}
Jul 07 14:40:15.228202 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:15.228125    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8" event={"ID":"95b2862c-fa99-48bf-a54a-ab7e9aa3af1b","Type":"ContainerDied","Data":"451910bfbbdbaed663613a87f9b36b110981eeb019c9d1cd87b08c9289d50eb2"}
Jul 07 14:40:15.228202 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:15.228154    2576 scope.go:117] "RemoveContainer" containerID="e73f742b03a01ef168c2fae3cd0f6f776a5e16d03d3abe502604871bf3c19888"
Jul 07 14:40:15.239011 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:15.238989    2576 scope.go:117] "RemoveContainer" containerID="e73f742b03a01ef168c2fae3cd0f6f776a5e16d03d3abe502604871bf3c19888"
Jul 07 14:40:15.239303 ip-10-0-140-192 kubenswrapper[2576]: E0707 14:40:15.239284    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e73f742b03a01ef168c2fae3cd0f6f776a5e16d03d3abe502604871bf3c19888\": container with ID starting with e73f742b03a01ef168c2fae3cd0f6f776a5e16d03d3abe502604871bf3c19888 not found: ID does not exist" containerID="e73f742b03a01ef168c2fae3cd0f6f776a5e16d03d3abe502604871bf3c19888"
Jul 07 14:40:15.239372 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:15.239313    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e73f742b03a01ef168c2fae3cd0f6f776a5e16d03d3abe502604871bf3c19888"} err="failed to get container status \"e73f742b03a01ef168c2fae3cd0f6f776a5e16d03d3abe502604871bf3c19888\": rpc error: code = NotFound desc = could not find container \"e73f742b03a01ef168c2fae3cd0f6f776a5e16d03d3abe502604871bf3c19888\": container with ID starting with e73f742b03a01ef168c2fae3cd0f6f776a5e16d03d3abe502604871bf3c19888 not found: ID does not exist"
Jul 07 14:40:15.251972 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:15.251930    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8"]
Jul 07 14:40:15.254294 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:15.254273    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-bb9591-776d97c7ff-v5wh8"]
Jul 07 14:40:15.309176 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:15.309143    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95b2862c-fa99-48bf-a54a-ab7e9aa3af1b-maas-api-tls\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:40:15.309176 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:15.309172    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svs5t\" (UniqueName: \"kubernetes.io/projected/95b2862c-fa99-48bf-a54a-ab7e9aa3af1b-kube-api-access-svs5t\") on node \"ip-10-0-140-192.ec2.internal\" DevicePath \"\""
Jul 07 14:40:17.075530 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:17.075498    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95b2862c-fa99-48bf-a54a-ab7e9aa3af1b" path="/var/lib/kubelet/pods/95b2862c-fa99-48bf-a54a-ab7e9aa3af1b/volumes"
Jul 07 14:40:20.630235 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:20.630180    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:40:20.699106 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:20.699076    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:40:20.928875 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:20.928791    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:40:21.186208 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:21.186119    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:40:21.649319 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:21.649287    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8db94bcf6-78qbg_44a0943e-5263-4fb7-8ad2-b4032311420d/authorino/0.log"
Jul 07 14:40:26.797294 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:26.797256    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-cfqnv_94335d50-943c-46df-a509-a5a3f98a5c83/manager/0.log"
Jul 07 14:40:26.931803 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:26.931775    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-765bbcc486-6b2pd_638eda70-51b4-4a9d-99e7-968ffe9bff09/maas-api/0.log"
Jul 07 14:40:27.058677 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:27.058593    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723895-vwlm9_c22b16a0-59b2-483e-9be6-5fcc72cc44e4/cleanup/0.log"
Jul 07 14:40:27.315816 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:27.315730    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-fbf7fb6dc-6kmh5_cc57e670-b579-4d18-a411-caba587e391d/manager/0.log"
Jul 07 14:40:27.432958 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:27.432918    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-wj2dh_ebbde3be-28ff-4a6e-b663-a335f306d6bb/server/0.log"
Jul 07 14:40:27.565770 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:27.565742    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-jkw2d_5f20482f-e21f-461c-860b-1eddc97aa724/manager/0.log"
Jul 07 14:40:27.948808 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:27.948782    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66d498b796-szhx6_ccfb2894-91a4-41c5-88f9-5113f427a92e/copy-manifests/0.log"
Jul 07 14:40:27.970431 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:27.970406    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66d498b796-szhx6_ccfb2894-91a4-41c5-88f9-5113f427a92e/manager/0.log"
Jul 07 14:40:28.100024 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:28.099997    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-chkfb_d5f6ef5f-5978-4f73-895f-018e9f5b9207/postgres/0.log"
Jul 07 14:40:29.493841 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:29.493806    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8db94bcf6-78qbg_44a0943e-5263-4fb7-8ad2-b4032311420d/authorino/0.log"
Jul 07 14:40:29.625012 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:29.624979    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-4vkkt_1613c131-6c4c-4094-a1ed-2c9d0ff18751/manager/0.log"
Jul 07 14:40:29.742674 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:29.742644    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-xb657_ba61b42f-2710-4fe0-9e0d-70816e16fa40/manager/0.log"
Jul 07 14:40:30.002411 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:30.002384    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-4w2gg_ea1c121f-8316-4668-8107-f61f454a73bb/registry-server/0.log"
Jul 07 14:40:30.148034 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:30.147993    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-h4lsw_4bf3d736-f238-49a5-85e5-a4ba0f69b134/manager/0.log"
Jul 07 14:40:31.183413 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:31.183370    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8459dd97f9-ttpl8_601f4ca6-623e-43a4-93b0-8b7d64e028f9/kube-auth-proxy/0.log"
Jul 07 14:40:31.314956 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:31.314900    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-b7gsj_f6cdffb1-f341-4a0a-9898-aff39af84ac7/istio-proxy/1.log"
Jul 07 14:40:31.443930 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:31.443902    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-pkr25_54a8ada3-11f8-4bfc-af03-aaa3fd075f31/payload-pre-processing/0.log"
Jul 07 14:40:31.583903 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:31.583869    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-2mv7v_79f3fbe1-c5e0-44ca-9c45-af881220eedc/payload-processing/0.log"
Jul 07 14:40:31.700425 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:31.700348    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b78666d57-trzqd_23a16488-280d-46f3-a2f6-8e5441851c9f/router/0.log"
Jul 07 14:40:32.081757 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:32.081664    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-8qhj7_6d4fce53-3129-4d36-a2a9-d942a3dba631/main/0.log"
Jul 07 14:40:32.475695 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:32.475662    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbvwlh9_acb5b927-f50e-4124-9b1d-b7d9603c0dcf/main/0.log"
Jul 07 14:40:37.153545 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:37.153509    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:40:37.250153 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:37.250115    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log" limit=1024
Jul 07 14:40:40.582281 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:40.582247    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jcfdk_57cf19e7-ca31-4cc2-bb09-5ca82de4355b/global-pull-secret-syncer/0.log"
Jul 07 14:40:40.690776 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:40.690748    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-p85j7_20f34439-6845-4778-b380-3cf2e9f47125/konnectivity-agent/0.log"
Jul 07 14:40:40.850881 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:40.850796    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-192.ec2.internal_f58afcd1466e885d24b7a0e18eb4c8af/haproxy/0.log"
Jul 07 14:40:46.314425 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:46.314385    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-8db94bcf6-78qbg_44a0943e-5263-4fb7-8ad2-b4032311420d/authorino/0.log"
Jul 07 14:40:46.344578 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:46.344548    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-4vkkt_1613c131-6c4c-4094-a1ed-2c9d0ff18751/manager/0.log"
Jul 07 14:40:46.367695 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:46.367670    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-xb657_ba61b42f-2710-4fe0-9e0d-70816e16fa40/manager/0.log"
Jul 07 14:40:46.453599 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:46.453563    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-4w2gg_ea1c121f-8316-4668-8107-f61f454a73bb/registry-server/0.log"
Jul 07 14:40:46.607708 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:46.607619    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-h4lsw_4bf3d736-f238-49a5-85e5-a4ba0f69b134/manager/0.log"
Jul 07 14:40:48.540776 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:48.540749    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-fr2kp_8b1219f1-d3d3-4533-8b55-546c7c1a4bc6/cluster-monitoring-operator/0.log"
Jul 07 14:40:48.912027 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:48.911922    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lwg2c_2bee1c70-fe31-4b05-aec2-da9d0f4d3776/node-exporter/0.log"
Jul 07 14:40:48.940814 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:48.940785    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lwg2c_2bee1c70-fe31-4b05-aec2-da9d0f4d3776/kube-rbac-proxy/0.log"
Jul 07 14:40:48.963068 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:48.963043    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lwg2c_2bee1c70-fe31-4b05-aec2-da9d0f4d3776/init-textfile/0.log"
Jul 07 14:40:49.358948 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:49.358901    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-46p7h_769dced6-2a5e-4a60-9b2f-5067cf1fa139/prometheus-operator-admission-webhook/0.log"
Jul 07 14:40:50.768804 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:50.768756    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-gt28z_631e19ce-68c5-4c57-aa07-0a81e2c7f5f4/networking-console-plugin/0.log"
Jul 07 14:40:50.820275 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:50.820242    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6d5pc/perf-node-gather-daemonset-h265g"]
Jul 07 14:40:50.820701 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:50.820686    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="114ad579-e206-42d3-904a-606d732e73ea" containerName="maas-api"
Jul 07 14:40:50.820746 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:50.820703    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="114ad579-e206-42d3-904a-606d732e73ea" containerName="maas-api"
Jul 07 14:40:50.820746 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:50.820713    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95b2862c-fa99-48bf-a54a-ab7e9aa3af1b" containerName="maas-api"
Jul 07 14:40:50.820746 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:50.820719    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="95b2862c-fa99-48bf-a54a-ab7e9aa3af1b" containerName="maas-api"
Jul 07 14:40:50.820846 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:50.820797    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="114ad579-e206-42d3-904a-606d732e73ea" containerName="maas-api"
Jul 07 14:40:50.820846 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:50.820808    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="95b2862c-fa99-48bf-a54a-ab7e9aa3af1b" containerName="maas-api"
Jul 07 14:40:50.824222 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:50.824202    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-h265g"
Jul 07 14:40:50.827058 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:50.827040    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6d5pc\"/\"default-dockercfg-ftvtb\""
Jul 07 14:40:50.828427 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:50.828410    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6d5pc\"/\"openshift-service-ca.crt\""
Jul 07 14:40:50.828591 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:50.828443    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6d5pc\"/\"kube-root-ca.crt\""
Jul 07 14:40:50.834562 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:50.834541    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6d5pc/perf-node-gather-daemonset-h265g"]
Jul 07 14:40:50.937116 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:50.937083    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/437172de-35e3-42c4-a7d9-36e08548d013-lib-modules\") pod \"perf-node-gather-daemonset-h265g\" (UID: \"437172de-35e3-42c4-a7d9-36e08548d013\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-h265g"
Jul 07 14:40:50.937299 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:50.937150    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9xrg\" (UniqueName: \"kubernetes.io/projected/437172de-35e3-42c4-a7d9-36e08548d013-kube-api-access-c9xrg\") pod \"perf-node-gather-daemonset-h265g\" (UID: \"437172de-35e3-42c4-a7d9-36e08548d013\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-h265g"
Jul 07 14:40:50.937299 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:50.937199    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/437172de-35e3-42c4-a7d9-36e08548d013-podres\") pod \"perf-node-gather-daemonset-h265g\" (UID: \"437172de-35e3-42c4-a7d9-36e08548d013\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-h265g"
Jul 07 14:40:50.937299 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:50.937284    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/437172de-35e3-42c4-a7d9-36e08548d013-proc\") pod \"perf-node-gather-daemonset-h265g\" (UID: \"437172de-35e3-42c4-a7d9-36e08548d013\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-h265g"
Jul 07 14:40:50.937446 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:50.937338    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/437172de-35e3-42c4-a7d9-36e08548d013-sys\") pod \"perf-node-gather-daemonset-h265g\" (UID: \"437172de-35e3-42c4-a7d9-36e08548d013\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-h265g"
Jul 07 14:40:51.038180 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:51.038091    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/437172de-35e3-42c4-a7d9-36e08548d013-proc\") pod \"perf-node-gather-daemonset-h265g\" (UID: \"437172de-35e3-42c4-a7d9-36e08548d013\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-h265g"
Jul 07 14:40:51.038180 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:51.038133    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/437172de-35e3-42c4-a7d9-36e08548d013-sys\") pod \"perf-node-gather-daemonset-h265g\" (UID: \"437172de-35e3-42c4-a7d9-36e08548d013\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-h265g"
Jul 07 14:40:51.038425 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:51.038213    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/437172de-35e3-42c4-a7d9-36e08548d013-sys\") pod \"perf-node-gather-daemonset-h265g\" (UID: \"437172de-35e3-42c4-a7d9-36e08548d013\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-h265g"
Jul 07 14:40:51.038425 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:51.038217    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/437172de-35e3-42c4-a7d9-36e08548d013-proc\") pod \"perf-node-gather-daemonset-h265g\" (UID: \"437172de-35e3-42c4-a7d9-36e08548d013\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-h265g"
Jul 07 14:40:51.038425 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:51.038264    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/437172de-35e3-42c4-a7d9-36e08548d013-lib-modules\") pod \"perf-node-gather-daemonset-h265g\" (UID: \"437172de-35e3-42c4-a7d9-36e08548d013\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-h265g"
Jul 07 14:40:51.038425 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:51.038343    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9xrg\" (UniqueName: \"kubernetes.io/projected/437172de-35e3-42c4-a7d9-36e08548d013-kube-api-access-c9xrg\") pod \"perf-node-gather-daemonset-h265g\" (UID: \"437172de-35e3-42c4-a7d9-36e08548d013\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-h265g"
Jul 07 14:40:51.038425 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:51.038400    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/437172de-35e3-42c4-a7d9-36e08548d013-podres\") pod \"perf-node-gather-daemonset-h265g\" (UID: \"437172de-35e3-42c4-a7d9-36e08548d013\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-h265g"
Jul 07 14:40:51.038425 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:51.038345    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/437172de-35e3-42c4-a7d9-36e08548d013-lib-modules\") pod \"perf-node-gather-daemonset-h265g\" (UID: \"437172de-35e3-42c4-a7d9-36e08548d013\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-h265g"
Jul 07 14:40:51.038701 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:51.038557    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/437172de-35e3-42c4-a7d9-36e08548d013-podres\") pod \"perf-node-gather-daemonset-h265g\" (UID: \"437172de-35e3-42c4-a7d9-36e08548d013\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-h265g"
Jul 07 14:40:51.047276 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:51.047247    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9xrg\" (UniqueName: \"kubernetes.io/projected/437172de-35e3-42c4-a7d9-36e08548d013-kube-api-access-c9xrg\") pod \"perf-node-gather-daemonset-h265g\" (UID: \"437172de-35e3-42c4-a7d9-36e08548d013\") " pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-h265g"
Jul 07 14:40:51.135192 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:51.135156    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-h265g"
Jul 07 14:40:51.271222 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:51.271198    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6d5pc/perf-node-gather-daemonset-h265g"]
Jul 07 14:40:51.273643 ip-10-0-140-192 kubenswrapper[2576]: W0707 14:40:51.273614    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod437172de_35e3_42c4_a7d9_36e08548d013.slice/crio-caa0a558da184428dd7bdc0ad346cfbab3ee13f86b7b9176ae62ff89ba802cd7 WatchSource:0}: Error finding container caa0a558da184428dd7bdc0ad346cfbab3ee13f86b7b9176ae62ff89ba802cd7: Status 404 returned error can't find the container with id caa0a558da184428dd7bdc0ad346cfbab3ee13f86b7b9176ae62ff89ba802cd7
Jul 07 14:40:51.415683 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:51.415647    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-h265g" event={"ID":"437172de-35e3-42c4-a7d9-36e08548d013","Type":"ContainerStarted","Data":"c11202de1480bc7f4f8c2e286d1566636be97c016527225b89b484f7d40fe934"}
Jul 07 14:40:51.415861 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:51.415700    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-h265g" event={"ID":"437172de-35e3-42c4-a7d9-36e08548d013","Type":"ContainerStarted","Data":"caa0a558da184428dd7bdc0ad346cfbab3ee13f86b7b9176ae62ff89ba802cd7"}
Jul 07 14:40:51.415861 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:51.415745    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-h265g"
Jul 07 14:40:51.435275 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:51.435226    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-h265g" podStartSLOduration=1.4352075530000001 podStartE2EDuration="1.435207553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:40:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:40:51.433087077 +0000 UTC m=+2517.045366070" watchObservedRunningTime="2026-07-07 14:40:51.435207553 +0000 UTC m=+2517.047486525"
Jul 07 14:40:51.449836 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:51.449815    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bglbr_d36dada3-7ddc-4de9-a1d5-62ff1f867dd9/console-operator/1.log"
Jul 07 14:40:51.457331 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:51.457309    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-bglbr_d36dada3-7ddc-4de9-a1d5-62ff1f867dd9/console-operator/2.log"
Jul 07 14:40:51.956857 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:51.956827    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-vn9td_bc2e85d9-6ad0-4ff2-9533-7d3d0108ace5/download-server/0.log"
Jul 07 14:40:52.554638 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:52.554609    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-tlhfh_a259d7f0-7c5d-44f1-b288-4f9460eda3d7/volume-data-source-validator/0.log"
Jul 07 14:40:53.612670 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:53.612633    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f76h8_f87880be-2cb0-4728-b0e4-7f9dfe55d961/dns/0.log"
Jul 07 14:40:53.633955 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:53.633923    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f76h8_f87880be-2cb0-4728-b0e4-7f9dfe55d961/kube-rbac-proxy/0.log"
Jul 07 14:40:53.812548 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:53.812515    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zf8wq_634f658b-6022-40f7-9c4c-3c14e6f9c27e/dns-node-resolver/0.log"
Jul 07 14:40:54.370599 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:54.370570    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-46w5l_bb58a368-1974-4d27-a323-5c6a8024c9ea/node-ca/0.log"
Jul 07 14:40:55.534718 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:55.534630    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8459dd97f9-ttpl8_601f4ca6-623e-43a4-93b0-8b7d64e028f9/kube-auth-proxy/0.log"
Jul 07 14:40:55.565878 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:55.565849    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-b7gsj_f6cdffb1-f341-4a0a-9898-aff39af84ac7/istio-proxy/0.log"
Jul 07 14:40:55.618403 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:55.618370    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-b7gsj_f6cdffb1-f341-4a0a-9898-aff39af84ac7/istio-proxy/1.log"
Jul 07 14:40:55.657132 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:55.657106    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-pkr25_54a8ada3-11f8-4bfc-af03-aaa3fd075f31/payload-pre-processing/0.log"
Jul 07 14:40:55.738158 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:55.738133    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-2mv7v_79f3fbe1-c5e0-44ca-9c45-af881220eedc/payload-processing/0.log"
Jul 07 14:40:55.763157 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:55.763134    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b78666d57-trzqd_23a16488-280d-46f3-a2f6-8e5441851c9f/router/0.log"
Jul 07 14:40:56.434151 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:56.434121    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-887km_fe2e0f1e-e3ad-4c6c-bdde-61135493ef8b/serve-healthcheck-canary/0.log"
Jul 07 14:40:57.060969 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:57.060920    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-qtl92_c932b4f6-5a4a-45f4-aa12-03bc4845857d/insights-operator/0.log"
Jul 07 14:40:57.064356 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:57.064333    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-qtl92_c932b4f6-5a4a-45f4-aa12-03bc4845857d/insights-operator/1.log"
Jul 07 14:40:57.171435 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:57.171401    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fj8vh_b8654fdc-761b-4a1a-964e-4ed6584e9132/kube-rbac-proxy/0.log"
Jul 07 14:40:57.192729 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:57.192696    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fj8vh_b8654fdc-761b-4a1a-964e-4ed6584e9132/exporter/0.log"
Jul 07 14:40:57.217079 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:57.217055    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fj8vh_b8654fdc-761b-4a1a-964e-4ed6584e9132/extractor/0.log"
Jul 07 14:40:57.431969 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:57.431885    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6d5pc/perf-node-gather-daemonset-h265g"
Jul 07 14:40:59.770126 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:59.770047    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-cfqnv_94335d50-943c-46df-a509-a5a3f98a5c83/manager/0.log"
Jul 07 14:40:59.823651 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:59.823613    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-765bbcc486-6b2pd_638eda70-51b4-4a9d-99e7-968ffe9bff09/maas-api/0.log"
Jul 07 14:40:59.846929 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:40:59.846902    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723895-vwlm9_c22b16a0-59b2-483e-9be6-5fcc72cc44e4/cleanup/0.log"
Jul 07 14:41:00.031775 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:41:00.031688    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-fbf7fb6dc-6kmh5_cc57e670-b579-4d18-a411-caba587e391d/manager/0.log"
Jul 07 14:41:00.057327 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:41:00.057303    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-wj2dh_ebbde3be-28ff-4a6e-b663-a335f306d6bb/server/0.log"
Jul 07 14:41:00.168438 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:41:00.168398    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-jkw2d_5f20482f-e21f-461c-860b-1eddc97aa724/manager/0.log"
Jul 07 14:41:00.408770 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:41:00.408673    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66d498b796-szhx6_ccfb2894-91a4-41c5-88f9-5113f427a92e/manager/0.log"
Jul 07 14:41:00.429071 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:41:00.429046    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-66d498b796-szhx6_ccfb2894-91a4-41c5-88f9-5113f427a92e/copy-manifests/0.log"
Jul 07 14:41:00.455330 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:41:00.455264    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-chkfb_d5f6ef5f-5978-4f73-895f-018e9f5b9207/postgres/0.log"
Jul 07 14:41:01.687267 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:41:01.687239    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8459dd97f9-ttpl8_601f4ca6-623e-43a4-93b0-8b7d64e028f9/kube-auth-proxy/0.log"
Jul 07 14:41:01.710149 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:41:01.710106    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-b7gsj_f6cdffb1-f341-4a0a-9898-aff39af84ac7/istio-proxy/0.log"
Jul 07 14:41:01.764889 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:41:01.764860    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-b7gsj_f6cdffb1-f341-4a0a-9898-aff39af84ac7/istio-proxy/1.log"
Jul 07 14:41:01.792008 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:41:01.791975    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-pkr25_54a8ada3-11f8-4bfc-af03-aaa3fd075f31/payload-pre-processing/0.log"
Jul 07 14:41:01.852154 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:41:01.852122    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-2mv7v_79f3fbe1-c5e0-44ca-9c45-af881220eedc/payload-processing/0.log"
Jul 07 14:41:01.871165 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:41:01.871133    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b78666d57-trzqd_23a16488-280d-46f3-a2f6-8e5441851c9f/router/0.log"
Jul 07 14:41:03.218305 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:41:03.218273    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8459dd97f9-ttpl8_601f4ca6-623e-43a4-93b0-8b7d64e028f9/kube-auth-proxy/0.log"
Jul 07 14:41:03.244061 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:41:03.244026    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-b7gsj_f6cdffb1-f341-4a0a-9898-aff39af84ac7/istio-proxy/0.log"
Jul 07 14:41:03.299167 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:41:03.299136    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-b7gsj_f6cdffb1-f341-4a0a-9898-aff39af84ac7/istio-proxy/1.log"
Jul 07 14:41:03.328733 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:41:03.328703    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-pkr25_54a8ada3-11f8-4bfc-af03-aaa3fd075f31/payload-pre-processing/0.log"
Jul 07 14:41:03.400266 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:41:03.400235    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-2mv7v_79f3fbe1-c5e0-44ca-9c45-af881220eedc/payload-processing/0.log"
Jul 07 14:41:03.415786 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:41:03.415758    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b78666d57-trzqd_23a16488-280d-46f3-a2f6-8e5441851c9f/router/0.log"
Jul 07 14:41:07.251863 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:41:07.251810    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-fx5gg_031cd0e2-51d9-4150-a830-44e06690ff06/migrator/0.log"
Jul 07 14:41:07.272777 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:41:07.272754    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-fx5gg_031cd0e2-51d9-4150-a830-44e06690ff06/graceful-termination/0.log"
Jul 07 14:41:07.636073 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:41:07.635983    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-76dfd_449662d7-d129-4774-bc10-7b32dc658f15/kube-storage-version-migrator-operator/1.log"
Jul 07 14:41:07.637642 ip-10-0-140-192 kubenswrapper[2576]: I0707 14:41:07.637615    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-76dfd_449662d7-d129-4774-bc10-7b32dc658f15/kube-storage-version-migrator-operator/0.log"