Jul 20 09:36:59.746898 ip-10-0-140-236 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 20 09:36:59.746914 ip-10-0-140-236 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 20 09:36:59.746925 ip-10-0-140-236 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 20 09:36:59.747233 ip-10-0-140-236 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 20 09:37:09.939678 ip-10-0-140-236 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 20 09:37:09.939693 ip-10-0-140-236 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 21d4da555956445db4a775ed192d7aae --
Jul 20 09:39:07.993276 ip-10-0-140-236 systemd[1]: Starting Kubernetes Kubelet...
Jul 20 09:39:08.468507 ip-10-0-140-236 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 09:39:08.468507 ip-10-0-140-236 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 20 09:39:08.468507 ip-10-0-140-236 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 09:39:08.468507 ip-10-0-140-236 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 20 09:39:08.468507 ip-10-0-140-236 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 09:39:08.468507 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.404781    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 20 09:39:08.468507 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413463    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 09:39:08.468507 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413476    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 09:39:08.468507 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413482    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 09:39:08.468507 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413487    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 09:39:08.468507 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413491    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 09:39:08.468507 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413494    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 09:39:08.468507 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413497    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 09:39:08.468507 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413501    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 09:39:08.469541 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413503    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 09:39:08.469541 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413506    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 09:39:08.469541 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413508    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 09:39:08.469541 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413511    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 09:39:08.469541 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413514    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 09:39:08.469541 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413518    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 09:39:08.469541 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413522    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 09:39:08.469541 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413525    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 09:39:08.469541 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413528    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 09:39:08.469541 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413531    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 09:39:08.469541 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413534    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 09:39:08.469541 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413536    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 09:39:08.469541 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413539    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 09:39:08.469541 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413542    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 09:39:08.469541 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413545    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 09:39:08.469541 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413547    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 09:39:08.469541 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413550    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 09:39:08.469541 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413553    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 09:39:08.469541 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413555    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 09:39:08.469541 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413558    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 09:39:08.470175 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413561    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 09:39:08.470175 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413564    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 09:39:08.470175 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413572    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 09:39:08.470175 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413575    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 09:39:08.470175 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413578    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 09:39:08.470175 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413581    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 09:39:08.470175 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413584    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 09:39:08.470175 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413586    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 09:39:08.470175 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413588    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 09:39:08.470175 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413591    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 09:39:08.470175 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413594    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 09:39:08.470175 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413598    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 09:39:08.470175 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413601    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 09:39:08.470175 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413604    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 09:39:08.470175 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413606    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 09:39:08.470175 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413610    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 09:39:08.470175 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413612    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 09:39:08.470175 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413615    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 09:39:08.470175 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413618    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 09:39:08.470175 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413620    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 09:39:08.470813 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413623    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 09:39:08.470813 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413626    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 09:39:08.470813 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413630    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 09:39:08.470813 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413632    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 09:39:08.470813 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413635    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 09:39:08.470813 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413637    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 09:39:08.470813 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413640    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 09:39:08.470813 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413643    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 09:39:08.470813 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413647    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 09:39:08.470813 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413650    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 09:39:08.470813 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413653    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 09:39:08.470813 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413656    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 09:39:08.470813 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413658    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 09:39:08.470813 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413661    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 09:39:08.470813 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413663    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 09:39:08.470813 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413666    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 09:39:08.470813 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413668    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 09:39:08.470813 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413671    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 09:39:08.470813 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413673    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 09:39:08.471665 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413676    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 09:39:08.471665 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413678    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 09:39:08.471665 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413681    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 09:39:08.471665 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413683    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 09:39:08.471665 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413687    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 09:39:08.471665 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413690    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 09:39:08.471665 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413692    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 09:39:08.471665 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413695    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 09:39:08.471665 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413698    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 09:39:08.471665 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413701    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 09:39:08.471665 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413703    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 09:39:08.471665 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413706    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 09:39:08.471665 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413708    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 09:39:08.471665 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413711    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 09:39:08.471665 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413713    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 09:39:08.471665 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413716    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 09:39:08.471665 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413718    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 09:39:08.471665 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413721    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 09:39:08.471665 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413723    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 09:39:08.471665 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413726    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 09:39:08.472530 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413728    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 09:39:08.472530 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413731    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 09:39:08.472530 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413734    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 09:39:08.472530 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413736    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 09:39:08.472530 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413739    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 09:39:08.472530 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413741    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 09:39:08.472530 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413744    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 09:39:08.472530 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413746    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 09:39:08.472530 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413749    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 09:39:08.472530 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413752    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 09:39:08.472530 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413754    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 09:39:08.472530 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.413757    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 09:39:08.472530 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414488    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 09:39:08.472530 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414495    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 09:39:08.472530 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414498    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 09:39:08.472530 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414501    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 09:39:08.472530 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414504    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 09:39:08.472530 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414509    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 09:39:08.472530 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414512    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 09:39:08.472530 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414515    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 09:39:08.473620 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414518    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 09:39:08.473620 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414520    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 09:39:08.473620 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414523    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 09:39:08.473620 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414526    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 09:39:08.473620 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414529    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 09:39:08.473620 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414532    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 09:39:08.473620 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414534    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 09:39:08.473620 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414537    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 09:39:08.473620 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414540    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 09:39:08.473620 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414542    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 09:39:08.473620 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414544    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 09:39:08.473620 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414547    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 09:39:08.473620 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414549    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 09:39:08.473620 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414552    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 09:39:08.473620 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414555    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 09:39:08.473620 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414557    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 09:39:08.473620 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414560    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 09:39:08.473620 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414562    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 09:39:08.473620 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414565    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 09:39:08.473620 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414568    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 09:39:08.474600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414570    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 09:39:08.474600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414573    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 09:39:08.474600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414575    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 09:39:08.474600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414578    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 09:39:08.474600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414580    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 09:39:08.474600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414583    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 09:39:08.474600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414585    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 09:39:08.474600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414588    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 09:39:08.474600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414590    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 09:39:08.474600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414593    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 09:39:08.474600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414596    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 09:39:08.474600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414598    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 09:39:08.474600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414601    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 09:39:08.474600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414605    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 09:39:08.474600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414608    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 09:39:08.474600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414610    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 09:39:08.474600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414613    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 09:39:08.474600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414617    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 09:39:08.474600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414619    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 09:39:08.474600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414622    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 09:39:08.478853 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414624    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 09:39:08.478853 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414627    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 09:39:08.478853 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414629    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 09:39:08.478853 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414632    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 09:39:08.478853 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414635    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 09:39:08.478853 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414637    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 09:39:08.478853 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414640    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 09:39:08.478853 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414643    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 09:39:08.478853 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414646    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 09:39:08.478853 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414648    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 09:39:08.478853 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414651    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 09:39:08.478853 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414653    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 09:39:08.478853 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414656    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 09:39:08.478853 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414659    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 09:39:08.478853 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414662    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 09:39:08.478853 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414664    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 09:39:08.478853 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414667    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 09:39:08.478853 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414669    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 09:39:08.478853 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414672    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 09:39:08.478853 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414674    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 09:39:08.479730 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414677    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 09:39:08.479730 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414679    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 09:39:08.479730 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414684    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 09:39:08.479730 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414690    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 09:39:08.479730 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414695    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 09:39:08.479730 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414700    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 09:39:08.479730 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414704    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 09:39:08.479730 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414707    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 09:39:08.479730 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414711    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 09:39:08.479730 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414714    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 09:39:08.479730 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414717    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 09:39:08.479730 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414720    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 09:39:08.479730 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414723    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 09:39:08.479730 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414725    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 09:39:08.479730 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414728    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 09:39:08.479730 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414731    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 09:39:08.479730 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414734    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 09:39:08.479730 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414736    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 09:39:08.479730 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414739    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 09:39:08.487290 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414742    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 09:39:08.487290 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414744    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 09:39:08.487290 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414747    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 09:39:08.487290 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414750    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 09:39:08.487290 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414752    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 09:39:08.487290 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414755    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 09:39:08.487290 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414759    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 09:39:08.487290 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414761    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 09:39:08.487290 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414764    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 09:39:08.487290 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414766    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 09:39:08.487290 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414769    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 09:39:08.487290 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.414771    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 09:39:08.487290 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415128    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 09:39:08.487290 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415134    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 09:39:08.487290 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415136    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 09:39:08.487290 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415141    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 09:39:08.487290 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415144    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 09:39:08.487290 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415147    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 09:39:08.487290 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415151    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 09:39:08.487923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415154    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 09:39:08.487923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415157    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 09:39:08.487923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415159    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 09:39:08.487923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415162    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 09:39:08.487923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415164    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 09:39:08.487923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415167    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 09:39:08.487923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415169    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 09:39:08.487923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415172    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 09:39:08.487923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415175    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 09:39:08.487923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415177    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 09:39:08.487923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415180    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 09:39:08.487923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415182    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 09:39:08.487923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415185    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 09:39:08.487923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415187    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 09:39:08.487923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415190    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 09:39:08.487923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415193    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 09:39:08.487923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415195    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 09:39:08.487923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415198    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 09:39:08.487923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415201    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 09:39:08.487923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415205    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 09:39:08.488557 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415208    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 09:39:08.488557 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415211    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 09:39:08.488557 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415214    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 09:39:08.488557 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415216    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 09:39:08.488557 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415219    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 09:39:08.488557 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415221    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 09:39:08.488557 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415224    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 09:39:08.488557 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415226    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 09:39:08.488557 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415230    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 09:39:08.488557 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415233    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 09:39:08.488557 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415236    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 09:39:08.488557 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415240    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 09:39:08.488557 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415243    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 09:39:08.488557 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415246    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 09:39:08.488557 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415248    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 09:39:08.488557 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415251    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 09:39:08.488557 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415253    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 09:39:08.488557 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415256    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 09:39:08.488557 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415258    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 09:39:08.488557 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415262    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 09:39:08.489205 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415264    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 09:39:08.489205 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415267    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 09:39:08.489205 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415269    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 09:39:08.489205 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415272    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 09:39:08.489205 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415276    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 09:39:08.489205 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415279    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 09:39:08.489205 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415282    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 09:39:08.489205 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415285    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 09:39:08.489205 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415288    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 09:39:08.489205 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415291    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 09:39:08.489205 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415293    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 09:39:08.489205 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415296    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 09:39:08.489205 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415299    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 09:39:08.489205 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415302    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 09:39:08.489205 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415304    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 09:39:08.489205 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415307    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 09:39:08.489205 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415310    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 09:39:08.489205 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415312    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 09:39:08.489205 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415315    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 09:39:08.489205 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415317    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 09:39:08.489883 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415321    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 09:39:08.489883 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415325    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 09:39:08.489883 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415328    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 09:39:08.489883 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415333    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 09:39:08.489883 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415337    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 09:39:08.489883 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415340    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 09:39:08.489883 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415343    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 09:39:08.489883 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415346    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 09:39:08.489883 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415349    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 09:39:08.489883 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415351    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 09:39:08.489883 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415354    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 09:39:08.489883 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415357    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 09:39:08.489883 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415359    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 09:39:08.489883 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415362    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 09:39:08.489883 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415364    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 09:39:08.489883 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415367    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 09:39:08.489883 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415369    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 09:39:08.489883 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415372    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 09:39:08.489883 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415374    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 09:39:08.543308 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415377    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 09:39:08.543308 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415379    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 09:39:08.543308 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415382    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 09:39:08.543308 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415384    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 09:39:08.543308 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415387    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 09:39:08.543308 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415389    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 09:39:08.543308 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415392    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 09:39:08.543308 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415394    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 09:39:08.543308 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415397    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 09:39:08.543308 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415399    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 09:39:08.543308 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415402    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 09:39:08.543308 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415404    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 09:39:08.543308 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.415407    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 09:39:08.543308 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415483    2581 flags.go:64] FLAG: --address="0.0.0.0"
Jul 20 09:39:08.543308 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415494    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 20 09:39:08.543308 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415503    2581 flags.go:64] FLAG: --anonymous-auth="true"
Jul 20 09:39:08.543308 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415511    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 20 09:39:08.543308 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415518    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 20 09:39:08.543308 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415522    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 20 09:39:08.543308 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415526    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 20 09:39:08.543308 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415531    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 20 09:39:08.527216 ip-10-0-140-236 systemd[1]: Started Kubernetes Kubelet.
Jul 20 09:39:08.544348 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415534    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 20 09:39:08.544348 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415537    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 20 09:39:08.544348 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415540    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 20 09:39:08.544348 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415543    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 20 09:39:08.544348 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415547    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 20 09:39:08.544348 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415549    2581 flags.go:64] FLAG: --cgroup-root=""
Jul 20 09:39:08.544348 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415552    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 20 09:39:08.544348 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415556    2581 flags.go:64] FLAG: --client-ca-file=""
Jul 20 09:39:08.544348 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415558    2581 flags.go:64] FLAG: --cloud-provider="external"
Jul 20 09:39:08.544348 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415561    2581 flags.go:64] FLAG: --cluster-dns="[]"
Jul 20 09:39:08.544348 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415565    2581 flags.go:64] FLAG: --cluster-domain=""
Jul 20 09:39:08.544348 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415568    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 20 09:39:08.544348 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415571    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 20 09:39:08.544348 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415574    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 20 09:39:08.544348 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415577    2581 flags.go:64] FLAG: --container-log-max-files="5"
Jul 20 09:39:08.544348 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415581    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 20 09:39:08.544348 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415584    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 20 09:39:08.544348 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415587    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 20 09:39:08.544348 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415590    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 20 09:39:08.544348 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415594    2581 flags.go:64] FLAG: --contention-profiling="false"
Jul 20 09:39:08.544348 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415596    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 20 09:39:08.544348 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415599    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 20 09:39:08.544348 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415602    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 20 09:39:08.544348 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415605    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 20 09:39:08.545217 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415610    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 20 09:39:08.545217 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415613    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 20 09:39:08.545217 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415616    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 20 09:39:08.545217 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415620    2581 flags.go:64] FLAG: --enable-load-reader="false"
Jul 20 09:39:08.545217 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415623    2581 flags.go:64] FLAG: --enable-server="true"
Jul 20 09:39:08.545217 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415627    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 20 09:39:08.545217 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415633    2581 flags.go:64] FLAG: --event-burst="100"
Jul 20 09:39:08.545217 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415636    2581 flags.go:64] FLAG: --event-qps="50"
Jul 20 09:39:08.545217 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415639    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 20 09:39:08.545217 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415642    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 20 09:39:08.545217 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415645    2581 flags.go:64] FLAG: --eviction-hard=""
Jul 20 09:39:08.545217 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415649    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 20 09:39:08.545217 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415652    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 20 09:39:08.545217 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415654    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 20 09:39:08.545217 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415657    2581 flags.go:64] FLAG: --eviction-soft=""
Jul 20 09:39:08.545217 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415660    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 20 09:39:08.545217 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415663    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 20 09:39:08.545217 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415666    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 20 09:39:08.545217 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415669    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 20 09:39:08.545217 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415672    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 20 09:39:08.545217 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415674    2581 flags.go:64] FLAG: --fail-swap-on="true"
Jul 20 09:39:08.545217 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415677    2581 flags.go:64] FLAG: --feature-gates=""
Jul 20 09:39:08.545217 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415681    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 20 09:39:08.545217 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415684    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 20 09:39:08.545217 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415687    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 20 09:39:08.546117 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415690    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 20 09:39:08.546117 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415693    2581 flags.go:64] FLAG: --healthz-port="10248"
Jul 20 09:39:08.546117 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415696    2581 flags.go:64] FLAG: --help="false"
Jul 20 09:39:08.546117 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415699    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-140-236.ec2.internal"
Jul 20 09:39:08.546117 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415702    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 20 09:39:08.546117 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415705    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 20 09:39:08.546117 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415708    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 20 09:39:08.546117 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415713    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 20 09:39:08.546117 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415717    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 20 09:39:08.546117 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415720    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 20 09:39:08.546117 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415725    2581 flags.go:64] FLAG: --image-service-endpoint=""
Jul 20 09:39:08.546117 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415728    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 20 09:39:08.546117 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415731    2581 flags.go:64] FLAG: --kube-api-burst="100"
Jul 20 09:39:08.546117 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415734    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 20 09:39:08.546117 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415737    2581 flags.go:64] FLAG: --kube-api-qps="50"
Jul 20 09:39:08.546117 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415740    2581 flags.go:64] FLAG: --kube-reserved=""
Jul 20 09:39:08.546117 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415743    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 20 09:39:08.546117 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415746    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 20 09:39:08.546117 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415749    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 20 09:39:08.546117 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415752    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 20 09:39:08.546117 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415754    2581 flags.go:64] FLAG: --lock-file=""
Jul 20 09:39:08.546117 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415757    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 20 09:39:08.546117 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415760    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 20 09:39:08.546117 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415763    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 20 09:39:08.547346 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415769    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 20 09:39:08.547346 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415772    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 20 09:39:08.547346 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415774    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 20 09:39:08.547346 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415777    2581 flags.go:64] FLAG: --logging-format="text"
Jul 20 09:39:08.547346 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415780    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 20 09:39:08.547346 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415783    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 20 09:39:08.547346 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415786    2581 flags.go:64] FLAG: --manifest-url=""
Jul 20 09:39:08.547346 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415789    2581 flags.go:64] FLAG: --manifest-url-header=""
Jul 20 09:39:08.547346 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415793    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 20 09:39:08.547346 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415796    2581 flags.go:64] FLAG: --max-open-files="1000000"
Jul 20 09:39:08.547346 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415800    2581 flags.go:64] FLAG: --max-pods="110"
Jul 20 09:39:08.547346 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415803    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 20 09:39:08.547346 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415805    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 20 09:39:08.547346 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415808    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 20 09:39:08.547346 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415811    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 20 09:39:08.547346 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415815    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 20 09:39:08.547346 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415818    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 20 09:39:08.547346 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415821    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 20 09:39:08.547346 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415829    2581 flags.go:64] FLAG: --node-status-max-images="50"
Jul 20 09:39:08.547346 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415832    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 20 09:39:08.547346 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415835    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 20 09:39:08.547346 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415838    2581 flags.go:64] FLAG: --pod-cidr=""
Jul 20 09:39:08.547346 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415845    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 20 09:39:08.548468 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415850    2581 flags.go:64] FLAG: --pod-manifest-path=""
Jul 20 09:39:08.548468 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415853    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 20 09:39:08.548468 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415856    2581 flags.go:64] FLAG: --pods-per-core="0"
Jul 20 09:39:08.548468 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415859    2581 flags.go:64] FLAG: --port="10250"
Jul 20 09:39:08.548468 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415862    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 20 09:39:08.548468 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415865    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-095aeb1d30b05566f"
Jul 20 09:39:08.548468 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415868    2581 flags.go:64] FLAG: --qos-reserved=""
Jul 20 09:39:08.548468 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415871    2581 flags.go:64] FLAG: --read-only-port="10255"
Jul 20 09:39:08.548468 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415874    2581 flags.go:64] FLAG: --register-node="true"
Jul 20 09:39:08.548468 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415877    2581 flags.go:64] FLAG: --register-with-taints=""
Jul 20 09:39:08.548468 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415880    2581 flags.go:64] FLAG: --registry-burst="10"
Jul 20 09:39:08.548468 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415883    2581 flags.go:64] FLAG: --registry-qps="5"
Jul 20 09:39:08.548468 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415886    2581 flags.go:64] FLAG: --reserved-cpus=""
Jul 20 09:39:08.548468 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415888    2581 flags.go:64] FLAG: --reserved-memory=""
Jul 20 09:39:08.548468 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415892    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 20 09:39:08.548468 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415895    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 20 09:39:08.548468 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415898    2581 flags.go:64] FLAG: --rotate-certificates="false"
Jul 20 09:39:08.548468 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415901    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 20 09:39:08.548468 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415904    2581 flags.go:64] FLAG: --runonce="false"
Jul 20 09:39:08.548468 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415906    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 20 09:39:08.548468 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415909    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 20 09:39:08.548468 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415912    2581 flags.go:64] FLAG: --seccomp-default="false"
Jul 20 09:39:08.548468 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415915    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 20 09:39:08.548468 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415918    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 20 09:39:08.548468 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415921    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 20 09:39:08.548468 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415926    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 20 09:39:08.549850 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415929    2581 flags.go:64] FLAG: --storage-driver-password="root"
Jul 20 09:39:08.549850 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415934    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 20 09:39:08.549850 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415937    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 20 09:39:08.549850 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415940    2581 flags.go:64] FLAG: --storage-driver-user="root"
Jul 20 09:39:08.549850 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415943    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 20 09:39:08.549850 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415946    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 20 09:39:08.549850 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415949    2581 flags.go:64] FLAG: --system-cgroups=""
Jul 20 09:39:08.549850 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415952    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 20 09:39:08.549850 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415971    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 20 09:39:08.549850 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415976    2581 flags.go:64] FLAG: --tls-cert-file=""
Jul 20 09:39:08.549850 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415981    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 20 09:39:08.549850 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415985    2581 flags.go:64] FLAG: --tls-min-version=""
Jul 20 09:39:08.549850 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415988    2581 flags.go:64] FLAG: --tls-private-key-file=""
Jul 20 09:39:08.549850 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415991    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 20 09:39:08.549850 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415993    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 20 09:39:08.549850 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415996    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 20 09:39:08.549850 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.415999    2581 flags.go:64] FLAG: --v="2"
Jul 20 09:39:08.549850 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.416003    2581 flags.go:64] FLAG: --version="false"
Jul 20 09:39:08.549850 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.416007    2581 flags.go:64] FLAG: --vmodule=""
Jul 20 09:39:08.549850 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.416011    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 20 09:39:08.549850 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.416014    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 20 09:39:08.549850 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416122    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 09:39:08.549850 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416126    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 09:39:08.549850 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416129    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 09:39:08.551025 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416132    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 09:39:08.551025 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416135    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 09:39:08.551025 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416138    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 09:39:08.551025 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416140    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 09:39:08.551025 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416143    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 09:39:08.551025 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416145    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 09:39:08.551025 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416148    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 09:39:08.551025 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416152    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 09:39:08.551025 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416155    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 09:39:08.551025 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416159    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 09:39:08.551025 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416161    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 09:39:08.551025 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416164    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 09:39:08.551025 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416167    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 09:39:08.551025 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416170    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 09:39:08.551025 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416172    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 09:39:08.551025 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416176    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 09:39:08.551025 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416178    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 09:39:08.551025 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416181    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 09:39:08.551025 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416184    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 09:39:08.551025 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416186    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 09:39:08.552192 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416189    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 09:39:08.552192 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416191    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 09:39:08.552192 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416194    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 09:39:08.552192 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416196    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 09:39:08.552192 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416199    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 09:39:08.552192 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416202    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 09:39:08.552192 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416206    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 09:39:08.552192 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416209    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 09:39:08.552192 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416212    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 09:39:08.552192 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416215    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 09:39:08.552192 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416218    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 09:39:08.552192 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416220    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 09:39:08.552192 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416222    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 09:39:08.552192 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416225    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 09:39:08.552192 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416227    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 09:39:08.552192 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416230    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 09:39:08.552192 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416233    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 09:39:08.552192 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416235    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 09:39:08.552192 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416238    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 09:39:08.553312 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416241    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 09:39:08.553312 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416244    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 09:39:08.553312 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416248    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 09:39:08.553312 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416250    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 09:39:08.553312 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416253    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 09:39:08.553312 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416256    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 09:39:08.553312 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416259    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 09:39:08.553312 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416263    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 09:39:08.553312 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416265    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 09:39:08.553312 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416269    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 09:39:08.553312 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416271    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 09:39:08.553312 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416275    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 09:39:08.553312 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416278    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 09:39:08.553312 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416280    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 09:39:08.553312 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416283    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 09:39:08.553312 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416285    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 09:39:08.553312 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416288    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 09:39:08.553312 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416290    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 09:39:08.553312 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416293    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 09:39:08.553956 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416295    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 09:39:08.553956 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416298    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 09:39:08.553956 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416300    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 09:39:08.553956 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416303    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 09:39:08.553956 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416305    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 09:39:08.553956 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416308    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 09:39:08.553956 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416310    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 09:39:08.553956 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416313    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 09:39:08.553956 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416315    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 09:39:08.553956 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416318    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 09:39:08.553956 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416320    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 09:39:08.553956 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416323    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 09:39:08.553956 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416326    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 09:39:08.553956 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416329    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 09:39:08.553956 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416332    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 09:39:08.553956 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416336    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 09:39:08.553956 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416339    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 09:39:08.553956 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416341    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 09:39:08.553956 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416344    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 09:39:08.553956 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416347    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 09:39:08.553956 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416349    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 09:39:08.554600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416352    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 09:39:08.554600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416354    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 09:39:08.554600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416358    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 09:39:08.554600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416360    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 09:39:08.554600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416363    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 09:39:08.554600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416365    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 09:39:08.554600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416369    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 09:39:08.554600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416372    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 09:39:08.554600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416375    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 09:39:08.554600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416377    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 09:39:08.554600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416380    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 09:39:08.554600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416382    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 09:39:08.554600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416385    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 09:39:08.554600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416388    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 09:39:08.554600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416390    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 09:39:08.554600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416393    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 09:39:08.554600 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.416395    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 09:39:08.555249 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.416404    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 09:39:08.555249 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.465363    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 20 09:39:08.555249 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.465380    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 20 09:39:08.555249 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.465399    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 20 09:39:08.555249 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.465405    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 20 09:39:08.555249 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465457    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 09:39:08.555249 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465462    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 09:39:08.555249 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465466    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 09:39:08.555249 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465469    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 09:39:08.555249 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465472    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 09:39:08.555249 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465476    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 09:39:08.555249 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465482    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 09:39:08.555249 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465485    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 09:39:08.555249 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465487    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 09:39:08.555679 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465490    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 09:39:08.555679 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465493    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 09:39:08.555679 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465496    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 09:39:08.555679 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465499    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 09:39:08.555679 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465501    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 09:39:08.555679 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465504    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 09:39:08.555679 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465508    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 09:39:08.555679 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465511    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 09:39:08.555679 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465513    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 09:39:08.555679 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465516    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 09:39:08.555679 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465518    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 09:39:08.555679 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465521    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 09:39:08.555679 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465524    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 09:39:08.555679 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465526    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 09:39:08.555679 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465529    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 09:39:08.555679 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465531    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 09:39:08.555679 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465534    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 09:39:08.555679 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465536    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 09:39:08.555679 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465539    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 09:39:08.556335 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465542    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 09:39:08.556335 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465545    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 09:39:08.556335 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465547    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 09:39:08.556335 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465550    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 09:39:08.556335 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465554    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 09:39:08.556335 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465558    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 09:39:08.556335 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465561    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 09:39:08.556335 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465563    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 09:39:08.556335 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465566    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 09:39:08.556335 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465568    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 09:39:08.556335 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465573    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 09:39:08.556335 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465575    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 09:39:08.556335 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465578    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 09:39:08.556335 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465580    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 09:39:08.556335 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465583    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 09:39:08.556335 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465586    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 09:39:08.556335 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465588    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 09:39:08.556335 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465591    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 09:39:08.556335 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465593    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 09:39:08.556335 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465597    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 09:39:08.559177 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465599    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 09:39:08.559177 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465602    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 09:39:08.559177 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465604    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 09:39:08.559177 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465608    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 09:39:08.559177 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465612    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 09:39:08.559177 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465614    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 09:39:08.559177 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465617    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 09:39:08.559177 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465620    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 09:39:08.559177 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465622    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 09:39:08.559177 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465625    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 09:39:08.559177 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465628    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 09:39:08.559177 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465631    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 09:39:08.559177 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465634    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 09:39:08.559177 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465636    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 09:39:08.559177 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465639    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 09:39:08.559177 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465642    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 09:39:08.559177 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465645    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 09:39:08.559177 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465649    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 09:39:08.559177 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465652    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 09:39:08.559799 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465654    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 09:39:08.559799 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465657    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 09:39:08.559799 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465659    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 09:39:08.559799 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465663    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 09:39:08.559799 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465666    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 09:39:08.559799 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465669    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 09:39:08.559799 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465671    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 09:39:08.559799 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465674    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 09:39:08.559799 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465676    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 09:39:08.559799 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465679    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 09:39:08.559799 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465681    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 09:39:08.559799 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465684    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 09:39:08.559799 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465688    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 09:39:08.559799 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465691    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 09:39:08.559799 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465694    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 09:39:08.559799 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465696    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 09:39:08.559799 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465699    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 09:39:08.559799 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465701    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 09:39:08.559799 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465704    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 09:39:08.559799 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465706    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 09:39:08.566008 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465709    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 09:39:08.566008 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465711    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 09:39:08.566008 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465714    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 09:39:08.566008 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465716    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 09:39:08.566008 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465719    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 09:39:08.566008 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465721    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 09:39:08.566008 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465724    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 09:39:08.566008 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465726    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 09:39:08.566008 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465730    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 09:39:08.566008 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465733    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 09:39:08.566008 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465736    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 09:39:08.566008 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465738    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 09:39:08.566008 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.465743    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 09:39:08.566008 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465849    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 09:39:08.566008 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465852    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 09:39:08.566642 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465855    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 09:39:08.566642 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465860    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 09:39:08.566642 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465863    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 09:39:08.566642 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465866    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 09:39:08.566642 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465868    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 09:39:08.566642 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465871    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 09:39:08.566642 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465873    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 09:39:08.566642 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465876    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 09:39:08.566642 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465878    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 09:39:08.566642 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465882    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 09:39:08.566642 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465887    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 09:39:08.566642 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465890    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 09:39:08.566642 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465893    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 09:39:08.566642 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465896    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 09:39:08.566642 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465899    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 09:39:08.566642 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465901    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 09:39:08.566642 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465904    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 09:39:08.566642 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465907    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 09:39:08.566642 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465909    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 09:39:08.567285 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465912    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 09:39:08.567285 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465914    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 09:39:08.567285 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465917    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 09:39:08.567285 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465919    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 09:39:08.567285 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465922    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 09:39:08.567285 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465924    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 09:39:08.567285 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465927    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 09:39:08.567285 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465930    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 09:39:08.567285 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465932    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 09:39:08.567285 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465935    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 09:39:08.567285 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465938    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 09:39:08.567285 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465940    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 09:39:08.567285 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465943    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 09:39:08.567285 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465945    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 09:39:08.567285 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465949    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 09:39:08.567285 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465952    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 09:39:08.567285 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465955    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 09:39:08.567285 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465979    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 09:39:08.567285 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465983    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 09:39:08.629923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465986    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 09:39:08.629923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465988    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 09:39:08.629923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465991    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 09:39:08.629923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465994    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 09:39:08.629923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.465997    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 09:39:08.629923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466000    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 09:39:08.629923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466002    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 09:39:08.629923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466005    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 09:39:08.629923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466007    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 09:39:08.629923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466010    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 09:39:08.629923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466012    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 09:39:08.629923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466015    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 09:39:08.629923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466017    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 09:39:08.629923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466020    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 09:39:08.629923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466022    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 09:39:08.629923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466025    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 09:39:08.629923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466027    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 09:39:08.629923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466030    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 09:39:08.629923 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466032    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 09:39:08.630548 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466035    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 09:39:08.630548 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466037    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 09:39:08.630548 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466041    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 09:39:08.630548 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466043    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 09:39:08.630548 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466045    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 09:39:08.630548 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466048    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 09:39:08.630548 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466050    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 09:39:08.630548 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466053    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 09:39:08.630548 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466057    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 09:39:08.630548 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466060    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 09:39:08.630548 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466062    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 09:39:08.630548 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466064    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 09:39:08.630548 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466067    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 09:39:08.630548 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466069    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 09:39:08.630548 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466072    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 09:39:08.630548 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466075    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 09:39:08.630548 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466078    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 09:39:08.630548 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466081    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 09:39:08.630548 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466084    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 09:39:08.630548 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466086    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 09:39:08.630548 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466089    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 09:39:08.631449 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466091    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 09:39:08.631449 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466094    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 09:39:08.631449 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466097    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 09:39:08.631449 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466099    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 09:39:08.631449 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466102    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 09:39:08.631449 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466104    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 09:39:08.631449 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466106    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 09:39:08.631449 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466110    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 09:39:08.631449 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466114    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 09:39:08.631449 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466116    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 09:39:08.631449 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466119    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 09:39:08.631449 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466122    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 09:39:08.631449 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466125    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 09:39:08.631449 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466128    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 09:39:08.631449 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466131    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 09:39:08.631449 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466134    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 09:39:08.631449 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466136    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 09:39:08.631449 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466138    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 09:39:08.631449 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:08.466141    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 09:39:08.632239 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.466147    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 09:39:08.632239 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.466263    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 20 09:39:08.632239 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.468326    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 20 09:39:08.632239 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.469828    2581 server.go:1019] "Starting client certificate rotation"
Jul 20 09:39:08.632239 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.469935    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 09:39:08.632239 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.470015    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 09:39:08.632239 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.472638    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 09:39:08.632239 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.474412    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 09:39:08.632239 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.492573    2581 log.go:25] "Validated CRI v1 runtime API"
Jul 20 09:39:08.632239 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.495104    2581 log.go:25] "Validated CRI v1 image API"
Jul 20 09:39:08.632239 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.495854    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 20 09:39:08.632239 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.497929    2581 fs.go:135] Filesystem UUIDs: map[1d756fa2-21f4-4857-93c5-1d713db14ab2:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 914427c0-d745-420e-81ba-86470dfe66ca:/dev/nvme0n1p4]
Jul 20 09:39:08.632642 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.497945    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 20 09:39:08.632642 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.502973    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 09:39:08.633285 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.503440    2581 manager.go:216] Machine: {Timestamp:2026-07-20 09:39:08.502248066 +0000 UTC m=+0.383694386 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101408 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec249210d2f88e0d4c44826d47a6b359 SystemUUID:ec249210-d2f8-8e0d-4c44-826d47a6b359 BootID:21d4da55-5956-445d-b4a7-75ed192d7aae Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d4:fd:dc:3d:49 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d4:fd:dc:3d:49 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:95:74:09:a9:f4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 20 09:39:08.633285 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.503548    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 20 09:39:08.633285 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.503648    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 20 09:39:08.633285 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.506842    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 20 09:39:08.633285 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.506863    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-236.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 20 09:39:08.633285 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.507564    2581 topology_manager.go:138] "Creating topology manager with none policy"
Jul 20 09:39:08.633285 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.507573    2581 container_manager_linux.go:309] "Creating device plugin manager"
Jul 20 09:39:08.633285 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.507580    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 09:39:08.633285 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.508328    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 09:39:08.633285 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.509794    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 20 09:39:08.633285 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.512664    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 09:39:08.633285 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.512779    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 20 09:39:08.633285 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.512805    2581 kubelet.go:486] "Attempting to sync node with API server"
Jul 20 09:39:08.633285 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.512818    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 20 09:39:08.633285 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.512832    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 20 09:39:08.633285 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.512840    2581 kubelet.go:398] "Adding apiserver pod source"
Jul 20 09:39:08.633285 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.512848    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 20 09:39:08.633285 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.513187    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.513205    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.515260    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.517258    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.517285    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.518700    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.518713    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.518719    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.518724    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.518733    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.518738    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.518745    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.518751    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.518761    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.518767    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.518775    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.518780    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.519790    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.519805    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.523028    2581 server.go:1268] "Started kubelet"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.523122    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.526706    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.526758    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.528012    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lf95h"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.529224    2581 server.go:310] "Adding debug handlers to kubelet server"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.530407    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:08.532152    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.536048    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.536062    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:08.536114    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-236.ec2.internal\" not found"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.536709    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.536723    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.536735    2581 factory.go:55] Registering systemd factory
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.536743    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.536749    2581 factory.go:223] Registration of the systemd container factory successfully
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.536813    2581 reconstruct.go:97] "Volume reconstruction finished"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.536821    2581 reconciler.go:29] "Reconciler: start to sync state"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.536954    2581 factory.go:153] Registering CRI-O factory
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.536984    2581 factory.go:223] Registration of the crio container factory successfully
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.537042    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.537060    2581 factory.go:103] Registering Raw factory
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.537074    2581 manager.go:1196] Started watching for new ooms in manager
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.537461    2581 manager.go:349] Starting recovery of all containers
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.537482    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lf95h"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.547370    2581 manager.go:354] Recovery completed
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.551686    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.578320    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.578352    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.578367    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasSufficientPID"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:08.578777    2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-236.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 20 09:39:08.633912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.578854    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 20 09:39:08.635416 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.578862    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 09:39:08.635416 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.578865    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 20 09:39:08.635416 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.578896    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 09:39:08.635416 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.579412    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-236.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 20 09:39:08.635416 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.579540    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 09:39:08.635416 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.579572    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 09:39:08.635416 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.579583    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasSufficientPID"
Jul 20 09:39:08.635416 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:08.579613    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 20 09:39:08.635416 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:08.579614    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 20 09:39:08.635416 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:08.579613    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-236.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 20 09:39:08.635416 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:08.578869    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-236.ec2.internal.18c3f5fdf910b448  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-236.ec2.internal,UID:ip-10-0-140-236.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-236.ec2.internal,},FirstTimestamp:2026-07-20 09:39:08.523000904 +0000 UTC m=+0.404447205,LastTimestamp:2026-07-20 09:39:08.523000904 +0000 UTC m=+0.404447205,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-236.ec2.internal,}"
Jul 20 09:39:08.635416 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.580026    2581 policy_none.go:49] "None policy: Start"
Jul 20 09:39:08.635416 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.580038    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 20 09:39:08.635416 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.580048    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 20 09:39:08.635416 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.581300    2581 policy_none.go:47] "Start"
Jul 20 09:39:08.636679 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:08.636324    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-236.ec2.internal\" not found"
Jul 20 09:39:08.736080 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.693628    2581 manager.go:337] "Starting Device Plugin manager"
Jul 20 09:39:08.736080 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:08.693784    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 20 09:39:08.736080 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.693796    2581 server.go:87] "Starting device plugin registration server"
Jul 20 09:39:08.736080 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.694035    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 20 09:39:08.736080 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.694046    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 20 09:39:08.736080 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.694134    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 20 09:39:08.736080 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.694203    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 20 09:39:08.736080 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:08.694211    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 20 09:39:08.736080 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:08.694681    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 20 09:39:08.736080 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:08.694733    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-236.ec2.internal\" not found"
Jul 20 09:39:09.417474 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.417452    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 09:39:09.418664 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.418645    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 09:39:09.418760 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.418680    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 09:39:09.418760 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.418692    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasSufficientPID"
Jul 20 09:39:09.418760 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.418720    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-236.ec2.internal"
Jul 20 09:39:09.427814 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:09.427758    2581 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-236.ec2.internal\" not found" node="ip-10-0-140-236.ec2.internal"
Jul 20 09:39:09.428725 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.428707    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-236.ec2.internal"
Jul 20 09:39:09.428768 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:09.428736    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-236.ec2.internal\": node \"ip-10-0-140-236.ec2.internal\" not found"
Jul 20 09:39:09.456930 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.456906    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 20 09:39:09.458145 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.458129    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 20 09:39:09.458232 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.458177    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 20 09:39:09.458232 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.458203    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 20 09:39:09.458334 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:09.458244    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 20 09:39:09.463584 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.463564    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 09:39:09.469154 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.469140    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 20 09:39:09.469578 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:09.469272    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{}\" for node \"ip-10-0-140-236.ec2.internal\": Patch \"https://a7b96ae60c8a94500b31f5cf65e477ab-eeb1d14d881e3edf.elb.us-east-1.amazonaws.com:6443/api/v1/nodes/ip-10-0-140-236.ec2.internal/status?timeout=10s\": read tcp 10.0.140.236:33526->34.204.143.137:6443: use of closed network connection"
Jul 20 09:39:09.469578 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.469304    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 09:39:09.469578 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:09.469300    2581 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://a7b96ae60c8a94500b31f5cf65e477ab-eeb1d14d881e3edf.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-140-236.ec2.internal.18c3f5fdfc5d96f3\": read tcp 10.0.140.236:33526->34.204.143.137:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-140-236.ec2.internal.18c3f5fdfc5d96f3  default   6563 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-236.ec2.internal,UID:ip-10-0-140-236.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-236.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-236.ec2.internal,},FirstTimestamp:2026-07-20 09:39:08 +0000 UTC,LastTimestamp:2026-07-20 09:39:09.418696109 +0000 UTC m=+1.300142410,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-236.ec2.internal,}"
Jul 20 09:39:09.515390 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:09.515367    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-236.ec2.internal\" not found"
Jul 20 09:39:09.541491 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.541461    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 09:34:08 +0000 UTC" deadline="2028-04-04 17:55:32.979637612 +0000 UTC"
Jul 20 09:39:09.541491 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.541486    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14984h16m23.438154091s"
Jul 20 09:39:09.559548 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.559524    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-236.ec2.internal"]
Jul 20 09:39:09.559599 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.559585    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 09:39:09.561738 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.561715    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 09:39:09.561794 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.561744    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 09:39:09.561794 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.561759    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasSufficientPID"
Jul 20 09:39:09.563254 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.563235    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 09:39:09.563356 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.563326    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal"
Jul 20 09:39:09.563409 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.563366    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 09:39:09.564076 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.564060    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 09:39:09.564159 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.564089    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 09:39:09.564159 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.564103    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasSufficientPID"
Jul 20 09:39:09.564159 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.564117    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 09:39:09.564159 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.564141    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 09:39:09.564159 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.564152    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasSufficientPID"
Jul 20 09:39:09.565720 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.565701    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-236.ec2.internal"
Jul 20 09:39:09.565812 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.565734    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 09:39:09.566538 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.566519    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 09:39:09.566616 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.566543    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 09:39:09.566616 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.566554    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeHasSufficientPID"
Jul 20 09:39:09.590729 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:09.590702    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-236.ec2.internal\" not found" node="ip-10-0-140-236.ec2.internal"
Jul 20 09:39:09.595295 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:09.595278    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-236.ec2.internal\" not found" node="ip-10-0-140-236.ec2.internal"
Jul 20 09:39:09.615974 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:09.615948    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-236.ec2.internal\" not found"
Jul 20 09:39:09.654783 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.654763    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 09:39:09.689847 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.689794    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8ef5df63ddb7b5d72473f9f24434be4d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal\" (UID: \"8ef5df63ddb7b5d72473f9f24434be4d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal"
Jul 20 09:39:09.689847 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.689827    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ef5df63ddb7b5d72473f9f24434be4d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal\" (UID: \"8ef5df63ddb7b5d72473f9f24434be4d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal"
Jul 20 09:39:09.689991 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.689891    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b2bd58dc38956b1c8ecf2cf823b81fbf-config\") pod \"kube-apiserver-proxy-ip-10-0-140-236.ec2.internal\" (UID: \"b2bd58dc38956b1c8ecf2cf823b81fbf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-236.ec2.internal"
Jul 20 09:39:09.716221 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:09.716190    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-236.ec2.internal\" not found"
Jul 20 09:39:09.794480 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.794453    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ef5df63ddb7b5d72473f9f24434be4d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal\" (UID: \"8ef5df63ddb7b5d72473f9f24434be4d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal"
Jul 20 09:39:09.794559 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.794411    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ef5df63ddb7b5d72473f9f24434be4d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal\" (UID: \"8ef5df63ddb7b5d72473f9f24434be4d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal"
Jul 20 09:39:09.794559 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.794522    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b2bd58dc38956b1c8ecf2cf823b81fbf-config\") pod \"kube-apiserver-proxy-ip-10-0-140-236.ec2.internal\" (UID: \"b2bd58dc38956b1c8ecf2cf823b81fbf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-236.ec2.internal"
Jul 20 09:39:09.794559 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.794541    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8ef5df63ddb7b5d72473f9f24434be4d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal\" (UID: \"8ef5df63ddb7b5d72473f9f24434be4d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal"
Jul 20 09:39:09.794702 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.794578    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8ef5df63ddb7b5d72473f9f24434be4d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal\" (UID: \"8ef5df63ddb7b5d72473f9f24434be4d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal"
Jul 20 09:39:09.794702 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.794630    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b2bd58dc38956b1c8ecf2cf823b81fbf-config\") pod \"kube-apiserver-proxy-ip-10-0-140-236.ec2.internal\" (UID: \"b2bd58dc38956b1c8ecf2cf823b81fbf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-236.ec2.internal"
Jul 20 09:39:09.817239 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:09.817209    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-236.ec2.internal\" not found"
Jul 20 09:39:09.894461 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.894433    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal"
Jul 20 09:39:09.898788 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.898435    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-236.ec2.internal"
Jul 20 09:39:09.917662 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:09.917636    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-236.ec2.internal\" not found"
Jul 20 09:39:09.944075 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:09.944025    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 09:39:10.018117 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:10.018089    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-236.ec2.internal\" not found"
Jul 20 09:39:10.101121 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.101099    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 09:39:10.137367 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.137341    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal"
Jul 20 09:39:10.151395 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.151373    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 09:39:10.152521 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.152508    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-236.ec2.internal"
Jul 20 09:39:10.164891 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.164873    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 09:39:10.492369 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:10.492335    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ef5df63ddb7b5d72473f9f24434be4d.slice/crio-1fa84c0102f2fddee2332b18a3827583ad3a8817000cd16cd79ffe08186d2321 WatchSource:0}: Error finding container 1fa84c0102f2fddee2332b18a3827583ad3a8817000cd16cd79ffe08186d2321: Status 404 returned error can't find the container with id 1fa84c0102f2fddee2332b18a3827583ad3a8817000cd16cd79ffe08186d2321
Jul 20 09:39:10.497097 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.497080    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 09:39:10.514621 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.514596    2581 apiserver.go:52] "Watching apiserver"
Jul 20 09:39:10.523516 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.522880    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 20 09:39:10.525873 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.525816    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xflk2","openshift-cluster-node-tuning-operator/tuned-77vlz","openshift-dns/node-resolver-pxtqn","openshift-multus/multus-additional-cni-plugins-fvswj","openshift-multus/network-metrics-daemon-fnzkg","openshift-network-operator/iptables-alerter-lg8hz","kube-system/konnectivity-agent-8q9d8","kube-system/kube-apiserver-proxy-ip-10-0-140-236.ec2.internal","openshift-image-registry/node-ca-nk6p8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal","openshift-multus/multus-rrbzg","openshift-network-diagnostics/network-check-target-d76tg","openshift-ovn-kubernetes/ovnkube-node-rgb4r","kube-system/global-pull-secret-syncer-xqb2z"]
Jul 20 09:39:10.528017 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.527997    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8q9d8"
Jul 20 09:39:10.530107 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.530083    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.530628 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.530594    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 20 09:39:10.530714 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.530650    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fwpzl\""
Jul 20 09:39:10.530714 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.530657    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 20 09:39:10.531660 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.531636    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pxtqn"
Jul 20 09:39:10.532264 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.532243    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 20 09:39:10.532264 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.532262    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 20 09:39:10.532440 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.532305    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 20 09:39:10.532813 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.532795    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 20 09:39:10.532912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.532827    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 20 09:39:10.533120 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.533103    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fvswj"
Jul 20 09:39:10.533784 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.533758    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 20 09:39:10.533879 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.533855    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-79h7l\""
Jul 20 09:39:10.533948 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.533855    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xtf86\""
Jul 20 09:39:10.533948 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.533903    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 20 09:39:10.534085 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.533977    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 20 09:39:10.534467 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.534450    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:10.534566 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:10.534531    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnzkg" podUID="2450d682-ad31-4104-b469-603d43b7b1b2"
Jul 20 09:39:10.535206 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.535193    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 20 09:39:10.535890 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.535838    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lg8hz"
Jul 20 09:39:10.535890 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.535866    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 20 09:39:10.536252 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.536230    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 20 09:39:10.536350 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.536288    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 20 09:39:10.536483 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.536468    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 20 09:39:10.536554 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.536512    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xm7ld\""
Jul 20 09:39:10.537446 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.537425    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 20 09:39:10.537834 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.537816    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nk6p8"
Jul 20 09:39:10.538597 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.538565    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 20 09:39:10.538597 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.538588    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kbvld\""
Jul 20 09:39:10.538784 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.538589    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 20 09:39:10.538784 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.538645    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 20 09:39:10.539910 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.539891    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xflk2"
Jul 20 09:39:10.540012 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.539922    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-x2ghp\""
Jul 20 09:39:10.540097 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.539897    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 20 09:39:10.540420 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.540398    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 20 09:39:10.540507 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.540399    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 20 09:39:10.541438 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.541421    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.541899 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.541883    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ttkbh\""
Jul 20 09:39:10.541996 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.541918    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 20 09:39:10.542412 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.542393    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 20 09:39:10.542698 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.542683    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 20 09:39:10.542945 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.542928    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:10.543048 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:10.543014    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqb2z" podUID="82e7c25c-d929-4258-8f87-ddfadcf5042e"
Jul 20 09:39:10.543444 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.543427    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 20 09:39:10.543885 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.543863    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 20 09:39:10.543999 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.543945    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jz444\""
Jul 20 09:39:10.544536 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.544519    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.547267 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.547243    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8tnzg\""
Jul 20 09:39:10.547634 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.547594    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 20 09:39:10.547879 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.547859    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:39:10.548272 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:10.548248    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d76tg" podUID="8e667eae-fd03-4ae1-b97d-1af58fb5e8fc"
Jul 20 09:39:10.551569 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.551549    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 09:39:10.567169 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:10.567148    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2bd58dc38956b1c8ecf2cf823b81fbf.slice/crio-b11beb25eff540d705c67c1922a0687219eadef0f03c03fc000a9e066cc5c558 WatchSource:0}: Error finding container b11beb25eff540d705c67c1922a0687219eadef0f03c03fc000a9e066cc5c558: Status 404 returned error can't find the container with id b11beb25eff540d705c67c1922a0687219eadef0f03c03fc000a9e066cc5c558
Jul 20 09:39:10.576554 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.576536    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9s6mw"
Jul 20 09:39:10.585726 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.585704    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9s6mw"
Jul 20 09:39:10.605912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.605889    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-host-slash\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.606019 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.605916    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-host-cni-bin\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.606019 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.605934    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99b0f7f9-46d3-4e18-a6b2-adf14bf396ea-tmp-dir\") pod \"node-resolver-pxtqn\" (UID: \"99b0f7f9-46d3-4e18-a6b2-adf14bf396ea\") " pod="openshift-dns/node-resolver-pxtqn"
Jul 20 09:39:10.606019 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.605953    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5dc72568-b630-42a0-8c33-58bcd45517ed-iptables-alerter-script\") pod \"iptables-alerter-lg8hz\" (UID: \"5dc72568-b630-42a0-8c33-58bcd45517ed\") " pod="openshift-network-operator/iptables-alerter-lg8hz"
Jul 20 09:39:10.606019 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.605996    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2qft\" (UniqueName: \"kubernetes.io/projected/5dc72568-b630-42a0-8c33-58bcd45517ed-kube-api-access-p2qft\") pod \"iptables-alerter-lg8hz\" (UID: \"5dc72568-b630-42a0-8c33-58bcd45517ed\") " pod="openshift-network-operator/iptables-alerter-lg8hz"
Jul 20 09:39:10.606019 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606015    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh6zs\" (UniqueName: \"kubernetes.io/projected/6475a644-97bb-467b-9bc6-b5482c92779c-kube-api-access-gh6zs\") pod \"node-ca-nk6p8\" (UID: \"6475a644-97bb-467b-9bc6-b5482c92779c\") " pod="openshift-image-registry/node-ca-nk6p8"
Jul 20 09:39:10.606224 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606030    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2450d682-ad31-4104-b469-603d43b7b1b2-metrics-certs\") pod \"network-metrics-daemon-fnzkg\" (UID: \"2450d682-ad31-4104-b469-603d43b7b1b2\") " pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:10.606224 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606051    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/39085fd7-7be1-4a24-9096-a11447449c89-agent-certs\") pod \"konnectivity-agent-8q9d8\" (UID: \"39085fd7-7be1-4a24-9096-a11447449c89\") " pod="kube-system/konnectivity-agent-8q9d8"
Jul 20 09:39:10.606224 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606075    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-node-log\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.606224 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606124    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdgn9\" (UniqueName: \"kubernetes.io/projected/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-kube-api-access-bdgn9\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.606224 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606161    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b-cnibin\") pod \"multus-additional-cni-plugins-fvswj\" (UID: \"41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b\") " pod="openshift-multus/multus-additional-cni-plugins-fvswj"
Jul 20 09:39:10.606224 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606179    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b-os-release\") pod \"multus-additional-cni-plugins-fvswj\" (UID: \"41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b\") " pod="openshift-multus/multus-additional-cni-plugins-fvswj"
Jul 20 09:39:10.606224 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606194    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-etc-openvswitch\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.606224 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606208    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-run-openvswitch\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.606224 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606223    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-log-socket\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.606577 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606237    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8w9g\" (UniqueName: \"kubernetes.io/projected/99b0f7f9-46d3-4e18-a6b2-adf14bf396ea-kube-api-access-v8w9g\") pod \"node-resolver-pxtqn\" (UID: \"99b0f7f9-46d3-4e18-a6b2-adf14bf396ea\") " pod="openshift-dns/node-resolver-pxtqn"
Jul 20 09:39:10.606577 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606253    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djmdj\" (UniqueName: \"kubernetes.io/projected/41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b-kube-api-access-djmdj\") pod \"multus-additional-cni-plugins-fvswj\" (UID: \"41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b\") " pod="openshift-multus/multus-additional-cni-plugins-fvswj"
Jul 20 09:39:10.606577 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606285    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6475a644-97bb-467b-9bc6-b5482c92779c-host\") pod \"node-ca-nk6p8\" (UID: \"6475a644-97bb-467b-9bc6-b5482c92779c\") " pod="openshift-image-registry/node-ca-nk6p8"
Jul 20 09:39:10.606577 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606315    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-host-run-netns\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.606577 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606362    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-var-lib-openvswitch\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.606577 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606393    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-host-cni-netd\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.606577 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606419    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-ovnkube-config\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.606577 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606449    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-env-overrides\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.606577 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606473    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/99b0f7f9-46d3-4e18-a6b2-adf14bf396ea-hosts-file\") pod \"node-resolver-pxtqn\" (UID: \"99b0f7f9-46d3-4e18-a6b2-adf14bf396ea\") " pod="openshift-dns/node-resolver-pxtqn"
Jul 20 09:39:10.606577 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606488    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fvswj\" (UID: \"41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b\") " pod="openshift-multus/multus-additional-cni-plugins-fvswj"
Jul 20 09:39:10.606577 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606504    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fvswj\" (UID: \"41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b\") " pod="openshift-multus/multus-additional-cni-plugins-fvswj"
Jul 20 09:39:10.606577 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606526    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/39085fd7-7be1-4a24-9096-a11447449c89-konnectivity-ca\") pod \"konnectivity-agent-8q9d8\" (UID: \"39085fd7-7be1-4a24-9096-a11447449c89\") " pod="kube-system/konnectivity-agent-8q9d8"
Jul 20 09:39:10.606577 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606556    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6475a644-97bb-467b-9bc6-b5482c92779c-serviceca\") pod \"node-ca-nk6p8\" (UID: \"6475a644-97bb-467b-9bc6-b5482c92779c\") " pod="openshift-image-registry/node-ca-nk6p8"
Jul 20 09:39:10.606577 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606582    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-run-systemd\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.607130 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606613    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.607130 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606630    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-ovn-node-metrics-cert\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.607130 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606653    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-ovnkube-script-lib\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.607130 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606668    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b-system-cni-dir\") pod \"multus-additional-cni-plugins-fvswj\" (UID: \"41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b\") " pod="openshift-multus/multus-additional-cni-plugins-fvswj"
Jul 20 09:39:10.607130 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606689    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b-cni-binary-copy\") pod \"multus-additional-cni-plugins-fvswj\" (UID: \"41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b\") " pod="openshift-multus/multus-additional-cni-plugins-fvswj"
Jul 20 09:39:10.607130 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606728    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25vjl\" (UniqueName: \"kubernetes.io/projected/2450d682-ad31-4104-b469-603d43b7b1b2-kube-api-access-25vjl\") pod \"network-metrics-daemon-fnzkg\" (UID: \"2450d682-ad31-4104-b469-603d43b7b1b2\") " pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:10.607130 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606757    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-host-kubelet\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.607130 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606787    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-host-run-ovn-kubernetes\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.607130 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606820    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5dc72568-b630-42a0-8c33-58bcd45517ed-host-slash\") pod \"iptables-alerter-lg8hz\" (UID: \"5dc72568-b630-42a0-8c33-58bcd45517ed\") " pod="openshift-network-operator/iptables-alerter-lg8hz"
Jul 20 09:39:10.607130 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606851    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-systemd-units\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.607130 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606877    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-run-ovn\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.607130 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.606915    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fvswj\" (UID: \"41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b\") " pod="openshift-multus/multus-additional-cni-plugins-fvswj"
Jul 20 09:39:10.638528 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.638481    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 20 09:39:10.708077 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708055    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-host-run-ovn-kubernetes\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.708190 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708091    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5dc72568-b630-42a0-8c33-58bcd45517ed-host-slash\") pod \"iptables-alerter-lg8hz\" (UID: \"5dc72568-b630-42a0-8c33-58bcd45517ed\") " pod="openshift-network-operator/iptables-alerter-lg8hz"
Jul 20 09:39:10.708190 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708115    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-systemd-units\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.708190 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708171    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5dc72568-b630-42a0-8c33-58bcd45517ed-host-slash\") pod \"iptables-alerter-lg8hz\" (UID: \"5dc72568-b630-42a0-8c33-58bcd45517ed\") " pod="openshift-network-operator/iptables-alerter-lg8hz"
Jul 20 09:39:10.708190 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708171    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-host-run-ovn-kubernetes\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.708366 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708171    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-systemd-units\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.708366 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708211    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-run-ovn\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.708366 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708247    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fvswj\" (UID: \"41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b\") " pod="openshift-multus/multus-additional-cni-plugins-fvswj"
Jul 20 09:39:10.708366 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708288    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-run-ovn\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.708366 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708317    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/662ca122-28b8-472e-8bc0-5a6173b5f375-etc-sysctl-conf\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.708366 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708343    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/662ca122-28b8-472e-8bc0-5a6173b5f375-lib-modules\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.708366 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708364    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/662ca122-28b8-472e-8bc0-5a6173b5f375-var-lib-kubelet\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.708671 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708385    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-hostroot\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.708671 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708406    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s98mn\" (UniqueName: \"kubernetes.io/projected/3e6fb336-81aa-448d-8532-860ff0916089-kube-api-access-s98mn\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.708671 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708445    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-host-cni-bin\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.708671 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708472    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99b0f7f9-46d3-4e18-a6b2-adf14bf396ea-tmp-dir\") pod \"node-resolver-pxtqn\" (UID: \"99b0f7f9-46d3-4e18-a6b2-adf14bf396ea\") " pod="openshift-dns/node-resolver-pxtqn"
Jul 20 09:39:10.708671 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708497    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh6zs\" (UniqueName: \"kubernetes.io/projected/6475a644-97bb-467b-9bc6-b5482c92779c-kube-api-access-gh6zs\") pod \"node-ca-nk6p8\" (UID: \"6475a644-97bb-467b-9bc6-b5482c92779c\") " pod="openshift-image-registry/node-ca-nk6p8"
Jul 20 09:39:10.708671 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708510    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-host-cni-bin\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.708671 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708544    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/662ca122-28b8-472e-8bc0-5a6173b5f375-etc-sysctl-d\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.708671 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708568    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/662ca122-28b8-472e-8bc0-5a6173b5f375-host\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.708671 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708592    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-host-run-multus-certs\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.708671 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708632    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1068b07e-5d5b-4104-b412-51f02e6236e7-device-dir\") pod \"aws-ebs-csi-driver-node-xflk2\" (UID: \"1068b07e-5d5b-4104-b412-51f02e6236e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xflk2"
Jul 20 09:39:10.708671 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708664    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-node-log\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.709329 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708683    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b-cnibin\") pod \"multus-additional-cni-plugins-fvswj\" (UID: \"41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b\") " pod="openshift-multus/multus-additional-cni-plugins-fvswj"
Jul 20 09:39:10.709329 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708700    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b-os-release\") pod \"multus-additional-cni-plugins-fvswj\" (UID: \"41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b\") " pod="openshift-multus/multus-additional-cni-plugins-fvswj"
Jul 20 09:39:10.709329 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708726    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-host-run-netns\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.709329 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708753    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-etc-openvswitch\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.709329 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708755    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-node-log\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.709329 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708757    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b-cnibin\") pod \"multus-additional-cni-plugins-fvswj\" (UID: \"41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b\") " pod="openshift-multus/multus-additional-cni-plugins-fvswj"
Jul 20 09:39:10.709329 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708779    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-run-openvswitch\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.709329 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708801    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-etc-openvswitch\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.709329 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708804    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djmdj\" (UniqueName: \"kubernetes.io/projected/41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b-kube-api-access-djmdj\") pod \"multus-additional-cni-plugins-fvswj\" (UID: \"41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b\") " pod="openshift-multus/multus-additional-cni-plugins-fvswj"
Jul 20 09:39:10.709329 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708840    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6475a644-97bb-467b-9bc6-b5482c92779c-host\") pod \"node-ca-nk6p8\" (UID: \"6475a644-97bb-467b-9bc6-b5482c92779c\") " pod="openshift-image-registry/node-ca-nk6p8"
Jul 20 09:39:10.709329 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708868    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/662ca122-28b8-472e-8bc0-5a6173b5f375-etc-kubernetes\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.709329 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708875    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-run-openvswitch\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.709329 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708893    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/662ca122-28b8-472e-8bc0-5a6173b5f375-run\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.709329 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708919    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6475a644-97bb-467b-9bc6-b5482c92779c-host\") pod \"node-ca-nk6p8\" (UID: \"6475a644-97bb-467b-9bc6-b5482c92779c\") " pod="openshift-image-registry/node-ca-nk6p8"
Jul 20 09:39:10.709329 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708919    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-multus-cni-dir\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.709329 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.708954    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghlv4\" (UniqueName: \"kubernetes.io/projected/8e667eae-fd03-4ae1-b97d-1af58fb5e8fc-kube-api-access-ghlv4\") pod \"network-check-target-d76tg\" (UID: \"8e667eae-fd03-4ae1-b97d-1af58fb5e8fc\") " pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:39:10.709329 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.709001    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6475a644-97bb-467b-9bc6-b5482c92779c-serviceca\") pod \"node-ca-nk6p8\" (UID: \"6475a644-97bb-467b-9bc6-b5482c92779c\") " pod="openshift-image-registry/node-ca-nk6p8"
Jul 20 09:39:10.710204 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.709029    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-ovnkube-config\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.710204 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.709019    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fvswj\" (UID: \"41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b\") " pod="openshift-multus/multus-additional-cni-plugins-fvswj"
Jul 20 09:39:10.710204 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.709132    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/99b0f7f9-46d3-4e18-a6b2-adf14bf396ea-hosts-file\") pod \"node-resolver-pxtqn\" (UID: \"99b0f7f9-46d3-4e18-a6b2-adf14bf396ea\") " pod="openshift-dns/node-resolver-pxtqn"
Jul 20 09:39:10.710204 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.709160    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fvswj\" (UID: \"41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b\") " pod="openshift-multus/multus-additional-cni-plugins-fvswj"
Jul 20 09:39:10.710204 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.709187    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fvswj\" (UID: \"41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b\") " pod="openshift-multus/multus-additional-cni-plugins-fvswj"
Jul 20 09:39:10.710204 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.709203    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/99b0f7f9-46d3-4e18-a6b2-adf14bf396ea-hosts-file\") pod \"node-resolver-pxtqn\" (UID: \"99b0f7f9-46d3-4e18-a6b2-adf14bf396ea\") " pod="openshift-dns/node-resolver-pxtqn"
Jul 20 09:39:10.710204 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.709214    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3e6fb336-81aa-448d-8532-860ff0916089-cni-binary-copy\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.710204 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.709244    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-host-var-lib-cni-bin\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.710204 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.709267    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-host-var-lib-cni-multus\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.710204 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.709307    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1068b07e-5d5b-4104-b412-51f02e6236e7-registration-dir\") pod \"aws-ebs-csi-driver-node-xflk2\" (UID: \"1068b07e-5d5b-4104-b412-51f02e6236e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xflk2"
Jul 20 09:39:10.710204 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.709323    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b-os-release\") pod \"multus-additional-cni-plugins-fvswj\" (UID: \"41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b\") " pod="openshift-multus/multus-additional-cni-plugins-fvswj"
Jul 20 09:39:10.710204 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.709391    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fvswj\" (UID: \"41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b\") " pod="openshift-multus/multus-additional-cni-plugins-fvswj"
Jul 20 09:39:10.710204 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.709388    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.710204 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.709359    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.710204 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.709817    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6475a644-97bb-467b-9bc6-b5482c92779c-serviceca\") pod \"node-ca-nk6p8\" (UID: \"6475a644-97bb-467b-9bc6-b5482c92779c\") " pod="openshift-image-registry/node-ca-nk6p8"
Jul 20 09:39:10.710204 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.709894    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-ovn-node-metrics-cert\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.710204 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.709950    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99b0f7f9-46d3-4e18-a6b2-adf14bf396ea-tmp-dir\") pod \"node-resolver-pxtqn\" (UID: \"99b0f7f9-46d3-4e18-a6b2-adf14bf396ea\") " pod="openshift-dns/node-resolver-pxtqn"
Jul 20 09:39:10.710966 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.709964    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fvswj\" (UID: \"41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b\") " pod="openshift-multus/multus-additional-cni-plugins-fvswj"
Jul 20 09:39:10.710966 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.709969    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-ovnkube-script-lib\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.710966 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.710081    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b-system-cni-dir\") pod \"multus-additional-cni-plugins-fvswj\" (UID: \"41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b\") " pod="openshift-multus/multus-additional-cni-plugins-fvswj"
Jul 20 09:39:10.710966 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.710122    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b-cni-binary-copy\") pod \"multus-additional-cni-plugins-fvswj\" (UID: \"41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b\") " pod="openshift-multus/multus-additional-cni-plugins-fvswj"
Jul 20 09:39:10.710966 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.710201    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-ovnkube-config\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.710966 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.710216    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b-system-cni-dir\") pod \"multus-additional-cni-plugins-fvswj\" (UID: \"41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b\") " pod="openshift-multus/multus-additional-cni-plugins-fvswj"
Jul 20 09:39:10.710966 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.710319    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/662ca122-28b8-472e-8bc0-5a6173b5f375-etc-sysconfig\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.710966 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.710361    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3e6fb336-81aa-448d-8532-860ff0916089-multus-daemon-config\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.710966 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.710392    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-host-kubelet\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.710966 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.710425    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-host-run-k8s-cni-cncf-io\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.710966 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.710458    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-etc-kubernetes\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.710966 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.710493    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/662ca122-28b8-472e-8bc0-5a6173b5f375-etc-systemd\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.710966 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.710520    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-ovnkube-script-lib\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.710966 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.710526    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/662ca122-28b8-472e-8bc0-5a6173b5f375-etc-tuned\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.710966 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.710576    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/82e7c25c-d929-4258-8f87-ddfadcf5042e-kubelet-config\") pod \"global-pull-secret-syncer-xqb2z\" (UID: \"82e7c25c-d929-4258-8f87-ddfadcf5042e\") " pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:10.710966 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.710632    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-multus-conf-dir\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.710966 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.710681    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-host-kubelet\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.711760 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.710699    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b-cni-binary-copy\") pod \"multus-additional-cni-plugins-fvswj\" (UID: \"41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b\") " pod="openshift-multus/multus-additional-cni-plugins-fvswj"
Jul 20 09:39:10.711760 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.710732    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1068b07e-5d5b-4104-b412-51f02e6236e7-etc-selinux\") pod \"aws-ebs-csi-driver-node-xflk2\" (UID: \"1068b07e-5d5b-4104-b412-51f02e6236e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xflk2"
Jul 20 09:39:10.711760 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.710805    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-host-slash\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.711760 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.710845    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5dc72568-b630-42a0-8c33-58bcd45517ed-iptables-alerter-script\") pod \"iptables-alerter-lg8hz\" (UID: \"5dc72568-b630-42a0-8c33-58bcd45517ed\") " pod="openshift-network-operator/iptables-alerter-lg8hz"
Jul 20 09:39:10.711760 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.710908    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-host-slash\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.711760 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.710929    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 20 09:39:10.711760 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.710930    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2qft\" (UniqueName: \"kubernetes.io/projected/5dc72568-b630-42a0-8c33-58bcd45517ed-kube-api-access-p2qft\") pod \"iptables-alerter-lg8hz\" (UID: \"5dc72568-b630-42a0-8c33-58bcd45517ed\") " pod="openshift-network-operator/iptables-alerter-lg8hz"
Jul 20 09:39:10.711760 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.711020    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2450d682-ad31-4104-b469-603d43b7b1b2-metrics-certs\") pod \"network-metrics-daemon-fnzkg\" (UID: \"2450d682-ad31-4104-b469-603d43b7b1b2\") " pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:10.711760 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:10.711126    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 09:39:10.711760 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:10.711222    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2450d682-ad31-4104-b469-603d43b7b1b2-metrics-certs podName:2450d682-ad31-4104-b469-603d43b7b1b2 nodeName:}" failed. No retries permitted until 2026-07-20 09:39:11.211172066 +0000 UTC m=+3.092618372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2450d682-ad31-4104-b469-603d43b7b1b2-metrics-certs") pod "network-metrics-daemon-fnzkg" (UID: "2450d682-ad31-4104-b469-603d43b7b1b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 09:39:10.711760 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.711264    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1068b07e-5d5b-4104-b412-51f02e6236e7-socket-dir\") pod \"aws-ebs-csi-driver-node-xflk2\" (UID: \"1068b07e-5d5b-4104-b412-51f02e6236e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xflk2"
Jul 20 09:39:10.711760 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.711297    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1068b07e-5d5b-4104-b412-51f02e6236e7-sys-fs\") pod \"aws-ebs-csi-driver-node-xflk2\" (UID: \"1068b07e-5d5b-4104-b412-51f02e6236e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xflk2"
Jul 20 09:39:10.711760 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.711326    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7gnd\" (UniqueName: \"kubernetes.io/projected/1068b07e-5d5b-4104-b412-51f02e6236e7-kube-api-access-v7gnd\") pod \"aws-ebs-csi-driver-node-xflk2\" (UID: \"1068b07e-5d5b-4104-b412-51f02e6236e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xflk2"
Jul 20 09:39:10.711760 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.711361    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/39085fd7-7be1-4a24-9096-a11447449c89-agent-certs\") pod \"konnectivity-agent-8q9d8\" (UID: \"39085fd7-7be1-4a24-9096-a11447449c89\") " pod="kube-system/konnectivity-agent-8q9d8"
Jul 20 09:39:10.711760 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.711393    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdgn9\" (UniqueName: \"kubernetes.io/projected/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-kube-api-access-bdgn9\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.711760 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.711423    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-system-cni-dir\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.711760 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.711429    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5dc72568-b630-42a0-8c33-58bcd45517ed-iptables-alerter-script\") pod \"iptables-alerter-lg8hz\" (UID: \"5dc72568-b630-42a0-8c33-58bcd45517ed\") " pod="openshift-network-operator/iptables-alerter-lg8hz"
Jul 20 09:39:10.712639 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.711453    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-multus-socket-dir-parent\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.712639 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.711595    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-log-socket\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.712639 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.711630    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8w9g\" (UniqueName: \"kubernetes.io/projected/99b0f7f9-46d3-4e18-a6b2-adf14bf396ea-kube-api-access-v8w9g\") pod \"node-resolver-pxtqn\" (UID: \"99b0f7f9-46d3-4e18-a6b2-adf14bf396ea\") " pod="openshift-dns/node-resolver-pxtqn"
Jul 20 09:39:10.712639 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.711657    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-host-var-lib-kubelet\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.712639 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.711924    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/662ca122-28b8-472e-8bc0-5a6173b5f375-etc-modprobe-d\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.713153 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.712907    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-log-socket\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.713153 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.712915    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-host-run-netns\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.713153 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.712973    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-var-lib-openvswitch\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.713153 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.713090    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-host-run-netns\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.713153 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.713095    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-host-cni-netd\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.713153 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.713112    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-var-lib-openvswitch\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.713153 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.713147    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-host-cni-netd\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.713557 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.713165    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-env-overrides\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.713557 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.713212    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp7m8\" (UniqueName: \"kubernetes.io/projected/662ca122-28b8-472e-8bc0-5a6173b5f375-kube-api-access-cp7m8\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.713557 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.713250    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/82e7c25c-d929-4258-8f87-ddfadcf5042e-dbus\") pod \"global-pull-secret-syncer-xqb2z\" (UID: \"82e7c25c-d929-4258-8f87-ddfadcf5042e\") " pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:10.713557 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.713280    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/39085fd7-7be1-4a24-9096-a11447449c89-konnectivity-ca\") pod \"konnectivity-agent-8q9d8\" (UID: \"39085fd7-7be1-4a24-9096-a11447449c89\") " pod="kube-system/konnectivity-agent-8q9d8"
Jul 20 09:39:10.713557 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.713357    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/662ca122-28b8-472e-8bc0-5a6173b5f375-sys\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.713557 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.713394    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/662ca122-28b8-472e-8bc0-5a6173b5f375-tmp\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.713557 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.713447    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-os-release\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.713557 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.713528    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1068b07e-5d5b-4104-b412-51f02e6236e7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xflk2\" (UID: \"1068b07e-5d5b-4104-b412-51f02e6236e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xflk2"
Jul 20 09:39:10.713922 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.713595    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-run-systemd\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.713922 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.713646    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25vjl\" (UniqueName: \"kubernetes.io/projected/2450d682-ad31-4104-b469-603d43b7b1b2-kube-api-access-25vjl\") pod \"network-metrics-daemon-fnzkg\" (UID: \"2450d682-ad31-4104-b469-603d43b7b1b2\") " pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:10.713922 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.713716    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/82e7c25c-d929-4258-8f87-ddfadcf5042e-original-pull-secret\") pod \"global-pull-secret-syncer-xqb2z\" (UID: \"82e7c25c-d929-4258-8f87-ddfadcf5042e\") " pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:10.713922 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.713727    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-run-systemd\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.713922 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.713753    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-cnibin\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.713922 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.713767    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-env-overrides\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.713922 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.713813    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/39085fd7-7be1-4a24-9096-a11447449c89-konnectivity-ca\") pod \"konnectivity-agent-8q9d8\" (UID: \"39085fd7-7be1-4a24-9096-a11447449c89\") " pod="kube-system/konnectivity-agent-8q9d8"
Jul 20 09:39:10.715472 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.715441    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-ovn-node-metrics-cert\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.715591 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.715572    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/39085fd7-7be1-4a24-9096-a11447449c89-agent-certs\") pod \"konnectivity-agent-8q9d8\" (UID: \"39085fd7-7be1-4a24-9096-a11447449c89\") " pod="kube-system/konnectivity-agent-8q9d8"
Jul 20 09:39:10.717151 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.717131    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh6zs\" (UniqueName: \"kubernetes.io/projected/6475a644-97bb-467b-9bc6-b5482c92779c-kube-api-access-gh6zs\") pod \"node-ca-nk6p8\" (UID: \"6475a644-97bb-467b-9bc6-b5482c92779c\") " pod="openshift-image-registry/node-ca-nk6p8"
Jul 20 09:39:10.721798 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.721777    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djmdj\" (UniqueName: \"kubernetes.io/projected/41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b-kube-api-access-djmdj\") pod \"multus-additional-cni-plugins-fvswj\" (UID: \"41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b\") " pod="openshift-multus/multus-additional-cni-plugins-fvswj"
Jul 20 09:39:10.723748 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.723722    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdgn9\" (UniqueName: \"kubernetes.io/projected/d6c73ac6-85c5-4b3f-aa58-71ac88099c0a-kube-api-access-bdgn9\") pod \"ovnkube-node-rgb4r\" (UID: \"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a\") " pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.723865 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.723848    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2qft\" (UniqueName: \"kubernetes.io/projected/5dc72568-b630-42a0-8c33-58bcd45517ed-kube-api-access-p2qft\") pod \"iptables-alerter-lg8hz\" (UID: \"5dc72568-b630-42a0-8c33-58bcd45517ed\") " pod="openshift-network-operator/iptables-alerter-lg8hz"
Jul 20 09:39:10.724027 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.724004    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8w9g\" (UniqueName: \"kubernetes.io/projected/99b0f7f9-46d3-4e18-a6b2-adf14bf396ea-kube-api-access-v8w9g\") pod \"node-resolver-pxtqn\" (UID: \"99b0f7f9-46d3-4e18-a6b2-adf14bf396ea\") " pod="openshift-dns/node-resolver-pxtqn"
Jul 20 09:39:10.724410 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.724393    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25vjl\" (UniqueName: \"kubernetes.io/projected/2450d682-ad31-4104-b469-603d43b7b1b2-kube-api-access-25vjl\") pod \"network-metrics-daemon-fnzkg\" (UID: \"2450d682-ad31-4104-b469-603d43b7b1b2\") " pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:10.814971 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.814942    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-hostroot\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.815133 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.814987    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s98mn\" (UniqueName: \"kubernetes.io/projected/3e6fb336-81aa-448d-8532-860ff0916089-kube-api-access-s98mn\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.815133 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815005    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/662ca122-28b8-472e-8bc0-5a6173b5f375-etc-sysctl-d\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.815133 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815022    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/662ca122-28b8-472e-8bc0-5a6173b5f375-host\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.815133 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815064    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-hostroot\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.815133 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815103    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/662ca122-28b8-472e-8bc0-5a6173b5f375-etc-sysctl-d\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.815133 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815127    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-host-run-multus-certs\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.815421 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815157    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-host-run-multus-certs\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.815421 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815160    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1068b07e-5d5b-4104-b412-51f02e6236e7-device-dir\") pod \"aws-ebs-csi-driver-node-xflk2\" (UID: \"1068b07e-5d5b-4104-b412-51f02e6236e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xflk2"
Jul 20 09:39:10.815421 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815137    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/662ca122-28b8-472e-8bc0-5a6173b5f375-host\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.815421 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815182    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-host-run-netns\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.815421 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815199    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/662ca122-28b8-472e-8bc0-5a6173b5f375-etc-kubernetes\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.815421 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815201    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1068b07e-5d5b-4104-b412-51f02e6236e7-device-dir\") pod \"aws-ebs-csi-driver-node-xflk2\" (UID: \"1068b07e-5d5b-4104-b412-51f02e6236e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xflk2"
Jul 20 09:39:10.815421 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815231    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/662ca122-28b8-472e-8bc0-5a6173b5f375-etc-kubernetes\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.815421 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815229    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/662ca122-28b8-472e-8bc0-5a6173b5f375-run\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.815421 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815239    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-host-run-netns\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.815421 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815267    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-multus-cni-dir\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.815421 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815286    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/662ca122-28b8-472e-8bc0-5a6173b5f375-run\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.815421 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815288    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghlv4\" (UniqueName: \"kubernetes.io/projected/8e667eae-fd03-4ae1-b97d-1af58fb5e8fc-kube-api-access-ghlv4\") pod \"network-check-target-d76tg\" (UID: \"8e667eae-fd03-4ae1-b97d-1af58fb5e8fc\") " pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:39:10.815421 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815312    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3e6fb336-81aa-448d-8532-860ff0916089-cni-binary-copy\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.815421 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815379    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-multus-cni-dir\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.816058 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815442    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-host-var-lib-cni-bin\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.816058 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815458    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-host-var-lib-cni-multus\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.816058 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815475    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1068b07e-5d5b-4104-b412-51f02e6236e7-registration-dir\") pod \"aws-ebs-csi-driver-node-xflk2\" (UID: \"1068b07e-5d5b-4104-b412-51f02e6236e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xflk2"
Jul 20 09:39:10.816058 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815496    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/662ca122-28b8-472e-8bc0-5a6173b5f375-etc-sysconfig\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.816058 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815506    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-host-var-lib-cni-bin\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.816058 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815515    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-host-var-lib-cni-multus\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.816058 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815522    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3e6fb336-81aa-448d-8532-860ff0916089-multus-daemon-config\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.816058 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815537    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1068b07e-5d5b-4104-b412-51f02e6236e7-registration-dir\") pod \"aws-ebs-csi-driver-node-xflk2\" (UID: \"1068b07e-5d5b-4104-b412-51f02e6236e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xflk2"
Jul 20 09:39:10.816058 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815548    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-host-run-k8s-cni-cncf-io\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.816058 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815548    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/662ca122-28b8-472e-8bc0-5a6173b5f375-etc-sysconfig\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.816058 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815575    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-etc-kubernetes\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.816058 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815617    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/662ca122-28b8-472e-8bc0-5a6173b5f375-etc-systemd\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.816058 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815627    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-etc-kubernetes\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.816058 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815631    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-host-run-k8s-cni-cncf-io\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.816058 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815639    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/662ca122-28b8-472e-8bc0-5a6173b5f375-etc-tuned\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.816058 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815684    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/82e7c25c-d929-4258-8f87-ddfadcf5042e-kubelet-config\") pod \"global-pull-secret-syncer-xqb2z\" (UID: \"82e7c25c-d929-4258-8f87-ddfadcf5042e\") " pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:10.816058 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815713    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-multus-conf-dir\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.816058 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815737    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-multus-conf-dir\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.816771 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815739    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1068b07e-5d5b-4104-b412-51f02e6236e7-etc-selinux\") pod \"aws-ebs-csi-driver-node-xflk2\" (UID: \"1068b07e-5d5b-4104-b412-51f02e6236e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xflk2"
Jul 20 09:39:10.816771 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815715    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/82e7c25c-d929-4258-8f87-ddfadcf5042e-kubelet-config\") pod \"global-pull-secret-syncer-xqb2z\" (UID: \"82e7c25c-d929-4258-8f87-ddfadcf5042e\") " pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:10.816771 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815688    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/662ca122-28b8-472e-8bc0-5a6173b5f375-etc-systemd\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.816771 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815801    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1068b07e-5d5b-4104-b412-51f02e6236e7-socket-dir\") pod \"aws-ebs-csi-driver-node-xflk2\" (UID: \"1068b07e-5d5b-4104-b412-51f02e6236e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xflk2"
Jul 20 09:39:10.816771 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815825    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1068b07e-5d5b-4104-b412-51f02e6236e7-etc-selinux\") pod \"aws-ebs-csi-driver-node-xflk2\" (UID: \"1068b07e-5d5b-4104-b412-51f02e6236e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xflk2"
Jul 20 09:39:10.816771 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815858    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1068b07e-5d5b-4104-b412-51f02e6236e7-sys-fs\") pod \"aws-ebs-csi-driver-node-xflk2\" (UID: \"1068b07e-5d5b-4104-b412-51f02e6236e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xflk2"
Jul 20 09:39:10.816771 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815886    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7gnd\" (UniqueName: \"kubernetes.io/projected/1068b07e-5d5b-4104-b412-51f02e6236e7-kube-api-access-v7gnd\") pod \"aws-ebs-csi-driver-node-xflk2\" (UID: \"1068b07e-5d5b-4104-b412-51f02e6236e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xflk2"
Jul 20 09:39:10.816771 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815910    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1068b07e-5d5b-4104-b412-51f02e6236e7-socket-dir\") pod \"aws-ebs-csi-driver-node-xflk2\" (UID: \"1068b07e-5d5b-4104-b412-51f02e6236e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xflk2"
Jul 20 09:39:10.816771 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815911    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3e6fb336-81aa-448d-8532-860ff0916089-cni-binary-copy\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.816771 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815914    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-system-cni-dir\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.816771 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815950    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-multus-socket-dir-parent\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.816771 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815968    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-host-var-lib-kubelet\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.816771 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.815962    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1068b07e-5d5b-4104-b412-51f02e6236e7-sys-fs\") pod \"aws-ebs-csi-driver-node-xflk2\" (UID: \"1068b07e-5d5b-4104-b412-51f02e6236e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xflk2"
Jul 20 09:39:10.816771 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.816001    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/662ca122-28b8-472e-8bc0-5a6173b5f375-etc-modprobe-d\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.816771 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.816020    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp7m8\" (UniqueName: \"kubernetes.io/projected/662ca122-28b8-472e-8bc0-5a6173b5f375-kube-api-access-cp7m8\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.816771 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.816039    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-multus-socket-dir-parent\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.816771 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.816057    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3e6fb336-81aa-448d-8532-860ff0916089-multus-daemon-config\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.817297 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.816078    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-host-var-lib-kubelet\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.817297 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.816041    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/82e7c25c-d929-4258-8f87-ddfadcf5042e-dbus\") pod \"global-pull-secret-syncer-xqb2z\" (UID: \"82e7c25c-d929-4258-8f87-ddfadcf5042e\") " pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:10.817297 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.816125    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-system-cni-dir\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.817297 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.816126    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/662ca122-28b8-472e-8bc0-5a6173b5f375-sys\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.817297 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.816151    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/662ca122-28b8-472e-8bc0-5a6173b5f375-etc-modprobe-d\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.817297 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.816154    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/662ca122-28b8-472e-8bc0-5a6173b5f375-tmp\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.817297 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.816194    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-os-release\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.817297 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.816201    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/82e7c25c-d929-4258-8f87-ddfadcf5042e-dbus\") pod \"global-pull-secret-syncer-xqb2z\" (UID: \"82e7c25c-d929-4258-8f87-ddfadcf5042e\") " pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:10.817297 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.816229    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1068b07e-5d5b-4104-b412-51f02e6236e7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xflk2\" (UID: \"1068b07e-5d5b-4104-b412-51f02e6236e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xflk2"
Jul 20 09:39:10.817297 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.816248    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/662ca122-28b8-472e-8bc0-5a6173b5f375-sys\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.817297 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.816263    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-os-release\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.817297 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.816255    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/82e7c25c-d929-4258-8f87-ddfadcf5042e-original-pull-secret\") pod \"global-pull-secret-syncer-xqb2z\" (UID: \"82e7c25c-d929-4258-8f87-ddfadcf5042e\") " pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:10.817297 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.816307    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-cnibin\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.817297 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:10.816327    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 09:39:10.817297 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.816339    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/662ca122-28b8-472e-8bc0-5a6173b5f375-etc-sysctl-conf\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.817297 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.816340    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1068b07e-5d5b-4104-b412-51f02e6236e7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xflk2\" (UID: \"1068b07e-5d5b-4104-b412-51f02e6236e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xflk2"
Jul 20 09:39:10.817297 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.816385    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3e6fb336-81aa-448d-8532-860ff0916089-cnibin\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.817297 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:10.816396    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82e7c25c-d929-4258-8f87-ddfadcf5042e-original-pull-secret podName:82e7c25c-d929-4258-8f87-ddfadcf5042e nodeName:}" failed. No retries permitted until 2026-07-20 09:39:11.316367797 +0000 UTC m=+3.197814093 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/82e7c25c-d929-4258-8f87-ddfadcf5042e-original-pull-secret") pod "global-pull-secret-syncer-xqb2z" (UID: "82e7c25c-d929-4258-8f87-ddfadcf5042e") : object "kube-system"/"original-pull-secret" not registered
Jul 20 09:39:10.817829 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.816418    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/662ca122-28b8-472e-8bc0-5a6173b5f375-lib-modules\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.817829 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.816441    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/662ca122-28b8-472e-8bc0-5a6173b5f375-var-lib-kubelet\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.817829 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.816473    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/662ca122-28b8-472e-8bc0-5a6173b5f375-etc-sysctl-conf\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.817829 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.816498    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/662ca122-28b8-472e-8bc0-5a6173b5f375-var-lib-kubelet\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.817829 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.816552    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/662ca122-28b8-472e-8bc0-5a6173b5f375-lib-modules\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.818105 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.818089    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/662ca122-28b8-472e-8bc0-5a6173b5f375-tmp\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.818233 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.818216    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/662ca122-28b8-472e-8bc0-5a6173b5f375-etc-tuned\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.822569 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:10.822547    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 09:39:10.822678 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:10.822576    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 09:39:10.822678 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:10.822591    2581 projected.go:196] Error preparing data for projected volume kube-api-access-ghlv4 for pod openshift-network-diagnostics/network-check-target-d76tg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 09:39:10.822678 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:10.822676    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e667eae-fd03-4ae1-b97d-1af58fb5e8fc-kube-api-access-ghlv4 podName:8e667eae-fd03-4ae1-b97d-1af58fb5e8fc nodeName:}" failed. No retries permitted until 2026-07-20 09:39:11.322638057 +0000 UTC m=+3.204084360 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ghlv4" (UniqueName: "kubernetes.io/projected/8e667eae-fd03-4ae1-b97d-1af58fb5e8fc-kube-api-access-ghlv4") pod "network-check-target-d76tg" (UID: "8e667eae-fd03-4ae1-b97d-1af58fb5e8fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 09:39:10.824735 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.824710    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s98mn\" (UniqueName: \"kubernetes.io/projected/3e6fb336-81aa-448d-8532-860ff0916089-kube-api-access-s98mn\") pod \"multus-rrbzg\" (UID: \"3e6fb336-81aa-448d-8532-860ff0916089\") " pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.825237 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.825211    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp7m8\" (UniqueName: \"kubernetes.io/projected/662ca122-28b8-472e-8bc0-5a6173b5f375-kube-api-access-cp7m8\") pod \"tuned-77vlz\" (UID: \"662ca122-28b8-472e-8bc0-5a6173b5f375\") " pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.825317 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.825300    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7gnd\" (UniqueName: \"kubernetes.io/projected/1068b07e-5d5b-4104-b412-51f02e6236e7-kube-api-access-v7gnd\") pod \"aws-ebs-csi-driver-node-xflk2\" (UID: \"1068b07e-5d5b-4104-b412-51f02e6236e7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xflk2"
Jul 20 09:39:10.839098 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.839078    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8q9d8"
Jul 20 09:39:10.847165 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.847147    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:10.847544 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:10.847512    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39085fd7_7be1_4a24_9096_a11447449c89.slice/crio-10eae4aa442991df7f4111cd9f9e84ee294ddae3e51bc758cbdb28871a4ca766 WatchSource:0}: Error finding container 10eae4aa442991df7f4111cd9f9e84ee294ddae3e51bc758cbdb28871a4ca766: Status 404 returned error can't find the container with id 10eae4aa442991df7f4111cd9f9e84ee294ddae3e51bc758cbdb28871a4ca766
Jul 20 09:39:10.854296 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:10.854274    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6c73ac6_85c5_4b3f_aa58_71ac88099c0a.slice/crio-cb11b0867c666b99086f6cdc3b2fd52cde8b98c095aa6ccdfd2eba7ae011ee5f WatchSource:0}: Error finding container cb11b0867c666b99086f6cdc3b2fd52cde8b98c095aa6ccdfd2eba7ae011ee5f: Status 404 returned error can't find the container with id cb11b0867c666b99086f6cdc3b2fd52cde8b98c095aa6ccdfd2eba7ae011ee5f
Jul 20 09:39:10.858415 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.858398    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pxtqn"
Jul 20 09:39:10.861251 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.861236    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fvswj"
Jul 20 09:39:10.866725 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:10.866705    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99b0f7f9_46d3_4e18_a6b2_adf14bf396ea.slice/crio-cbd6c8d1a9cad2d66d556abec04ae0d53ec41f28069763a9ea5a9888076ccae8 WatchSource:0}: Error finding container cbd6c8d1a9cad2d66d556abec04ae0d53ec41f28069763a9ea5a9888076ccae8: Status 404 returned error can't find the container with id cbd6c8d1a9cad2d66d556abec04ae0d53ec41f28069763a9ea5a9888076ccae8
Jul 20 09:39:10.867983 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.867967    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lg8hz"
Jul 20 09:39:10.869397 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:10.869377    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41ea0fc1_c719_40ae_9c83_1b9d7dcc7d4b.slice/crio-3bf0aaa928f700205e2b248b62f86188350625a7ce2d50eab901cf54f8c3a975 WatchSource:0}: Error finding container 3bf0aaa928f700205e2b248b62f86188350625a7ce2d50eab901cf54f8c3a975: Status 404 returned error can't find the container with id 3bf0aaa928f700205e2b248b62f86188350625a7ce2d50eab901cf54f8c3a975
Jul 20 09:39:10.874639 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.874617    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nk6p8"
Jul 20 09:39:10.875274 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:10.875257    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dc72568_b630_42a0_8c33_58bcd45517ed.slice/crio-160ab4a67439c0e8c65ecf48c6b42aee61501b66b4942f530df8f2627213e9f9 WatchSource:0}: Error finding container 160ab4a67439c0e8c65ecf48c6b42aee61501b66b4942f530df8f2627213e9f9: Status 404 returned error can't find the container with id 160ab4a67439c0e8c65ecf48c6b42aee61501b66b4942f530df8f2627213e9f9
Jul 20 09:39:10.881451 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.881425    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xflk2"
Jul 20 09:39:10.887236 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.887220    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-77vlz"
Jul 20 09:39:10.888699 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:10.888647    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1068b07e_5d5b_4104_b412_51f02e6236e7.slice/crio-71e3481b2c4a57b53a1d7988d2988d6456d7c5c178be4fee65064d762e27c716 WatchSource:0}: Error finding container 71e3481b2c4a57b53a1d7988d2988d6456d7c5c178be4fee65064d762e27c716: Status 404 returned error can't find the container with id 71e3481b2c4a57b53a1d7988d2988d6456d7c5c178be4fee65064d762e27c716
Jul 20 09:39:10.890562 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:10.890394    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rrbzg"
Jul 20 09:39:10.896707 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:10.896686    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod662ca122_28b8_472e_8bc0_5a6173b5f375.slice/crio-5eb82904d2e0772d160bb7447797d60fc58eda4ede05dac232e55d988bf212f3 WatchSource:0}: Error finding container 5eb82904d2e0772d160bb7447797d60fc58eda4ede05dac232e55d988bf212f3: Status 404 returned error can't find the container with id 5eb82904d2e0772d160bb7447797d60fc58eda4ede05dac232e55d988bf212f3
Jul 20 09:39:11.012873 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:11.012851    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 09:39:11.219861 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:11.219789    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2450d682-ad31-4104-b469-603d43b7b1b2-metrics-certs\") pod \"network-metrics-daemon-fnzkg\" (UID: \"2450d682-ad31-4104-b469-603d43b7b1b2\") " pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:11.220021 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:11.219910    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 09:39:11.220021 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:11.219975    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2450d682-ad31-4104-b469-603d43b7b1b2-metrics-certs podName:2450d682-ad31-4104-b469-603d43b7b1b2 nodeName:}" failed. No retries permitted until 2026-07-20 09:39:12.219958366 +0000 UTC m=+4.101404654 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2450d682-ad31-4104-b469-603d43b7b1b2-metrics-certs") pod "network-metrics-daemon-fnzkg" (UID: "2450d682-ad31-4104-b469-603d43b7b1b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 09:39:11.321035 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:11.320969    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/82e7c25c-d929-4258-8f87-ddfadcf5042e-original-pull-secret\") pod \"global-pull-secret-syncer-xqb2z\" (UID: \"82e7c25c-d929-4258-8f87-ddfadcf5042e\") " pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:11.321204 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:11.321138    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 09:39:11.321279 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:11.321210    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82e7c25c-d929-4258-8f87-ddfadcf5042e-original-pull-secret podName:82e7c25c-d929-4258-8f87-ddfadcf5042e nodeName:}" failed. No retries permitted until 2026-07-20 09:39:12.321187737 +0000 UTC m=+4.202634045 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/82e7c25c-d929-4258-8f87-ddfadcf5042e-original-pull-secret") pod "global-pull-secret-syncer-xqb2z" (UID: "82e7c25c-d929-4258-8f87-ddfadcf5042e") : object "kube-system"/"original-pull-secret" not registered
Jul 20 09:39:11.421814 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:11.421772    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghlv4\" (UniqueName: \"kubernetes.io/projected/8e667eae-fd03-4ae1-b97d-1af58fb5e8fc-kube-api-access-ghlv4\") pod \"network-check-target-d76tg\" (UID: \"8e667eae-fd03-4ae1-b97d-1af58fb5e8fc\") " pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:39:11.422040 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:11.421943    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 09:39:11.422040 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:11.421966    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 09:39:11.422040 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:11.421979    2581 projected.go:196] Error preparing data for projected volume kube-api-access-ghlv4 for pod openshift-network-diagnostics/network-check-target-d76tg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 09:39:11.422229 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:11.422059    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e667eae-fd03-4ae1-b97d-1af58fb5e8fc-kube-api-access-ghlv4 podName:8e667eae-fd03-4ae1-b97d-1af58fb5e8fc nodeName:}" failed. No retries permitted until 2026-07-20 09:39:12.422039563 +0000 UTC m=+4.303485867 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ghlv4" (UniqueName: "kubernetes.io/projected/8e667eae-fd03-4ae1-b97d-1af58fb5e8fc-kube-api-access-ghlv4") pod "network-check-target-d76tg" (UID: "8e667eae-fd03-4ae1-b97d-1af58fb5e8fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 09:39:11.477443 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:11.477296    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rrbzg" event={"ID":"3e6fb336-81aa-448d-8532-860ff0916089","Type":"ContainerStarted","Data":"2878c5e6a1711b192e0c0fe91c4256c2d7de2ba0e17cfd7f1ef4fd5b1807af0d"}
Jul 20 09:39:11.487688 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:11.487580    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-77vlz" event={"ID":"662ca122-28b8-472e-8bc0-5a6173b5f375","Type":"ContainerStarted","Data":"5eb82904d2e0772d160bb7447797d60fc58eda4ede05dac232e55d988bf212f3"}
Jul 20 09:39:11.490957 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:11.490878    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xflk2" event={"ID":"1068b07e-5d5b-4104-b412-51f02e6236e7","Type":"ContainerStarted","Data":"71e3481b2c4a57b53a1d7988d2988d6456d7c5c178be4fee65064d762e27c716"}
Jul 20 09:39:11.498308 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:11.498198    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lg8hz" event={"ID":"5dc72568-b630-42a0-8c33-58bcd45517ed","Type":"ContainerStarted","Data":"160ab4a67439c0e8c65ecf48c6b42aee61501b66b4942f530df8f2627213e9f9"}
Jul 20 09:39:11.504974 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:11.504908    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nk6p8" event={"ID":"6475a644-97bb-467b-9bc6-b5482c92779c","Type":"ContainerStarted","Data":"8b1934089655c8f8744b5557a531c0afdbbfe6e84706f1e570e28878d045d01e"}
Jul 20 09:39:11.511915 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:11.511889    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fvswj" event={"ID":"41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b","Type":"ContainerStarted","Data":"3bf0aaa928f700205e2b248b62f86188350625a7ce2d50eab901cf54f8c3a975"}
Jul 20 09:39:11.516907 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:11.516882    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pxtqn" event={"ID":"99b0f7f9-46d3-4e18-a6b2-adf14bf396ea","Type":"ContainerStarted","Data":"cbd6c8d1a9cad2d66d556abec04ae0d53ec41f28069763a9ea5a9888076ccae8"}
Jul 20 09:39:11.531898 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:11.531871    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r" event={"ID":"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a","Type":"ContainerStarted","Data":"cb11b0867c666b99086f6cdc3b2fd52cde8b98c095aa6ccdfd2eba7ae011ee5f"}
Jul 20 09:39:11.534603 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:11.534564    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8q9d8" event={"ID":"39085fd7-7be1-4a24-9096-a11447449c89","Type":"ContainerStarted","Data":"10eae4aa442991df7f4111cd9f9e84ee294ddae3e51bc758cbdb28871a4ca766"}
Jul 20 09:39:11.538788 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:11.538714    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-236.ec2.internal" event={"ID":"b2bd58dc38956b1c8ecf2cf823b81fbf","Type":"ContainerStarted","Data":"b11beb25eff540d705c67c1922a0687219eadef0f03c03fc000a9e066cc5c558"}
Jul 20 09:39:11.553367 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:11.553339    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal" event={"ID":"8ef5df63ddb7b5d72473f9f24434be4d","Type":"ContainerStarted","Data":"1fa84c0102f2fddee2332b18a3827583ad3a8817000cd16cd79ffe08186d2321"}
Jul 20 09:39:11.588644 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:11.588521    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 09:34:10 +0000 UTC" deadline="2028-01-28 21:34:09.942277271 +0000 UTC"
Jul 20 09:39:11.588644 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:11.588554    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13379h54m58.353728117s"
Jul 20 09:39:12.228942 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:12.228670    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2450d682-ad31-4104-b469-603d43b7b1b2-metrics-certs\") pod \"network-metrics-daemon-fnzkg\" (UID: \"2450d682-ad31-4104-b469-603d43b7b1b2\") " pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:12.228942 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:12.228849    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 09:39:12.228942 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:12.228908    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2450d682-ad31-4104-b469-603d43b7b1b2-metrics-certs podName:2450d682-ad31-4104-b469-603d43b7b1b2 nodeName:}" failed. No retries permitted until 2026-07-20 09:39:14.228889127 +0000 UTC m=+6.110335419 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2450d682-ad31-4104-b469-603d43b7b1b2-metrics-certs") pod "network-metrics-daemon-fnzkg" (UID: "2450d682-ad31-4104-b469-603d43b7b1b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 09:39:12.330080 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:12.330045    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/82e7c25c-d929-4258-8f87-ddfadcf5042e-original-pull-secret\") pod \"global-pull-secret-syncer-xqb2z\" (UID: \"82e7c25c-d929-4258-8f87-ddfadcf5042e\") " pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:12.330252 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:12.330201    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 09:39:12.330312 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:12.330297    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82e7c25c-d929-4258-8f87-ddfadcf5042e-original-pull-secret podName:82e7c25c-d929-4258-8f87-ddfadcf5042e nodeName:}" failed. No retries permitted until 2026-07-20 09:39:14.3302783 +0000 UTC m=+6.211724587 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/82e7c25c-d929-4258-8f87-ddfadcf5042e-original-pull-secret") pod "global-pull-secret-syncer-xqb2z" (UID: "82e7c25c-d929-4258-8f87-ddfadcf5042e") : object "kube-system"/"original-pull-secret" not registered
Jul 20 09:39:12.431383 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:12.430740    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghlv4\" (UniqueName: \"kubernetes.io/projected/8e667eae-fd03-4ae1-b97d-1af58fb5e8fc-kube-api-access-ghlv4\") pod \"network-check-target-d76tg\" (UID: \"8e667eae-fd03-4ae1-b97d-1af58fb5e8fc\") " pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:39:12.431383 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:12.430931    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 09:39:12.431383 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:12.430953    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 09:39:12.431383 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:12.430984    2581 projected.go:196] Error preparing data for projected volume kube-api-access-ghlv4 for pod openshift-network-diagnostics/network-check-target-d76tg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 09:39:12.431383 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:12.431048    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e667eae-fd03-4ae1-b97d-1af58fb5e8fc-kube-api-access-ghlv4 podName:8e667eae-fd03-4ae1-b97d-1af58fb5e8fc nodeName:}" failed. No retries permitted until 2026-07-20 09:39:14.43102834 +0000 UTC m=+6.312474627 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ghlv4" (UniqueName: "kubernetes.io/projected/8e667eae-fd03-4ae1-b97d-1af58fb5e8fc-kube-api-access-ghlv4") pod "network-check-target-d76tg" (UID: "8e667eae-fd03-4ae1-b97d-1af58fb5e8fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 09:39:12.459118 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:12.458620    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:39:12.459118 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:12.458735    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d76tg" podUID="8e667eae-fd03-4ae1-b97d-1af58fb5e8fc"
Jul 20 09:39:12.459118 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:12.458819    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:12.459118 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:12.458894    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnzkg" podUID="2450d682-ad31-4104-b469-603d43b7b1b2"
Jul 20 09:39:12.459118 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:12.458955    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:12.459118 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:12.459053    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqb2z" podUID="82e7c25c-d929-4258-8f87-ddfadcf5042e"
Jul 20 09:39:12.589453 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:12.589304    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 09:34:10 +0000 UTC" deadline="2028-04-10 16:03:24.80483551 +0000 UTC"
Jul 20 09:39:12.589453 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:12.589367    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15126h24m12.215472023s"
Jul 20 09:39:14.243843 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:14.243805    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2450d682-ad31-4104-b469-603d43b7b1b2-metrics-certs\") pod \"network-metrics-daemon-fnzkg\" (UID: \"2450d682-ad31-4104-b469-603d43b7b1b2\") " pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:14.244321 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:14.243940    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 09:39:14.244321 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:14.244015    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2450d682-ad31-4104-b469-603d43b7b1b2-metrics-certs podName:2450d682-ad31-4104-b469-603d43b7b1b2 nodeName:}" failed. No retries permitted until 2026-07-20 09:39:18.243995721 +0000 UTC m=+10.125442022 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2450d682-ad31-4104-b469-603d43b7b1b2-metrics-certs") pod "network-metrics-daemon-fnzkg" (UID: "2450d682-ad31-4104-b469-603d43b7b1b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 09:39:14.344173 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:14.344136    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/82e7c25c-d929-4258-8f87-ddfadcf5042e-original-pull-secret\") pod \"global-pull-secret-syncer-xqb2z\" (UID: \"82e7c25c-d929-4258-8f87-ddfadcf5042e\") " pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:14.344336 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:14.344295    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 09:39:14.344406 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:14.344361    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82e7c25c-d929-4258-8f87-ddfadcf5042e-original-pull-secret podName:82e7c25c-d929-4258-8f87-ddfadcf5042e nodeName:}" failed. No retries permitted until 2026-07-20 09:39:18.344341906 +0000 UTC m=+10.225788197 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/82e7c25c-d929-4258-8f87-ddfadcf5042e-original-pull-secret") pod "global-pull-secret-syncer-xqb2z" (UID: "82e7c25c-d929-4258-8f87-ddfadcf5042e") : object "kube-system"/"original-pull-secret" not registered
Jul 20 09:39:14.445262 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:14.445220    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghlv4\" (UniqueName: \"kubernetes.io/projected/8e667eae-fd03-4ae1-b97d-1af58fb5e8fc-kube-api-access-ghlv4\") pod \"network-check-target-d76tg\" (UID: \"8e667eae-fd03-4ae1-b97d-1af58fb5e8fc\") " pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:39:14.445501 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:14.445482    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 09:39:14.445585 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:14.445509    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 09:39:14.445585 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:14.445523    2581 projected.go:196] Error preparing data for projected volume kube-api-access-ghlv4 for pod openshift-network-diagnostics/network-check-target-d76tg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 09:39:14.445688 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:14.445584    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e667eae-fd03-4ae1-b97d-1af58fb5e8fc-kube-api-access-ghlv4 podName:8e667eae-fd03-4ae1-b97d-1af58fb5e8fc nodeName:}" failed. No retries permitted until 2026-07-20 09:39:18.445565753 +0000 UTC m=+10.327012063 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ghlv4" (UniqueName: "kubernetes.io/projected/8e667eae-fd03-4ae1-b97d-1af58fb5e8fc-kube-api-access-ghlv4") pod "network-check-target-d76tg" (UID: "8e667eae-fd03-4ae1-b97d-1af58fb5e8fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 09:39:14.459310 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:14.459286    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:39:14.459443 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:14.459400    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d76tg" podUID="8e667eae-fd03-4ae1-b97d-1af58fb5e8fc"
Jul 20 09:39:14.459499 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:14.459461    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:14.459499 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:14.459473    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:14.459600 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:14.459545    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnzkg" podUID="2450d682-ad31-4104-b469-603d43b7b1b2"
Jul 20 09:39:14.459654 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:14.459622    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqb2z" podUID="82e7c25c-d929-4258-8f87-ddfadcf5042e"
Jul 20 09:39:16.458900 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:16.458866    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:39:16.459488 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:16.458915    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:16.459488 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:16.458915    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:16.459488 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:16.459018    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d76tg" podUID="8e667eae-fd03-4ae1-b97d-1af58fb5e8fc"
Jul 20 09:39:16.459488 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:16.459140    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqb2z" podUID="82e7c25c-d929-4258-8f87-ddfadcf5042e"
Jul 20 09:39:16.459488 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:16.459227    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnzkg" podUID="2450d682-ad31-4104-b469-603d43b7b1b2"
Jul 20 09:39:18.279370 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:18.279094    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2450d682-ad31-4104-b469-603d43b7b1b2-metrics-certs\") pod \"network-metrics-daemon-fnzkg\" (UID: \"2450d682-ad31-4104-b469-603d43b7b1b2\") " pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:18.279370 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:18.279286    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 09:39:18.279370 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:18.279355    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2450d682-ad31-4104-b469-603d43b7b1b2-metrics-certs podName:2450d682-ad31-4104-b469-603d43b7b1b2 nodeName:}" failed. No retries permitted until 2026-07-20 09:39:26.27933535 +0000 UTC m=+18.160781640 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2450d682-ad31-4104-b469-603d43b7b1b2-metrics-certs") pod "network-metrics-daemon-fnzkg" (UID: "2450d682-ad31-4104-b469-603d43b7b1b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 09:39:18.380732 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:18.380245    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/82e7c25c-d929-4258-8f87-ddfadcf5042e-original-pull-secret\") pod \"global-pull-secret-syncer-xqb2z\" (UID: \"82e7c25c-d929-4258-8f87-ddfadcf5042e\") " pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:18.380732 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:18.380465    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 09:39:18.380732 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:18.380533    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82e7c25c-d929-4258-8f87-ddfadcf5042e-original-pull-secret podName:82e7c25c-d929-4258-8f87-ddfadcf5042e nodeName:}" failed. No retries permitted until 2026-07-20 09:39:26.380512274 +0000 UTC m=+18.261958583 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/82e7c25c-d929-4258-8f87-ddfadcf5042e-original-pull-secret") pod "global-pull-secret-syncer-xqb2z" (UID: "82e7c25c-d929-4258-8f87-ddfadcf5042e") : object "kube-system"/"original-pull-secret" not registered
Jul 20 09:39:18.458678 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:18.458643    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:18.458835 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:18.458676    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:39:18.458835 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:18.458785    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqb2z" podUID="82e7c25c-d929-4258-8f87-ddfadcf5042e"
Jul 20 09:39:18.459049 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:18.459032    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:18.459146 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:18.459125    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnzkg" podUID="2450d682-ad31-4104-b469-603d43b7b1b2"
Jul 20 09:39:18.459229 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:18.459196    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d76tg" podUID="8e667eae-fd03-4ae1-b97d-1af58fb5e8fc"
Jul 20 09:39:18.481559 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:18.481441    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghlv4\" (UniqueName: \"kubernetes.io/projected/8e667eae-fd03-4ae1-b97d-1af58fb5e8fc-kube-api-access-ghlv4\") pod \"network-check-target-d76tg\" (UID: \"8e667eae-fd03-4ae1-b97d-1af58fb5e8fc\") " pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:39:18.481683 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:18.481638    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 09:39:18.481683 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:18.481664    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 09:39:18.481683 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:18.481678    2581 projected.go:196] Error preparing data for projected volume kube-api-access-ghlv4 for pod openshift-network-diagnostics/network-check-target-d76tg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 09:39:18.481864 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:18.481735    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e667eae-fd03-4ae1-b97d-1af58fb5e8fc-kube-api-access-ghlv4 podName:8e667eae-fd03-4ae1-b97d-1af58fb5e8fc nodeName:}" failed. No retries permitted until 2026-07-20 09:39:26.48171642 +0000 UTC m=+18.363162724 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ghlv4" (UniqueName: "kubernetes.io/projected/8e667eae-fd03-4ae1-b97d-1af58fb5e8fc-kube-api-access-ghlv4") pod "network-check-target-d76tg" (UID: "8e667eae-fd03-4ae1-b97d-1af58fb5e8fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 09:39:20.458541 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:20.458501    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:39:20.459028 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:20.458546    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:20.459028 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:20.458549    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:20.459028 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:20.458632    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d76tg" podUID="8e667eae-fd03-4ae1-b97d-1af58fb5e8fc"
Jul 20 09:39:20.459028 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:20.458724    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqb2z" podUID="82e7c25c-d929-4258-8f87-ddfadcf5042e"
Jul 20 09:39:20.459028 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:20.458812    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnzkg" podUID="2450d682-ad31-4104-b469-603d43b7b1b2"
Jul 20 09:39:22.459196 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:22.459171    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:22.459196 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:22.459183    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:22.459489 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:22.459270    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnzkg" podUID="2450d682-ad31-4104-b469-603d43b7b1b2"
Jul 20 09:39:22.459489 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:22.459291    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:39:22.459489 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:22.459359    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d76tg" podUID="8e667eae-fd03-4ae1-b97d-1af58fb5e8fc"
Jul 20 09:39:22.459489 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:22.459412    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqb2z" podUID="82e7c25c-d929-4258-8f87-ddfadcf5042e"
Jul 20 09:39:24.459327 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:24.459297    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:24.459703 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:24.459297    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:24.459703 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:24.459411    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnzkg" podUID="2450d682-ad31-4104-b469-603d43b7b1b2"
Jul 20 09:39:24.459703 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:24.459297    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:39:24.459703 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:24.459489    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqb2z" podUID="82e7c25c-d929-4258-8f87-ddfadcf5042e"
Jul 20 09:39:24.459703 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:24.459551    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d76tg" podUID="8e667eae-fd03-4ae1-b97d-1af58fb5e8fc"
Jul 20 09:39:26.340229 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:26.340185    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2450d682-ad31-4104-b469-603d43b7b1b2-metrics-certs\") pod \"network-metrics-daemon-fnzkg\" (UID: \"2450d682-ad31-4104-b469-603d43b7b1b2\") " pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:26.340633 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:26.340341    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 09:39:26.340633 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:26.340407    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2450d682-ad31-4104-b469-603d43b7b1b2-metrics-certs podName:2450d682-ad31-4104-b469-603d43b7b1b2 nodeName:}" failed. No retries permitted until 2026-07-20 09:39:42.340391621 +0000 UTC m=+34.221837908 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2450d682-ad31-4104-b469-603d43b7b1b2-metrics-certs") pod "network-metrics-daemon-fnzkg" (UID: "2450d682-ad31-4104-b469-603d43b7b1b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 09:39:26.440569 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:26.440527    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/82e7c25c-d929-4258-8f87-ddfadcf5042e-original-pull-secret\") pod \"global-pull-secret-syncer-xqb2z\" (UID: \"82e7c25c-d929-4258-8f87-ddfadcf5042e\") " pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:26.440732 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:26.440672    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 09:39:26.440776 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:26.440733    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82e7c25c-d929-4258-8f87-ddfadcf5042e-original-pull-secret podName:82e7c25c-d929-4258-8f87-ddfadcf5042e nodeName:}" failed. No retries permitted until 2026-07-20 09:39:42.440716377 +0000 UTC m=+34.322162681 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/82e7c25c-d929-4258-8f87-ddfadcf5042e-original-pull-secret") pod "global-pull-secret-syncer-xqb2z" (UID: "82e7c25c-d929-4258-8f87-ddfadcf5042e") : object "kube-system"/"original-pull-secret" not registered
Jul 20 09:39:26.458906 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:26.458874    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:26.458906 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:26.458903    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:39:26.459080 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:26.458888    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:26.459080 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:26.459001    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnzkg" podUID="2450d682-ad31-4104-b469-603d43b7b1b2"
Jul 20 09:39:26.459080 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:26.459050    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqb2z" podUID="82e7c25c-d929-4258-8f87-ddfadcf5042e"
Jul 20 09:39:26.459203 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:26.459120    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d76tg" podUID="8e667eae-fd03-4ae1-b97d-1af58fb5e8fc"
Jul 20 09:39:26.541891 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:26.541864    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghlv4\" (UniqueName: \"kubernetes.io/projected/8e667eae-fd03-4ae1-b97d-1af58fb5e8fc-kube-api-access-ghlv4\") pod \"network-check-target-d76tg\" (UID: \"8e667eae-fd03-4ae1-b97d-1af58fb5e8fc\") " pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:39:26.542069 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:26.542051    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 09:39:26.542137 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:26.542075    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 09:39:26.542137 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:26.542089    2581 projected.go:196] Error preparing data for projected volume kube-api-access-ghlv4 for pod openshift-network-diagnostics/network-check-target-d76tg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 09:39:26.542214 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:26.542151    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e667eae-fd03-4ae1-b97d-1af58fb5e8fc-kube-api-access-ghlv4 podName:8e667eae-fd03-4ae1-b97d-1af58fb5e8fc nodeName:}" failed. No retries permitted until 2026-07-20 09:39:42.542131537 +0000 UTC m=+34.423577830 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ghlv4" (UniqueName: "kubernetes.io/projected/8e667eae-fd03-4ae1-b97d-1af58fb5e8fc-kube-api-access-ghlv4") pod "network-check-target-d76tg" (UID: "8e667eae-fd03-4ae1-b97d-1af58fb5e8fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 09:39:28.458936 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:28.458717    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:28.459390 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:28.458755    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:39:28.459390 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:28.459050    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqb2z" podUID="82e7c25c-d929-4258-8f87-ddfadcf5042e"
Jul 20 09:39:28.459390 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:28.458767    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:28.459390 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:28.459131    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d76tg" podUID="8e667eae-fd03-4ae1-b97d-1af58fb5e8fc"
Jul 20 09:39:28.459390 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:28.459212    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnzkg" podUID="2450d682-ad31-4104-b469-603d43b7b1b2"
Jul 20 09:39:30.459066 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:30.459028    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:30.459066 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:30.459048    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:39:30.459524 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:30.459041    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:30.459524 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:30.459162    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqb2z" podUID="82e7c25c-d929-4258-8f87-ddfadcf5042e"
Jul 20 09:39:30.459524 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:30.459274    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnzkg" podUID="2450d682-ad31-4104-b469-603d43b7b1b2"
Jul 20 09:39:30.459524 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:30.459350    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d76tg" podUID="8e667eae-fd03-4ae1-b97d-1af58fb5e8fc"
Jul 20 09:39:31.602098 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:31.601925    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rgb4r_d6c73ac6-85c5-4b3f-aa58-71ac88099c0a/ovn-acl-logging/0.log"
Jul 20 09:39:31.602669 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:31.602359    2581 generic.go:356] "Generic (PLEG): container finished" podID="d6c73ac6-85c5-4b3f-aa58-71ac88099c0a" containerID="51372fc5d4e4e61fa7933799566e04360b81cbc80b2257d5dc381b27297ab220" exitCode=1
Jul 20 09:39:31.602669 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:31.602420    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r" event={"ID":"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a","Type":"ContainerStarted","Data":"aa2eac57e1c027113270da47f0d090dd2b55647dacbee422cb8796d933c80212"}
Jul 20 09:39:31.602669 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:31.602487    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r" event={"ID":"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a","Type":"ContainerStarted","Data":"32dcb482303762a92ff38f76bef02d4c716d837a1251a56a4c40757740704a2d"}
Jul 20 09:39:31.602669 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:31.602527    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r" event={"ID":"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a","Type":"ContainerStarted","Data":"fe67dafdebeb4c399e5e5431fc2cfd3621591988a3a4458912e24308eca2bfd1"}
Jul 20 09:39:31.602669 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:31.602557    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r" event={"ID":"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a","Type":"ContainerStarted","Data":"a8c0aae43c6118d2832d10c722ac51690db18c398a3341aeb66a51d74c2736fb"}
Jul 20 09:39:31.602669 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:31.602587    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r" event={"ID":"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a","Type":"ContainerDied","Data":"51372fc5d4e4e61fa7933799566e04360b81cbc80b2257d5dc381b27297ab220"}
Jul 20 09:39:31.602669 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:31.602622    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r" event={"ID":"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a","Type":"ContainerStarted","Data":"b978804950a5643c39806c7d68f2ded8bc3311ad059d4c50f16e46f3d4e03f39"}
Jul 20 09:39:31.604116 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:31.604096    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-236.ec2.internal" event={"ID":"b2bd58dc38956b1c8ecf2cf823b81fbf","Type":"ContainerStarted","Data":"1aba1dc55845cb610c8cdc7aea9f0f648f8e0ed54953607dafc74cb3085cc752"}
Jul 20 09:39:31.605557 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:31.605534    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rrbzg" event={"ID":"3e6fb336-81aa-448d-8532-860ff0916089","Type":"ContainerStarted","Data":"f020736f076baf4124ea9f75d57efc70101059949677d77efd4ff31ce487e8eb"}
Jul 20 09:39:31.606789 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:31.606771    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-77vlz" event={"ID":"662ca122-28b8-472e-8bc0-5a6173b5f375","Type":"ContainerStarted","Data":"9d313a3138f72717fce818d756c022b0f6fdce061a2a193777eb751b68d763d7"}
Jul 20 09:39:31.621474 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:31.621435    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-236.ec2.internal" podStartSLOduration=21.621423246 podStartE2EDuration="21.621423246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:39:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:31.621235109 +0000 UTC m=+23.502681417" watchObservedRunningTime="2026-07-20 09:39:31.621423246 +0000 UTC m=+23.502869554"
Jul 20 09:39:31.639401 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:31.639364    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-77vlz" podStartSLOduration=2.615950024 podStartE2EDuration="22.639351903s" totalImagesPullingTime="20.023401879s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:39:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:31.638828396 +0000 UTC m=+23.520274703" watchObservedRunningTime="2026-07-20 09:39:31.639351903 +0000 UTC m=+23.520798210"
Jul 20 09:39:32.459094 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:32.458841    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:32.459235 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:32.458851    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:32.459235 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:32.459115    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqb2z" podUID="82e7c25c-d929-4258-8f87-ddfadcf5042e"
Jul 20 09:39:32.459235 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:32.458893    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:39:32.459235 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:32.459219    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnzkg" podUID="2450d682-ad31-4104-b469-603d43b7b1b2"
Jul 20 09:39:32.459386 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:32.459313    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d76tg" podUID="8e667eae-fd03-4ae1-b97d-1af58fb5e8fc"
Jul 20 09:39:32.609796 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:32.609763    2581 generic.go:356] "Generic (PLEG): container finished" podID="41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b" containerID="4738c8356999620e0776d343ad61612f32b32f2e6c044da1aafdb000c3eb2d30" exitCode=0
Jul 20 09:39:32.610389 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:32.609835    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fvswj" event={"ID":"41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b","Type":"ContainerDied","Data":"4738c8356999620e0776d343ad61612f32b32f2e6c044da1aafdb000c3eb2d30"}
Jul 20 09:39:32.611508 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:32.611388    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pxtqn" event={"ID":"99b0f7f9-46d3-4e18-a6b2-adf14bf396ea","Type":"ContainerStarted","Data":"13938a49887bc0c77b4f70e4e289e217a7238d3de065f959c98b58207674f7fb"}
Jul 20 09:39:32.612913 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:32.612788    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8q9d8" event={"ID":"39085fd7-7be1-4a24-9096-a11447449c89","Type":"ContainerStarted","Data":"f5364194aa3804b6f6257d9039fc03780e64002d019a3a731eb2b56ed9bb5ae8"}
Jul 20 09:39:32.617343 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:32.617319    2581 generic.go:356] "Generic (PLEG): container finished" podID="8ef5df63ddb7b5d72473f9f24434be4d" containerID="2d0d82e539388ad4769907e57e3ca40e6cb3d63501c3ac23984af0f072d8bc71" exitCode=0
Jul 20 09:39:32.617482 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:32.617393    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal" event={"ID":"8ef5df63ddb7b5d72473f9f24434be4d","Type":"ContainerDied","Data":"2d0d82e539388ad4769907e57e3ca40e6cb3d63501c3ac23984af0f072d8bc71"}
Jul 20 09:39:32.618789 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:32.618755    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xflk2" event={"ID":"1068b07e-5d5b-4104-b412-51f02e6236e7","Type":"ContainerStarted","Data":"0291669f062a6c1f9ede593810b912a1ef1a0283c8e8ca6da064e843a95694fb"}
Jul 20 09:39:32.620192 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:32.620166    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lg8hz" event={"ID":"5dc72568-b630-42a0-8c33-58bcd45517ed","Type":"ContainerStarted","Data":"231f14cd193f63872a040921b0ff7243d91d17d40c07b772937db30a8256f386"}
Jul 20 09:39:32.621881 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:32.621861    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nk6p8" event={"ID":"6475a644-97bb-467b-9bc6-b5482c92779c","Type":"ContainerStarted","Data":"bbabbac6b907596c89e07a48c26fb953dbea5894a9d0fe5b9a1c5011ca4ec226"}
Jul 20 09:39:32.633527 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:32.633493    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rrbzg" podStartSLOduration=3.426995357 podStartE2EDuration="23.633481917s" totalImagesPullingTime="20.20648656s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:39:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:31.657496566 +0000 UTC m=+23.538942875" watchObservedRunningTime="2026-07-20 09:39:32.633481917 +0000 UTC m=+24.514928225"
Jul 20 09:39:32.648612 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:32.648568    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nk6p8" podStartSLOduration=3.76809681 podStartE2EDuration="23.64855044s" totalImagesPullingTime="19.88045363s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:39:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:32.647865592 +0000 UTC m=+24.529311921" watchObservedRunningTime="2026-07-20 09:39:32.64855044 +0000 UTC m=+24.529996751"
Jul 20 09:39:32.705239 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:32.705196    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lg8hz" podStartSLOduration=3.661974459 podStartE2EDuration="23.705179162s" totalImagesPullingTime="20.043204703s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:39:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:32.682766516 +0000 UTC m=+24.564212839" watchObservedRunningTime="2026-07-20 09:39:32.705179162 +0000 UTC m=+24.586625473"
Jul 20 09:39:32.705400 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:32.705280    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8q9d8" podStartSLOduration=3.7904051340000002 podStartE2EDuration="23.705272973s" totalImagesPullingTime="19.914867839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:39:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:32.702849613 +0000 UTC m=+24.584295933" watchObservedRunningTime="2026-07-20 09:39:32.705272973 +0000 UTC m=+24.586719282"
Jul 20 09:39:32.726447 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:32.726375    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pxtqn" podStartSLOduration=3.850795717 podStartE2EDuration="23.726365013s" totalImagesPullingTime="19.875569296s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:39:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:32.726136945 +0000 UTC m=+24.607583254" watchObservedRunningTime="2026-07-20 09:39:32.726365013 +0000 UTC m=+24.607811320"
Jul 20 09:39:33.098407 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:33.098386    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 20 09:39:33.580702 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:33.580662    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:33.627298 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:33.627263    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal" event={"ID":"8ef5df63ddb7b5d72473f9f24434be4d","Type":"ContainerStarted","Data":"430e4bf31e0a91bc810ad2878621a88768f70cfd36a261f6867ac1e27e77ce74"}
Jul 20 09:39:33.630675 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:33.630645    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xflk2" event={"ID":"1068b07e-5d5b-4104-b412-51f02e6236e7","Type":"ContainerStarted","Data":"a977fc5e9246d20fea4f536f383483b61efb8f4be87f4c047bf3a320a40421b7"}
Jul 20 09:39:33.644261 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:33.644209    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-236.ec2.internal" podStartSLOduration=23.644189339 podStartE2EDuration="23.644189339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:39:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:33.643845578 +0000 UTC m=+25.525291887" watchObservedRunningTime="2026-07-20 09:39:33.644189339 +0000 UTC m=+25.525635664"
Jul 20 09:39:33.648616 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:33.648551    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:33.710775 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:33.710683    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T09:39:33.098402243Z","UUID":"d3820c1d-f09e-47df-8d74-6df1a29b0fa7","Handler":null,"Name":"","Endpoint":""}
Jul 20 09:39:33.712159 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:33.712142    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 20 09:39:33.712238 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:33.712179    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 20 09:39:34.303852 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:34.303815    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8q9d8"
Jul 20 09:39:34.304428 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:34.304406    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8q9d8"
Jul 20 09:39:34.459160 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:34.459135    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:39:34.459160 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:34.459154    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:34.459328 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:34.459253    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d76tg" podUID="8e667eae-fd03-4ae1-b97d-1af58fb5e8fc"
Jul 20 09:39:34.459328 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:34.459271    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:34.459469 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:34.459394    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnzkg" podUID="2450d682-ad31-4104-b469-603d43b7b1b2"
Jul 20 09:39:34.459543 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:34.459517    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqb2z" podUID="82e7c25c-d929-4258-8f87-ddfadcf5042e"
Jul 20 09:39:34.636226 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:34.636201    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rgb4r_d6c73ac6-85c5-4b3f-aa58-71ac88099c0a/ovn-acl-logging/0.log"
Jul 20 09:39:34.636732 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:34.636705    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r" event={"ID":"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a","Type":"ContainerStarted","Data":"6abec6167dfa67f5842123eceac6c25fcbe347bbaa804e89b4c6b0236e0cdb7c"}
Jul 20 09:39:34.638986 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:34.638945    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xflk2" event={"ID":"1068b07e-5d5b-4104-b412-51f02e6236e7","Type":"ContainerStarted","Data":"841472e18ee244e1ba4c56dbc15e3f07721be2aa772c10995ba2be3312d9e57a"}
Jul 20 09:39:34.639706 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:34.639493    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8q9d8"
Jul 20 09:39:34.639845 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:34.639827    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8q9d8"
Jul 20 09:39:34.673364 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:34.673319    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xflk2" podStartSLOduration=3.35749929 podStartE2EDuration="25.673301675s" totalImagesPullingTime="22.315802385s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:39:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:34.657773014 +0000 UTC m=+26.539219334" watchObservedRunningTime="2026-07-20 09:39:34.673301675 +0000 UTC m=+26.554747984"
Jul 20 09:39:34.983559 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:34.983466    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:35.110867 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:35.110838    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:35.353304 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:35.353272    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:35.457633 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:35.457605    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:35.695456 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:35.695374    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:36.458614 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:36.458583    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:39:36.458777 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:36.458688    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:36.458777 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:36.458700    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d76tg" podUID="8e667eae-fd03-4ae1-b97d-1af58fb5e8fc"
Jul 20 09:39:36.458777 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:36.458726    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:36.458930 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:36.458837    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqb2z" podUID="82e7c25c-d929-4258-8f87-ddfadcf5042e"
Jul 20 09:39:36.459020 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:36.458976    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnzkg" podUID="2450d682-ad31-4104-b469-603d43b7b1b2"
Jul 20 09:39:36.525422 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:36.525395    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:36.887243 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:36.887074    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:37.280665 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:37.280639    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:37.647350 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:37.647317    2581 generic.go:356] "Generic (PLEG): container finished" podID="41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b" containerID="4e3a2f043137018c04d8894cb367d8e98e2cbdbf50b38a82951fc101b1ba7805" exitCode=0
Jul 20 09:39:37.647475 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:37.647398    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fvswj" event={"ID":"41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b","Type":"ContainerDied","Data":"4e3a2f043137018c04d8894cb367d8e98e2cbdbf50b38a82951fc101b1ba7805"}
Jul 20 09:39:37.650936 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:37.650917    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rgb4r_d6c73ac6-85c5-4b3f-aa58-71ac88099c0a/ovn-acl-logging/0.log"
Jul 20 09:39:37.651339 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:37.651320    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r" event={"ID":"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a","Type":"ContainerStarted","Data":"a65ce88ed329689ed73209af7e7176fa9ead4713aae783dc7a3513f7bcd0a8e9"}
Jul 20 09:39:37.651520 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:37.651504    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:37.651587 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:37.651569    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:37.651746 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:37.651728    2581 scope.go:117] "RemoveContainer" containerID="51372fc5d4e4e61fa7933799566e04360b81cbc80b2257d5dc381b27297ab220"
Jul 20 09:39:37.665947 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:37.665925    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:37.691160 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:37.691141    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:37.889431 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:37.889407    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:38.458699 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:38.458671    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:38.458952 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:38.458671    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:39:38.458952 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:38.458786    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnzkg" podUID="2450d682-ad31-4104-b469-603d43b7b1b2"
Jul 20 09:39:38.458952 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:38.458671    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:38.458952 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:38.458831    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d76tg" podUID="8e667eae-fd03-4ae1-b97d-1af58fb5e8fc"
Jul 20 09:39:38.458952 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:38.458914    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqb2z" podUID="82e7c25c-d929-4258-8f87-ddfadcf5042e"
Jul 20 09:39:38.492853 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:38.492825    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:38.655835 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:38.655805    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rgb4r_d6c73ac6-85c5-4b3f-aa58-71ac88099c0a/ovn-acl-logging/0.log"
Jul 20 09:39:38.656177 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:38.656156    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r" event={"ID":"d6c73ac6-85c5-4b3f-aa58-71ac88099c0a","Type":"ContainerStarted","Data":"c48083927b2fe31bf73793c82d350225a7321906e7310854d092d258909feb8a"}
Jul 20 09:39:38.656381 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:38.656363    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:38.670988 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:38.670818    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:39:38.686018 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:38.685956    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r" podStartSLOduration=9.580574877 podStartE2EDuration="29.685944326s" totalImagesPullingTime="20.105369449s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:39:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:38.684692638 +0000 UTC m=+30.566138947" watchObservedRunningTime="2026-07-20 09:39:38.685944326 +0000 UTC m=+30.567390633"
Jul 20 09:39:38.689582 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:38.689564    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:38.886860 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:38.886839    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:38.950161 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:38.950134    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:39.278212 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:39.278173    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:39.660437 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:39.660407    2581 generic.go:356] "Generic (PLEG): container finished" podID="41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b" containerID="e11e8734e2fc9d784191097c6e7fa7c63c9eec05e78f444bb1255673ef276c8a" exitCode=0
Jul 20 09:39:39.660579 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:39.660489    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fvswj" event={"ID":"41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b","Type":"ContainerDied","Data":"e11e8734e2fc9d784191097c6e7fa7c63c9eec05e78f444bb1255673ef276c8a"}
Jul 20 09:39:39.687406 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:39.687361    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:39.747428 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:39.747405    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:40.084098 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:40.084030    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:40.287460 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:40.287424    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:40.458593 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:40.458567    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:40.458738 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:40.458607    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:40.458738 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:40.458665    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:39:40.458738 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:40.458678    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnzkg" podUID="2450d682-ad31-4104-b469-603d43b7b1b2"
Jul 20 09:39:40.458838 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:40.458733    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d76tg" podUID="8e667eae-fd03-4ae1-b97d-1af58fb5e8fc"
Jul 20 09:39:40.458838 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:40.458803    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqb2z" podUID="82e7c25c-d929-4258-8f87-ddfadcf5042e"
Jul 20 09:39:40.884896 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:40.884872    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:41.197232 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:41.197204    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:41.482162 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:41.482103    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:41.666920 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:41.666891    2581 generic.go:356] "Generic (PLEG): container finished" podID="41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b" containerID="993ce278a3c8aa7ee7ee10d374f15f25b7e241ccae70529fa8471b5b879e766c" exitCode=0
Jul 20 09:39:41.667066 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:41.666950    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fvswj" event={"ID":"41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b","Type":"ContainerDied","Data":"993ce278a3c8aa7ee7ee10d374f15f25b7e241ccae70529fa8471b5b879e766c"}
Jul 20 09:39:41.678861 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:41.678832    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:41.793792 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:41.793740    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:41.898727 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:41.898703    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:41.959920 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:41.959874    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:42.093783 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:42.093727    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:42.180416 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:42.180396    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:42.283973 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:42.283926    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:42.360641 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:42.360615    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2450d682-ad31-4104-b469-603d43b7b1b2-metrics-certs\") pod \"network-metrics-daemon-fnzkg\" (UID: \"2450d682-ad31-4104-b469-603d43b7b1b2\") " pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:42.360753 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:42.360719    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 09:39:42.360789 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:42.360774    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2450d682-ad31-4104-b469-603d43b7b1b2-metrics-certs podName:2450d682-ad31-4104-b469-603d43b7b1b2 nodeName:}" failed. No retries permitted until 2026-07-20 09:40:14.360758786 +0000 UTC m=+66.242205072 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2450d682-ad31-4104-b469-603d43b7b1b2-metrics-certs") pod "network-metrics-daemon-fnzkg" (UID: "2450d682-ad31-4104-b469-603d43b7b1b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 09:39:42.459246 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:42.459220    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:39:42.459450 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:42.459328    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d76tg" podUID="8e667eae-fd03-4ae1-b97d-1af58fb5e8fc"
Jul 20 09:39:42.459450 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:42.459429    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:42.459583 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:42.459533    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnzkg" podUID="2450d682-ad31-4104-b469-603d43b7b1b2"
Jul 20 09:39:42.459583 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:42.459557    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:42.459736 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:42.459621    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqb2z" podUID="82e7c25c-d929-4258-8f87-ddfadcf5042e"
Jul 20 09:39:42.461450 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:42.461418    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/82e7c25c-d929-4258-8f87-ddfadcf5042e-original-pull-secret\") pod \"global-pull-secret-syncer-xqb2z\" (UID: \"82e7c25c-d929-4258-8f87-ddfadcf5042e\") " pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:42.461566 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:42.461549    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 09:39:42.461638 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:42.461612    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82e7c25c-d929-4258-8f87-ddfadcf5042e-original-pull-secret podName:82e7c25c-d929-4258-8f87-ddfadcf5042e nodeName:}" failed. No retries permitted until 2026-07-20 09:40:14.461593391 +0000 UTC m=+66.343039691 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/82e7c25c-d929-4258-8f87-ddfadcf5042e-original-pull-secret") pod "global-pull-secret-syncer-xqb2z" (UID: "82e7c25c-d929-4258-8f87-ddfadcf5042e") : object "kube-system"/"original-pull-secret" not registered
Jul 20 09:39:42.472378 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:42.472334    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:42.561838 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:42.561812    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghlv4\" (UniqueName: \"kubernetes.io/projected/8e667eae-fd03-4ae1-b97d-1af58fb5e8fc-kube-api-access-ghlv4\") pod \"network-check-target-d76tg\" (UID: \"8e667eae-fd03-4ae1-b97d-1af58fb5e8fc\") " pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:39:42.561977 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:42.561929    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 09:39:42.561977 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:42.561941    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 09:39:42.561977 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:42.561950    2581 projected.go:196] Error preparing data for projected volume kube-api-access-ghlv4 for pod openshift-network-diagnostics/network-check-target-d76tg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 09:39:42.562075 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:42.562005    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8e667eae-fd03-4ae1-b97d-1af58fb5e8fc-kube-api-access-ghlv4 podName:8e667eae-fd03-4ae1-b97d-1af58fb5e8fc nodeName:}" failed. No retries permitted until 2026-07-20 09:40:14.561993079 +0000 UTC m=+66.443439365 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ghlv4" (UniqueName: "kubernetes.io/projected/8e667eae-fd03-4ae1-b97d-1af58fb5e8fc-kube-api-access-ghlv4") pod "network-check-target-d76tg" (UID: "8e667eae-fd03-4ae1-b97d-1af58fb5e8fc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 09:39:42.574671 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:42.574649    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:42.672735 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:42.672648    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:42.732954 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:42.732924    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:42.888907 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:42.888874    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:42.950972 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:42.950884    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:43.292461 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:43.292390    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:43.490043 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:43.490003    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:43.557900 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:43.557826    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:43.685269 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:43.685238    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:43.883626 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:43.883598    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:44.086644 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:44.086612    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:44.308155 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:44.308076    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:44.372121 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:44.372087    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:44.458871 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:44.458841    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:39:44.459024 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:44.458937    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:44.459024 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:44.458951    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d76tg" podUID="8e667eae-fd03-4ae1-b97d-1af58fb5e8fc"
Jul 20 09:39:44.459024 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:44.458990    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:44.459184 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:44.459114    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnzkg" podUID="2450d682-ad31-4104-b469-603d43b7b1b2"
Jul 20 09:39:44.459231 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:44.459190    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqb2z" podUID="82e7c25c-d929-4258-8f87-ddfadcf5042e"
Jul 20 09:39:45.304731 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:45.304692    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:45.516418 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:45.516386    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:45.699522 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:45.699485    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:45.905065 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:45.905029    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:46.089106 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:46.089074    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:46.458853 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:46.458825    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:46.459011 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:46.458828    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:39:46.459011 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:46.458934    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnzkg" podUID="2450d682-ad31-4104-b469-603d43b7b1b2"
Jul 20 09:39:46.459108 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:46.459028    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d76tg" podUID="8e667eae-fd03-4ae1-b97d-1af58fb5e8fc"
Jul 20 09:39:46.459108 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:46.458844    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:46.459179 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:46.459105    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqb2z" podUID="82e7c25c-d929-4258-8f87-ddfadcf5042e"
Jul 20 09:39:46.681826 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:46.681790    2581 generic.go:356] "Generic (PLEG): container finished" podID="41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b" containerID="b33c9e2cd4ac76af1919edbad7cbdea2524666d9f4ea86a428301b3b8aa8f991" exitCode=0
Jul 20 09:39:46.682177 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:46.681851    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fvswj" event={"ID":"41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b","Type":"ContainerDied","Data":"b33c9e2cd4ac76af1919edbad7cbdea2524666d9f4ea86a428301b3b8aa8f991"}
Jul 20 09:39:47.686761 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:47.686731    2581 generic.go:356] "Generic (PLEG): container finished" podID="41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b" containerID="ed7b3cbff58af795a09883a9f7aae78cdf47f4b0ab75dee6b156f2c71cea94f5" exitCode=0
Jul 20 09:39:47.687134 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:47.686791    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fvswj" event={"ID":"41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b","Type":"ContainerDied","Data":"ed7b3cbff58af795a09883a9f7aae78cdf47f4b0ab75dee6b156f2c71cea94f5"}
Jul 20 09:39:48.458955 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:48.458925    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:48.458955 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:48.458952    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:39:48.459204 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:48.458928    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:48.459204 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:48.459023    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqb2z" podUID="82e7c25c-d929-4258-8f87-ddfadcf5042e"
Jul 20 09:39:48.459204 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:48.459123    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnzkg" podUID="2450d682-ad31-4104-b469-603d43b7b1b2"
Jul 20 09:39:48.459204 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:48.459170    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d76tg" podUID="8e667eae-fd03-4ae1-b97d-1af58fb5e8fc"
Jul 20 09:39:48.692060 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:48.692033    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fvswj" event={"ID":"41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b","Type":"ContainerStarted","Data":"dcdf6a108e1bf8c16c0b53a58f43009cec923111baa322796bf60b98d005ebd3"}
Jul 20 09:39:48.715857 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:48.715800    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:48.724955 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:48.724919    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fvswj" podStartSLOduration=8.539393293 podStartE2EDuration="39.724904477s" totalImagesPullingTime="31.185511184s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:39:09 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:39:48.723238119 +0000 UTC m=+40.604684426" watchObservedRunningTime="2026-07-20 09:39:48.724904477 +0000 UTC m=+40.606350785"
Jul 20 09:39:50.459091 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:50.459066    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:50.459487 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:50.459093    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:50.459487 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:50.459067    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:39:50.459487 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:50.459160    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnzkg" podUID="2450d682-ad31-4104-b469-603d43b7b1b2"
Jul 20 09:39:50.459487 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:50.459221    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d76tg" podUID="8e667eae-fd03-4ae1-b97d-1af58fb5e8fc"
Jul 20 09:39:50.459487 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:50.459312    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqb2z" podUID="82e7c25c-d929-4258-8f87-ddfadcf5042e"
Jul 20 09:39:52.458641 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:52.458612    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:52.459031 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:52.458610    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:52.459031 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:52.458705    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqb2z" podUID="82e7c25c-d929-4258-8f87-ddfadcf5042e"
Jul 20 09:39:52.459031 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:52.458610    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:39:52.459031 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:52.458788    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnzkg" podUID="2450d682-ad31-4104-b469-603d43b7b1b2"
Jul 20 09:39:52.459031 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:52.458846    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d76tg" podUID="8e667eae-fd03-4ae1-b97d-1af58fb5e8fc"
Jul 20 09:39:53.174579 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:53.174538    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:53.282377 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:53.282336    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:53.384631 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:53.384573    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:53.497857 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:53.497786    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:53.606851 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:53.606819    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:53.714672 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:53.714649    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:53.805794 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:53.805721    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:54.298570 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:54.298399    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xqb2z"]
Jul 20 09:39:54.298727 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:54.298698    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:54.298834 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:54.298811    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqb2z" podUID="82e7c25c-d929-4258-8f87-ddfadcf5042e"
Jul 20 09:39:54.301947 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:54.301921    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-d76tg"]
Jul 20 09:39:54.302077 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:54.302042    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:39:54.302193 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:54.302134    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d76tg" podUID="8e667eae-fd03-4ae1-b97d-1af58fb5e8fc"
Jul 20 09:39:54.304676 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:54.304653    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fnzkg"]
Jul 20 09:39:54.304807 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:54.304758    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:54.304886 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:54.304865    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnzkg" podUID="2450d682-ad31-4104-b469-603d43b7b1b2"
Jul 20 09:39:55.339151 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:55.339052    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:55.410792 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:55.410769    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:56.458492 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:56.458425    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:39:56.458876 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:56.458515    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:56.458876 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:56.458523    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d76tg" podUID="8e667eae-fd03-4ae1-b97d-1af58fb5e8fc"
Jul 20 09:39:56.458876 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:56.458537    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:56.458876 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:56.458596    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fnzkg" podUID="2450d682-ad31-4104-b469-603d43b7b1b2"
Jul 20 09:39:56.458876 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:39:56.458649    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xqb2z" podUID="82e7c25c-d929-4258-8f87-ddfadcf5042e"
Jul 20 09:39:57.751065 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:57.751024    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:57.853818 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:57.853790    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:57.943533 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:57.943509    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:57.976172 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:57.976155    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-236.ec2.internal" event="NodeReady"
Jul 20 09:39:57.976269 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:57.976253    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 20 09:39:58.039016 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.038992    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-n9bd9"]
Jul 20 09:39:58.076665 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.076640    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9d2xv"]
Jul 20 09:39:58.076769 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.076754    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n9bd9"
Jul 20 09:39:58.079433 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.079413    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 20 09:39:58.079523 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.079454    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 20 09:39:58.079585 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.079551    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 20 09:39:58.079585 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.079575    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 20 09:39:58.079689 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.079651    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vz98l\""
Jul 20 09:39:58.092334 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.092270    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n9bd9"]
Jul 20 09:39:58.092334 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.092331    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9d2xv"
Jul 20 09:39:58.092453 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.092375    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9d2xv"]
Jul 20 09:39:58.095163 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.095147    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 20 09:39:58.095263 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.095184    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 20 09:39:58.095699 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.095683    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-v7wvr\""
Jul 20 09:39:58.095751 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.095713    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 20 09:39:58.134982 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.134922    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-v9ns4"]
Jul 20 09:39:58.160839 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.160822    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v9ns4"
Jul 20 09:39:58.163306 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.163285    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 20 09:39:58.163880 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.163866    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6tr7c\""
Jul 20 09:39:58.164080 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.164068    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 20 09:39:58.172705 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.172689    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v9ns4"]
Jul 20 09:39:58.180335 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.180318    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9dcbaa05-de0c-4ffd-b71f-e9fd807b187b-cert\") pod \"ingress-canary-9d2xv\" (UID: \"9dcbaa05-de0c-4ffd-b71f-e9fd807b187b\") " pod="openshift-ingress-canary/ingress-canary-9d2xv"
Jul 20 09:39:58.180425 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.180343    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hww8\" (UniqueName: \"kubernetes.io/projected/90ea7755-183e-4a0d-b30d-eb9459261ae9-kube-api-access-5hww8\") pod \"insights-runtime-extractor-n9bd9\" (UID: \"90ea7755-183e-4a0d-b30d-eb9459261ae9\") " pod="openshift-insights/insights-runtime-extractor-n9bd9"
Jul 20 09:39:58.180425 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.180365    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz9ws\" (UniqueName: \"kubernetes.io/projected/9dcbaa05-de0c-4ffd-b71f-e9fd807b187b-kube-api-access-wz9ws\") pod \"ingress-canary-9d2xv\" (UID: \"9dcbaa05-de0c-4ffd-b71f-e9fd807b187b\") " pod="openshift-ingress-canary/ingress-canary-9d2xv"
Jul 20 09:39:58.180500 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.180420    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/90ea7755-183e-4a0d-b30d-eb9459261ae9-crio-socket\") pod \"insights-runtime-extractor-n9bd9\" (UID: \"90ea7755-183e-4a0d-b30d-eb9459261ae9\") " pod="openshift-insights/insights-runtime-extractor-n9bd9"
Jul 20 09:39:58.180556 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.180538    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/90ea7755-183e-4a0d-b30d-eb9459261ae9-data-volume\") pod \"insights-runtime-extractor-n9bd9\" (UID: \"90ea7755-183e-4a0d-b30d-eb9459261ae9\") " pod="openshift-insights/insights-runtime-extractor-n9bd9"
Jul 20 09:39:58.180595 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.180564    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/90ea7755-183e-4a0d-b30d-eb9459261ae9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n9bd9\" (UID: \"90ea7755-183e-4a0d-b30d-eb9459261ae9\") " pod="openshift-insights/insights-runtime-extractor-n9bd9"
Jul 20 09:39:58.180625 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.180598    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/90ea7755-183e-4a0d-b30d-eb9459261ae9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n9bd9\" (UID: \"90ea7755-183e-4a0d-b30d-eb9459261ae9\") " pod="openshift-insights/insights-runtime-extractor-n9bd9"
Jul 20 09:39:58.208129 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.208103    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:58.281441 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.281421    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/90ea7755-183e-4a0d-b30d-eb9459261ae9-crio-socket\") pod \"insights-runtime-extractor-n9bd9\" (UID: \"90ea7755-183e-4a0d-b30d-eb9459261ae9\") " pod="openshift-insights/insights-runtime-extractor-n9bd9"
Jul 20 09:39:58.281527 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.281447    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e604f9a4-6af8-4110-b748-4760445401d3-tmp-dir\") pod \"dns-default-v9ns4\" (UID: \"e604f9a4-6af8-4110-b748-4760445401d3\") " pod="openshift-dns/dns-default-v9ns4"
Jul 20 09:39:58.281527 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.281479    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/90ea7755-183e-4a0d-b30d-eb9459261ae9-data-volume\") pod \"insights-runtime-extractor-n9bd9\" (UID: \"90ea7755-183e-4a0d-b30d-eb9459261ae9\") " pod="openshift-insights/insights-runtime-extractor-n9bd9"
Jul 20 09:39:58.281527 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.281494    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/90ea7755-183e-4a0d-b30d-eb9459261ae9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n9bd9\" (UID: \"90ea7755-183e-4a0d-b30d-eb9459261ae9\") " pod="openshift-insights/insights-runtime-extractor-n9bd9"
Jul 20 09:39:58.281527 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.281509    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e604f9a4-6af8-4110-b748-4760445401d3-config-volume\") pod \"dns-default-v9ns4\" (UID: \"e604f9a4-6af8-4110-b748-4760445401d3\") " pod="openshift-dns/dns-default-v9ns4"
Jul 20 09:39:58.281665 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.281538    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/90ea7755-183e-4a0d-b30d-eb9459261ae9-crio-socket\") pod \"insights-runtime-extractor-n9bd9\" (UID: \"90ea7755-183e-4a0d-b30d-eb9459261ae9\") " pod="openshift-insights/insights-runtime-extractor-n9bd9"
Jul 20 09:39:58.281665 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.281608    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e604f9a4-6af8-4110-b748-4760445401d3-metrics-tls\") pod \"dns-default-v9ns4\" (UID: \"e604f9a4-6af8-4110-b748-4760445401d3\") " pod="openshift-dns/dns-default-v9ns4"
Jul 20 09:39:58.281741 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.281666    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/90ea7755-183e-4a0d-b30d-eb9459261ae9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n9bd9\" (UID: \"90ea7755-183e-4a0d-b30d-eb9459261ae9\") " pod="openshift-insights/insights-runtime-extractor-n9bd9"
Jul 20 09:39:58.281741 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.281695    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9dcbaa05-de0c-4ffd-b71f-e9fd807b187b-cert\") pod \"ingress-canary-9d2xv\" (UID: \"9dcbaa05-de0c-4ffd-b71f-e9fd807b187b\") " pod="openshift-ingress-canary/ingress-canary-9d2xv"
Jul 20 09:39:58.281741 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.281720    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hww8\" (UniqueName: \"kubernetes.io/projected/90ea7755-183e-4a0d-b30d-eb9459261ae9-kube-api-access-5hww8\") pod \"insights-runtime-extractor-n9bd9\" (UID: \"90ea7755-183e-4a0d-b30d-eb9459261ae9\") " pod="openshift-insights/insights-runtime-extractor-n9bd9"
Jul 20 09:39:58.281869 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.281756    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz9ws\" (UniqueName: \"kubernetes.io/projected/9dcbaa05-de0c-4ffd-b71f-e9fd807b187b-kube-api-access-wz9ws\") pod \"ingress-canary-9d2xv\" (UID: \"9dcbaa05-de0c-4ffd-b71f-e9fd807b187b\") " pod="openshift-ingress-canary/ingress-canary-9d2xv"
Jul 20 09:39:58.281869 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.281782    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmlvj\" (UniqueName: \"kubernetes.io/projected/e604f9a4-6af8-4110-b748-4760445401d3-kube-api-access-xmlvj\") pod \"dns-default-v9ns4\" (UID: \"e604f9a4-6af8-4110-b748-4760445401d3\") " pod="openshift-dns/dns-default-v9ns4"
Jul 20 09:39:58.281869 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.281797    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/90ea7755-183e-4a0d-b30d-eb9459261ae9-data-volume\") pod \"insights-runtime-extractor-n9bd9\" (UID: \"90ea7755-183e-4a0d-b30d-eb9459261ae9\") " pod="openshift-insights/insights-runtime-extractor-n9bd9"
Jul 20 09:39:58.282186 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.282166    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/90ea7755-183e-4a0d-b30d-eb9459261ae9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n9bd9\" (UID: \"90ea7755-183e-4a0d-b30d-eb9459261ae9\") " pod="openshift-insights/insights-runtime-extractor-n9bd9"
Jul 20 09:39:58.285402 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.285383    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/90ea7755-183e-4a0d-b30d-eb9459261ae9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n9bd9\" (UID: \"90ea7755-183e-4a0d-b30d-eb9459261ae9\") " pod="openshift-insights/insights-runtime-extractor-n9bd9"
Jul 20 09:39:58.285535 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.285516    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9dcbaa05-de0c-4ffd-b71f-e9fd807b187b-cert\") pod \"ingress-canary-9d2xv\" (UID: \"9dcbaa05-de0c-4ffd-b71f-e9fd807b187b\") " pod="openshift-ingress-canary/ingress-canary-9d2xv"
Jul 20 09:39:58.290088 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.290069    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hww8\" (UniqueName: \"kubernetes.io/projected/90ea7755-183e-4a0d-b30d-eb9459261ae9-kube-api-access-5hww8\") pod \"insights-runtime-extractor-n9bd9\" (UID: \"90ea7755-183e-4a0d-b30d-eb9459261ae9\") " pod="openshift-insights/insights-runtime-extractor-n9bd9"
Jul 20 09:39:58.290530 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.290508    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz9ws\" (UniqueName: \"kubernetes.io/projected/9dcbaa05-de0c-4ffd-b71f-e9fd807b187b-kube-api-access-wz9ws\") pod \"ingress-canary-9d2xv\" (UID: \"9dcbaa05-de0c-4ffd-b71f-e9fd807b187b\") " pod="openshift-ingress-canary/ingress-canary-9d2xv"
Jul 20 09:39:58.298646 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.298629    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:58.366061 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.366041    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:58.382045 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.382028    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmlvj\" (UniqueName: \"kubernetes.io/projected/e604f9a4-6af8-4110-b748-4760445401d3-kube-api-access-xmlvj\") pod \"dns-default-v9ns4\" (UID: \"e604f9a4-6af8-4110-b748-4760445401d3\") " pod="openshift-dns/dns-default-v9ns4"
Jul 20 09:39:58.382106 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.382064    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e604f9a4-6af8-4110-b748-4760445401d3-tmp-dir\") pod \"dns-default-v9ns4\" (UID: \"e604f9a4-6af8-4110-b748-4760445401d3\") " pod="openshift-dns/dns-default-v9ns4"
Jul 20 09:39:58.382106 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.382093    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e604f9a4-6af8-4110-b748-4760445401d3-config-volume\") pod \"dns-default-v9ns4\" (UID: \"e604f9a4-6af8-4110-b748-4760445401d3\") " pod="openshift-dns/dns-default-v9ns4"
Jul 20 09:39:58.382171 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.382109    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e604f9a4-6af8-4110-b748-4760445401d3-metrics-tls\") pod \"dns-default-v9ns4\" (UID: \"e604f9a4-6af8-4110-b748-4760445401d3\") " pod="openshift-dns/dns-default-v9ns4"
Jul 20 09:39:58.382349 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.382336    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e604f9a4-6af8-4110-b748-4760445401d3-tmp-dir\") pod \"dns-default-v9ns4\" (UID: \"e604f9a4-6af8-4110-b748-4760445401d3\") " pod="openshift-dns/dns-default-v9ns4"
Jul 20 09:39:58.382663 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.382638    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e604f9a4-6af8-4110-b748-4760445401d3-config-volume\") pod \"dns-default-v9ns4\" (UID: \"e604f9a4-6af8-4110-b748-4760445401d3\") " pod="openshift-dns/dns-default-v9ns4"
Jul 20 09:39:58.383982 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.383942    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e604f9a4-6af8-4110-b748-4760445401d3-metrics-tls\") pod \"dns-default-v9ns4\" (UID: \"e604f9a4-6af8-4110-b748-4760445401d3\") " pod="openshift-dns/dns-default-v9ns4"
Jul 20 09:39:58.385980 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.385936    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n9bd9"
Jul 20 09:39:58.390699 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.390678    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmlvj\" (UniqueName: \"kubernetes.io/projected/e604f9a4-6af8-4110-b748-4760445401d3-kube-api-access-xmlvj\") pod \"dns-default-v9ns4\" (UID: \"e604f9a4-6af8-4110-b748-4760445401d3\") " pod="openshift-dns/dns-default-v9ns4"
Jul 20 09:39:58.400606 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.400591    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9d2xv"
Jul 20 09:39:58.458438 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.458412    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:39:58.458557 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.458511    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:39:58.458720 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.458700    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:39:58.461621 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.461602    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 09:39:58.462289 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.462122    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 09:39:58.462289 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.462152    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 09:39:58.462289 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.462125    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pgl5c\""
Jul 20 09:39:58.462289 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.462177    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 09:39:58.462289 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.462189    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hssrx\""
Jul 20 09:39:58.468581 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.468552    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v9ns4"
Jul 20 09:39:58.600642 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.600375    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9d2xv"]
Jul 20 09:39:58.604767 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.604741    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n9bd9"]
Jul 20 09:39:58.606409 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:58.606380    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dcbaa05_de0c_4ffd_b71f_e9fd807b187b.slice/crio-ef3bc2de4ea5592a9e8ad93ff35d46f903b960d5990487082ea5e120ab3eb287 WatchSource:0}: Error finding container ef3bc2de4ea5592a9e8ad93ff35d46f903b960d5990487082ea5e120ab3eb287: Status 404 returned error can't find the container with id ef3bc2de4ea5592a9e8ad93ff35d46f903b960d5990487082ea5e120ab3eb287
Jul 20 09:39:58.607062 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:58.607033    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90ea7755_183e_4a0d_b30d_eb9459261ae9.slice/crio-1e69079f3459e04882d4fdf8bd0bdda410cada34ac6f7dfd5a2a212951b22bd1 WatchSource:0}: Error finding container 1e69079f3459e04882d4fdf8bd0bdda410cada34ac6f7dfd5a2a212951b22bd1: Status 404 returned error can't find the container with id 1e69079f3459e04882d4fdf8bd0bdda410cada34ac6f7dfd5a2a212951b22bd1
Jul 20 09:39:58.638251 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.638175    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v9ns4"]
Jul 20 09:39:58.640821 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:39:58.640801    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode604f9a4_6af8_4110_b748_4760445401d3.slice/crio-c054573c53f5355403be55b1b7326a499a9fed972926ee69c34102fd4baad151 WatchSource:0}: Error finding container c054573c53f5355403be55b1b7326a499a9fed972926ee69c34102fd4baad151: Status 404 returned error can't find the container with id c054573c53f5355403be55b1b7326a499a9fed972926ee69c34102fd4baad151
Jul 20 09:39:58.717035 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.717006    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v9ns4" event={"ID":"e604f9a4-6af8-4110-b748-4760445401d3","Type":"ContainerStarted","Data":"c054573c53f5355403be55b1b7326a499a9fed972926ee69c34102fd4baad151"}
Jul 20 09:39:58.718022 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.717994    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9d2xv" event={"ID":"9dcbaa05-de0c-4ffd-b71f-e9fd807b187b","Type":"ContainerStarted","Data":"ef3bc2de4ea5592a9e8ad93ff35d46f903b960d5990487082ea5e120ab3eb287"}
Jul 20 09:39:58.718994 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:58.718953    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n9bd9" event={"ID":"90ea7755-183e-4a0d-b30d-eb9459261ae9","Type":"ContainerStarted","Data":"1e69079f3459e04882d4fdf8bd0bdda410cada34ac6f7dfd5a2a212951b22bd1"}
Jul 20 09:39:59.611421 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:59.611350    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:39:59.711345 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:39:59.711311    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:00.515630 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.515600    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-775cf4658-m48pg"]
Jul 20 09:40:00.523918 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.523869    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:00.533048 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.533004    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-775cf4658-m48pg"]
Jul 20 09:40:00.533186 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.533130    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-775cf4658-m48pg"
Jul 20 09:40:00.536539 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.536517    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 20 09:40:00.537477 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.537451    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 20 09:40:00.537578 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.537549    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 20 09:40:00.537578 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.537548    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bwk56\""
Jul 20 09:40:00.537712 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.537696    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 20 09:40:00.537854 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.537808    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 20 09:40:00.537897 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.537870    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 20 09:40:00.538041 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.538015    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 20 09:40:00.542947 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.542924    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 20 09:40:00.592095 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.592064    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:00.702191 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.702152    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd387e8c-9f3e-471d-addf-a3560052c674-service-ca\") pod \"console-775cf4658-m48pg\" (UID: \"bd387e8c-9f3e-471d-addf-a3560052c674\") " pod="openshift-console/console-775cf4658-m48pg"
Jul 20 09:40:00.702635 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.702230    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd387e8c-9f3e-471d-addf-a3560052c674-console-oauth-config\") pod \"console-775cf4658-m48pg\" (UID: \"bd387e8c-9f3e-471d-addf-a3560052c674\") " pod="openshift-console/console-775cf4658-m48pg"
Jul 20 09:40:00.702635 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.702278    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd387e8c-9f3e-471d-addf-a3560052c674-console-serving-cert\") pod \"console-775cf4658-m48pg\" (UID: \"bd387e8c-9f3e-471d-addf-a3560052c674\") " pod="openshift-console/console-775cf4658-m48pg"
Jul 20 09:40:00.702635 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.702306    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgwv8\" (UniqueName: \"kubernetes.io/projected/bd387e8c-9f3e-471d-addf-a3560052c674-kube-api-access-mgwv8\") pod \"console-775cf4658-m48pg\" (UID: \"bd387e8c-9f3e-471d-addf-a3560052c674\") " pod="openshift-console/console-775cf4658-m48pg"
Jul 20 09:40:00.702635 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.702384    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd387e8c-9f3e-471d-addf-a3560052c674-trusted-ca-bundle\") pod \"console-775cf4658-m48pg\" (UID: \"bd387e8c-9f3e-471d-addf-a3560052c674\") " pod="openshift-console/console-775cf4658-m48pg"
Jul 20 09:40:00.702635 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.702488    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd387e8c-9f3e-471d-addf-a3560052c674-console-config\") pod \"console-775cf4658-m48pg\" (UID: \"bd387e8c-9f3e-471d-addf-a3560052c674\") " pod="openshift-console/console-775cf4658-m48pg"
Jul 20 09:40:00.702635 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.702570    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd387e8c-9f3e-471d-addf-a3560052c674-oauth-serving-cert\") pod \"console-775cf4658-m48pg\" (UID: \"bd387e8c-9f3e-471d-addf-a3560052c674\") " pod="openshift-console/console-775cf4658-m48pg"
Jul 20 09:40:00.803239 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.803163    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd387e8c-9f3e-471d-addf-a3560052c674-console-config\") pod \"console-775cf4658-m48pg\" (UID: \"bd387e8c-9f3e-471d-addf-a3560052c674\") " pod="openshift-console/console-775cf4658-m48pg"
Jul 20 09:40:00.803239 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.803211    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd387e8c-9f3e-471d-addf-a3560052c674-oauth-serving-cert\") pod \"console-775cf4658-m48pg\" (UID: \"bd387e8c-9f3e-471d-addf-a3560052c674\") " pod="openshift-console/console-775cf4658-m48pg"
Jul 20 09:40:00.803449 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.803274    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd387e8c-9f3e-471d-addf-a3560052c674-service-ca\") pod \"console-775cf4658-m48pg\" (UID: \"bd387e8c-9f3e-471d-addf-a3560052c674\") " pod="openshift-console/console-775cf4658-m48pg"
Jul 20 09:40:00.803449 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.803332    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd387e8c-9f3e-471d-addf-a3560052c674-console-oauth-config\") pod \"console-775cf4658-m48pg\" (UID: \"bd387e8c-9f3e-471d-addf-a3560052c674\") " pod="openshift-console/console-775cf4658-m48pg"
Jul 20 09:40:00.803449 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.803371    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd387e8c-9f3e-471d-addf-a3560052c674-console-serving-cert\") pod \"console-775cf4658-m48pg\" (UID: \"bd387e8c-9f3e-471d-addf-a3560052c674\") " pod="openshift-console/console-775cf4658-m48pg"
Jul 20 09:40:00.803449 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.803398    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgwv8\" (UniqueName: \"kubernetes.io/projected/bd387e8c-9f3e-471d-addf-a3560052c674-kube-api-access-mgwv8\") pod \"console-775cf4658-m48pg\" (UID: \"bd387e8c-9f3e-471d-addf-a3560052c674\") " pod="openshift-console/console-775cf4658-m48pg"
Jul 20 09:40:00.803449 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.803440    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd387e8c-9f3e-471d-addf-a3560052c674-trusted-ca-bundle\") pod \"console-775cf4658-m48pg\" (UID: \"bd387e8c-9f3e-471d-addf-a3560052c674\") " pod="openshift-console/console-775cf4658-m48pg"
Jul 20 09:40:00.804012 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.803985    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd387e8c-9f3e-471d-addf-a3560052c674-oauth-serving-cert\") pod \"console-775cf4658-m48pg\" (UID: \"bd387e8c-9f3e-471d-addf-a3560052c674\") " pod="openshift-console/console-775cf4658-m48pg"
Jul 20 09:40:00.804118 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.804040    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd387e8c-9f3e-471d-addf-a3560052c674-service-ca\") pod \"console-775cf4658-m48pg\" (UID: \"bd387e8c-9f3e-471d-addf-a3560052c674\") " pod="openshift-console/console-775cf4658-m48pg"
Jul 20 09:40:00.804353 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.804307    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd387e8c-9f3e-471d-addf-a3560052c674-trusted-ca-bundle\") pod \"console-775cf4658-m48pg\" (UID: \"bd387e8c-9f3e-471d-addf-a3560052c674\") " pod="openshift-console/console-775cf4658-m48pg"
Jul 20 09:40:00.804635 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.804584    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd387e8c-9f3e-471d-addf-a3560052c674-console-config\") pod \"console-775cf4658-m48pg\" (UID: \"bd387e8c-9f3e-471d-addf-a3560052c674\") " pod="openshift-console/console-775cf4658-m48pg"
Jul 20 09:40:00.807592 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.807568    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd387e8c-9f3e-471d-addf-a3560052c674-console-oauth-config\") pod \"console-775cf4658-m48pg\" (UID: \"bd387e8c-9f3e-471d-addf-a3560052c674\") " pod="openshift-console/console-775cf4658-m48pg"
Jul 20 09:40:00.808089 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.808069    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd387e8c-9f3e-471d-addf-a3560052c674-console-serving-cert\") pod \"console-775cf4658-m48pg\" (UID: \"bd387e8c-9f3e-471d-addf-a3560052c674\") " pod="openshift-console/console-775cf4658-m48pg"
Jul 20 09:40:00.813661 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.813641    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgwv8\" (UniqueName: \"kubernetes.io/projected/bd387e8c-9f3e-471d-addf-a3560052c674-kube-api-access-mgwv8\") pod \"console-775cf4658-m48pg\" (UID: \"bd387e8c-9f3e-471d-addf-a3560052c674\") " pod="openshift-console/console-775cf4658-m48pg"
Jul 20 09:40:00.851599 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:00.851554    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-775cf4658-m48pg"
Jul 20 09:40:01.109944 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:01.109909    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:01.211317 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:01.211269    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:03.968073 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:03.968037    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:04.023645 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:04.023616    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-5mnl8"]
Jul 20 09:40:04.068437 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:04.068409    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:04.154329 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:04.154265    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-5mnl8"]
Jul 20 09:40:04.154432 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:04.154374    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-5mnl8"
Jul 20 09:40:04.157589 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:04.157569    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 20 09:40:04.158046 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:04.158019    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-gj8qt\""
Jul 20 09:40:04.158046 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:04.158039    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 20 09:40:04.158181 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:04.158057    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 20 09:40:04.158181 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:04.158044    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 20 09:40:04.158181 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:04.158072    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 20 09:40:04.331880 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:04.331858    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3065b42b-2720-4e98-9e2e-a86a36da5ba0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-5mnl8\" (UID: \"3065b42b-2720-4e98-9e2e-a86a36da5ba0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5mnl8"
Jul 20 09:40:04.331991 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:04.331937    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3065b42b-2720-4e98-9e2e-a86a36da5ba0-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-5mnl8\" (UID: \"3065b42b-2720-4e98-9e2e-a86a36da5ba0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5mnl8"
Jul 20 09:40:04.331991 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:04.331957    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbfn6\" (UniqueName: \"kubernetes.io/projected/3065b42b-2720-4e98-9e2e-a86a36da5ba0-kube-api-access-dbfn6\") pod \"prometheus-operator-5945b5cfd-5mnl8\" (UID: \"3065b42b-2720-4e98-9e2e-a86a36da5ba0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5mnl8"
Jul 20 09:40:04.332067 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:04.332008    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3065b42b-2720-4e98-9e2e-a86a36da5ba0-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-5mnl8\" (UID: \"3065b42b-2720-4e98-9e2e-a86a36da5ba0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5mnl8"
Jul 20 09:40:04.334338 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:04.334314    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:04.432853 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:04.432794    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3065b42b-2720-4e98-9e2e-a86a36da5ba0-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-5mnl8\" (UID: \"3065b42b-2720-4e98-9e2e-a86a36da5ba0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5mnl8"
Jul 20 09:40:04.432853 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:04.432826    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbfn6\" (UniqueName: \"kubernetes.io/projected/3065b42b-2720-4e98-9e2e-a86a36da5ba0-kube-api-access-dbfn6\") pod \"prometheus-operator-5945b5cfd-5mnl8\" (UID: \"3065b42b-2720-4e98-9e2e-a86a36da5ba0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5mnl8"
Jul 20 09:40:04.433071 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:04.432850    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3065b42b-2720-4e98-9e2e-a86a36da5ba0-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-5mnl8\" (UID: \"3065b42b-2720-4e98-9e2e-a86a36da5ba0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5mnl8"
Jul 20 09:40:04.433071 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:04.432893    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3065b42b-2720-4e98-9e2e-a86a36da5ba0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-5mnl8\" (UID: \"3065b42b-2720-4e98-9e2e-a86a36da5ba0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5mnl8"
Jul 20 09:40:04.433071 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:40:04.432950    2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 20 09:40:04.433071 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:40:04.433034    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3065b42b-2720-4e98-9e2e-a86a36da5ba0-prometheus-operator-tls podName:3065b42b-2720-4e98-9e2e-a86a36da5ba0 nodeName:}" failed. No retries permitted until 2026-07-20 09:40:04.933014666 +0000 UTC m=+56.814460954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/3065b42b-2720-4e98-9e2e-a86a36da5ba0-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-5mnl8" (UID: "3065b42b-2720-4e98-9e2e-a86a36da5ba0") : secret "prometheus-operator-tls" not found
Jul 20 09:40:04.433633 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:04.433609    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3065b42b-2720-4e98-9e2e-a86a36da5ba0-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-5mnl8\" (UID: \"3065b42b-2720-4e98-9e2e-a86a36da5ba0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5mnl8"
Jul 20 09:40:04.435523 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:04.435494    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3065b42b-2720-4e98-9e2e-a86a36da5ba0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-5mnl8\" (UID: \"3065b42b-2720-4e98-9e2e-a86a36da5ba0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5mnl8"
Jul 20 09:40:04.445908 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:04.445881    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbfn6\" (UniqueName: \"kubernetes.io/projected/3065b42b-2720-4e98-9e2e-a86a36da5ba0-kube-api-access-dbfn6\") pod \"prometheus-operator-5945b5cfd-5mnl8\" (UID: \"3065b42b-2720-4e98-9e2e-a86a36da5ba0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5mnl8"
Jul 20 09:40:04.448792 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:04.448712    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:04.773571 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:04.773507    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:04.906342 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:04.906298    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:04.936470 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:04.936435    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3065b42b-2720-4e98-9e2e-a86a36da5ba0-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-5mnl8\" (UID: \"3065b42b-2720-4e98-9e2e-a86a36da5ba0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5mnl8"
Jul 20 09:40:04.939037 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:04.939010    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3065b42b-2720-4e98-9e2e-a86a36da5ba0-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-5mnl8\" (UID: \"3065b42b-2720-4e98-9e2e-a86a36da5ba0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5mnl8"
Jul 20 09:40:05.021095 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:05.021031    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:05.063377 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:05.063348    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-5mnl8"
Jul 20 09:40:05.126395 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:05.126362    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:05.245338 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:05.245159    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:05.246868 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:05.246730    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-775cf4658-m48pg"]
Jul 20 09:40:05.255309 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:40:05.252880    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd387e8c_9f3e_471d_addf_a3560052c674.slice/crio-98b7869c0cbf6df5c2a2241400e34474a064f8a411b107fc5e45906cd601ea44 WatchSource:0}: Error finding container 98b7869c0cbf6df5c2a2241400e34474a064f8a411b107fc5e45906cd601ea44: Status 404 returned error can't find the container with id 98b7869c0cbf6df5c2a2241400e34474a064f8a411b107fc5e45906cd601ea44
Jul 20 09:40:05.304216 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:05.303864    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-5mnl8"]
Jul 20 09:40:05.308729 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:40:05.308667    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3065b42b_2720_4e98_9e2e_a86a36da5ba0.slice/crio-aad0a4eff28ebdb4a86aa161b8109abd99c13d4b6663dc0523d944525155751c WatchSource:0}: Error finding container aad0a4eff28ebdb4a86aa161b8109abd99c13d4b6663dc0523d944525155751c: Status 404 returned error can't find the container with id aad0a4eff28ebdb4a86aa161b8109abd99c13d4b6663dc0523d944525155751c
Jul 20 09:40:05.338471 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:05.338443    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:05.543285 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:05.543255    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:05.617188 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:05.617165    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:05.744085 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:05.744050    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v9ns4" event={"ID":"e604f9a4-6af8-4110-b748-4760445401d3","Type":"ContainerStarted","Data":"d7276aaa31e5888fdcc0d9646e7e0335e5d4e29853ba94b074d16c5c5239a55f"}
Jul 20 09:40:05.744265 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:05.744114    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v9ns4" event={"ID":"e604f9a4-6af8-4110-b748-4760445401d3","Type":"ContainerStarted","Data":"1c642340688f64fa464f41b39b625294607e757ea15f2081c3878fd9e3809a7f"}
Jul 20 09:40:05.744265 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:05.744250    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-v9ns4"
Jul 20 09:40:05.745830 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:05.745806    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-5mnl8" event={"ID":"3065b42b-2720-4e98-9e2e-a86a36da5ba0","Type":"ContainerStarted","Data":"aad0a4eff28ebdb4a86aa161b8109abd99c13d4b6663dc0523d944525155751c"}
Jul 20 09:40:05.748584 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:05.748559    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9d2xv" event={"ID":"9dcbaa05-de0c-4ffd-b71f-e9fd807b187b","Type":"ContainerStarted","Data":"e2e21b56fc8ed29ecdfe3ed39a4f244157916e3668c08284ef1b4cbcf70ec5da"}
Jul 20 09:40:05.750358 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:05.750323    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n9bd9" event={"ID":"90ea7755-183e-4a0d-b30d-eb9459261ae9","Type":"ContainerStarted","Data":"705f7b11867b44576c8f2ae5e28028b246ddd5af50d3e6ec16ab770d094e0447"}
Jul 20 09:40:05.752294 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:05.752257    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-775cf4658-m48pg" event={"ID":"bd387e8c-9f3e-471d-addf-a3560052c674","Type":"ContainerStarted","Data":"98b7869c0cbf6df5c2a2241400e34474a064f8a411b107fc5e45906cd601ea44"}
Jul 20 09:40:05.783977 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:05.783916    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-v9ns4" podStartSLOduration=1.369186291 podStartE2EDuration="7.783898767s" totalImagesPullingTime="6.414712476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:39:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:40:05.763555355 +0000 UTC m=+57.645001665" watchObservedRunningTime="2026-07-20 09:40:05.783898767 +0000 UTC m=+57.665345110"
Jul 20 09:40:05.784423 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:05.784387    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9d2xv" podStartSLOduration=1.333836873 podStartE2EDuration="7.784373153s" totalImagesPullingTime="6.45053628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:39:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:40:05.7838217 +0000 UTC m=+57.665268011" watchObservedRunningTime="2026-07-20 09:40:05.784373153 +0000 UTC m=+57.665819461"
Jul 20 09:40:10.296561 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:10.296532    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:10.440717 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:10.440688    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:10.541099 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:10.541039    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:10.678395 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:10.678372    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rgb4r"
Jul 20 09:40:10.767587 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:10.767559    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-5mnl8" event={"ID":"3065b42b-2720-4e98-9e2e-a86a36da5ba0","Type":"ContainerStarted","Data":"d1ccd2f3201a6f4fb1e79663bfbb9b4cdddcb7b126f3dc06fbbbf071ee0d9660"}
Jul 20 09:40:10.767730 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:10.767613    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-5mnl8" event={"ID":"3065b42b-2720-4e98-9e2e-a86a36da5ba0","Type":"ContainerStarted","Data":"8bd42457768dd4191f3e818ee865680d3fdcf6d540759d7fffaafdf97680f176"}
Jul 20 09:40:10.769395 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:10.769368    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n9bd9" event={"ID":"90ea7755-183e-4a0d-b30d-eb9459261ae9","Type":"ContainerStarted","Data":"35b942c36bfdb872336e6a45b90e5b3d421ab376fa4026faa5e33193462c8f7a"}
Jul 20 09:40:10.770800 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:10.770782    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-775cf4658-m48pg" event={"ID":"bd387e8c-9f3e-471d-addf-a3560052c674","Type":"ContainerStarted","Data":"9659bd2eafd240774e7deea9989008a583d5d78478680e023b344fdb984885bf"}
Jul 20 09:40:10.792113 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:10.792014    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-5mnl8" podStartSLOduration=3.1582213 podStartE2EDuration="7.791996671s" totalImagesPullingTime="4.633775371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:40:10.791126606 +0000 UTC m=+62.672572935" watchObservedRunningTime="2026-07-20 09:40:10.791996671 +0000 UTC m=+62.673442982"
Jul 20 09:40:10.822344 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:10.822306    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-775cf4658-m48pg" podStartSLOduration=6.127362856 podStartE2EDuration="10.822294326s" totalImagesPullingTime="4.69493147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:40:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:40:10.821994445 +0000 UTC m=+62.703440778" watchObservedRunningTime="2026-07-20 09:40:10.822294326 +0000 UTC m=+62.703740612"
Jul 20 09:40:10.834907 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:10.834879    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:10.851754 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:10.851729    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-775cf4658-m48pg"
Jul 20 09:40:10.851850 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:10.851789    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-775cf4658-m48pg"
Jul 20 09:40:10.857436 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:10.857417    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-775cf4658-m48pg"
Jul 20 09:40:10.905664 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:10.905641    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:11.779231 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:11.779202    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-775cf4658-m48pg"
Jul 20 09:40:11.791199 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:11.791170    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:11.891902 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:11.891866    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:12.113482 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.113449    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:12.208892 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.208860    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:12.369082 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.368994    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:12.399948 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.399922    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-vtnmg"]
Jul 20 09:40:12.403327 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.403300    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vtnmg"
Jul 20 09:40:12.405796 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.405772    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 20 09:40:12.405931 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.405863    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 20 09:40:12.405931 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.405882    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-4hh78\""
Jul 20 09:40:12.413917 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.413898    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-vtnmg"]
Jul 20 09:40:12.426577 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.426552    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-2gm4f"]
Jul 20 09:40:12.428713 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.428697    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-2gm4f"
Jul 20 09:40:12.431177 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.431156    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-nqcl9\""
Jul 20 09:40:12.431289 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.431210    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 20 09:40:12.431289 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.431248    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-c88hw"]
Jul 20 09:40:12.431507 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.431489    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 20 09:40:12.431615 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.431563    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 20 09:40:12.433333 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.433317    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c88hw"
Jul 20 09:40:12.437427 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.436951    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 20 09:40:12.437427 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.436996    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9vmvl\""
Jul 20 09:40:12.437543 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.437458    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 20 09:40:12.437826 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.437800    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 20 09:40:12.447001 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.446958    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-2gm4f"]
Jul 20 09:40:12.471283 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.471263    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:12.499883 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.499855    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/de328f9c-a1a4-46d4-944c-f35a939e79e7-node-exporter-accelerators-collector-config\") pod \"node-exporter-c88hw\" (UID: \"de328f9c-a1a4-46d4-944c-f35a939e79e7\") " pod="openshift-monitoring/node-exporter-c88hw"
Jul 20 09:40:12.500038 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.499900    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0c7a1564-d312-4a6a-968b-7872adce776f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-2gm4f\" (UID: \"0c7a1564-d312-4a6a-968b-7872adce776f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2gm4f"
Jul 20 09:40:12.500038 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.499927    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/de328f9c-a1a4-46d4-944c-f35a939e79e7-root\") pod \"node-exporter-c88hw\" (UID: \"de328f9c-a1a4-46d4-944c-f35a939e79e7\") " pod="openshift-monitoring/node-exporter-c88hw"
Jul 20 09:40:12.500038 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.500018    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lzs9\" (UniqueName: \"kubernetes.io/projected/de328f9c-a1a4-46d4-944c-f35a939e79e7-kube-api-access-2lzs9\") pod \"node-exporter-c88hw\" (UID: \"de328f9c-a1a4-46d4-944c-f35a939e79e7\") " pod="openshift-monitoring/node-exporter-c88hw"
Jul 20 09:40:12.500194 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.500061    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6wxm\" (UniqueName: \"kubernetes.io/projected/0c7a1564-d312-4a6a-968b-7872adce776f-kube-api-access-b6wxm\") pod \"kube-state-metrics-56c5594674-2gm4f\" (UID: \"0c7a1564-d312-4a6a-968b-7872adce776f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2gm4f"
Jul 20 09:40:12.500194 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.500087    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de328f9c-a1a4-46d4-944c-f35a939e79e7-sys\") pod \"node-exporter-c88hw\" (UID: \"de328f9c-a1a4-46d4-944c-f35a939e79e7\") " pod="openshift-monitoring/node-exporter-c88hw"
Jul 20 09:40:12.500194 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.500168    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkwl8\" (UniqueName: \"kubernetes.io/projected/c5206388-28f6-4b47-ad2a-b9ece3507289-kube-api-access-fkwl8\") pod \"openshift-state-metrics-79f6958cdf-vtnmg\" (UID: \"c5206388-28f6-4b47-ad2a-b9ece3507289\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vtnmg"
Jul 20 09:40:12.500310 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.500249    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c7a1564-d312-4a6a-968b-7872adce776f-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-2gm4f\" (UID: \"0c7a1564-d312-4a6a-968b-7872adce776f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2gm4f"
Jul 20 09:40:12.500310 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.500295    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c7a1564-d312-4a6a-968b-7872adce776f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-2gm4f\" (UID: \"0c7a1564-d312-4a6a-968b-7872adce776f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2gm4f"
Jul 20 09:40:12.500408 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.500320    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/de328f9c-a1a4-46d4-944c-f35a939e79e7-node-exporter-textfile\") pod \"node-exporter-c88hw\" (UID: \"de328f9c-a1a4-46d4-944c-f35a939e79e7\") " pod="openshift-monitoring/node-exporter-c88hw"
Jul 20 09:40:12.500408 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.500342    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/de328f9c-a1a4-46d4-944c-f35a939e79e7-node-exporter-tls\") pod \"node-exporter-c88hw\" (UID: \"de328f9c-a1a4-46d4-944c-f35a939e79e7\") " pod="openshift-monitoring/node-exporter-c88hw"
Jul 20 09:40:12.500408 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.500370    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0c7a1564-d312-4a6a-968b-7872adce776f-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-2gm4f\" (UID: \"0c7a1564-d312-4a6a-968b-7872adce776f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2gm4f"
Jul 20 09:40:12.500408 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.500400    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de328f9c-a1a4-46d4-944c-f35a939e79e7-metrics-client-ca\") pod \"node-exporter-c88hw\" (UID: \"de328f9c-a1a4-46d4-944c-f35a939e79e7\") " pod="openshift-monitoring/node-exporter-c88hw"
Jul 20 09:40:12.500571 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.500425    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de328f9c-a1a4-46d4-944c-f35a939e79e7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c88hw\" (UID: \"de328f9c-a1a4-46d4-944c-f35a939e79e7\") " pod="openshift-monitoring/node-exporter-c88hw"
Jul 20 09:40:12.500571 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.500460    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/de328f9c-a1a4-46d4-944c-f35a939e79e7-node-exporter-wtmp\") pod \"node-exporter-c88hw\" (UID: \"de328f9c-a1a4-46d4-944c-f35a939e79e7\") " pod="openshift-monitoring/node-exporter-c88hw"
Jul 20 09:40:12.500571 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.500496    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5206388-28f6-4b47-ad2a-b9ece3507289-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-vtnmg\" (UID: \"c5206388-28f6-4b47-ad2a-b9ece3507289\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vtnmg"
Jul 20 09:40:12.500571 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.500542    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5206388-28f6-4b47-ad2a-b9ece3507289-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-vtnmg\" (UID: \"c5206388-28f6-4b47-ad2a-b9ece3507289\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vtnmg"
Jul 20 09:40:12.500729 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.500571    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c7a1564-d312-4a6a-968b-7872adce776f-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-2gm4f\" (UID: \"0c7a1564-d312-4a6a-968b-7872adce776f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2gm4f"
Jul 20 09:40:12.500729 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.500600    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5206388-28f6-4b47-ad2a-b9ece3507289-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-vtnmg\" (UID: \"c5206388-28f6-4b47-ad2a-b9ece3507289\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vtnmg"
Jul 20 09:40:12.566979 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.566934    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:12.601102 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.601075    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lzs9\" (UniqueName: \"kubernetes.io/projected/de328f9c-a1a4-46d4-944c-f35a939e79e7-kube-api-access-2lzs9\") pod \"node-exporter-c88hw\" (UID: \"de328f9c-a1a4-46d4-944c-f35a939e79e7\") " pod="openshift-monitoring/node-exporter-c88hw"
Jul 20 09:40:12.601276 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.601115    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6wxm\" (UniqueName: \"kubernetes.io/projected/0c7a1564-d312-4a6a-968b-7872adce776f-kube-api-access-b6wxm\") pod \"kube-state-metrics-56c5594674-2gm4f\" (UID: \"0c7a1564-d312-4a6a-968b-7872adce776f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2gm4f"
Jul 20 09:40:12.601276 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.601139    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de328f9c-a1a4-46d4-944c-f35a939e79e7-sys\") pod \"node-exporter-c88hw\" (UID: \"de328f9c-a1a4-46d4-944c-f35a939e79e7\") " pod="openshift-monitoring/node-exporter-c88hw"
Jul 20 09:40:12.601276 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.601186    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkwl8\" (UniqueName: \"kubernetes.io/projected/c5206388-28f6-4b47-ad2a-b9ece3507289-kube-api-access-fkwl8\") pod \"openshift-state-metrics-79f6958cdf-vtnmg\" (UID: \"c5206388-28f6-4b47-ad2a-b9ece3507289\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vtnmg"
Jul 20 09:40:12.601276 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.601219    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c7a1564-d312-4a6a-968b-7872adce776f-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-2gm4f\" (UID: \"0c7a1564-d312-4a6a-968b-7872adce776f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2gm4f"
Jul 20 09:40:12.601276 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.601269    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c7a1564-d312-4a6a-968b-7872adce776f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-2gm4f\" (UID: \"0c7a1564-d312-4a6a-968b-7872adce776f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2gm4f"
Jul 20 09:40:12.601562 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.601271    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de328f9c-a1a4-46d4-944c-f35a939e79e7-sys\") pod \"node-exporter-c88hw\" (UID: \"de328f9c-a1a4-46d4-944c-f35a939e79e7\") " pod="openshift-monitoring/node-exporter-c88hw"
Jul 20 09:40:12.601562 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.601293    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/de328f9c-a1a4-46d4-944c-f35a939e79e7-node-exporter-textfile\") pod \"node-exporter-c88hw\" (UID: \"de328f9c-a1a4-46d4-944c-f35a939e79e7\") " pod="openshift-monitoring/node-exporter-c88hw"
Jul 20 09:40:12.601562 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.601315    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/de328f9c-a1a4-46d4-944c-f35a939e79e7-node-exporter-tls\") pod \"node-exporter-c88hw\" (UID: \"de328f9c-a1a4-46d4-944c-f35a939e79e7\") " pod="openshift-monitoring/node-exporter-c88hw"
Jul 20 09:40:12.601562 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.601348    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0c7a1564-d312-4a6a-968b-7872adce776f-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-2gm4f\" (UID: \"0c7a1564-d312-4a6a-968b-7872adce776f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2gm4f"
Jul 20 09:40:12.601562 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.601384    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de328f9c-a1a4-46d4-944c-f35a939e79e7-metrics-client-ca\") pod \"node-exporter-c88hw\" (UID: \"de328f9c-a1a4-46d4-944c-f35a939e79e7\") " pod="openshift-monitoring/node-exporter-c88hw"
Jul 20 09:40:12.601562 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.601415    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de328f9c-a1a4-46d4-944c-f35a939e79e7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c88hw\" (UID: \"de328f9c-a1a4-46d4-944c-f35a939e79e7\") " pod="openshift-monitoring/node-exporter-c88hw"
Jul 20 09:40:12.601562 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.601444    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/de328f9c-a1a4-46d4-944c-f35a939e79e7-node-exporter-wtmp\") pod \"node-exporter-c88hw\" (UID: \"de328f9c-a1a4-46d4-944c-f35a939e79e7\") " pod="openshift-monitoring/node-exporter-c88hw"
Jul 20 09:40:12.601562 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.601480    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5206388-28f6-4b47-ad2a-b9ece3507289-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-vtnmg\" (UID: \"c5206388-28f6-4b47-ad2a-b9ece3507289\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vtnmg"
Jul 20 09:40:12.601562 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.601524    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5206388-28f6-4b47-ad2a-b9ece3507289-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-vtnmg\" (UID: \"c5206388-28f6-4b47-ad2a-b9ece3507289\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vtnmg"
Jul 20 09:40:12.601562 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.601555    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c7a1564-d312-4a6a-968b-7872adce776f-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-2gm4f\" (UID: \"0c7a1564-d312-4a6a-968b-7872adce776f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2gm4f"
Jul 20 09:40:12.602058 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.601583    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5206388-28f6-4b47-ad2a-b9ece3507289-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-vtnmg\" (UID: \"c5206388-28f6-4b47-ad2a-b9ece3507289\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vtnmg"
Jul 20 09:40:12.602058 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.601619    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/de328f9c-a1a4-46d4-944c-f35a939e79e7-node-exporter-accelerators-collector-config\") pod \"node-exporter-c88hw\" (UID: \"de328f9c-a1a4-46d4-944c-f35a939e79e7\") " pod="openshift-monitoring/node-exporter-c88hw"
Jul 20 09:40:12.602058 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.601653    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0c7a1564-d312-4a6a-968b-7872adce776f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-2gm4f\" (UID: \"0c7a1564-d312-4a6a-968b-7872adce776f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2gm4f"
Jul 20 09:40:12.602058 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.601669    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/de328f9c-a1a4-46d4-944c-f35a939e79e7-node-exporter-textfile\") pod \"node-exporter-c88hw\" (UID: \"de328f9c-a1a4-46d4-944c-f35a939e79e7\") " pod="openshift-monitoring/node-exporter-c88hw"
Jul 20 09:40:12.602058 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.601678    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/de328f9c-a1a4-46d4-944c-f35a939e79e7-root\") pod \"node-exporter-c88hw\" (UID: \"de328f9c-a1a4-46d4-944c-f35a939e79e7\") " pod="openshift-monitoring/node-exporter-c88hw"
Jul 20 09:40:12.602058 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.602043    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c7a1564-d312-4a6a-968b-7872adce776f-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-2gm4f\" (UID: \"0c7a1564-d312-4a6a-968b-7872adce776f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2gm4f"
Jul 20 09:40:12.602058 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.602052    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de328f9c-a1a4-46d4-944c-f35a939e79e7-metrics-client-ca\") pod \"node-exporter-c88hw\" (UID: \"de328f9c-a1a4-46d4-944c-f35a939e79e7\") " pod="openshift-monitoring/node-exporter-c88hw"
Jul 20 09:40:12.602442 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.602347    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0c7a1564-d312-4a6a-968b-7872adce776f-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-2gm4f\" (UID: \"0c7a1564-d312-4a6a-968b-7872adce776f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2gm4f"
Jul 20 09:40:12.602442 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.602406    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/de328f9c-a1a4-46d4-944c-f35a939e79e7-root\") pod \"node-exporter-c88hw\" (UID: \"de328f9c-a1a4-46d4-944c-f35a939e79e7\") " pod="openshift-monitoring/node-exporter-c88hw"
Jul 20 09:40:12.602541 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.602476    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5206388-28f6-4b47-ad2a-b9ece3507289-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-vtnmg\" (UID: \"c5206388-28f6-4b47-ad2a-b9ece3507289\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vtnmg"
Jul 20 09:40:12.602541 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.602518    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/de328f9c-a1a4-46d4-944c-f35a939e79e7-node-exporter-accelerators-collector-config\") pod \"node-exporter-c88hw\" (UID: \"de328f9c-a1a4-46d4-944c-f35a939e79e7\") " pod="openshift-monitoring/node-exporter-c88hw"
Jul 20 09:40:12.602636 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.602613    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/de328f9c-a1a4-46d4-944c-f35a939e79e7-node-exporter-wtmp\") pod \"node-exporter-c88hw\" (UID: \"de328f9c-a1a4-46d4-944c-f35a939e79e7\") " pod="openshift-monitoring/node-exporter-c88hw"
Jul 20 09:40:12.603357 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.603302    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0c7a1564-d312-4a6a-968b-7872adce776f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-2gm4f\" (UID: \"0c7a1564-d312-4a6a-968b-7872adce776f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2gm4f"
Jul 20 09:40:12.605066 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.605022    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/de328f9c-a1a4-46d4-944c-f35a939e79e7-node-exporter-tls\") pod \"node-exporter-c88hw\" (UID: \"de328f9c-a1a4-46d4-944c-f35a939e79e7\") " pod="openshift-monitoring/node-exporter-c88hw"
Jul 20 09:40:12.605175 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.605122    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c7a1564-d312-4a6a-968b-7872adce776f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-2gm4f\" (UID: \"0c7a1564-d312-4a6a-968b-7872adce776f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2gm4f"
Jul 20 09:40:12.606040 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.606017    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de328f9c-a1a4-46d4-944c-f35a939e79e7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c88hw\" (UID: \"de328f9c-a1a4-46d4-944c-f35a939e79e7\") " pod="openshift-monitoring/node-exporter-c88hw"
Jul 20 09:40:12.606233 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.606204    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5206388-28f6-4b47-ad2a-b9ece3507289-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-vtnmg\" (UID: \"c5206388-28f6-4b47-ad2a-b9ece3507289\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vtnmg"
Jul 20 09:40:12.606748 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.606702    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5206388-28f6-4b47-ad2a-b9ece3507289-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-vtnmg\" (UID: \"c5206388-28f6-4b47-ad2a-b9ece3507289\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vtnmg"
Jul 20 09:40:12.607397 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.607374    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c7a1564-d312-4a6a-968b-7872adce776f-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-2gm4f\" (UID: \"0c7a1564-d312-4a6a-968b-7872adce776f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2gm4f"
Jul 20 09:40:12.610408 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.610384    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkwl8\" (UniqueName: \"kubernetes.io/projected/c5206388-28f6-4b47-ad2a-b9ece3507289-kube-api-access-fkwl8\") pod \"openshift-state-metrics-79f6958cdf-vtnmg\" (UID: \"c5206388-28f6-4b47-ad2a-b9ece3507289\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vtnmg"
Jul 20 09:40:12.610606 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.610580    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6wxm\" (UniqueName: \"kubernetes.io/projected/0c7a1564-d312-4a6a-968b-7872adce776f-kube-api-access-b6wxm\") pod \"kube-state-metrics-56c5594674-2gm4f\" (UID: \"0c7a1564-d312-4a6a-968b-7872adce776f\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-2gm4f"
Jul 20 09:40:12.611188 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.611168    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lzs9\" (UniqueName: \"kubernetes.io/projected/de328f9c-a1a4-46d4-944c-f35a939e79e7-kube-api-access-2lzs9\") pod \"node-exporter-c88hw\" (UID: \"de328f9c-a1a4-46d4-944c-f35a939e79e7\") " pod="openshift-monitoring/node-exporter-c88hw"
Jul 20 09:40:12.665742 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.665669    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:12.713500 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.713456    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vtnmg"
Jul 20 09:40:12.740885 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.740857    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-2gm4f"
Jul 20 09:40:12.747671 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.747652    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c88hw"
Jul 20 09:40:12.766733 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:12.766711    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:13.379867 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.379812    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:13.467156 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.467119    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:13.473238 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.473211    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 09:40:13.484816 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.484791    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.487515 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.487486    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 20 09:40:13.487633 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.487561    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 20 09:40:13.487704 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.487638    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 20 09:40:13.487704 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.487561    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 20 09:40:13.487704 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.487679    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 20 09:40:13.487865 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.487826    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 20 09:40:13.487922 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.487879    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 20 09:40:13.488016 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.488001    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bq99s\""
Jul 20 09:40:13.488081 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.488052    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 20 09:40:13.488250 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.488226    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 20 09:40:13.494879 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.494857    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 09:40:13.508990 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.508949    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/71d8d9f0-e21b-41de-8093-a4300123cd61-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.509110 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.509006    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvn6k\" (UniqueName: \"kubernetes.io/projected/71d8d9f0-e21b-41de-8093-a4300123cd61-kube-api-access-wvn6k\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.509110 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.509068    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/71d8d9f0-e21b-41de-8093-a4300123cd61-config-volume\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.509110 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.509102    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/71d8d9f0-e21b-41de-8093-a4300123cd61-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.509271 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.509139    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/71d8d9f0-e21b-41de-8093-a4300123cd61-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.509271 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.509174    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/71d8d9f0-e21b-41de-8093-a4300123cd61-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.509271 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.509237    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/71d8d9f0-e21b-41de-8093-a4300123cd61-config-out\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.509412 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.509293    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/71d8d9f0-e21b-41de-8093-a4300123cd61-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.509412 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.509330    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/71d8d9f0-e21b-41de-8093-a4300123cd61-tls-assets\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.509412 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.509353    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71d8d9f0-e21b-41de-8093-a4300123cd61-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.509554 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.509449    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/71d8d9f0-e21b-41de-8093-a4300123cd61-web-config\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.509554 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.509476    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71d8d9f0-e21b-41de-8093-a4300123cd61-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.509554 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.509509    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/71d8d9f0-e21b-41de-8093-a4300123cd61-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.610328 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.610282    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/71d8d9f0-e21b-41de-8093-a4300123cd61-config-out\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.610487 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.610361    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/71d8d9f0-e21b-41de-8093-a4300123cd61-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.610487 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.610395    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/71d8d9f0-e21b-41de-8093-a4300123cd61-tls-assets\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.610487 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.610423    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71d8d9f0-e21b-41de-8093-a4300123cd61-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.610652 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.610497    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/71d8d9f0-e21b-41de-8093-a4300123cd61-web-config\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.610652 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.610526    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71d8d9f0-e21b-41de-8093-a4300123cd61-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.610652 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.610560    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/71d8d9f0-e21b-41de-8093-a4300123cd61-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.610652 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.610606    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/71d8d9f0-e21b-41de-8093-a4300123cd61-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.610652 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.610640    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvn6k\" (UniqueName: \"kubernetes.io/projected/71d8d9f0-e21b-41de-8093-a4300123cd61-kube-api-access-wvn6k\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.610905 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.610666    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/71d8d9f0-e21b-41de-8093-a4300123cd61-config-volume\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.610905 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.610691    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/71d8d9f0-e21b-41de-8093-a4300123cd61-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.610905 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.610723    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/71d8d9f0-e21b-41de-8093-a4300123cd61-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.610905 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.610756    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/71d8d9f0-e21b-41de-8093-a4300123cd61-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.611155 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:40:13.611133    2581 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 20 09:40:13.612981 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:40:13.611218    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71d8d9f0-e21b-41de-8093-a4300123cd61-secret-alertmanager-main-tls podName:71d8d9f0-e21b-41de-8093-a4300123cd61 nodeName:}" failed. No retries permitted until 2026-07-20 09:40:14.11119347 +0000 UTC m=+65.992639756 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/71d8d9f0-e21b-41de-8093-a4300123cd61-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "71d8d9f0-e21b-41de-8093-a4300123cd61") : secret "alertmanager-main-tls" not found
Jul 20 09:40:13.612981 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.611359    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/71d8d9f0-e21b-41de-8093-a4300123cd61-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.612981 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.612084    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/71d8d9f0-e21b-41de-8093-a4300123cd61-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.612981 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.612918    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71d8d9f0-e21b-41de-8093-a4300123cd61-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.613525 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.613477    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/71d8d9f0-e21b-41de-8093-a4300123cd61-config-out\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.614160 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.614114    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/71d8d9f0-e21b-41de-8093-a4300123cd61-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.614604 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.614316    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/71d8d9f0-e21b-41de-8093-a4300123cd61-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.614604 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.614545    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/71d8d9f0-e21b-41de-8093-a4300123cd61-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.614756 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.614652    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/71d8d9f0-e21b-41de-8093-a4300123cd61-tls-assets\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.614935 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.614913    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/71d8d9f0-e21b-41de-8093-a4300123cd61-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.615100 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.615074    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/71d8d9f0-e21b-41de-8093-a4300123cd61-web-config\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.616083 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.615900    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/71d8d9f0-e21b-41de-8093-a4300123cd61-config-volume\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.619909 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.619890    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvn6k\" (UniqueName: \"kubernetes.io/projected/71d8d9f0-e21b-41de-8093-a4300123cd61-kube-api-access-wvn6k\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:13.838924 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:40:13.838892    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde328f9c_a1a4_46d4_944c_f35a939e79e7.slice/crio-cea8727fa3b808d46096f70cdb6e490c3f526f0a3e13397bf7c4a746c551f96d WatchSource:0}: Error finding container cea8727fa3b808d46096f70cdb6e490c3f526f0a3e13397bf7c4a746c551f96d: Status 404 returned error can't find the container with id cea8727fa3b808d46096f70cdb6e490c3f526f0a3e13397bf7c4a746c551f96d
Jul 20 09:40:13.919542 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.919509    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:13.970934 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.970899    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-2gm4f"]
Jul 20 09:40:13.974770 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:40:13.974746    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c7a1564_d312_4a6a_968b_7872adce776f.slice/crio-3a81b56e3447907e6998d2882b36a9db876945c49fd9198a17584b02db5fb052 WatchSource:0}: Error finding container 3a81b56e3447907e6998d2882b36a9db876945c49fd9198a17584b02db5fb052: Status 404 returned error can't find the container with id 3a81b56e3447907e6998d2882b36a9db876945c49fd9198a17584b02db5fb052
Jul 20 09:40:13.984321 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:13.984297    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-vtnmg"]
Jul 20 09:40:13.987041 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:40:13.987023    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5206388_28f6_4b47_ad2a_b9ece3507289.slice/crio-5ef9881312ce98a7837129c44f4dbb1d2cfbbec07c25d8d5d056fe42a566034a WatchSource:0}: Error finding container 5ef9881312ce98a7837129c44f4dbb1d2cfbbec07c25d8d5d056fe42a566034a: Status 404 returned error can't find the container with id 5ef9881312ce98a7837129c44f4dbb1d2cfbbec07c25d8d5d056fe42a566034a
Jul 20 09:40:14.115522 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:14.115498    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/71d8d9f0-e21b-41de-8093-a4300123cd61-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:14.117684 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:14.117664    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/71d8d9f0-e21b-41de-8093-a4300123cd61-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"71d8d9f0-e21b-41de-8093-a4300123cd61\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:14.397386 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:14.397357    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 09:40:14.417810 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:14.417782    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2450d682-ad31-4104-b469-603d43b7b1b2-metrics-certs\") pod \"network-metrics-daemon-fnzkg\" (UID: \"2450d682-ad31-4104-b469-603d43b7b1b2\") " pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:40:14.420079 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:14.420058    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 09:40:14.430016 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:14.429997    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2450d682-ad31-4104-b469-603d43b7b1b2-metrics-certs\") pod \"network-metrics-daemon-fnzkg\" (UID: \"2450d682-ad31-4104-b469-603d43b7b1b2\") " pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:40:14.519113 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:14.519080    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/82e7c25c-d929-4258-8f87-ddfadcf5042e-original-pull-secret\") pod \"global-pull-secret-syncer-xqb2z\" (UID: \"82e7c25c-d929-4258-8f87-ddfadcf5042e\") " pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:40:14.521498 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:14.521469    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 09:40:14.531634 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:14.531611    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/82e7c25c-d929-4258-8f87-ddfadcf5042e-original-pull-secret\") pod \"global-pull-secret-syncer-xqb2z\" (UID: \"82e7c25c-d929-4258-8f87-ddfadcf5042e\") " pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:40:14.541919 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:14.541894    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 09:40:14.544505 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:40:14.544471    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71d8d9f0_e21b_41de_8093_a4300123cd61.slice/crio-73109bd2ace0f075e58c85bbf89e4c2216d0c23336f1cd5f6e485e23cd136fc8 WatchSource:0}: Error finding container 73109bd2ace0f075e58c85bbf89e4c2216d0c23336f1cd5f6e485e23cd136fc8: Status 404 returned error can't find the container with id 73109bd2ace0f075e58c85bbf89e4c2216d0c23336f1cd5f6e485e23cd136fc8
Jul 20 09:40:14.619574 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:14.619545    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghlv4\" (UniqueName: \"kubernetes.io/projected/8e667eae-fd03-4ae1-b97d-1af58fb5e8fc-kube-api-access-ghlv4\") pod \"network-check-target-d76tg\" (UID: \"8e667eae-fd03-4ae1-b97d-1af58fb5e8fc\") " pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:40:14.622314 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:14.622289    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 09:40:14.633521 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:14.633498    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 09:40:14.643675 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:14.643652    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghlv4\" (UniqueName: \"kubernetes.io/projected/8e667eae-fd03-4ae1-b97d-1af58fb5e8fc-kube-api-access-ghlv4\") pod \"network-check-target-d76tg\" (UID: \"8e667eae-fd03-4ae1-b97d-1af58fb5e8fc\") " pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:40:14.671857 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:14.671803    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pgl5c\""
Jul 20 09:40:14.676008 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:14.675985    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xqb2z"
Jul 20 09:40:14.679828 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:14.679790    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:40:14.683716 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:14.683536    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hssrx\""
Jul 20 09:40:14.692007 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:14.691818    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fnzkg"
Jul 20 09:40:14.792715 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:14.792329    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vtnmg" event={"ID":"c5206388-28f6-4b47-ad2a-b9ece3507289","Type":"ContainerStarted","Data":"709164c253060ce0d1694f20ef453c8b67dcb5d27e92baa5f6eb23c6a7a14e0d"}
Jul 20 09:40:14.792715 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:14.792403    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vtnmg" event={"ID":"c5206388-28f6-4b47-ad2a-b9ece3507289","Type":"ContainerStarted","Data":"5b3f6ca361872c7e51ac00c0ef1b4b6b3c576d72a65505dc2b0ec55ec53af90f"}
Jul 20 09:40:14.792715 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:14.792441    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vtnmg" event={"ID":"c5206388-28f6-4b47-ad2a-b9ece3507289","Type":"ContainerStarted","Data":"5ef9881312ce98a7837129c44f4dbb1d2cfbbec07c25d8d5d056fe42a566034a"}
Jul 20 09:40:14.796530 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:14.796456    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c88hw" event={"ID":"de328f9c-a1a4-46d4-944c-f35a939e79e7","Type":"ContainerStarted","Data":"cea8727fa3b808d46096f70cdb6e490c3f526f0a3e13397bf7c4a746c551f96d"}
Jul 20 09:40:14.798814 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:14.798719    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-2gm4f" event={"ID":"0c7a1564-d312-4a6a-968b-7872adce776f","Type":"ContainerStarted","Data":"3a81b56e3447907e6998d2882b36a9db876945c49fd9198a17584b02db5fb052"}
Jul 20 09:40:14.803550 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:14.803500    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n9bd9" event={"ID":"90ea7755-183e-4a0d-b30d-eb9459261ae9","Type":"ContainerStarted","Data":"52f31a1621b61c4c15db2507b25109758c9c92b4d8474a1f9bd7d31bb613d329"}
Jul 20 09:40:14.809089 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:14.809061    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71d8d9f0-e21b-41de-8093-a4300123cd61","Type":"ContainerStarted","Data":"73109bd2ace0f075e58c85bbf89e4c2216d0c23336f1cd5f6e485e23cd136fc8"}
Jul 20 09:40:14.828914 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:14.828860    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-n9bd9" podStartSLOduration=1.831743162 podStartE2EDuration="16.828839225s" totalImagesPullingTime="14.997096063s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:39:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:40:14.827513527 +0000 UTC m=+66.708959862" watchObservedRunningTime="2026-07-20 09:40:14.828839225 +0000 UTC m=+66.710285537"
Jul 20 09:40:14.855949 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:14.855879    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xqb2z"]
Jul 20 09:40:15.028353 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:40:15.028267    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82e7c25c_d929_4258_8f87_ddfadcf5042e.slice/crio-eb2dfd445fd2a25e07bbb5ea3b85afdd2d6b48b4626b6f377c9c64b3f10b038e WatchSource:0}: Error finding container eb2dfd445fd2a25e07bbb5ea3b85afdd2d6b48b4626b6f377c9c64b3f10b038e: Status 404 returned error can't find the container with id eb2dfd445fd2a25e07bbb5ea3b85afdd2d6b48b4626b6f377c9c64b3f10b038e
Jul 20 09:40:15.092442 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.092413    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-d76tg"]
Jul 20 09:40:15.096044 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.096017    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fnzkg"]
Jul 20 09:40:15.281913 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:40:15.281752    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e667eae_fd03_4ae1_b97d_1af58fb5e8fc.slice/crio-9cc63b6cf5f4c5574864ac6c34478d3c10762ad177d39cdcf082c4baee39bdc7 WatchSource:0}: Error finding container 9cc63b6cf5f4c5574864ac6c34478d3c10762ad177d39cdcf082c4baee39bdc7: Status 404 returned error can't find the container with id 9cc63b6cf5f4c5574864ac6c34478d3c10762ad177d39cdcf082c4baee39bdc7
Jul 20 09:40:15.333882 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.333834    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:15.428491 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.428452    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:15.476270 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.476240    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-66f4d847f-mv478"]
Jul 20 09:40:15.479165 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.479138    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66f4d847f-mv478"
Jul 20 09:40:15.481761 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.481590    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 20 09:40:15.481761 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.481667    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 20 09:40:15.481918 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.481778    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 20 09:40:15.481918 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.481809    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-fnvf7\""
Jul 20 09:40:15.481918 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.481816    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 20 09:40:15.481918 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.481902    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 20 09:40:15.482302 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.482169    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-nqkikv00f37n\""
Jul 20 09:40:15.491915 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.491841    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66f4d847f-mv478"]
Jul 20 09:40:15.523034 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.523003    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:15.527480 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.527452    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6svk7\" (UniqueName: \"kubernetes.io/projected/674f9c86-0221-4d03-905c-c548fdd91ef2-kube-api-access-6svk7\") pod \"thanos-querier-66f4d847f-mv478\" (UID: \"674f9c86-0221-4d03-905c-c548fdd91ef2\") " pod="openshift-monitoring/thanos-querier-66f4d847f-mv478"
Jul 20 09:40:15.527560 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.527490    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/674f9c86-0221-4d03-905c-c548fdd91ef2-secret-thanos-querier-tls\") pod \"thanos-querier-66f4d847f-mv478\" (UID: \"674f9c86-0221-4d03-905c-c548fdd91ef2\") " pod="openshift-monitoring/thanos-querier-66f4d847f-mv478"
Jul 20 09:40:15.527560 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.527520    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/674f9c86-0221-4d03-905c-c548fdd91ef2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66f4d847f-mv478\" (UID: \"674f9c86-0221-4d03-905c-c548fdd91ef2\") " pod="openshift-monitoring/thanos-querier-66f4d847f-mv478"
Jul 20 09:40:15.527560 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.527552    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/674f9c86-0221-4d03-905c-c548fdd91ef2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66f4d847f-mv478\" (UID: \"674f9c86-0221-4d03-905c-c548fdd91ef2\") " pod="openshift-monitoring/thanos-querier-66f4d847f-mv478"
Jul 20 09:40:15.527671 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.527614    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/674f9c86-0221-4d03-905c-c548fdd91ef2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66f4d847f-mv478\" (UID: \"674f9c86-0221-4d03-905c-c548fdd91ef2\") " pod="openshift-monitoring/thanos-querier-66f4d847f-mv478"
Jul 20 09:40:15.527671 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.527639    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/674f9c86-0221-4d03-905c-c548fdd91ef2-secret-grpc-tls\") pod \"thanos-querier-66f4d847f-mv478\" (UID: \"674f9c86-0221-4d03-905c-c548fdd91ef2\") " pod="openshift-monitoring/thanos-querier-66f4d847f-mv478"
Jul 20 09:40:15.527760 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.527677    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/674f9c86-0221-4d03-905c-c548fdd91ef2-metrics-client-ca\") pod \"thanos-querier-66f4d847f-mv478\" (UID: \"674f9c86-0221-4d03-905c-c548fdd91ef2\") " pod="openshift-monitoring/thanos-querier-66f4d847f-mv478"
Jul 20 09:40:15.527760 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.527718    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/674f9c86-0221-4d03-905c-c548fdd91ef2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66f4d847f-mv478\" (UID: \"674f9c86-0221-4d03-905c-c548fdd91ef2\") " pod="openshift-monitoring/thanos-querier-66f4d847f-mv478"
Jul 20 09:40:15.593851 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.593772    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:15.628156 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.628128    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/674f9c86-0221-4d03-905c-c548fdd91ef2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66f4d847f-mv478\" (UID: \"674f9c86-0221-4d03-905c-c548fdd91ef2\") " pod="openshift-monitoring/thanos-querier-66f4d847f-mv478"
Jul 20 09:40:15.628335 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.628176    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6svk7\" (UniqueName: \"kubernetes.io/projected/674f9c86-0221-4d03-905c-c548fdd91ef2-kube-api-access-6svk7\") pod \"thanos-querier-66f4d847f-mv478\" (UID: \"674f9c86-0221-4d03-905c-c548fdd91ef2\") " pod="openshift-monitoring/thanos-querier-66f4d847f-mv478"
Jul 20 09:40:15.628466 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.628429    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/674f9c86-0221-4d03-905c-c548fdd91ef2-secret-thanos-querier-tls\") pod \"thanos-querier-66f4d847f-mv478\" (UID: \"674f9c86-0221-4d03-905c-c548fdd91ef2\") " pod="openshift-monitoring/thanos-querier-66f4d847f-mv478"
Jul 20 09:40:15.628526 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.628485    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/674f9c86-0221-4d03-905c-c548fdd91ef2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66f4d847f-mv478\" (UID: \"674f9c86-0221-4d03-905c-c548fdd91ef2\") " pod="openshift-monitoring/thanos-querier-66f4d847f-mv478"
Jul 20 09:40:15.628526 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.628517    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/674f9c86-0221-4d03-905c-c548fdd91ef2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66f4d847f-mv478\" (UID: \"674f9c86-0221-4d03-905c-c548fdd91ef2\") " pod="openshift-monitoring/thanos-querier-66f4d847f-mv478"
Jul 20 09:40:15.628614 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.628584    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/674f9c86-0221-4d03-905c-c548fdd91ef2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66f4d847f-mv478\" (UID: \"674f9c86-0221-4d03-905c-c548fdd91ef2\") " pod="openshift-monitoring/thanos-querier-66f4d847f-mv478"
Jul 20 09:40:15.628660 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.628610    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/674f9c86-0221-4d03-905c-c548fdd91ef2-secret-grpc-tls\") pod \"thanos-querier-66f4d847f-mv478\" (UID: \"674f9c86-0221-4d03-905c-c548fdd91ef2\") " pod="openshift-monitoring/thanos-querier-66f4d847f-mv478"
Jul 20 09:40:15.628660 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.628650    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/674f9c86-0221-4d03-905c-c548fdd91ef2-metrics-client-ca\") pod \"thanos-querier-66f4d847f-mv478\" (UID: \"674f9c86-0221-4d03-905c-c548fdd91ef2\") " pod="openshift-monitoring/thanos-querier-66f4d847f-mv478"
Jul 20 09:40:15.629411 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.629379    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/674f9c86-0221-4d03-905c-c548fdd91ef2-metrics-client-ca\") pod \"thanos-querier-66f4d847f-mv478\" (UID: \"674f9c86-0221-4d03-905c-c548fdd91ef2\") " pod="openshift-monitoring/thanos-querier-66f4d847f-mv478"
Jul 20 09:40:15.631259 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.631233    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/674f9c86-0221-4d03-905c-c548fdd91ef2-secret-thanos-querier-tls\") pod \"thanos-querier-66f4d847f-mv478\" (UID: \"674f9c86-0221-4d03-905c-c548fdd91ef2\") " pod="openshift-monitoring/thanos-querier-66f4d847f-mv478"
Jul 20 09:40:15.631259 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.631254    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/674f9c86-0221-4d03-905c-c548fdd91ef2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66f4d847f-mv478\" (UID: \"674f9c86-0221-4d03-905c-c548fdd91ef2\") " pod="openshift-monitoring/thanos-querier-66f4d847f-mv478"
Jul 20 09:40:15.631419 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.631288    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/674f9c86-0221-4d03-905c-c548fdd91ef2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66f4d847f-mv478\" (UID: \"674f9c86-0221-4d03-905c-c548fdd91ef2\") " pod="openshift-monitoring/thanos-querier-66f4d847f-mv478"
Jul 20 09:40:15.631419 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.631295    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/674f9c86-0221-4d03-905c-c548fdd91ef2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66f4d847f-mv478\" (UID: \"674f9c86-0221-4d03-905c-c548fdd91ef2\") " pod="openshift-monitoring/thanos-querier-66f4d847f-mv478"
Jul 20 09:40:15.631520 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.631452    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/674f9c86-0221-4d03-905c-c548fdd91ef2-secret-grpc-tls\") pod \"thanos-querier-66f4d847f-mv478\" (UID: \"674f9c86-0221-4d03-905c-c548fdd91ef2\") " pod="openshift-monitoring/thanos-querier-66f4d847f-mv478"
Jul 20 09:40:15.632612 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.632592    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/674f9c86-0221-4d03-905c-c548fdd91ef2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66f4d847f-mv478\" (UID: \"674f9c86-0221-4d03-905c-c548fdd91ef2\") " pod="openshift-monitoring/thanos-querier-66f4d847f-mv478"
Jul 20 09:40:15.637660 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.637638    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6svk7\" (UniqueName: \"kubernetes.io/projected/674f9c86-0221-4d03-905c-c548fdd91ef2-kube-api-access-6svk7\") pod \"thanos-querier-66f4d847f-mv478\" (UID: \"674f9c86-0221-4d03-905c-c548fdd91ef2\") " pod="openshift-monitoring/thanos-querier-66f4d847f-mv478"
Jul 20 09:40:15.657177 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:40:15.657153    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2450d682_ad31_4104_b469_603d43b7b1b2.slice/crio-178a86b0c9d6ae7e694def268386dd98f8745be510083361eb323fc961c57ac9 WatchSource:0}: Error finding container 178a86b0c9d6ae7e694def268386dd98f8745be510083361eb323fc961c57ac9: Status 404 returned error can't find the container with id 178a86b0c9d6ae7e694def268386dd98f8745be510083361eb323fc961c57ac9
Jul 20 09:40:15.673106 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.672989    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:15.758410 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.758381    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-v9ns4"
Jul 20 09:40:15.793390 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.792612    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66f4d847f-mv478"
Jul 20 09:40:15.803149 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.803058    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:15.816314 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.816238    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xqb2z" event={"ID":"82e7c25c-d929-4258-8f87-ddfadcf5042e","Type":"ContainerStarted","Data":"eb2dfd445fd2a25e07bbb5ea3b85afdd2d6b48b4626b6f377c9c64b3f10b038e"}
Jul 20 09:40:15.818951 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.818825    2581 generic.go:356] "Generic (PLEG): container finished" podID="de328f9c-a1a4-46d4-944c-f35a939e79e7" containerID="8c66223aff36f1923e11d2eaeba6035a7e7d9a1efa2317a6c69fb17927f57194" exitCode=0
Jul 20 09:40:15.819335 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.819274    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c88hw" event={"ID":"de328f9c-a1a4-46d4-944c-f35a939e79e7","Type":"ContainerDied","Data":"8c66223aff36f1923e11d2eaeba6035a7e7d9a1efa2317a6c69fb17927f57194"}
Jul 20 09:40:15.821299 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.821237    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fnzkg" event={"ID":"2450d682-ad31-4104-b469-603d43b7b1b2","Type":"ContainerStarted","Data":"178a86b0c9d6ae7e694def268386dd98f8745be510083361eb323fc961c57ac9"}
Jul 20 09:40:15.823323 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:15.823287    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-d76tg" event={"ID":"8e667eae-fd03-4ae1-b97d-1af58fb5e8fc","Type":"ContainerStarted","Data":"9cc63b6cf5f4c5574864ac6c34478d3c10762ad177d39cdcf082c4baee39bdc7"}
Jul 20 09:40:16.178941 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.178915    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66f4d847f-mv478"]
Jul 20 09:40:16.684762 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.684114    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-f84cffc44-x9447"]
Jul 20 09:40:16.688810 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.687605    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f84cffc44-x9447"
Jul 20 09:40:16.691590 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.691370    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 20 09:40:16.691590 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.691370    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-26ii0ikvp6rep\""
Jul 20 09:40:16.693650 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.692881    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-nbj5l\""
Jul 20 09:40:16.693650 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.693138    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 20 09:40:16.693650 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.693593    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 20 09:40:16.693861 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.693784    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 20 09:40:16.701130 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.701110    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f84cffc44-x9447"]
Jul 20 09:40:16.742720 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.742688    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6c7dabf5-4e59-4cae-a967-da3a783217be-audit-log\") pod \"metrics-server-f84cffc44-x9447\" (UID: \"6c7dabf5-4e59-4cae-a967-da3a783217be\") " pod="openshift-monitoring/metrics-server-f84cffc44-x9447"
Jul 20 09:40:16.742862 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.742736    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6c7dabf5-4e59-4cae-a967-da3a783217be-secret-metrics-server-tls\") pod \"metrics-server-f84cffc44-x9447\" (UID: \"6c7dabf5-4e59-4cae-a967-da3a783217be\") " pod="openshift-monitoring/metrics-server-f84cffc44-x9447"
Jul 20 09:40:16.742862 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.742837    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6c7dabf5-4e59-4cae-a967-da3a783217be-metrics-server-audit-profiles\") pod \"metrics-server-f84cffc44-x9447\" (UID: \"6c7dabf5-4e59-4cae-a967-da3a783217be\") " pod="openshift-monitoring/metrics-server-f84cffc44-x9447"
Jul 20 09:40:16.743008 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.742878    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c7dabf5-4e59-4cae-a967-da3a783217be-client-ca-bundle\") pod \"metrics-server-f84cffc44-x9447\" (UID: \"6c7dabf5-4e59-4cae-a967-da3a783217be\") " pod="openshift-monitoring/metrics-server-f84cffc44-x9447"
Jul 20 09:40:16.743008 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.742910    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c7dabf5-4e59-4cae-a967-da3a783217be-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f84cffc44-x9447\" (UID: \"6c7dabf5-4e59-4cae-a967-da3a783217be\") " pod="openshift-monitoring/metrics-server-f84cffc44-x9447"
Jul 20 09:40:16.743008 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.742985    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6c7dabf5-4e59-4cae-a967-da3a783217be-secret-metrics-server-client-certs\") pod \"metrics-server-f84cffc44-x9447\" (UID: \"6c7dabf5-4e59-4cae-a967-da3a783217be\") " pod="openshift-monitoring/metrics-server-f84cffc44-x9447"
Jul 20 09:40:16.743143 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.743033    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccs5l\" (UniqueName: \"kubernetes.io/projected/6c7dabf5-4e59-4cae-a967-da3a783217be-kube-api-access-ccs5l\") pod \"metrics-server-f84cffc44-x9447\" (UID: \"6c7dabf5-4e59-4cae-a967-da3a783217be\") " pod="openshift-monitoring/metrics-server-f84cffc44-x9447"
Jul 20 09:40:16.836655 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.836073    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vtnmg" event={"ID":"c5206388-28f6-4b47-ad2a-b9ece3507289","Type":"ContainerStarted","Data":"7560d5d8f145e69994d42ab2cc00632d8c472c6bb8acf76f8dc06562c1ab4e0d"}
Jul 20 09:40:16.840733 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.840072    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c88hw" event={"ID":"de328f9c-a1a4-46d4-944c-f35a939e79e7","Type":"ContainerStarted","Data":"341314fc93dcfd8d1335845c520ef322886d76e08bcafe20d51ab6ed46890ed1"}
Jul 20 09:40:16.840733 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.840122    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c88hw" event={"ID":"de328f9c-a1a4-46d4-944c-f35a939e79e7","Type":"ContainerStarted","Data":"a916b8bb80f53e78b190376a09b6d1778f6eaefc3f41cb15a7cdeb7893403985"}
Jul 20 09:40:16.844737 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.843411    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6c7dabf5-4e59-4cae-a967-da3a783217be-audit-log\") pod \"metrics-server-f84cffc44-x9447\" (UID: \"6c7dabf5-4e59-4cae-a967-da3a783217be\") " pod="openshift-monitoring/metrics-server-f84cffc44-x9447"
Jul 20 09:40:16.844737 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.843452    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6c7dabf5-4e59-4cae-a967-da3a783217be-secret-metrics-server-tls\") pod \"metrics-server-f84cffc44-x9447\" (UID: \"6c7dabf5-4e59-4cae-a967-da3a783217be\") " pod="openshift-monitoring/metrics-server-f84cffc44-x9447"
Jul 20 09:40:16.844737 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.843497    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6c7dabf5-4e59-4cae-a967-da3a783217be-metrics-server-audit-profiles\") pod \"metrics-server-f84cffc44-x9447\" (UID: \"6c7dabf5-4e59-4cae-a967-da3a783217be\") " pod="openshift-monitoring/metrics-server-f84cffc44-x9447"
Jul 20 09:40:16.844737 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.843527    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c7dabf5-4e59-4cae-a967-da3a783217be-client-ca-bundle\") pod \"metrics-server-f84cffc44-x9447\" (UID: \"6c7dabf5-4e59-4cae-a967-da3a783217be\") " pod="openshift-monitoring/metrics-server-f84cffc44-x9447"
Jul 20 09:40:16.844737 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.843554    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c7dabf5-4e59-4cae-a967-da3a783217be-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f84cffc44-x9447\" (UID: \"6c7dabf5-4e59-4cae-a967-da3a783217be\") " pod="openshift-monitoring/metrics-server-f84cffc44-x9447"
Jul 20 09:40:16.844737 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.843619    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6c7dabf5-4e59-4cae-a967-da3a783217be-secret-metrics-server-client-certs\") pod \"metrics-server-f84cffc44-x9447\" (UID: \"6c7dabf5-4e59-4cae-a967-da3a783217be\") " pod="openshift-monitoring/metrics-server-f84cffc44-x9447"
Jul 20 09:40:16.844737 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.843653    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccs5l\" (UniqueName: \"kubernetes.io/projected/6c7dabf5-4e59-4cae-a967-da3a783217be-kube-api-access-ccs5l\") pod \"metrics-server-f84cffc44-x9447\" (UID: \"6c7dabf5-4e59-4cae-a967-da3a783217be\") " pod="openshift-monitoring/metrics-server-f84cffc44-x9447"
Jul 20 09:40:16.844737 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.844328    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6c7dabf5-4e59-4cae-a967-da3a783217be-audit-log\") pod \"metrics-server-f84cffc44-x9447\" (UID: \"6c7dabf5-4e59-4cae-a967-da3a783217be\") " pod="openshift-monitoring/metrics-server-f84cffc44-x9447"
Jul 20 09:40:16.846453 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.845479    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-2gm4f" event={"ID":"0c7a1564-d312-4a6a-968b-7872adce776f","Type":"ContainerStarted","Data":"29d896b744a5fcd546364ea4610b1b55b85980ea75e70bed61c4ba19fc8a3a75"}
Jul 20 09:40:16.846453 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.845532    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-2gm4f" event={"ID":"0c7a1564-d312-4a6a-968b-7872adce776f","Type":"ContainerStarted","Data":"10617576ce390f6fa2805ed570a26d7374997c38d6ac5b3a99fd5822761e38a9"}
Jul 20 09:40:16.846453 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.845559    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-2gm4f" event={"ID":"0c7a1564-d312-4a6a-968b-7872adce776f","Type":"ContainerStarted","Data":"443188083c481d349e1f76780fac6db46abb4ade71645ffb6a5f5b55e1d3a1a1"}
Jul 20 09:40:16.849112 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.847497    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c7dabf5-4e59-4cae-a967-da3a783217be-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f84cffc44-x9447\" (UID: \"6c7dabf5-4e59-4cae-a967-da3a783217be\") " pod="openshift-monitoring/metrics-server-f84cffc44-x9447"
Jul 20 09:40:16.849112 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.848937    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6c7dabf5-4e59-4cae-a967-da3a783217be-metrics-server-audit-profiles\") pod \"metrics-server-f84cffc44-x9447\" (UID: \"6c7dabf5-4e59-4cae-a967-da3a783217be\") " pod="openshift-monitoring/metrics-server-f84cffc44-x9447"
Jul 20 09:40:16.849534 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.849501    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66f4d847f-mv478" event={"ID":"674f9c86-0221-4d03-905c-c548fdd91ef2","Type":"ContainerStarted","Data":"e7424eee35e825753dd0aeef32ea3310384843073e367e402d9f493fdc133242"}
Jul 20 09:40:16.851371 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.851330    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6c7dabf5-4e59-4cae-a967-da3a783217be-client-ca-bundle\") pod \"metrics-server-f84cffc44-x9447\" (UID: \"6c7dabf5-4e59-4cae-a967-da3a783217be\") " pod="openshift-monitoring/metrics-server-f84cffc44-x9447"
Jul 20 09:40:16.851856 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.851835    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6c7dabf5-4e59-4cae-a967-da3a783217be-secret-metrics-server-tls\") pod \"metrics-server-f84cffc44-x9447\" (UID: \"6c7dabf5-4e59-4cae-a967-da3a783217be\") " pod="openshift-monitoring/metrics-server-f84cffc44-x9447"
Jul 20 09:40:16.852585 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.852558    2581 generic.go:356] "Generic (PLEG): container finished" podID="71d8d9f0-e21b-41de-8093-a4300123cd61" containerID="45b842034f100b7a1a7cd0263d44a16cf2f3337e07621e3d27b67124f6b9dd4c" exitCode=0
Jul 20 09:40:16.852679 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.852600    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71d8d9f0-e21b-41de-8093-a4300123cd61","Type":"ContainerDied","Data":"45b842034f100b7a1a7cd0263d44a16cf2f3337e07621e3d27b67124f6b9dd4c"}
Jul 20 09:40:16.855438 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.855301    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccs5l\" (UniqueName: \"kubernetes.io/projected/6c7dabf5-4e59-4cae-a967-da3a783217be-kube-api-access-ccs5l\") pod \"metrics-server-f84cffc44-x9447\" (UID: \"6c7dabf5-4e59-4cae-a967-da3a783217be\") " pod="openshift-monitoring/metrics-server-f84cffc44-x9447"
Jul 20 09:40:16.858786 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.858741    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6c7dabf5-4e59-4cae-a967-da3a783217be-secret-metrics-server-client-certs\") pod \"metrics-server-f84cffc44-x9447\" (UID: \"6c7dabf5-4e59-4cae-a967-da3a783217be\") " pod="openshift-monitoring/metrics-server-f84cffc44-x9447"
Jul 20 09:40:16.860327 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.859498    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vtnmg" podStartSLOduration=2.9736086569999998 podStartE2EDuration="4.859480333s" totalImagesPullingTime="1.885871676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:40:16.859028532 +0000 UTC m=+68.740474861" watchObservedRunningTime="2026-07-20 09:40:16.859480333 +0000 UTC m=+68.740926671"
Jul 20 09:40:16.892068 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.890776    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-2gm4f" podStartSLOduration=2.8711924030000002 podStartE2EDuration="4.890758718s" totalImagesPullingTime="2.019566315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:40:16.889922652 +0000 UTC m=+68.771368961" watchObservedRunningTime="2026-07-20 09:40:16.890758718 +0000 UTC m=+68.772205027"
Jul 20 09:40:16.912483 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:16.912041    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-c88hw" podStartSLOduration=3.633529184 podStartE2EDuration="4.912020949s" totalImagesPullingTime="1.19680055s" totalInitContainerRuntime="81.691215ms" isStatefulPod=true podCreationTimestamp="2026-07-20 09:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:40:16.911471231 +0000 UTC m=+68.792917552" watchObservedRunningTime="2026-07-20 09:40:16.912020949 +0000 UTC m=+68.793467261"
Jul 20 09:40:17.005223 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.005113    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f84cffc44-x9447"
Jul 20 09:40:17.167224 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.165924    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d5c7c54f8-cqqzn"]
Jul 20 09:40:17.171385 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.171358    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d5c7c54f8-cqqzn"
Jul 20 09:40:17.185429 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.185372    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d5c7c54f8-cqqzn"]
Jul 20 09:40:17.190686 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.189251    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-2j97h"]
Jul 20 09:40:17.194298 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.194225    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-2j97h"
Jul 20 09:40:17.197358 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.197205    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 20 09:40:17.197630 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.197467    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-9s6gd\""
Jul 20 09:40:17.216824 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.216708    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f84cffc44-x9447"]
Jul 20 09:40:17.219703 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.219348    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-2j97h"]
Jul 20 09:40:17.221650 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.221612    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:17.229870 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:40:17.229808    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c7dabf5_4e59_4cae_a967_da3a783217be.slice/crio-c8d450aeaf1e03ed6c275768f4e7cd81f219aba165881d2c4d80961da88a7d97 WatchSource:0}: Error finding container c8d450aeaf1e03ed6c275768f4e7cd81f219aba165881d2c4d80961da88a7d97: Status 404 returned error can't find the container with id c8d450aeaf1e03ed6c275768f4e7cd81f219aba165881d2c4d80961da88a7d97
Jul 20 09:40:17.248833 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.248417    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ca1f102-953c-43e2-bef7-ec1633ce42ae-trusted-ca-bundle\") pod \"console-6d5c7c54f8-cqqzn\" (UID: \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\") " pod="openshift-console/console-6d5c7c54f8-cqqzn"
Jul 20 09:40:17.248833 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.248464    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9daca065-4948-48cb-939c-3ea28dfcb862-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-2j97h\" (UID: \"9daca065-4948-48cb-939c-3ea28dfcb862\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-2j97h"
Jul 20 09:40:17.248833 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.248494    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fggz7\" (UniqueName: \"kubernetes.io/projected/9daca065-4948-48cb-939c-3ea28dfcb862-kube-api-access-fggz7\") pod \"monitoring-plugin-7b7b7bc8bf-2j97h\" (UID: \"9daca065-4948-48cb-939c-3ea28dfcb862\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-2j97h"
Jul 20 09:40:17.248833 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.248537    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ca1f102-953c-43e2-bef7-ec1633ce42ae-console-config\") pod \"console-6d5c7c54f8-cqqzn\" (UID: \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\") " pod="openshift-console/console-6d5c7c54f8-cqqzn"
Jul 20 09:40:17.248833 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.248580    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ca1f102-953c-43e2-bef7-ec1633ce42ae-console-oauth-config\") pod \"console-6d5c7c54f8-cqqzn\" (UID: \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\") " pod="openshift-console/console-6d5c7c54f8-cqqzn"
Jul 20 09:40:17.248833 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.248609    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ca1f102-953c-43e2-bef7-ec1633ce42ae-service-ca\") pod \"console-6d5c7c54f8-cqqzn\" (UID: \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\") " pod="openshift-console/console-6d5c7c54f8-cqqzn"
Jul 20 09:40:17.249324 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.249287    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ca1f102-953c-43e2-bef7-ec1633ce42ae-console-serving-cert\") pod \"console-6d5c7c54f8-cqqzn\" (UID: \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\") " pod="openshift-console/console-6d5c7c54f8-cqqzn"
Jul 20 09:40:17.249578 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.249462    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ca1f102-953c-43e2-bef7-ec1633ce42ae-oauth-serving-cert\") pod \"console-6d5c7c54f8-cqqzn\" (UID: \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\") " pod="openshift-console/console-6d5c7c54f8-cqqzn"
Jul 20 09:40:17.249874 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.249530    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x27l9\" (UniqueName: \"kubernetes.io/projected/3ca1f102-953c-43e2-bef7-ec1633ce42ae-kube-api-access-x27l9\") pod \"console-6d5c7c54f8-cqqzn\" (UID: \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\") " pod="openshift-console/console-6d5c7c54f8-cqqzn"
Jul 20 09:40:17.315368 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.315308    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:17.350568 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.350543    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ca1f102-953c-43e2-bef7-ec1633ce42ae-trusted-ca-bundle\") pod \"console-6d5c7c54f8-cqqzn\" (UID: \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\") " pod="openshift-console/console-6d5c7c54f8-cqqzn"
Jul 20 09:40:17.350683 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.350591    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9daca065-4948-48cb-939c-3ea28dfcb862-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-2j97h\" (UID: \"9daca065-4948-48cb-939c-3ea28dfcb862\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-2j97h"
Jul 20 09:40:17.350683 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.350620    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fggz7\" (UniqueName: \"kubernetes.io/projected/9daca065-4948-48cb-939c-3ea28dfcb862-kube-api-access-fggz7\") pod \"monitoring-plugin-7b7b7bc8bf-2j97h\" (UID: \"9daca065-4948-48cb-939c-3ea28dfcb862\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-2j97h"
Jul 20 09:40:17.350683 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.350657    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ca1f102-953c-43e2-bef7-ec1633ce42ae-console-config\") pod \"console-6d5c7c54f8-cqqzn\" (UID: \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\") " pod="openshift-console/console-6d5c7c54f8-cqqzn"
Jul 20 09:40:17.350842 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.350696    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ca1f102-953c-43e2-bef7-ec1633ce42ae-console-oauth-config\") pod \"console-6d5c7c54f8-cqqzn\" (UID: \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\") " pod="openshift-console/console-6d5c7c54f8-cqqzn"
Jul 20 09:40:17.350842 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.350725    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ca1f102-953c-43e2-bef7-ec1633ce42ae-service-ca\") pod \"console-6d5c7c54f8-cqqzn\" (UID: \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\") " pod="openshift-console/console-6d5c7c54f8-cqqzn"
Jul 20 09:40:17.350842 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.350753    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ca1f102-953c-43e2-bef7-ec1633ce42ae-console-serving-cert\") pod \"console-6d5c7c54f8-cqqzn\" (UID: \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\") " pod="openshift-console/console-6d5c7c54f8-cqqzn"
Jul 20 09:40:17.350842 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.350788    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ca1f102-953c-43e2-bef7-ec1633ce42ae-oauth-serving-cert\") pod \"console-6d5c7c54f8-cqqzn\" (UID: \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\") " pod="openshift-console/console-6d5c7c54f8-cqqzn"
Jul 20 09:40:17.350842 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.350820    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x27l9\" (UniqueName: \"kubernetes.io/projected/3ca1f102-953c-43e2-bef7-ec1633ce42ae-kube-api-access-x27l9\") pod \"console-6d5c7c54f8-cqqzn\" (UID: \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\") " pod="openshift-console/console-6d5c7c54f8-cqqzn"
Jul 20 09:40:17.351682 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:40:17.351209    2581 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 20 09:40:17.351682 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:40:17.351297    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9daca065-4948-48cb-939c-3ea28dfcb862-monitoring-plugin-cert podName:9daca065-4948-48cb-939c-3ea28dfcb862 nodeName:}" failed. No retries permitted until 2026-07-20 09:40:17.851251256 +0000 UTC m=+69.732697556 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/9daca065-4948-48cb-939c-3ea28dfcb862-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-2j97h" (UID: "9daca065-4948-48cb-939c-3ea28dfcb862") : secret "monitoring-plugin-cert" not found
Jul 20 09:40:17.351682 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.351471    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ca1f102-953c-43e2-bef7-ec1633ce42ae-trusted-ca-bundle\") pod \"console-6d5c7c54f8-cqqzn\" (UID: \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\") " pod="openshift-console/console-6d5c7c54f8-cqqzn"
Jul 20 09:40:17.352036 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.352014    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ca1f102-953c-43e2-bef7-ec1633ce42ae-service-ca\") pod \"console-6d5c7c54f8-cqqzn\" (UID: \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\") " pod="openshift-console/console-6d5c7c54f8-cqqzn"
Jul 20 09:40:17.352215 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.352171    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ca1f102-953c-43e2-bef7-ec1633ce42ae-console-config\") pod \"console-6d5c7c54f8-cqqzn\" (UID: \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\") " pod="openshift-console/console-6d5c7c54f8-cqqzn"
Jul 20 09:40:17.352329 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.352310    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ca1f102-953c-43e2-bef7-ec1633ce42ae-oauth-serving-cert\") pod \"console-6d5c7c54f8-cqqzn\" (UID: \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\") " pod="openshift-console/console-6d5c7c54f8-cqqzn"
Jul 20 09:40:17.354485 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.354434    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ca1f102-953c-43e2-bef7-ec1633ce42ae-console-serving-cert\") pod \"console-6d5c7c54f8-cqqzn\" (UID: \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\") " pod="openshift-console/console-6d5c7c54f8-cqqzn"
Jul 20 09:40:17.354784 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.354765    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ca1f102-953c-43e2-bef7-ec1633ce42ae-console-oauth-config\") pod \"console-6d5c7c54f8-cqqzn\" (UID: \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\") " pod="openshift-console/console-6d5c7c54f8-cqqzn"
Jul 20 09:40:17.362689 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.362645    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x27l9\" (UniqueName: \"kubernetes.io/projected/3ca1f102-953c-43e2-bef7-ec1633ce42ae-kube-api-access-x27l9\") pod \"console-6d5c7c54f8-cqqzn\" (UID: \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\") " pod="openshift-console/console-6d5c7c54f8-cqqzn"
Jul 20 09:40:17.362852 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.362828    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fggz7\" (UniqueName: \"kubernetes.io/projected/9daca065-4948-48cb-939c-3ea28dfcb862-kube-api-access-fggz7\") pod \"monitoring-plugin-7b7b7bc8bf-2j97h\" (UID: \"9daca065-4948-48cb-939c-3ea28dfcb862\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-2j97h"
Jul 20 09:40:17.410556 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.410529    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:17.486513 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.486318    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d5c7c54f8-cqqzn"
Jul 20 09:40:17.533666 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.533595    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:17.681468 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.681440    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d5c7c54f8-cqqzn"]
Jul 20 09:40:17.857860 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.856414    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9daca065-4948-48cb-939c-3ea28dfcb862-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-2j97h\" (UID: \"9daca065-4948-48cb-939c-3ea28dfcb862\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-2j97h"
Jul 20 09:40:17.860167 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.860107    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9daca065-4948-48cb-939c-3ea28dfcb862-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-2j97h\" (UID: \"9daca065-4948-48cb-939c-3ea28dfcb862\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-2j97h"
Jul 20 09:40:17.860877 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.860647    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d5c7c54f8-cqqzn" event={"ID":"3ca1f102-953c-43e2-bef7-ec1633ce42ae","Type":"ContainerStarted","Data":"8ec51ee5392eeff6fdaba5e1a10bce3bfdaabcdf83a6232449b3a751e09869e4"}
Jul 20 09:40:17.860877 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.860694    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d5c7c54f8-cqqzn" event={"ID":"3ca1f102-953c-43e2-bef7-ec1633ce42ae","Type":"ContainerStarted","Data":"15e1308077e95480cdde22577059b749db3a94777f93902d7396cf54ed796553"}
Jul 20 09:40:17.862392 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.862369    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f84cffc44-x9447" event={"ID":"6c7dabf5-4e59-4cae-a967-da3a783217be","Type":"ContainerStarted","Data":"c8d450aeaf1e03ed6c275768f4e7cd81f219aba165881d2c4d80961da88a7d97"}
Jul 20 09:40:17.865982 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.865466    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fnzkg" event={"ID":"2450d682-ad31-4104-b469-603d43b7b1b2","Type":"ContainerStarted","Data":"363aa8aa46740644104bbbe24a31e4fd6cb24e298fd97f3af15f6b4efc452075"}
Jul 20 09:40:17.865982 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.865521    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fnzkg" event={"ID":"2450d682-ad31-4104-b469-603d43b7b1b2","Type":"ContainerStarted","Data":"451572de051c73fb08fdd610b4e62ca4f4f3dfeb5823ac68b697e70720f24fff"}
Jul 20 09:40:17.889744 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.889575    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d5c7c54f8-cqqzn" podStartSLOduration=0.889556005 podStartE2EDuration="889.556005ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:40:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:40:17.889281756 +0000 UTC m=+69.770728065" watchObservedRunningTime="2026-07-20 09:40:17.889556005 +0000 UTC m=+69.771002314"
Jul 20 09:40:17.913009 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:17.912537    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fnzkg" podStartSLOduration=67.484665232 podStartE2EDuration="1m8.912516378s" totalImagesPullingTime="1.427851146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:39:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:40:17.911093633 +0000 UTC m=+69.792539956" watchObservedRunningTime="2026-07-20 09:40:17.912516378 +0000 UTC m=+69.793962665"
Jul 20 09:40:18.021868 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.021739    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:18.091119 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.091084    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:18.119515 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.119490    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-2j97h"
Jul 20 09:40:18.336244 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.336066    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-2j97h"]
Jul 20 09:40:18.690386 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.688279    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 09:40:18.695579 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.695543    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:18.702613 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.702589    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.709921 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.709640    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 20 09:40:18.709921 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.709669    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 20 09:40:18.709921 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.709708    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kk9b4\""
Jul 20 09:40:18.709921 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.709831    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 20 09:40:18.711198 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.710923    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 20 09:40:18.711198 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.710943    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 20 09:40:18.711198 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.711001    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 20 09:40:18.711198 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.711014    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 20 09:40:18.711198 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.711063    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 20 09:40:18.711198 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.711110    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 20 09:40:18.711198 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.711128    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-742b3offgo0np\""
Jul 20 09:40:18.711642 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.711200    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 20 09:40:18.711642 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.711332    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 20 09:40:18.723508 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.720379    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 20 09:40:18.725090 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.723730    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 20 09:40:18.728329 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.728309    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 09:40:18.734188 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.734168    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 20 09:40:18.765678 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.765560    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.765678 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.765623    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.765678 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.765651    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.765678 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.765677    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.766014 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.765702    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.766014 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.765726    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-config\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.766014 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.765763    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-config-out\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.766014 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.765793    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjkmw\" (UniqueName: \"kubernetes.io/projected/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-kube-api-access-wjkmw\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.766014 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.765822    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.766014 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.765871    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-web-config\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.766014 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.765895    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.766014 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.765926    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.766014 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.765951    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.766014 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.765997    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.766911 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.766037    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.766911 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.766059    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.766911 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.766087    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.766911 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.766111    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.766911 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.766136    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.766911 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.766164    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.866856 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.866823    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.867395 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.866928    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.867395 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.866981    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.867395 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.867011    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.867395 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.867037    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.867395 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.867060    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-config\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.867395 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.867101    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-config-out\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.867395 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.867133    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjkmw\" (UniqueName: \"kubernetes.io/projected/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-kube-api-access-wjkmw\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.867395 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.867162    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.867395 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.867218    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-web-config\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.867395 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.867242    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.867395 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.867272    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.867395 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.867296    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.867395 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.867320    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.867395 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.867340    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.867395 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.867362    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.867395 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.867389    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.868283 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.867413    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.868283 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.867438    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.868283 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.867467    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.868283 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.867756    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.868471 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.868405    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.869308 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.869276    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.869483 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.869461    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.869670 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.869648    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.872599 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.872567    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.872879 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.872853    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.873175 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.873113    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.874368 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.874347    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-web-config\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.876742 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.876700    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.878448 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.878396    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.879346 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.879326    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.879480 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.879371    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.880952 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.880910    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.880952 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.880933    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-config\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.881678 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.881563    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.881678 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.881606    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.881910 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.881766    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-config-out\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.882484 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.882456    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:18.883253 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:18.883211    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjkmw\" (UniqueName: \"kubernetes.io/projected/0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680-kube-api-access-wjkmw\") pod \"prometheus-k8s-0\" (UID: \"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:19.026460 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:19.026375    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:19.405899 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:19.405862    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:19.589440 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:40:19.589377    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9daca065_4948_48cb_939c_3ea28dfcb862.slice/crio-a440bcd8ad39c45ce98d92ded111a3d424ddac1047003331bbf5653b9f4ff84d WatchSource:0}: Error finding container a440bcd8ad39c45ce98d92ded111a3d424ddac1047003331bbf5653b9f4ff84d: Status 404 returned error can't find the container with id a440bcd8ad39c45ce98d92ded111a3d424ddac1047003331bbf5653b9f4ff84d
Jul 20 09:40:19.877401 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:19.877364    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-2j97h" event={"ID":"9daca065-4948-48cb-939c-3ea28dfcb862","Type":"ContainerStarted","Data":"a440bcd8ad39c45ce98d92ded111a3d424ddac1047003331bbf5653b9f4ff84d"}
Jul 20 09:40:20.831784 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:20.831749    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:20.914545 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:20.914509    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:21.160214 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:21.160181    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:21.263420 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:21.263385    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:22.455238 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:22.453957    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 09:40:22.891897 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:22.891868    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f84cffc44-x9447" event={"ID":"6c7dabf5-4e59-4cae-a967-da3a783217be","Type":"ContainerStarted","Data":"c96c4e3644054174336817c2e7153266e0013b431944f76ccf045212ddca60ce"}
Jul 20 09:40:22.893902 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:22.893873    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-d76tg" event={"ID":"8e667eae-fd03-4ae1-b97d-1af58fb5e8fc","Type":"ContainerStarted","Data":"e0d060db31fa998c1cdcafe7ad003db1dfbfbbed18789a4a16653bf86759d235"}
Jul 20 09:40:22.894063 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:22.893956    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:40:22.896338 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:22.896312    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66f4d847f-mv478" event={"ID":"674f9c86-0221-4d03-905c-c548fdd91ef2","Type":"ContainerStarted","Data":"e386670517170f0e811633b8db737b2de20c48d01fe9ae06e283bd13e495802f"}
Jul 20 09:40:22.896459 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:22.896380    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66f4d847f-mv478" event={"ID":"674f9c86-0221-4d03-905c-c548fdd91ef2","Type":"ContainerStarted","Data":"39f14331da5bf571fdeade2084da312a6c4600e521d1dcc61a7db8a65ec0f052"}
Jul 20 09:40:22.896459 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:22.896421    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66f4d847f-mv478" event={"ID":"674f9c86-0221-4d03-905c-c548fdd91ef2","Type":"ContainerStarted","Data":"4c9134a7384c514ace9b1aa44cbb341df40647a270418be8b74dc0d83d951f13"}
Jul 20 09:40:22.900518 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:22.900496    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71d8d9f0-e21b-41de-8093-a4300123cd61","Type":"ContainerStarted","Data":"53247625c7579a573c9877e7a888d47002703e149dcde37bfbc260af77258932"}
Jul 20 09:40:22.900637 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:22.900556    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71d8d9f0-e21b-41de-8093-a4300123cd61","Type":"ContainerStarted","Data":"2b5b371afc2f97863739257a1381d511e160136626f27717067bb26cf4b4a6bd"}
Jul 20 09:40:22.900637 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:22.900588    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71d8d9f0-e21b-41de-8093-a4300123cd61","Type":"ContainerStarted","Data":"5c4b88541c95369c8ef5a46b23d93648ff568bae78540c90d364881916ed5bf2"}
Jul 20 09:40:22.900637 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:22.900625    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71d8d9f0-e21b-41de-8093-a4300123cd61","Type":"ContainerStarted","Data":"052203f2c1ba2fa9b39f2f2c0511ee2e450701b743348361bd63ecd9ac3083b7"}
Jul 20 09:40:22.900782 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:22.900666    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71d8d9f0-e21b-41de-8093-a4300123cd61","Type":"ContainerStarted","Data":"7aca87d4b7c3f61d1f0e603a702350621bb0a2f2e5e186385f2313a6ae1ce238"}
Jul 20 09:40:22.902210 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:22.902187    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xqb2z" event={"ID":"82e7c25c-d929-4258-8f87-ddfadcf5042e","Type":"ContainerStarted","Data":"526460a2683f5faa374985f0ba2df3fc3ef50e8b840460a6e23272ae9b7b479d"}
Jul 20 09:40:22.904022 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:22.903998    2581 generic.go:356] "Generic (PLEG): container finished" podID="0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680" containerID="89ff95d79211b0d3da756db94803f0a1d531495f5c5145382c2d3dfd6e209248" exitCode=0
Jul 20 09:40:22.904140 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:22.904041    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680","Type":"ContainerDied","Data":"89ff95d79211b0d3da756db94803f0a1d531495f5c5145382c2d3dfd6e209248"}
Jul 20 09:40:22.904140 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:22.904095    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680","Type":"ContainerStarted","Data":"1955a900499762130ca5e9ed64eed96e2af8673808c8e82674e9793d1b119d84"}
Jul 20 09:40:22.915074 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:22.915032    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-f84cffc44-x9447" podStartSLOduration=1.899611307 podStartE2EDuration="6.915018186s" totalImagesPullingTime="5.015406879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:40:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:40:22.912665029 +0000 UTC m=+74.794111385" watchObservedRunningTime="2026-07-20 09:40:22.915018186 +0000 UTC m=+74.796464576"
Jul 20 09:40:22.972006 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:22.971866    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xqb2z" podStartSLOduration=66.747199032 podStartE2EDuration="1m13.971845488s" totalImagesPullingTime="7.224646456s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:39:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:40:22.971555861 +0000 UTC m=+74.853002207" watchObservedRunningTime="2026-07-20 09:40:22.971845488 +0000 UTC m=+74.853291796"
Jul 20 09:40:22.993411 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:22.993365    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-d76tg" podStartSLOduration=67.032159119 podStartE2EDuration="1m13.993351126s" totalImagesPullingTime="6.961192007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:39:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:40:22.991575778 +0000 UTC m=+74.873022106" watchObservedRunningTime="2026-07-20 09:40:22.993351126 +0000 UTC m=+74.874797432"
Jul 20 09:40:23.912746 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:23.912712    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66f4d847f-mv478" event={"ID":"674f9c86-0221-4d03-905c-c548fdd91ef2","Type":"ContainerStarted","Data":"7c303d37f90d916fbf9574440651bb2a8edfcddd305ec9ce13bc067a89750055"}
Jul 20 09:40:23.917292 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:23.917204    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"71d8d9f0-e21b-41de-8093-a4300123cd61","Type":"ContainerStarted","Data":"4e76658fe34c37890f58e6d4ae4e36272eba09befde683aada524789c408796c"}
Jul 20 09:40:23.919565 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:23.919501    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-2j97h" event={"ID":"9daca065-4948-48cb-939c-3ea28dfcb862","Type":"ContainerStarted","Data":"180d470eab899239eccf507e994f63b8a362e1a74166464b94a87a968ef48552"}
Jul 20 09:40:23.920122 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:23.919861    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-2j97h"
Jul 20 09:40:23.925497 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:23.925478    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-2j97h"
Jul 20 09:40:23.957810 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:23.957772    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.9570165729999998 podStartE2EDuration="10.957757866s" totalImagesPullingTime="7.97965634s" totalInitContainerRuntime="21.084953ms" isStatefulPod=false podCreationTimestamp="2026-07-20 09:40:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:40:23.956269766 +0000 UTC m=+75.837716101" watchObservedRunningTime="2026-07-20 09:40:23.957757866 +0000 UTC m=+75.839204173"
Jul 20 09:40:23.984835 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:23.984780    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-2j97h" podStartSLOduration=3.236065653 podStartE2EDuration="6.984757231s" totalImagesPullingTime="3.748691578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:40:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:40:23.983809809 +0000 UTC m=+75.865256140" watchObservedRunningTime="2026-07-20 09:40:23.984757231 +0000 UTC m=+75.866203540"
Jul 20 09:40:24.928211 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:24.928168    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66f4d847f-mv478" event={"ID":"674f9c86-0221-4d03-905c-c548fdd91ef2","Type":"ContainerStarted","Data":"d6ea3dcb4101954544d27dad42a9cf582952a9e1d568626613280405c71dccdf"}
Jul 20 09:40:24.928656 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:24.928306    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66f4d847f-mv478" event={"ID":"674f9c86-0221-4d03-905c-c548fdd91ef2","Type":"ContainerStarted","Data":"9b577209e5b5ecf6b955862bb0ded7f0a5118a12842dcbd3c0b0481231e9e5c4"}
Jul 20 09:40:24.928871 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:24.928819    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-66f4d847f-mv478"
Jul 20 09:40:24.966012 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:24.965939    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-66f4d847f-mv478" podStartSLOduration=2.720389527 podStartE2EDuration="9.965924667s" totalImagesPullingTime="7.24553514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:40:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:40:24.964173492 +0000 UTC m=+76.845619822" watchObservedRunningTime="2026-07-20 09:40:24.965924667 +0000 UTC m=+76.847370976"
Jul 20 09:40:26.940579 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:26.940539    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680","Type":"ContainerStarted","Data":"732bb7e39600cf1ff35b68c61dbaf2e2ff3a8558b43fce56b9d00665141bb441"}
Jul 20 09:40:26.940918 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:26.940637    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680","Type":"ContainerStarted","Data":"42bd2ac68ebe478b2577dc4b6bd5027ae502ff444118e499809be5c975a17613"}
Jul 20 09:40:26.940918 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:26.940669    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680","Type":"ContainerStarted","Data":"71f451ed1442a4e92ddaf829ec2a69faf296d644b7bd55d31d288d805d65af6a"}
Jul 20 09:40:26.940918 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:26.940695    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680","Type":"ContainerStarted","Data":"3f48bc19df01eb8f0df7454cea272c10f118e5765fb347786787cd01d0be291a"}
Jul 20 09:40:26.940918 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:26.940727    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680","Type":"ContainerStarted","Data":"fc21c333b346f4f2475fb9b19a1ddad1193de9c4080f3d51bceae82077299c6d"}
Jul 20 09:40:26.940918 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:26.940749    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680","Type":"ContainerStarted","Data":"2b01af24b108f883c35bbd75d8a1f08e70fadae4b4074d8af6198ceee1fc1f52"}
Jul 20 09:40:26.988587 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:26.988519    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.764908545 podStartE2EDuration="8.988499161s" totalImagesPullingTime="3.192174405s" totalInitContainerRuntime="31.416211ms" isStatefulPod=false podCreationTimestamp="2026-07-20 09:40:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:40:26.986471106 +0000 UTC m=+78.867917472" watchObservedRunningTime="2026-07-20 09:40:26.988499161 +0000 UTC m=+78.869945468"
Jul 20 09:40:27.487233 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:27.487194    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d5c7c54f8-cqqzn"
Jul 20 09:40:27.487376 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:27.487250    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d5c7c54f8-cqqzn"
Jul 20 09:40:27.492060 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:27.492037    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d5c7c54f8-cqqzn"
Jul 20 09:40:27.605113 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:27.605084    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:27.706169 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:27.706146    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:27.949257 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:27.949231    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d5c7c54f8-cqqzn"
Jul 20 09:40:28.012243 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:28.012212    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-775cf4658-m48pg"]
Jul 20 09:40:28.159501 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:28.159469    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:28.256464 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:28.256390    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:28.415652 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:28.415621    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:28.579374 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:28.579303    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:28.657975 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:28.657946    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:29.027267 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:29.027234    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:40:30.052123 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:30.052091    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:30.148645 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:30.148618    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:30.938741 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:30.938633    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-66f4d847f-mv478"
Jul 20 09:40:37.005506 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:37.005475    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-f84cffc44-x9447"
Jul 20 09:40:37.006019 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:37.005522    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-f84cffc44-x9447"
Jul 20 09:40:42.599035 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:42.598991    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:42.668520 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:42.668492    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:44.054178 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:44.054146    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:44.127759 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:44.127734    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:53.032616 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:53.032557    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-775cf4658-m48pg" podUID="bd387e8c-9f3e-471d-addf-a3560052c674" containerName="console" containerID="cri-o://9659bd2eafd240774e7deea9989008a583d5d78478680e023b344fdb984885bf" gracePeriod=15
Jul 20 09:40:53.272570 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:53.272545    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-775cf4658-m48pg"
Jul 20 09:40:53.372821 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:53.372797    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd387e8c-9f3e-471d-addf-a3560052c674-console-oauth-config\") pod \"bd387e8c-9f3e-471d-addf-a3560052c674\" (UID: \"bd387e8c-9f3e-471d-addf-a3560052c674\") "
Jul 20 09:40:53.372981 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:53.372828    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd387e8c-9f3e-471d-addf-a3560052c674-console-config\") pod \"bd387e8c-9f3e-471d-addf-a3560052c674\" (UID: \"bd387e8c-9f3e-471d-addf-a3560052c674\") "
Jul 20 09:40:53.372981 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:53.372859    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd387e8c-9f3e-471d-addf-a3560052c674-service-ca\") pod \"bd387e8c-9f3e-471d-addf-a3560052c674\" (UID: \"bd387e8c-9f3e-471d-addf-a3560052c674\") "
Jul 20 09:40:53.372981 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:53.372885    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgwv8\" (UniqueName: \"kubernetes.io/projected/bd387e8c-9f3e-471d-addf-a3560052c674-kube-api-access-mgwv8\") pod \"bd387e8c-9f3e-471d-addf-a3560052c674\" (UID: \"bd387e8c-9f3e-471d-addf-a3560052c674\") "
Jul 20 09:40:53.372981 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:53.372909    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd387e8c-9f3e-471d-addf-a3560052c674-console-serving-cert\") pod \"bd387e8c-9f3e-471d-addf-a3560052c674\" (UID: \"bd387e8c-9f3e-471d-addf-a3560052c674\") "
Jul 20 09:40:53.372981 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:53.372936    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd387e8c-9f3e-471d-addf-a3560052c674-oauth-serving-cert\") pod \"bd387e8c-9f3e-471d-addf-a3560052c674\" (UID: \"bd387e8c-9f3e-471d-addf-a3560052c674\") "
Jul 20 09:40:53.372981 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:53.372953    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd387e8c-9f3e-471d-addf-a3560052c674-trusted-ca-bundle\") pod \"bd387e8c-9f3e-471d-addf-a3560052c674\" (UID: \"bd387e8c-9f3e-471d-addf-a3560052c674\") "
Jul 20 09:40:53.373363 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:53.373320    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd387e8c-9f3e-471d-addf-a3560052c674-service-ca" (OuterVolumeSpecName: "service-ca") pod "bd387e8c-9f3e-471d-addf-a3560052c674" (UID: "bd387e8c-9f3e-471d-addf-a3560052c674"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 09:40:53.373494 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:53.373327    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd387e8c-9f3e-471d-addf-a3560052c674-console-config" (OuterVolumeSpecName: "console-config") pod "bd387e8c-9f3e-471d-addf-a3560052c674" (UID: "bd387e8c-9f3e-471d-addf-a3560052c674"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 09:40:53.373494 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:53.373365    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd387e8c-9f3e-471d-addf-a3560052c674-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bd387e8c-9f3e-471d-addf-a3560052c674" (UID: "bd387e8c-9f3e-471d-addf-a3560052c674"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 09:40:53.373494 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:53.373450    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd387e8c-9f3e-471d-addf-a3560052c674-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bd387e8c-9f3e-471d-addf-a3560052c674" (UID: "bd387e8c-9f3e-471d-addf-a3560052c674"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 09:40:53.375393 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:53.375366    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd387e8c-9f3e-471d-addf-a3560052c674-kube-api-access-mgwv8" (OuterVolumeSpecName: "kube-api-access-mgwv8") pod "bd387e8c-9f3e-471d-addf-a3560052c674" (UID: "bd387e8c-9f3e-471d-addf-a3560052c674"). InnerVolumeSpecName "kube-api-access-mgwv8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 09:40:53.375393 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:53.375379    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd387e8c-9f3e-471d-addf-a3560052c674-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bd387e8c-9f3e-471d-addf-a3560052c674" (UID: "bd387e8c-9f3e-471d-addf-a3560052c674"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 09:40:53.375516 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:53.375443    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd387e8c-9f3e-471d-addf-a3560052c674-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bd387e8c-9f3e-471d-addf-a3560052c674" (UID: "bd387e8c-9f3e-471d-addf-a3560052c674"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 09:40:53.473905 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:53.473887    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd387e8c-9f3e-471d-addf-a3560052c674-oauth-serving-cert\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 09:40:53.474000 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:53.473906    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd387e8c-9f3e-471d-addf-a3560052c674-trusted-ca-bundle\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 09:40:53.474000 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:53.473916    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd387e8c-9f3e-471d-addf-a3560052c674-console-oauth-config\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 09:40:53.474000 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:53.473925    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd387e8c-9f3e-471d-addf-a3560052c674-console-config\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 09:40:53.474000 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:53.473933    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd387e8c-9f3e-471d-addf-a3560052c674-service-ca\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 09:40:53.474000 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:53.473941    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgwv8\" (UniqueName: \"kubernetes.io/projected/bd387e8c-9f3e-471d-addf-a3560052c674-kube-api-access-mgwv8\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 09:40:53.474000 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:53.473949    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd387e8c-9f3e-471d-addf-a3560052c674-console-serving-cert\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 09:40:53.922086 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:53.922058    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-d76tg"
Jul 20 09:40:54.051956 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:54.051925    2581 generic.go:356] "Generic (PLEG): container finished" podID="bd387e8c-9f3e-471d-addf-a3560052c674" containerID="9659bd2eafd240774e7deea9989008a583d5d78478680e023b344fdb984885bf" exitCode=0
Jul 20 09:40:54.052446 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:54.051988    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-775cf4658-m48pg"
Jul 20 09:40:54.052446 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:54.052013    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-775cf4658-m48pg" event={"ID":"bd387e8c-9f3e-471d-addf-a3560052c674","Type":"ContainerDied","Data":"9659bd2eafd240774e7deea9989008a583d5d78478680e023b344fdb984885bf"}
Jul 20 09:40:54.052446 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:54.052077    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-775cf4658-m48pg" event={"ID":"bd387e8c-9f3e-471d-addf-a3560052c674","Type":"ContainerDied","Data":"98b7869c0cbf6df5c2a2241400e34474a064f8a411b107fc5e45906cd601ea44"}
Jul 20 09:40:54.052446 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:54.052108    2581 scope.go:117] "RemoveContainer" containerID="9659bd2eafd240774e7deea9989008a583d5d78478680e023b344fdb984885bf"
Jul 20 09:40:54.060070 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:54.060055    2581 scope.go:117] "RemoveContainer" containerID="9659bd2eafd240774e7deea9989008a583d5d78478680e023b344fdb984885bf"
Jul 20 09:40:54.060328 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:40:54.060302    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9659bd2eafd240774e7deea9989008a583d5d78478680e023b344fdb984885bf\": container with ID starting with 9659bd2eafd240774e7deea9989008a583d5d78478680e023b344fdb984885bf not found: ID does not exist" containerID="9659bd2eafd240774e7deea9989008a583d5d78478680e023b344fdb984885bf"
Jul 20 09:40:54.060375 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:54.060337    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9659bd2eafd240774e7deea9989008a583d5d78478680e023b344fdb984885bf"} err="failed to get container status \"9659bd2eafd240774e7deea9989008a583d5d78478680e023b344fdb984885bf\": rpc error: code = NotFound desc = could not find container \"9659bd2eafd240774e7deea9989008a583d5d78478680e023b344fdb984885bf\": container with ID starting with 9659bd2eafd240774e7deea9989008a583d5d78478680e023b344fdb984885bf not found: ID does not exist"
Jul 20 09:40:54.070500 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:54.070480    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-775cf4658-m48pg"]
Jul 20 09:40:54.076239 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:54.076222    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-775cf4658-m48pg"]
Jul 20 09:40:55.464531 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:55.464504    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd387e8c-9f3e-471d-addf-a3560052c674" path="/var/lib/kubelet/pods/bd387e8c-9f3e-471d-addf-a3560052c674/volumes"
Jul 20 09:40:56.772723 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:56.772690    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:56.889549 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:56.889522    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:40:57.011013 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:57.010982    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-f84cffc44-x9447"
Jul 20 09:40:57.014687 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:57.014669    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-f84cffc44-x9447"
Jul 20 09:40:57.131005 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:40:57.130954    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:41:02.573496 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:02.573462    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:41:02.631868 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:02.631845    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:41:19.027396 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:19.027359    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:41:19.048497 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:19.048472    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:41:19.169746 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:19.169719    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 09:41:31.704733 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:31.704696    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:41:31.847625 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:31.847594    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:41:36.740555 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.740513    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-bc44f749-jjxm5"]
Jul 20 09:41:36.741324 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.741296    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd387e8c-9f3e-471d-addf-a3560052c674" containerName="console"
Jul 20 09:41:36.741324 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.741322    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd387e8c-9f3e-471d-addf-a3560052c674" containerName="console"
Jul 20 09:41:36.741493 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.741374    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd387e8c-9f3e-471d-addf-a3560052c674" containerName="console"
Jul 20 09:41:36.743562 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.743546    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-bc44f749-jjxm5"
Jul 20 09:41:36.746800 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.746782    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 20 09:41:36.747462 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.747441    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 20 09:41:36.747462 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.747290    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 20 09:41:36.747632 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.747338    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9kfd7\""
Jul 20 09:41:36.747632 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.746999    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 20 09:41:36.747747 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.747732    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 20 09:41:36.754877 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.754861    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 20 09:41:36.764062 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.764043    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-bc44f749-jjxm5"]
Jul 20 09:41:36.818445 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.818416    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1222f686-ed8e-49b1-bdab-3da2a1cd2549-secret-telemeter-client\") pod \"telemeter-client-bc44f749-jjxm5\" (UID: \"1222f686-ed8e-49b1-bdab-3da2a1cd2549\") " pod="openshift-monitoring/telemeter-client-bc44f749-jjxm5"
Jul 20 09:41:36.818608 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.818466    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1222f686-ed8e-49b1-bdab-3da2a1cd2549-federate-client-tls\") pod \"telemeter-client-bc44f749-jjxm5\" (UID: \"1222f686-ed8e-49b1-bdab-3da2a1cd2549\") " pod="openshift-monitoring/telemeter-client-bc44f749-jjxm5"
Jul 20 09:41:36.818608 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.818494    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1222f686-ed8e-49b1-bdab-3da2a1cd2549-telemeter-client-tls\") pod \"telemeter-client-bc44f749-jjxm5\" (UID: \"1222f686-ed8e-49b1-bdab-3da2a1cd2549\") " pod="openshift-monitoring/telemeter-client-bc44f749-jjxm5"
Jul 20 09:41:36.818608 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.818532    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1222f686-ed8e-49b1-bdab-3da2a1cd2549-metrics-client-ca\") pod \"telemeter-client-bc44f749-jjxm5\" (UID: \"1222f686-ed8e-49b1-bdab-3da2a1cd2549\") " pod="openshift-monitoring/telemeter-client-bc44f749-jjxm5"
Jul 20 09:41:36.818608 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.818547    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5pbq\" (UniqueName: \"kubernetes.io/projected/1222f686-ed8e-49b1-bdab-3da2a1cd2549-kube-api-access-r5pbq\") pod \"telemeter-client-bc44f749-jjxm5\" (UID: \"1222f686-ed8e-49b1-bdab-3da2a1cd2549\") " pod="openshift-monitoring/telemeter-client-bc44f749-jjxm5"
Jul 20 09:41:36.818608 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.818568    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1222f686-ed8e-49b1-bdab-3da2a1cd2549-serving-certs-ca-bundle\") pod \"telemeter-client-bc44f749-jjxm5\" (UID: \"1222f686-ed8e-49b1-bdab-3da2a1cd2549\") " pod="openshift-monitoring/telemeter-client-bc44f749-jjxm5"
Jul 20 09:41:36.818608 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.818592    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1222f686-ed8e-49b1-bdab-3da2a1cd2549-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bc44f749-jjxm5\" (UID: \"1222f686-ed8e-49b1-bdab-3da2a1cd2549\") " pod="openshift-monitoring/telemeter-client-bc44f749-jjxm5"
Jul 20 09:41:36.818608 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.818608    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1222f686-ed8e-49b1-bdab-3da2a1cd2549-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bc44f749-jjxm5\" (UID: \"1222f686-ed8e-49b1-bdab-3da2a1cd2549\") " pod="openshift-monitoring/telemeter-client-bc44f749-jjxm5"
Jul 20 09:41:36.919711 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.919678    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1222f686-ed8e-49b1-bdab-3da2a1cd2549-secret-telemeter-client\") pod \"telemeter-client-bc44f749-jjxm5\" (UID: \"1222f686-ed8e-49b1-bdab-3da2a1cd2549\") " pod="openshift-monitoring/telemeter-client-bc44f749-jjxm5"
Jul 20 09:41:36.919891 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.919812    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1222f686-ed8e-49b1-bdab-3da2a1cd2549-federate-client-tls\") pod \"telemeter-client-bc44f749-jjxm5\" (UID: \"1222f686-ed8e-49b1-bdab-3da2a1cd2549\") " pod="openshift-monitoring/telemeter-client-bc44f749-jjxm5"
Jul 20 09:41:36.919891 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.919854    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1222f686-ed8e-49b1-bdab-3da2a1cd2549-telemeter-client-tls\") pod \"telemeter-client-bc44f749-jjxm5\" (UID: \"1222f686-ed8e-49b1-bdab-3da2a1cd2549\") " pod="openshift-monitoring/telemeter-client-bc44f749-jjxm5"
Jul 20 09:41:36.920066 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.919908    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1222f686-ed8e-49b1-bdab-3da2a1cd2549-metrics-client-ca\") pod \"telemeter-client-bc44f749-jjxm5\" (UID: \"1222f686-ed8e-49b1-bdab-3da2a1cd2549\") " pod="openshift-monitoring/telemeter-client-bc44f749-jjxm5"
Jul 20 09:41:36.920066 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.919930    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5pbq\" (UniqueName: \"kubernetes.io/projected/1222f686-ed8e-49b1-bdab-3da2a1cd2549-kube-api-access-r5pbq\") pod \"telemeter-client-bc44f749-jjxm5\" (UID: \"1222f686-ed8e-49b1-bdab-3da2a1cd2549\") " pod="openshift-monitoring/telemeter-client-bc44f749-jjxm5"
Jul 20 09:41:36.920066 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.919991    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1222f686-ed8e-49b1-bdab-3da2a1cd2549-serving-certs-ca-bundle\") pod \"telemeter-client-bc44f749-jjxm5\" (UID: \"1222f686-ed8e-49b1-bdab-3da2a1cd2549\") " pod="openshift-monitoring/telemeter-client-bc44f749-jjxm5"
Jul 20 09:41:36.920066 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.920036    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1222f686-ed8e-49b1-bdab-3da2a1cd2549-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bc44f749-jjxm5\" (UID: \"1222f686-ed8e-49b1-bdab-3da2a1cd2549\") " pod="openshift-monitoring/telemeter-client-bc44f749-jjxm5"
Jul 20 09:41:36.920274 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.920066    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1222f686-ed8e-49b1-bdab-3da2a1cd2549-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bc44f749-jjxm5\" (UID: \"1222f686-ed8e-49b1-bdab-3da2a1cd2549\") " pod="openshift-monitoring/telemeter-client-bc44f749-jjxm5"
Jul 20 09:41:36.920766 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.920740    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1222f686-ed8e-49b1-bdab-3da2a1cd2549-metrics-client-ca\") pod \"telemeter-client-bc44f749-jjxm5\" (UID: \"1222f686-ed8e-49b1-bdab-3da2a1cd2549\") " pod="openshift-monitoring/telemeter-client-bc44f749-jjxm5"
Jul 20 09:41:36.920881 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.920740    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1222f686-ed8e-49b1-bdab-3da2a1cd2549-serving-certs-ca-bundle\") pod \"telemeter-client-bc44f749-jjxm5\" (UID: \"1222f686-ed8e-49b1-bdab-3da2a1cd2549\") " pod="openshift-monitoring/telemeter-client-bc44f749-jjxm5"
Jul 20 09:41:36.920881 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.920858    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1222f686-ed8e-49b1-bdab-3da2a1cd2549-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bc44f749-jjxm5\" (UID: \"1222f686-ed8e-49b1-bdab-3da2a1cd2549\") " pod="openshift-monitoring/telemeter-client-bc44f749-jjxm5"
Jul 20 09:41:36.922795 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.922774    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1222f686-ed8e-49b1-bdab-3da2a1cd2549-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bc44f749-jjxm5\" (UID: \"1222f686-ed8e-49b1-bdab-3da2a1cd2549\") " pod="openshift-monitoring/telemeter-client-bc44f749-jjxm5"
Jul 20 09:41:36.922877 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.922796    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1222f686-ed8e-49b1-bdab-3da2a1cd2549-secret-telemeter-client\") pod \"telemeter-client-bc44f749-jjxm5\" (UID: \"1222f686-ed8e-49b1-bdab-3da2a1cd2549\") " pod="openshift-monitoring/telemeter-client-bc44f749-jjxm5"
Jul 20 09:41:36.922877 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.922831    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1222f686-ed8e-49b1-bdab-3da2a1cd2549-federate-client-tls\") pod \"telemeter-client-bc44f749-jjxm5\" (UID: \"1222f686-ed8e-49b1-bdab-3da2a1cd2549\") " pod="openshift-monitoring/telemeter-client-bc44f749-jjxm5"
Jul 20 09:41:36.922975 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.922928    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1222f686-ed8e-49b1-bdab-3da2a1cd2549-telemeter-client-tls\") pod \"telemeter-client-bc44f749-jjxm5\" (UID: \"1222f686-ed8e-49b1-bdab-3da2a1cd2549\") " pod="openshift-monitoring/telemeter-client-bc44f749-jjxm5"
Jul 20 09:41:36.928122 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:36.928099    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5pbq\" (UniqueName: \"kubernetes.io/projected/1222f686-ed8e-49b1-bdab-3da2a1cd2549-kube-api-access-r5pbq\") pod \"telemeter-client-bc44f749-jjxm5\" (UID: \"1222f686-ed8e-49b1-bdab-3da2a1cd2549\") " pod="openshift-monitoring/telemeter-client-bc44f749-jjxm5"
Jul 20 09:41:37.055442 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:37.055380    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-bc44f749-jjxm5"
Jul 20 09:41:37.187286 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:37.187257    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-bc44f749-jjxm5"]
Jul 20 09:41:37.190381 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:41:37.190358    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1222f686_ed8e_49b1_bdab_3da2a1cd2549.slice/crio-29611e716b45e512c22cb5055fa5eda98f690735ba41cab8490115921cbd1020 WatchSource:0}: Error finding container 29611e716b45e512c22cb5055fa5eda98f690735ba41cab8490115921cbd1020: Status 404 returned error can't find the container with id 29611e716b45e512c22cb5055fa5eda98f690735ba41cab8490115921cbd1020
Jul 20 09:41:37.224703 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:37.224668    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bc44f749-jjxm5" event={"ID":"1222f686-ed8e-49b1-bdab-3da2a1cd2549","Type":"ContainerStarted","Data":"29611e716b45e512c22cb5055fa5eda98f690735ba41cab8490115921cbd1020"}
Jul 20 09:41:39.234532 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:39.234484    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bc44f749-jjxm5" event={"ID":"1222f686-ed8e-49b1-bdab-3da2a1cd2549","Type":"ContainerStarted","Data":"74da400687ec8eb4d51c45c62a3987c8317fe6c35a11db98e69b79964d507760"}
Jul 20 09:41:40.241162 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:40.241123    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bc44f749-jjxm5" event={"ID":"1222f686-ed8e-49b1-bdab-3da2a1cd2549","Type":"ContainerStarted","Data":"b22bcd2e6b2b15f50eac9eb7383a5c9ed3d42554193fef2098fe562455fc9b3a"}
Jul 20 09:41:40.241624 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:40.241200    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bc44f749-jjxm5" event={"ID":"1222f686-ed8e-49b1-bdab-3da2a1cd2549","Type":"ContainerStarted","Data":"92a4a32f510d090c5340de47e2c5dede1008abab6b32ee8c4acc310cdc0b4255"}
Jul 20 09:41:40.266696 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:40.266642    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-bc44f749-jjxm5" podStartSLOduration=2.339015358 podStartE2EDuration="4.266626235s" totalImagesPullingTime="1.927610877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:41:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:41:40.265284448 +0000 UTC m=+152.146730747" watchObservedRunningTime="2026-07-20 09:41:40.266626235 +0000 UTC m=+152.148072544"
Jul 20 09:41:41.262225 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:41.262197    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:41:41.357786 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:41.357757    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:41:46.916678 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:46.916643    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:41:46.979729 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:46.979700    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:41:52.065797 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:52.065765    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d5c7c54f8-cqqzn"]
Jul 20 09:41:52.213173 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:52.213141    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:41:52.516953 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:52.516927    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:41:52.658091 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:52.658061    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:41:53.138038 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:53.138007    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:41:53.202938 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:53.202908    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:41:53.924423 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:53.924394    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:41:53.990492 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:53.990460    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:41:58.911393 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:58.911361    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:41:58.971283 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:41:58.971254    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:42:03.236762 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:03.236679    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:42:03.336683 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:03.336650    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:42:03.437551 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:03.437521    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:42:11.041594 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:11.041561    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:42:12.592884 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:12.592848    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:42:12.696349 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:12.696327    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:42:17.085709 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:17.085661    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d5c7c54f8-cqqzn" podUID="3ca1f102-953c-43e2-bef7-ec1633ce42ae" containerName="console" containerID="cri-o://8ec51ee5392eeff6fdaba5e1a10bce3bfdaabcdf83a6232449b3a751e09869e4" gracePeriod=15
Jul 20 09:42:17.341510 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:17.341453    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d5c7c54f8-cqqzn"
Jul 20 09:42:17.394831 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:17.394801    2581 generic.go:356] "Generic (PLEG): container finished" podID="3ca1f102-953c-43e2-bef7-ec1633ce42ae" containerID="8ec51ee5392eeff6fdaba5e1a10bce3bfdaabcdf83a6232449b3a751e09869e4" exitCode=0
Jul 20 09:42:17.394988 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:17.394848    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d5c7c54f8-cqqzn"
Jul 20 09:42:17.394988 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:17.394846    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d5c7c54f8-cqqzn" event={"ID":"3ca1f102-953c-43e2-bef7-ec1633ce42ae","Type":"ContainerDied","Data":"8ec51ee5392eeff6fdaba5e1a10bce3bfdaabcdf83a6232449b3a751e09869e4"}
Jul 20 09:42:17.395079 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:17.395000    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d5c7c54f8-cqqzn" event={"ID":"3ca1f102-953c-43e2-bef7-ec1633ce42ae","Type":"ContainerDied","Data":"15e1308077e95480cdde22577059b749db3a94777f93902d7396cf54ed796553"}
Jul 20 09:42:17.395079 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:17.395038    2581 scope.go:117] "RemoveContainer" containerID="8ec51ee5392eeff6fdaba5e1a10bce3bfdaabcdf83a6232449b3a751e09869e4"
Jul 20 09:42:17.403459 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:17.403441    2581 scope.go:117] "RemoveContainer" containerID="8ec51ee5392eeff6fdaba5e1a10bce3bfdaabcdf83a6232449b3a751e09869e4"
Jul 20 09:42:17.403755 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:42:17.403723    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ec51ee5392eeff6fdaba5e1a10bce3bfdaabcdf83a6232449b3a751e09869e4\": container with ID starting with 8ec51ee5392eeff6fdaba5e1a10bce3bfdaabcdf83a6232449b3a751e09869e4 not found: ID does not exist" containerID="8ec51ee5392eeff6fdaba5e1a10bce3bfdaabcdf83a6232449b3a751e09869e4"
Jul 20 09:42:17.403803 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:17.403765    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ec51ee5392eeff6fdaba5e1a10bce3bfdaabcdf83a6232449b3a751e09869e4"} err="failed to get container status \"8ec51ee5392eeff6fdaba5e1a10bce3bfdaabcdf83a6232449b3a751e09869e4\": rpc error: code = NotFound desc = could not find container \"8ec51ee5392eeff6fdaba5e1a10bce3bfdaabcdf83a6232449b3a751e09869e4\": container with ID starting with 8ec51ee5392eeff6fdaba5e1a10bce3bfdaabcdf83a6232449b3a751e09869e4 not found: ID does not exist"
Jul 20 09:42:17.437058 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:17.437039    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ca1f102-953c-43e2-bef7-ec1633ce42ae-console-serving-cert\") pod \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\" (UID: \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\") "
Jul 20 09:42:17.437158 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:17.437083    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ca1f102-953c-43e2-bef7-ec1633ce42ae-oauth-serving-cert\") pod \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\" (UID: \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\") "
Jul 20 09:42:17.437158 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:17.437109    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ca1f102-953c-43e2-bef7-ec1633ce42ae-service-ca\") pod \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\" (UID: \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\") "
Jul 20 09:42:17.437158 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:17.437128    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x27l9\" (UniqueName: \"kubernetes.io/projected/3ca1f102-953c-43e2-bef7-ec1633ce42ae-kube-api-access-x27l9\") pod \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\" (UID: \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\") "
Jul 20 09:42:17.437158 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:17.437156    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ca1f102-953c-43e2-bef7-ec1633ce42ae-trusted-ca-bundle\") pod \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\" (UID: \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\") "
Jul 20 09:42:17.437327 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:17.437181    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ca1f102-953c-43e2-bef7-ec1633ce42ae-console-config\") pod \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\" (UID: \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\") "
Jul 20 09:42:17.437327 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:17.437206    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ca1f102-953c-43e2-bef7-ec1633ce42ae-console-oauth-config\") pod \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\" (UID: \"3ca1f102-953c-43e2-bef7-ec1633ce42ae\") "
Jul 20 09:42:17.437506 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:17.437479    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ca1f102-953c-43e2-bef7-ec1633ce42ae-service-ca" (OuterVolumeSpecName: "service-ca") pod "3ca1f102-953c-43e2-bef7-ec1633ce42ae" (UID: "3ca1f102-953c-43e2-bef7-ec1633ce42ae"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 09:42:17.437586 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:17.437547    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ca1f102-953c-43e2-bef7-ec1633ce42ae-console-config" (OuterVolumeSpecName: "console-config") pod "3ca1f102-953c-43e2-bef7-ec1633ce42ae" (UID: "3ca1f102-953c-43e2-bef7-ec1633ce42ae"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 09:42:17.437645 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:17.437557    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ca1f102-953c-43e2-bef7-ec1633ce42ae-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3ca1f102-953c-43e2-bef7-ec1633ce42ae" (UID: "3ca1f102-953c-43e2-bef7-ec1633ce42ae"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 09:42:17.437773 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:17.437750    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ca1f102-953c-43e2-bef7-ec1633ce42ae-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3ca1f102-953c-43e2-bef7-ec1633ce42ae" (UID: "3ca1f102-953c-43e2-bef7-ec1633ce42ae"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 09:42:17.439370 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:17.439342    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ca1f102-953c-43e2-bef7-ec1633ce42ae-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3ca1f102-953c-43e2-bef7-ec1633ce42ae" (UID: "3ca1f102-953c-43e2-bef7-ec1633ce42ae"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 09:42:17.439456 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:17.439369    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ca1f102-953c-43e2-bef7-ec1633ce42ae-kube-api-access-x27l9" (OuterVolumeSpecName: "kube-api-access-x27l9") pod "3ca1f102-953c-43e2-bef7-ec1633ce42ae" (UID: "3ca1f102-953c-43e2-bef7-ec1633ce42ae"). InnerVolumeSpecName "kube-api-access-x27l9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 09:42:17.439456 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:17.439384    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ca1f102-953c-43e2-bef7-ec1633ce42ae-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3ca1f102-953c-43e2-bef7-ec1633ce42ae" (UID: "3ca1f102-953c-43e2-bef7-ec1633ce42ae"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 09:42:17.538746 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:17.538722    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ca1f102-953c-43e2-bef7-ec1633ce42ae-trusted-ca-bundle\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 09:42:17.538746 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:17.538743    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3ca1f102-953c-43e2-bef7-ec1633ce42ae-console-config\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 09:42:17.538892 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:17.538752    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3ca1f102-953c-43e2-bef7-ec1633ce42ae-console-oauth-config\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 09:42:17.538892 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:17.538761    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ca1f102-953c-43e2-bef7-ec1633ce42ae-console-serving-cert\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 09:42:17.538892 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:17.538770    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3ca1f102-953c-43e2-bef7-ec1633ce42ae-oauth-serving-cert\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 09:42:17.538892 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:17.538779    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3ca1f102-953c-43e2-bef7-ec1633ce42ae-service-ca\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 09:42:17.538892 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:17.538788    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x27l9\" (UniqueName: \"kubernetes.io/projected/3ca1f102-953c-43e2-bef7-ec1633ce42ae-kube-api-access-x27l9\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 09:42:17.709830 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:17.709807    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d5c7c54f8-cqqzn"]
Jul 20 09:42:17.714064 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:17.714042    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d5c7c54f8-cqqzn"]
Jul 20 09:42:19.463106 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:19.463075    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ca1f102-953c-43e2-bef7-ec1633ce42ae" path="/var/lib/kubelet/pods/3ca1f102-953c-43e2-bef7-ec1633ce42ae/volumes"
Jul 20 09:42:21.834465 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:21.834432    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:42:21.889581 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:21.889559    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:42:32.711055 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:32.711024    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:42:32.769417 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:42:32.769391    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:43:03.256332 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:03.256293    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:43:03.349107 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:03.349068    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:43:25.340910 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:25.340858    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:43:26.693369 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:26.693322    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:43:28.903256 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:28.903222    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:43:29.003471 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:29.003438    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:43:30.631369 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:30.631292    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:43:30.740280 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:30.740254    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:43:30.875879 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:30.875844    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:43:31.796501 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:31.796469    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-c5qdr"]
Jul 20 09:43:31.796857 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:31.796801    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ca1f102-953c-43e2-bef7-ec1633ce42ae" containerName="console"
Jul 20 09:43:31.796857 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:31.796813    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ca1f102-953c-43e2-bef7-ec1633ce42ae" containerName="console"
Jul 20 09:43:31.796931 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:31.796896    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ca1f102-953c-43e2-bef7-ec1633ce42ae" containerName="console"
Jul 20 09:43:31.799639 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:31.799624    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-c5qdr"
Jul 20 09:43:31.802168 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:31.802146    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 20 09:43:31.802988 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:31.802954    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-5hgv5\""
Jul 20 09:43:31.803080 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:31.803009    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 20 09:43:31.812824 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:31.812802    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-c5qdr"]
Jul 20 09:43:31.889636 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:31.889610    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw7tb\" (UniqueName: \"kubernetes.io/projected/b47f919a-ea4f-4583-b0fe-7935f317bcce-kube-api-access-dw7tb\") pod \"cert-manager-webhook-6486ffd997-c5qdr\" (UID: \"b47f919a-ea4f-4583-b0fe-7935f317bcce\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c5qdr"
Jul 20 09:43:31.889741 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:31.889660    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b47f919a-ea4f-4583-b0fe-7935f317bcce-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-c5qdr\" (UID: \"b47f919a-ea4f-4583-b0fe-7935f317bcce\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c5qdr"
Jul 20 09:43:31.990685 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:31.990659    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw7tb\" (UniqueName: \"kubernetes.io/projected/b47f919a-ea4f-4583-b0fe-7935f317bcce-kube-api-access-dw7tb\") pod \"cert-manager-webhook-6486ffd997-c5qdr\" (UID: \"b47f919a-ea4f-4583-b0fe-7935f317bcce\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c5qdr"
Jul 20 09:43:31.990840 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:31.990708    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b47f919a-ea4f-4583-b0fe-7935f317bcce-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-c5qdr\" (UID: \"b47f919a-ea4f-4583-b0fe-7935f317bcce\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c5qdr"
Jul 20 09:43:31.999031 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:31.999007    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b47f919a-ea4f-4583-b0fe-7935f317bcce-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-c5qdr\" (UID: \"b47f919a-ea4f-4583-b0fe-7935f317bcce\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c5qdr"
Jul 20 09:43:31.999382 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:31.999361    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw7tb\" (UniqueName: \"kubernetes.io/projected/b47f919a-ea4f-4583-b0fe-7935f317bcce-kube-api-access-dw7tb\") pod \"cert-manager-webhook-6486ffd997-c5qdr\" (UID: \"b47f919a-ea4f-4583-b0fe-7935f317bcce\") " pod="cert-manager/cert-manager-webhook-6486ffd997-c5qdr"
Jul 20 09:43:32.116649 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:32.116612    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-c5qdr"
Jul 20 09:43:32.240901 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:32.240879    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-c5qdr"]
Jul 20 09:43:32.243253 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:43:32.243224    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb47f919a_ea4f_4583_b0fe_7935f317bcce.slice/crio-8123274bfe3aa26dadbfea722efda964c890e169348c8c01a174ac38b1500963 WatchSource:0}: Error finding container 8123274bfe3aa26dadbfea722efda964c890e169348c8c01a174ac38b1500963: Status 404 returned error can't find the container with id 8123274bfe3aa26dadbfea722efda964c890e169348c8c01a174ac38b1500963
Jul 20 09:43:32.675570 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:32.675537    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-c5qdr" event={"ID":"b47f919a-ea4f-4583-b0fe-7935f317bcce","Type":"ContainerStarted","Data":"8123274bfe3aa26dadbfea722efda964c890e169348c8c01a174ac38b1500963"}
Jul 20 09:43:33.019344 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:33.019267    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:43:33.253390 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:33.253351    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:43:33.503197 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:33.503155    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cw4ft"]
Jul 20 09:43:33.506646 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:33.506619    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cw4ft"
Jul 20 09:43:33.509635 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:33.509589    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-prw6f\""
Jul 20 09:43:33.521782 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:33.521755    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cw4ft"]
Jul 20 09:43:33.605338 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:33.605301    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc4c027f-4344-43d7-b596-64d7a7084096-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cw4ft\" (UID: \"dc4c027f-4344-43d7-b596-64d7a7084096\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cw4ft"
Jul 20 09:43:33.605523 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:33.605370    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsjrq\" (UniqueName: \"kubernetes.io/projected/dc4c027f-4344-43d7-b596-64d7a7084096-kube-api-access-tsjrq\") pod \"cert-manager-cainjector-559cdd8c87-cw4ft\" (UID: \"dc4c027f-4344-43d7-b596-64d7a7084096\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cw4ft"
Jul 20 09:43:33.706853 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:33.706819    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc4c027f-4344-43d7-b596-64d7a7084096-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cw4ft\" (UID: \"dc4c027f-4344-43d7-b596-64d7a7084096\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cw4ft"
Jul 20 09:43:33.707057 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:33.706896    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsjrq\" (UniqueName: \"kubernetes.io/projected/dc4c027f-4344-43d7-b596-64d7a7084096-kube-api-access-tsjrq\") pod \"cert-manager-cainjector-559cdd8c87-cw4ft\" (UID: \"dc4c027f-4344-43d7-b596-64d7a7084096\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cw4ft"
Jul 20 09:43:33.715855 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:33.715827    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc4c027f-4344-43d7-b596-64d7a7084096-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cw4ft\" (UID: \"dc4c027f-4344-43d7-b596-64d7a7084096\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cw4ft"
Jul 20 09:43:33.715984 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:33.715871    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsjrq\" (UniqueName: \"kubernetes.io/projected/dc4c027f-4344-43d7-b596-64d7a7084096-kube-api-access-tsjrq\") pod \"cert-manager-cainjector-559cdd8c87-cw4ft\" (UID: \"dc4c027f-4344-43d7-b596-64d7a7084096\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cw4ft"
Jul 20 09:43:33.820087 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:33.820023    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cw4ft"
Jul 20 09:43:35.479244 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:35.479116    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cw4ft"]
Jul 20 09:43:35.482103 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:43:35.482079    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc4c027f_4344_43d7_b596_64d7a7084096.slice/crio-bb7f24bed8f9733a6d71bac2777a213bca493bb906c900baaa2ecd5c9609c9e4 WatchSource:0}: Error finding container bb7f24bed8f9733a6d71bac2777a213bca493bb906c900baaa2ecd5c9609c9e4: Status 404 returned error can't find the container with id bb7f24bed8f9733a6d71bac2777a213bca493bb906c900baaa2ecd5c9609c9e4
Jul 20 09:43:35.692084 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:35.691986    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-c5qdr" event={"ID":"b47f919a-ea4f-4583-b0fe-7935f317bcce","Type":"ContainerStarted","Data":"13f728cae6007f83479774a30c3f70458c4ef70f02c3f0b97e0d2bb42f2d4aab"}
Jul 20 09:43:35.692084 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:35.692039    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-c5qdr"
Jul 20 09:43:35.693617 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:35.693585    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cw4ft" event={"ID":"dc4c027f-4344-43d7-b596-64d7a7084096","Type":"ContainerStarted","Data":"cdc051da9b64d6f10beed359ddcc4285fe94d61095077f0c4e728d32b1488a52"}
Jul 20 09:43:35.693730 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:35.693626    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cw4ft" event={"ID":"dc4c027f-4344-43d7-b596-64d7a7084096","Type":"ContainerStarted","Data":"bb7f24bed8f9733a6d71bac2777a213bca493bb906c900baaa2ecd5c9609c9e4"}
Jul 20 09:43:35.708152 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:35.708111    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-c5qdr" podStartSLOduration=1.533206895 podStartE2EDuration="4.708096397s" totalImagesPullingTime="3.174889502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:43:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:43:35.706779286 +0000 UTC m=+267.588225607" watchObservedRunningTime="2026-07-20 09:43:35.708096397 +0000 UTC m=+267.589542704"
Jul 20 09:43:35.722871 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:35.722820    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cw4ft" podStartSLOduration=2.722799959 podStartE2EDuration="2.722799959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:43:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:43:35.720624221 +0000 UTC m=+267.602070532" watchObservedRunningTime="2026-07-20 09:43:35.722799959 +0000 UTC m=+267.604246268"
Jul 20 09:43:35.858744 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:35.858711    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:43:35.918358 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:35.918326    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:43:40.228097 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:40.228054    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:43:41.700481 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:41.700446    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-c5qdr"
Jul 20 09:43:42.278659 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:42.278608    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:43:42.379481 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:42.379451    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:43:48.174221 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:48.174184    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:43:49.234786 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:49.234752    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:43:50.598794 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:50.598738    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:43:55.521124 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:55.521091    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:43:55.589944 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:43:55.589913    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:02.883983 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:02.883930    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:02.985863 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:02.985830    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:03.493162 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:03.493134    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:03.798616 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:03.798539    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:03.905419 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:03.905392    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:03.959908 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:03.959880    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-9l42d"]
Jul 20 09:44:03.963378 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:03.963357    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-9l42d"
Jul 20 09:44:03.965728 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:03.965707    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 20 09:44:03.966406 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:03.966388    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6kkln\""
Jul 20 09:44:03.966703 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:03.966687    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 20 09:44:03.966880 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:03.966868    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 20 09:44:03.967319 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:03.967278    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 20 09:44:03.999601 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:03.999579    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-9l42d"]
Jul 20 09:44:04.154528 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:04.154500    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f0fb549f-d2ce-4875-ad55-f315acdd1ddb-webhook-cert\") pod \"opendatahub-operator-controller-manager-bc4dbfcf4-9l42d\" (UID: \"f0fb549f-d2ce-4875-ad55-f315acdd1ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-9l42d"
Jul 20 09:44:04.154668 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:04.154543    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f0fb549f-d2ce-4875-ad55-f315acdd1ddb-manifests\") pod \"opendatahub-operator-controller-manager-bc4dbfcf4-9l42d\" (UID: \"f0fb549f-d2ce-4875-ad55-f315acdd1ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-9l42d"
Jul 20 09:44:04.154668 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:04.154632    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f0fb549f-d2ce-4875-ad55-f315acdd1ddb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bc4dbfcf4-9l42d\" (UID: \"f0fb549f-d2ce-4875-ad55-f315acdd1ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-9l42d"
Jul 20 09:44:04.154739 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:04.154692    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jczgk\" (UniqueName: \"kubernetes.io/projected/f0fb549f-d2ce-4875-ad55-f315acdd1ddb-kube-api-access-jczgk\") pod \"opendatahub-operator-controller-manager-bc4dbfcf4-9l42d\" (UID: \"f0fb549f-d2ce-4875-ad55-f315acdd1ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-9l42d"
Jul 20 09:44:04.154739 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:04.154727    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0fb549f-d2ce-4875-ad55-f315acdd1ddb-tmp\") pod \"opendatahub-operator-controller-manager-bc4dbfcf4-9l42d\" (UID: \"f0fb549f-d2ce-4875-ad55-f315acdd1ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-9l42d"
Jul 20 09:44:04.157335 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:04.157309    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:04.255603 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:04.255561    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f0fb549f-d2ce-4875-ad55-f315acdd1ddb-manifests\") pod \"opendatahub-operator-controller-manager-bc4dbfcf4-9l42d\" (UID: \"f0fb549f-d2ce-4875-ad55-f315acdd1ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-9l42d"
Jul 20 09:44:04.255603 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:04.255604    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f0fb549f-d2ce-4875-ad55-f315acdd1ddb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bc4dbfcf4-9l42d\" (UID: \"f0fb549f-d2ce-4875-ad55-f315acdd1ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-9l42d"
Jul 20 09:44:04.255910 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:04.255640    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jczgk\" (UniqueName: \"kubernetes.io/projected/f0fb549f-d2ce-4875-ad55-f315acdd1ddb-kube-api-access-jczgk\") pod \"opendatahub-operator-controller-manager-bc4dbfcf4-9l42d\" (UID: \"f0fb549f-d2ce-4875-ad55-f315acdd1ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-9l42d"
Jul 20 09:44:04.255910 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:04.255669    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0fb549f-d2ce-4875-ad55-f315acdd1ddb-tmp\") pod \"opendatahub-operator-controller-manager-bc4dbfcf4-9l42d\" (UID: \"f0fb549f-d2ce-4875-ad55-f315acdd1ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-9l42d"
Jul 20 09:44:04.255910 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:04.255717    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f0fb549f-d2ce-4875-ad55-f315acdd1ddb-webhook-cert\") pod \"opendatahub-operator-controller-manager-bc4dbfcf4-9l42d\" (UID: \"f0fb549f-d2ce-4875-ad55-f315acdd1ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-9l42d"
Jul 20 09:44:04.256190 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:04.256073    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f0fb549f-d2ce-4875-ad55-f315acdd1ddb-manifests\") pod \"opendatahub-operator-controller-manager-bc4dbfcf4-9l42d\" (UID: \"f0fb549f-d2ce-4875-ad55-f315acdd1ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-9l42d"
Jul 20 09:44:04.258436 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:04.258401    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0fb549f-d2ce-4875-ad55-f315acdd1ddb-tmp\") pod \"opendatahub-operator-controller-manager-bc4dbfcf4-9l42d\" (UID: \"f0fb549f-d2ce-4875-ad55-f315acdd1ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-9l42d"
Jul 20 09:44:04.258782 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:04.258608    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f0fb549f-d2ce-4875-ad55-f315acdd1ddb-webhook-cert\") pod \"opendatahub-operator-controller-manager-bc4dbfcf4-9l42d\" (UID: \"f0fb549f-d2ce-4875-ad55-f315acdd1ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-9l42d"
Jul 20 09:44:04.258782 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:04.258650    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f0fb549f-d2ce-4875-ad55-f315acdd1ddb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bc4dbfcf4-9l42d\" (UID: \"f0fb549f-d2ce-4875-ad55-f315acdd1ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-9l42d"
Jul 20 09:44:04.259621 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:04.259594    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:04.273943 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:04.273918    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jczgk\" (UniqueName: \"kubernetes.io/projected/f0fb549f-d2ce-4875-ad55-f315acdd1ddb-kube-api-access-jczgk\") pod \"opendatahub-operator-controller-manager-bc4dbfcf4-9l42d\" (UID: \"f0fb549f-d2ce-4875-ad55-f315acdd1ddb\") " pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-9l42d"
Jul 20 09:44:04.278671 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:04.278640    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-9l42d"
Jul 20 09:44:04.352062 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:04.352035    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:04.418029 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:04.417937    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-9l42d"]
Jul 20 09:44:04.421831 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:44:04.421798    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0fb549f_d2ce_4875_ad55_f315acdd1ddb.slice/crio-78fb760ab85f540824c3c8b21a14781c0b4c9919b0a5348381775c9f9eee4e49 WatchSource:0}: Error finding container 78fb760ab85f540824c3c8b21a14781c0b4c9919b0a5348381775c9f9eee4e49: Status 404 returned error can't find the container with id 78fb760ab85f540824c3c8b21a14781c0b4c9919b0a5348381775c9f9eee4e49
Jul 20 09:44:04.455166 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:04.455142    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:04.551847 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:04.551823    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:04.652320 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:04.652297    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:04.753708 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:04.753653    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:04.810059 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:04.810033    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-9l42d" event={"ID":"f0fb549f-d2ce-4875-ad55-f315acdd1ddb","Type":"ContainerStarted","Data":"78fb760ab85f540824c3c8b21a14781c0b4c9919b0a5348381775c9f9eee4e49"}
Jul 20 09:44:07.826457 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:07.826368    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-9l42d" event={"ID":"f0fb549f-d2ce-4875-ad55-f315acdd1ddb","Type":"ContainerStarted","Data":"5878eebd046986033c3c2db68f4f6c7e1eb34088ea440d96709dba7d7d23b829"}
Jul 20 09:44:08.563218 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:08.563194    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rgb4r_d6c73ac6-85c5-4b3f-aa58-71ac88099c0a/ovn-acl-logging/0.log"
Jul 20 09:44:08.567030 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:08.567008    2581 kubelet.go:1648] "Image garbage collection succeeded"
Jul 20 09:44:08.567548 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:08.567530    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rgb4r_d6c73ac6-85c5-4b3f-aa58-71ac88099c0a/ovn-acl-logging/0.log"
Jul 20 09:44:08.831954 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:08.831786    2581 generic.go:356] "Generic (PLEG): container finished" podID="f0fb549f-d2ce-4875-ad55-f315acdd1ddb" containerID="5878eebd046986033c3c2db68f4f6c7e1eb34088ea440d96709dba7d7d23b829" exitCode=0
Jul 20 09:44:08.831954 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:08.831859    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-9l42d" event={"ID":"f0fb549f-d2ce-4875-ad55-f315acdd1ddb","Type":"ContainerDied","Data":"5878eebd046986033c3c2db68f4f6c7e1eb34088ea440d96709dba7d7d23b829"}
Jul 20 09:44:09.838794 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:09.838691    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-9l42d" event={"ID":"f0fb549f-d2ce-4875-ad55-f315acdd1ddb","Type":"ContainerStarted","Data":"36b58552cfa34d2362bd352c6ee7f51a864cc15428eddc716cfd890af752b248"}
Jul 20 09:44:09.838794 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:09.838779    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-9l42d"
Jul 20 09:44:09.869333 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:09.869281    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-9l42d" podStartSLOduration=2.300641854 podStartE2EDuration="6.869263997s" totalImagesPullingTime="3.494996462s" totalInitContainerRuntime="1.073625681s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:44:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:44:09.865885968 +0000 UTC m=+301.747332284" watchObservedRunningTime="2026-07-20 09:44:09.869263997 +0000 UTC m=+301.750710304"
Jul 20 09:44:15.088788 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:15.088757    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:15.191924 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:15.191895    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:17.085542 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:17.085515    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:17.219125 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:17.219092    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:20.846393 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:20.846360    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bc4dbfcf4-9l42d"
Jul 20 09:44:23.292930 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:23.292899    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:23.389645 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:23.389610    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d9fcc6574-v7kmp"]
Jul 20 09:44:23.398691 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:23.398663    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-v7kmp"
Jul 20 09:44:23.403859 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:23.403836    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d9fcc6574-v7kmp"]
Jul 20 09:44:23.412455 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:23.412105    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-x46x7\""
Jul 20 09:44:23.412455 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:23.412106    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 20 09:44:23.412786 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:23.412757    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 20 09:44:23.413102 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:23.412981    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 20 09:44:23.413102 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:23.412988    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 20 09:44:23.413312 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:23.413292    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 20 09:44:23.488187 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:23.488155    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:23.519715 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:23.519685    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fde56948-1449-4eb3-a401-2782c4bd1adb-metrics-cert\") pod \"lws-controller-manager-6d9fcc6574-v7kmp\" (UID: \"fde56948-1449-4eb3-a401-2782c4bd1adb\") " pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-v7kmp"
Jul 20 09:44:23.519861 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:23.519734    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fde56948-1449-4eb3-a401-2782c4bd1adb-cert\") pod \"lws-controller-manager-6d9fcc6574-v7kmp\" (UID: \"fde56948-1449-4eb3-a401-2782c4bd1adb\") " pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-v7kmp"
Jul 20 09:44:23.519861 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:23.519756    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fde56948-1449-4eb3-a401-2782c4bd1adb-manager-config\") pod \"lws-controller-manager-6d9fcc6574-v7kmp\" (UID: \"fde56948-1449-4eb3-a401-2782c4bd1adb\") " pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-v7kmp"
Jul 20 09:44:23.519861 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:23.519776    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmft4\" (UniqueName: \"kubernetes.io/projected/fde56948-1449-4eb3-a401-2782c4bd1adb-kube-api-access-jmft4\") pod \"lws-controller-manager-6d9fcc6574-v7kmp\" (UID: \"fde56948-1449-4eb3-a401-2782c4bd1adb\") " pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-v7kmp"
Jul 20 09:44:23.621080 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:23.621048    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fde56948-1449-4eb3-a401-2782c4bd1adb-metrics-cert\") pod \"lws-controller-manager-6d9fcc6574-v7kmp\" (UID: \"fde56948-1449-4eb3-a401-2782c4bd1adb\") " pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-v7kmp"
Jul 20 09:44:23.621243 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:23.621107    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fde56948-1449-4eb3-a401-2782c4bd1adb-cert\") pod \"lws-controller-manager-6d9fcc6574-v7kmp\" (UID: \"fde56948-1449-4eb3-a401-2782c4bd1adb\") " pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-v7kmp"
Jul 20 09:44:23.621243 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:23.621143    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fde56948-1449-4eb3-a401-2782c4bd1adb-manager-config\") pod \"lws-controller-manager-6d9fcc6574-v7kmp\" (UID: \"fde56948-1449-4eb3-a401-2782c4bd1adb\") " pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-v7kmp"
Jul 20 09:44:23.621243 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:23.621171    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmft4\" (UniqueName: \"kubernetes.io/projected/fde56948-1449-4eb3-a401-2782c4bd1adb-kube-api-access-jmft4\") pod \"lws-controller-manager-6d9fcc6574-v7kmp\" (UID: \"fde56948-1449-4eb3-a401-2782c4bd1adb\") " pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-v7kmp"
Jul 20 09:44:23.622012 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:23.621981    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fde56948-1449-4eb3-a401-2782c4bd1adb-manager-config\") pod \"lws-controller-manager-6d9fcc6574-v7kmp\" (UID: \"fde56948-1449-4eb3-a401-2782c4bd1adb\") " pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-v7kmp"
Jul 20 09:44:23.623735 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:23.623703    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fde56948-1449-4eb3-a401-2782c4bd1adb-cert\") pod \"lws-controller-manager-6d9fcc6574-v7kmp\" (UID: \"fde56948-1449-4eb3-a401-2782c4bd1adb\") " pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-v7kmp"
Jul 20 09:44:23.623845 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:23.623783    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fde56948-1449-4eb3-a401-2782c4bd1adb-metrics-cert\") pod \"lws-controller-manager-6d9fcc6574-v7kmp\" (UID: \"fde56948-1449-4eb3-a401-2782c4bd1adb\") " pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-v7kmp"
Jul 20 09:44:23.646238 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:23.646217    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmft4\" (UniqueName: \"kubernetes.io/projected/fde56948-1449-4eb3-a401-2782c4bd1adb-kube-api-access-jmft4\") pod \"lws-controller-manager-6d9fcc6574-v7kmp\" (UID: \"fde56948-1449-4eb3-a401-2782c4bd1adb\") " pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-v7kmp"
Jul 20 09:44:23.710907 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:23.710880    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-v7kmp"
Jul 20 09:44:23.852602 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:23.852568    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d9fcc6574-v7kmp"]
Jul 20 09:44:23.855652 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:44:23.855623    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfde56948_1449_4eb3_a401_2782c4bd1adb.slice/crio-e346b56366b0fd3fd06ffbcc1dda8077bf2c71bfd99e514e2bad53333f87e806 WatchSource:0}: Error finding container e346b56366b0fd3fd06ffbcc1dda8077bf2c71bfd99e514e2bad53333f87e806: Status 404 returned error can't find the container with id e346b56366b0fd3fd06ffbcc1dda8077bf2c71bfd99e514e2bad53333f87e806
Jul 20 09:44:23.857799 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:23.857781    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 09:44:23.901534 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:23.901470    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-v7kmp" event={"ID":"fde56948-1449-4eb3-a401-2782c4bd1adb","Type":"ContainerStarted","Data":"e346b56366b0fd3fd06ffbcc1dda8077bf2c71bfd99e514e2bad53333f87e806"}
Jul 20 09:44:23.951697 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:23.951670    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:24.064349 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:24.064311    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7b6cfc896b-l2tmx"]
Jul 20 09:44:24.073073 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:24.073045    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7b6cfc896b-l2tmx"
Jul 20 09:44:24.076398 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:24.076350    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 20 09:44:24.076785 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:24.076755    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 20 09:44:24.076883 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:24.076865    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 20 09:44:24.076945 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:24.076880    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-cksps\""
Jul 20 09:44:24.082610 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:24.082594    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 20 09:44:24.091099 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:24.091079    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7b6cfc896b-l2tmx"]
Jul 20 09:44:24.125973 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:24.125928    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/885575b4-da20-4d53-9914-456331abe1a2-tmp\") pod \"kube-auth-proxy-7b6cfc896b-l2tmx\" (UID: \"885575b4-da20-4d53-9914-456331abe1a2\") " pod="openshift-ingress/kube-auth-proxy-7b6cfc896b-l2tmx"
Jul 20 09:44:24.126080 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:24.126014    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/885575b4-da20-4d53-9914-456331abe1a2-tls-certs\") pod \"kube-auth-proxy-7b6cfc896b-l2tmx\" (UID: \"885575b4-da20-4d53-9914-456331abe1a2\") " pod="openshift-ingress/kube-auth-proxy-7b6cfc896b-l2tmx"
Jul 20 09:44:24.126080 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:24.126048    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkb7h\" (UniqueName: \"kubernetes.io/projected/885575b4-da20-4d53-9914-456331abe1a2-kube-api-access-gkb7h\") pod \"kube-auth-proxy-7b6cfc896b-l2tmx\" (UID: \"885575b4-da20-4d53-9914-456331abe1a2\") " pod="openshift-ingress/kube-auth-proxy-7b6cfc896b-l2tmx"
Jul 20 09:44:24.137299 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:24.137268    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:24.226892 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:24.226812    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkb7h\" (UniqueName: \"kubernetes.io/projected/885575b4-da20-4d53-9914-456331abe1a2-kube-api-access-gkb7h\") pod \"kube-auth-proxy-7b6cfc896b-l2tmx\" (UID: \"885575b4-da20-4d53-9914-456331abe1a2\") " pod="openshift-ingress/kube-auth-proxy-7b6cfc896b-l2tmx"
Jul 20 09:44:24.226892 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:24.226880    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/885575b4-da20-4d53-9914-456331abe1a2-tmp\") pod \"kube-auth-proxy-7b6cfc896b-l2tmx\" (UID: \"885575b4-da20-4d53-9914-456331abe1a2\") " pod="openshift-ingress/kube-auth-proxy-7b6cfc896b-l2tmx"
Jul 20 09:44:24.227138 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:24.226977    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/885575b4-da20-4d53-9914-456331abe1a2-tls-certs\") pod \"kube-auth-proxy-7b6cfc896b-l2tmx\" (UID: \"885575b4-da20-4d53-9914-456331abe1a2\") " pod="openshift-ingress/kube-auth-proxy-7b6cfc896b-l2tmx"
Jul 20 09:44:24.229189 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:24.229165    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/885575b4-da20-4d53-9914-456331abe1a2-tmp\") pod \"kube-auth-proxy-7b6cfc896b-l2tmx\" (UID: \"885575b4-da20-4d53-9914-456331abe1a2\") " pod="openshift-ingress/kube-auth-proxy-7b6cfc896b-l2tmx"
Jul 20 09:44:24.229408 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:24.229389    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/885575b4-da20-4d53-9914-456331abe1a2-tls-certs\") pod \"kube-auth-proxy-7b6cfc896b-l2tmx\" (UID: \"885575b4-da20-4d53-9914-456331abe1a2\") " pod="openshift-ingress/kube-auth-proxy-7b6cfc896b-l2tmx"
Jul 20 09:44:24.238141 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:24.238112    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkb7h\" (UniqueName: \"kubernetes.io/projected/885575b4-da20-4d53-9914-456331abe1a2-kube-api-access-gkb7h\") pod \"kube-auth-proxy-7b6cfc896b-l2tmx\" (UID: \"885575b4-da20-4d53-9914-456331abe1a2\") " pod="openshift-ingress/kube-auth-proxy-7b6cfc896b-l2tmx"
Jul 20 09:44:24.383817 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:24.383782    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7b6cfc896b-l2tmx"
Jul 20 09:44:24.442235 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:24.442203    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:24.527534 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:24.527459    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7b6cfc896b-l2tmx"]
Jul 20 09:44:24.531087 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:24.531054    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:24.532716 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:44:24.532688    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod885575b4_da20_4d53_9914_456331abe1a2.slice/crio-cf2f4cb7cf5321df428854ea14a1ff305d330f05bcbdb5564fecae64e272349b WatchSource:0}: Error finding container cf2f4cb7cf5321df428854ea14a1ff305d330f05bcbdb5564fecae64e272349b: Status 404 returned error can't find the container with id cf2f4cb7cf5321df428854ea14a1ff305d330f05bcbdb5564fecae64e272349b
Jul 20 09:44:24.608853 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:24.608821    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:24.822405 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:24.822286    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:24.909068 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:24.909028    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7b6cfc896b-l2tmx" event={"ID":"885575b4-da20-4d53-9914-456331abe1a2","Type":"ContainerStarted","Data":"cf2f4cb7cf5321df428854ea14a1ff305d330f05bcbdb5564fecae64e272349b"}
Jul 20 09:44:25.366127 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:25.366087    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:25.639019 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:25.638931    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:25.735454 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:25.735407    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:25.825147 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:25.825079    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:26.877975 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:26.877938    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:27.927589 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:27.927551    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-v7kmp" event={"ID":"fde56948-1449-4eb3-a401-2782c4bd1adb","Type":"ContainerStarted","Data":"4d8c83c6f0e44b41cb0f6d4cb23d0145228e3a3e6c2d94885358ec395f49035a"}
Jul 20 09:44:27.928099 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:27.927616    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-v7kmp"
Jul 20 09:44:27.929148 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:27.929121    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7b6cfc896b-l2tmx" event={"ID":"885575b4-da20-4d53-9914-456331abe1a2","Type":"ContainerStarted","Data":"93e064a39e8d4fc95be493628a1ab682223df1c74611171ac6e6c0654cef1416"}
Jul 20 09:44:27.948850 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:27.948807    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-v7kmp" podStartSLOduration=1.4912408529999999 podStartE2EDuration="4.948794388s" totalImagesPullingTime="3.457553535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:44:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:44:27.946385961 +0000 UTC m=+319.827832269" watchObservedRunningTime="2026-07-20 09:44:27.948794388 +0000 UTC m=+319.830240696"
Jul 20 09:44:27.964208 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:27.964165    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7b6cfc896b-l2tmx" podStartSLOduration=1.181807569 podStartE2EDuration="3.964151098s" totalImagesPullingTime="2.782343529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:44:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:44:27.962767945 +0000 UTC m=+319.844214254" watchObservedRunningTime="2026-07-20 09:44:27.964151098 +0000 UTC m=+319.845597411"
Jul 20 09:44:30.321956 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:30.321923    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:30.419839 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:30.419801    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:30.701152 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:30.701106    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:30.802530 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:30.802491    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:31.645081 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:31.645047    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:31.947390 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:31.947274    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:32.063613 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:32.063568    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:32.511271 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:32.511234    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:32.617983 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:32.617937    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:35.439750 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:35.439720    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:35.558203 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:35.558173    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:36.016313 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:36.016284    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:36.205362 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:36.205334    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:36.876996 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:36.876937    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:36.999988 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:36.999936    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:44:38.937035 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:44:38.937007    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6d9fcc6574-v7kmp"
Jul 20 09:45:05.643804 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:45:05.643768    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:45:24.802382 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:45:24.802329    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:45:24.910032 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:45:24.910002    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:45:25.011510 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:45:25.011475    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:45:25.722534 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:45:25.722495    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:45:25.923483 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:45:25.923434    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:45:53.870768 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:45:53.870736    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:45:57.299001 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:45:57.298948    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:45:58.142508 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:45:58.142460    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:01.286387 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:01.286332    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:01.777451 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:01.777423    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:01.880806 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:01.880775    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:03.695941 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:03.695910    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:04.944599 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:04.944563    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:06.288326 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:06.288294    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:06.590332 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:06.590253    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:09.263687 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:09.263655    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:09.365337 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:09.365306    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:14.008048 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:14.008015    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:14.174245 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:14.174215    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:14.655239 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:14.655205    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:14.761816 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:14.761788    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:15.066381 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:15.066303    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:15.184768 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:15.184744    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:18.750226 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:18.750191    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:18.851222 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:18.851194    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:24.289493 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:24.289463    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-792ld"]
Jul 20 09:46:24.292430 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:24.292411    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-792ld"
Jul 20 09:46:24.296822 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:24.296805    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 20 09:46:24.297730 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:24.297712    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 20 09:46:24.297988 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:24.297955    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-xctf2\""
Jul 20 09:46:24.307817 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:24.307770    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-792ld"]
Jul 20 09:46:24.417754 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:24.417728    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5vzw\" (UniqueName: \"kubernetes.io/projected/37743e17-b50f-449a-8c3e-d2d88ce2a9f5-kube-api-access-h5vzw\") pod \"kuadrant-operator-controller-manager-55467d9f7-792ld\" (UID: \"37743e17-b50f-449a-8c3e-d2d88ce2a9f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-792ld"
Jul 20 09:46:24.417882 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:24.417766    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37743e17-b50f-449a-8c3e-d2d88ce2a9f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-792ld\" (UID: \"37743e17-b50f-449a-8c3e-d2d88ce2a9f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-792ld"
Jul 20 09:46:24.518580 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:24.518539    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5vzw\" (UniqueName: \"kubernetes.io/projected/37743e17-b50f-449a-8c3e-d2d88ce2a9f5-kube-api-access-h5vzw\") pod \"kuadrant-operator-controller-manager-55467d9f7-792ld\" (UID: \"37743e17-b50f-449a-8c3e-d2d88ce2a9f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-792ld"
Jul 20 09:46:24.518726 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:24.518588    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37743e17-b50f-449a-8c3e-d2d88ce2a9f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-792ld\" (UID: \"37743e17-b50f-449a-8c3e-d2d88ce2a9f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-792ld"
Jul 20 09:46:24.518928 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:24.518911    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37743e17-b50f-449a-8c3e-d2d88ce2a9f5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-792ld\" (UID: \"37743e17-b50f-449a-8c3e-d2d88ce2a9f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-792ld"
Jul 20 09:46:24.530136 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:24.530112    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5vzw\" (UniqueName: \"kubernetes.io/projected/37743e17-b50f-449a-8c3e-d2d88ce2a9f5-kube-api-access-h5vzw\") pod \"kuadrant-operator-controller-manager-55467d9f7-792ld\" (UID: \"37743e17-b50f-449a-8c3e-d2d88ce2a9f5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-792ld"
Jul 20 09:46:24.575951 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:24.575894    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-792ld"]
Jul 20 09:46:24.576247 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:24.576233    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-792ld"
Jul 20 09:46:24.580256 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:24.580236    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-792ld"]
Jul 20 09:46:24.607539 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:24.607513    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qr747"]
Jul 20 09:46:24.611070 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:24.611042    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qr747"
Jul 20 09:46:24.629006 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:24.628981    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qr747"]
Jul 20 09:46:24.720060 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:24.720024    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtmkl\" (UniqueName: \"kubernetes.io/projected/ed702667-8b8c-49c3-844b-27931fc9b502-kube-api-access-rtmkl\") pod \"kuadrant-operator-controller-manager-55467d9f7-qr747\" (UID: \"ed702667-8b8c-49c3-844b-27931fc9b502\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qr747"
Jul 20 09:46:24.720227 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:24.720073    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed702667-8b8c-49c3-844b-27931fc9b502-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-qr747\" (UID: \"ed702667-8b8c-49c3-844b-27931fc9b502\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qr747"
Jul 20 09:46:24.820922 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:24.820899    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtmkl\" (UniqueName: \"kubernetes.io/projected/ed702667-8b8c-49c3-844b-27931fc9b502-kube-api-access-rtmkl\") pod \"kuadrant-operator-controller-manager-55467d9f7-qr747\" (UID: \"ed702667-8b8c-49c3-844b-27931fc9b502\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qr747"
Jul 20 09:46:24.821070 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:24.820936    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed702667-8b8c-49c3-844b-27931fc9b502-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-qr747\" (UID: \"ed702667-8b8c-49c3-844b-27931fc9b502\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qr747"
Jul 20 09:46:24.821266 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:24.821248    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed702667-8b8c-49c3-844b-27931fc9b502-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-qr747\" (UID: \"ed702667-8b8c-49c3-844b-27931fc9b502\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qr747"
Jul 20 09:46:24.829663 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:24.829605    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtmkl\" (UniqueName: \"kubernetes.io/projected/ed702667-8b8c-49c3-844b-27931fc9b502-kube-api-access-rtmkl\") pod \"kuadrant-operator-controller-manager-55467d9f7-qr747\" (UID: \"ed702667-8b8c-49c3-844b-27931fc9b502\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qr747"
Jul 20 09:46:24.923715 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:24.923675    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qr747"
Jul 20 09:46:25.063246 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:25.063224    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qr747"]
Jul 20 09:46:25.064844 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:46:25.064814    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded702667_8b8c_49c3_844b_27931fc9b502.slice/crio-998ce17f8b8ab5ca5b5417024d3db6967d7716747a50b0e320072426c7c9cea9 WatchSource:0}: Error finding container 998ce17f8b8ab5ca5b5417024d3db6967d7716747a50b0e320072426c7c9cea9: Status 404 returned error can't find the container with id 998ce17f8b8ab5ca5b5417024d3db6967d7716747a50b0e320072426c7c9cea9
Jul 20 09:46:25.464771 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:25.464738    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qr747" event={"ID":"ed702667-8b8c-49c3-844b-27931fc9b502","Type":"ContainerStarted","Data":"998ce17f8b8ab5ca5b5417024d3db6967d7716747a50b0e320072426c7c9cea9"}
Jul 20 09:46:25.471864 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:25.471841    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:25.688019 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:25.687958    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:27.118471 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:46:27.118423    2581 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-792ld_kuadrant-system_37743e17-b50f-449a-8c3e-d2d88ce2a9f5_0(b44751f235db1787349995ee88b5993d67745258d4af5877091d8a57c1036e0d): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-792ld to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 20 09:46:27.118735 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:46:27.118503    2581 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-792ld_kuadrant-system_37743e17-b50f-449a-8c3e-d2d88ce2a9f5_0(b44751f235db1787349995ee88b5993d67745258d4af5877091d8a57c1036e0d): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-792ld to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-792ld"
Jul 20 09:46:27.468292 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:27.468214    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-792ld"
Jul 20 09:46:27.475035 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:27.475012    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-792ld"
Jul 20 09:46:27.478160 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:46:27.478133    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-792ld\" is forbidden: User \"system:node:ip-10-0-140-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-236.ec2.internal' and this object" podUID="37743e17-b50f-449a-8c3e-d2d88ce2a9f5" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-792ld"
Jul 20 09:46:27.547225 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:27.547192    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37743e17-b50f-449a-8c3e-d2d88ce2a9f5-extensions-socket-volume\") pod \"37743e17-b50f-449a-8c3e-d2d88ce2a9f5\" (UID: \"37743e17-b50f-449a-8c3e-d2d88ce2a9f5\") "
Jul 20 09:46:27.547350 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:27.547323    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5vzw\" (UniqueName: \"kubernetes.io/projected/37743e17-b50f-449a-8c3e-d2d88ce2a9f5-kube-api-access-h5vzw\") pod \"37743e17-b50f-449a-8c3e-d2d88ce2a9f5\" (UID: \"37743e17-b50f-449a-8c3e-d2d88ce2a9f5\") "
Jul 20 09:46:27.547506 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:27.547464    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37743e17-b50f-449a-8c3e-d2d88ce2a9f5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "37743e17-b50f-449a-8c3e-d2d88ce2a9f5" (UID: "37743e17-b50f-449a-8c3e-d2d88ce2a9f5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 09:46:27.547644 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:27.547625    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37743e17-b50f-449a-8c3e-d2d88ce2a9f5-extensions-socket-volume\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 09:46:27.549797 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:27.549773    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37743e17-b50f-449a-8c3e-d2d88ce2a9f5-kube-api-access-h5vzw" (OuterVolumeSpecName: "kube-api-access-h5vzw") pod "37743e17-b50f-449a-8c3e-d2d88ce2a9f5" (UID: "37743e17-b50f-449a-8c3e-d2d88ce2a9f5"). InnerVolumeSpecName "kube-api-access-h5vzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 09:46:27.648287 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:27.648255    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5vzw\" (UniqueName: \"kubernetes.io/projected/37743e17-b50f-449a-8c3e-d2d88ce2a9f5-kube-api-access-h5vzw\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 09:46:27.883343 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:27.883300    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:27.989143 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:27.989116    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:28.473587 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:28.473550    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-792ld"
Jul 20 09:46:28.475824 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:46:28.475789    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-792ld\" is forbidden: User \"system:node:ip-10-0-140-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-236.ec2.internal' and this object" podUID="37743e17-b50f-449a-8c3e-d2d88ce2a9f5" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-792ld"
Jul 20 09:46:28.483497 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:46:28.483471    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-792ld\" is forbidden: User \"system:node:ip-10-0-140-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-236.ec2.internal' and this object" podUID="37743e17-b50f-449a-8c3e-d2d88ce2a9f5" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-792ld"
Jul 20 09:46:29.466793 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:46:29.463518    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-792ld\" is forbidden: User \"system:node:ip-10-0-140-236.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-236.ec2.internal' and this object" podUID="37743e17-b50f-449a-8c3e-d2d88ce2a9f5" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-792ld"
Jul 20 09:46:29.471925 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:29.471893    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37743e17-b50f-449a-8c3e-d2d88ce2a9f5" path="/var/lib/kubelet/pods/37743e17-b50f-449a-8c3e-d2d88ce2a9f5/volumes"
Jul 20 09:46:30.485530 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:30.485455    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qr747" event={"ID":"ed702667-8b8c-49c3-844b-27931fc9b502","Type":"ContainerStarted","Data":"0ac53d69f099915c68ec9d4c1d0cb00ee85264ec7aad4d85466b68cce35b3238"}
Jul 20 09:46:30.485876 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:30.485570    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qr747"
Jul 20 09:46:30.516896 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:30.516843    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qr747" podStartSLOduration=2.16976454 podStartE2EDuration="6.516827151s" totalImagesPullingTime="4.347062611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:46:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:46:30.516626796 +0000 UTC m=+442.398073152" watchObservedRunningTime="2026-07-20 09:46:30.516827151 +0000 UTC m=+442.398273459"
Jul 20 09:46:33.272515 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:33.272481    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:33.371779 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:33.371743    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:33.846401 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:33.846367    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:33.911489 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:33.911463    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:37.513979 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:37.513934    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:37.631983 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:37.631933    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:41.492265 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:41.492237    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qr747"
Jul 20 09:46:41.850655 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:41.850625    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:42.794859 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:42.794829    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:42.897536 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:42.897512    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:45.267494 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:45.267461    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:45.370953 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:45.370921    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:53.678841 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:53.678805    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:54.001213 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:54.001125    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qr747"]
Jul 20 09:46:54.001455 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:54.001400    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qr747" podUID="ed702667-8b8c-49c3-844b-27931fc9b502" containerName="manager" containerID="cri-o://0ac53d69f099915c68ec9d4c1d0cb00ee85264ec7aad4d85466b68cce35b3238" gracePeriod=10
Jul 20 09:46:54.254131 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:54.254079    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qr747"
Jul 20 09:46:54.360048 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:54.360021    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed702667-8b8c-49c3-844b-27931fc9b502-extensions-socket-volume\") pod \"ed702667-8b8c-49c3-844b-27931fc9b502\" (UID: \"ed702667-8b8c-49c3-844b-27931fc9b502\") "
Jul 20 09:46:54.360211 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:54.360063    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtmkl\" (UniqueName: \"kubernetes.io/projected/ed702667-8b8c-49c3-844b-27931fc9b502-kube-api-access-rtmkl\") pod \"ed702667-8b8c-49c3-844b-27931fc9b502\" (UID: \"ed702667-8b8c-49c3-844b-27931fc9b502\") "
Jul 20 09:46:54.360485 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:54.360452    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed702667-8b8c-49c3-844b-27931fc9b502-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ed702667-8b8c-49c3-844b-27931fc9b502" (UID: "ed702667-8b8c-49c3-844b-27931fc9b502"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 09:46:54.362205 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:54.362180    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed702667-8b8c-49c3-844b-27931fc9b502-kube-api-access-rtmkl" (OuterVolumeSpecName: "kube-api-access-rtmkl") pod "ed702667-8b8c-49c3-844b-27931fc9b502" (UID: "ed702667-8b8c-49c3-844b-27931fc9b502"). InnerVolumeSpecName "kube-api-access-rtmkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 09:46:54.460866 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:54.460834    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed702667-8b8c-49c3-844b-27931fc9b502-extensions-socket-volume\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 09:46:54.460866 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:54.460861    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtmkl\" (UniqueName: \"kubernetes.io/projected/ed702667-8b8c-49c3-844b-27931fc9b502-kube-api-access-rtmkl\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 09:46:54.593661 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:54.593575    2581 generic.go:356] "Generic (PLEG): container finished" podID="ed702667-8b8c-49c3-844b-27931fc9b502" containerID="0ac53d69f099915c68ec9d4c1d0cb00ee85264ec7aad4d85466b68cce35b3238" exitCode=0
Jul 20 09:46:54.593661 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:54.593626    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qr747"
Jul 20 09:46:54.593863 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:54.593658    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qr747" event={"ID":"ed702667-8b8c-49c3-844b-27931fc9b502","Type":"ContainerDied","Data":"0ac53d69f099915c68ec9d4c1d0cb00ee85264ec7aad4d85466b68cce35b3238"}
Jul 20 09:46:54.593863 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:54.593709    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qr747" event={"ID":"ed702667-8b8c-49c3-844b-27931fc9b502","Type":"ContainerDied","Data":"998ce17f8b8ab5ca5b5417024d3db6967d7716747a50b0e320072426c7c9cea9"}
Jul 20 09:46:54.593863 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:54.593732    2581 scope.go:117] "RemoveContainer" containerID="0ac53d69f099915c68ec9d4c1d0cb00ee85264ec7aad4d85466b68cce35b3238"
Jul 20 09:46:54.602261 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:54.602246    2581 scope.go:117] "RemoveContainer" containerID="0ac53d69f099915c68ec9d4c1d0cb00ee85264ec7aad4d85466b68cce35b3238"
Jul 20 09:46:54.602521 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:46:54.602503    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ac53d69f099915c68ec9d4c1d0cb00ee85264ec7aad4d85466b68cce35b3238\": container with ID starting with 0ac53d69f099915c68ec9d4c1d0cb00ee85264ec7aad4d85466b68cce35b3238 not found: ID does not exist" containerID="0ac53d69f099915c68ec9d4c1d0cb00ee85264ec7aad4d85466b68cce35b3238"
Jul 20 09:46:54.602567 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:54.602528    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ac53d69f099915c68ec9d4c1d0cb00ee85264ec7aad4d85466b68cce35b3238"} err="failed to get container status \"0ac53d69f099915c68ec9d4c1d0cb00ee85264ec7aad4d85466b68cce35b3238\": rpc error: code = NotFound desc = could not find container \"0ac53d69f099915c68ec9d4c1d0cb00ee85264ec7aad4d85466b68cce35b3238\": container with ID starting with 0ac53d69f099915c68ec9d4c1d0cb00ee85264ec7aad4d85466b68cce35b3238 not found: ID does not exist"
Jul 20 09:46:54.616666 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:54.616645    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qr747"]
Jul 20 09:46:54.620975 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:54.620949    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-qr747"]
Jul 20 09:46:55.463870 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:55.463825    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed702667-8b8c-49c3-844b-27931fc9b502" path="/var/lib/kubelet/pods/ed702667-8b8c-49c3-844b-27931fc9b502/volumes"
Jul 20 09:46:58.078623 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:58.078594    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:46:58.344315 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:46:58.344245    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:47:12.167300 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:12.167263    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ps89s"]
Jul 20 09:47:12.167803 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:12.167791    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed702667-8b8c-49c3-844b-27931fc9b502" containerName="manager"
Jul 20 09:47:12.167874 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:12.167811    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed702667-8b8c-49c3-844b-27931fc9b502" containerName="manager"
Jul 20 09:47:12.167942 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:12.167919    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed702667-8b8c-49c3-844b-27931fc9b502" containerName="manager"
Jul 20 09:47:12.175203 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:12.175171    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ps89s"
Jul 20 09:47:12.178370 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:12.178344    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 20 09:47:12.178871 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:12.178849    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 20 09:47:12.179156 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:12.179138    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6tgfg\""
Jul 20 09:47:12.179272 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:12.179177    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 20 09:47:12.180095 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:12.180076    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ps89s"]
Jul 20 09:47:12.200229 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:12.200209    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:47:12.207460 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:12.207438    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46nzq\" (UniqueName: \"kubernetes.io/projected/c184c1e6-5202-417d-b0a7-cbbec667ffd2-kube-api-access-46nzq\") pod \"limitador-limitador-64c94fd64f-ps89s\" (UID: \"c184c1e6-5202-417d-b0a7-cbbec667ffd2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ps89s"
Jul 20 09:47:12.207545 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:12.207534    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c184c1e6-5202-417d-b0a7-cbbec667ffd2-config-file\") pod \"limitador-limitador-64c94fd64f-ps89s\" (UID: \"c184c1e6-5202-417d-b0a7-cbbec667ffd2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ps89s"
Jul 20 09:47:12.263516 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:12.263488    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ps89s"]
Jul 20 09:47:12.267366 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:12.267337    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:47:12.308624 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:12.308599    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46nzq\" (UniqueName: \"kubernetes.io/projected/c184c1e6-5202-417d-b0a7-cbbec667ffd2-kube-api-access-46nzq\") pod \"limitador-limitador-64c94fd64f-ps89s\" (UID: \"c184c1e6-5202-417d-b0a7-cbbec667ffd2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ps89s"
Jul 20 09:47:12.308729 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:12.308702    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c184c1e6-5202-417d-b0a7-cbbec667ffd2-config-file\") pod \"limitador-limitador-64c94fd64f-ps89s\" (UID: \"c184c1e6-5202-417d-b0a7-cbbec667ffd2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ps89s"
Jul 20 09:47:12.309302 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:12.309284    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c184c1e6-5202-417d-b0a7-cbbec667ffd2-config-file\") pod \"limitador-limitador-64c94fd64f-ps89s\" (UID: \"c184c1e6-5202-417d-b0a7-cbbec667ffd2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ps89s"
Jul 20 09:47:12.317602 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:12.317584    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46nzq\" (UniqueName: \"kubernetes.io/projected/c184c1e6-5202-417d-b0a7-cbbec667ffd2-kube-api-access-46nzq\") pod \"limitador-limitador-64c94fd64f-ps89s\" (UID: \"c184c1e6-5202-417d-b0a7-cbbec667ffd2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ps89s"
Jul 20 09:47:12.329624 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:12.329606    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:47:12.485956 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:12.485861    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ps89s"
Jul 20 09:47:12.614606 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:12.614586    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ps89s"]
Jul 20 09:47:12.616909 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:47:12.616883    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc184c1e6_5202_417d_b0a7_cbbec667ffd2.slice/crio-8963f4d062b821027e3a30745d677fadfd45e5f43d86f3718858a2aade62f187 WatchSource:0}: Error finding container 8963f4d062b821027e3a30745d677fadfd45e5f43d86f3718858a2aade62f187: Status 404 returned error can't find the container with id 8963f4d062b821027e3a30745d677fadfd45e5f43d86f3718858a2aade62f187
Jul 20 09:47:12.671942 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:12.671916    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ps89s" event={"ID":"c184c1e6-5202-417d-b0a7-cbbec667ffd2","Type":"ContainerStarted","Data":"8963f4d062b821027e3a30745d677fadfd45e5f43d86f3718858a2aade62f187"}
Jul 20 09:47:12.979534 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:12.979506    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-qf6vd"]
Jul 20 09:47:12.982844 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:12.982823    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qf6vd"
Jul 20 09:47:12.985711 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:12.985695    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-69txb\""
Jul 20 09:47:12.994929 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:12.994905    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-qf6vd"]
Jul 20 09:47:13.012949 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:13.012923    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhxkp\" (UniqueName: \"kubernetes.io/projected/fefa6786-aef2-4952-b177-bf2c5da2840b-kube-api-access-mhxkp\") pod \"authorino-58cd955675-qf6vd\" (UID: \"fefa6786-aef2-4952-b177-bf2c5da2840b\") " pod="kuadrant-system/authorino-58cd955675-qf6vd"
Jul 20 09:47:13.025580 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:13.025562    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:47:13.113634 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:13.113608    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhxkp\" (UniqueName: \"kubernetes.io/projected/fefa6786-aef2-4952-b177-bf2c5da2840b-kube-api-access-mhxkp\") pod \"authorino-58cd955675-qf6vd\" (UID: \"fefa6786-aef2-4952-b177-bf2c5da2840b\") " pod="kuadrant-system/authorino-58cd955675-qf6vd"
Jul 20 09:47:13.131287 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:13.131267    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhxkp\" (UniqueName: \"kubernetes.io/projected/fefa6786-aef2-4952-b177-bf2c5da2840b-kube-api-access-mhxkp\") pod \"authorino-58cd955675-qf6vd\" (UID: \"fefa6786-aef2-4952-b177-bf2c5da2840b\") " pod="kuadrant-system/authorino-58cd955675-qf6vd"
Jul 20 09:47:13.136715 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:13.136697    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:47:13.292116 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:13.292015    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qf6vd"
Jul 20 09:47:13.457573 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:13.457376    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-qf6vd"]
Jul 20 09:47:13.462875 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:47:13.462843    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfefa6786_aef2_4952_b177_bf2c5da2840b.slice/crio-c4516024cb0f2ed70a870fe6608cceaff1b0937812c6732e366456013bbf4b69 WatchSource:0}: Error finding container c4516024cb0f2ed70a870fe6608cceaff1b0937812c6732e366456013bbf4b69: Status 404 returned error can't find the container with id c4516024cb0f2ed70a870fe6608cceaff1b0937812c6732e366456013bbf4b69
Jul 20 09:47:13.678103 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:13.678067    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qf6vd" event={"ID":"fefa6786-aef2-4952-b177-bf2c5da2840b","Type":"ContainerStarted","Data":"c4516024cb0f2ed70a870fe6608cceaff1b0937812c6732e366456013bbf4b69"}
Jul 20 09:47:15.691760 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:15.691716    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ps89s" event={"ID":"c184c1e6-5202-417d-b0a7-cbbec667ffd2","Type":"ContainerStarted","Data":"94197dede9f045deb2a2db7fc091c7ad09ee06a3e83e0fdb7010ae1989217454"}
Jul 20 09:47:15.692260 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:15.691827    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-ps89s"
Jul 20 09:47:15.709898 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:15.709840    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-ps89s" podStartSLOduration=1.042700841 podStartE2EDuration="3.709819203s" totalImagesPullingTime="2.667118362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:47:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:47:15.707609942 +0000 UTC m=+487.589056299" watchObservedRunningTime="2026-07-20 09:47:15.709819203 +0000 UTC m=+487.591265514"
Jul 20 09:47:17.702072 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:17.702038    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qf6vd" event={"ID":"fefa6786-aef2-4952-b177-bf2c5da2840b","Type":"ContainerStarted","Data":"c9f61d9cc95cf85e4de6f50b55328ebf3a4475ca69493abcf541044efb083660"}
Jul 20 09:47:17.738595 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:17.738543    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-qf6vd" podStartSLOduration=1.6560767570000001 podStartE2EDuration="5.738528364s" totalImagesPullingTime="4.082451607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:47:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:47:17.73450292 +0000 UTC m=+489.615949239" watchObservedRunningTime="2026-07-20 09:47:17.738528364 +0000 UTC m=+489.619974697"
Jul 20 09:47:18.152951 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:18.152913    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-qf6vd"]
Jul 20 09:47:19.711188 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:19.711148    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-qf6vd" podUID="fefa6786-aef2-4952-b177-bf2c5da2840b" containerName="authorino" containerID="cri-o://c9f61d9cc95cf85e4de6f50b55328ebf3a4475ca69493abcf541044efb083660" gracePeriod=30
Jul 20 09:47:19.947380 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:19.947358    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qf6vd"
Jul 20 09:47:20.076166 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:20.076087    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhxkp\" (UniqueName: \"kubernetes.io/projected/fefa6786-aef2-4952-b177-bf2c5da2840b-kube-api-access-mhxkp\") pod \"fefa6786-aef2-4952-b177-bf2c5da2840b\" (UID: \"fefa6786-aef2-4952-b177-bf2c5da2840b\") "
Jul 20 09:47:20.078106 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:20.078081    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fefa6786-aef2-4952-b177-bf2c5da2840b-kube-api-access-mhxkp" (OuterVolumeSpecName: "kube-api-access-mhxkp") pod "fefa6786-aef2-4952-b177-bf2c5da2840b" (UID: "fefa6786-aef2-4952-b177-bf2c5da2840b"). InnerVolumeSpecName "kube-api-access-mhxkp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 09:47:20.177511 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:20.177466    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhxkp\" (UniqueName: \"kubernetes.io/projected/fefa6786-aef2-4952-b177-bf2c5da2840b-kube-api-access-mhxkp\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 09:47:20.717011 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:20.716976    2581 generic.go:356] "Generic (PLEG): container finished" podID="fefa6786-aef2-4952-b177-bf2c5da2840b" containerID="c9f61d9cc95cf85e4de6f50b55328ebf3a4475ca69493abcf541044efb083660" exitCode=0
Jul 20 09:47:20.717423 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:20.717037    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qf6vd"
Jul 20 09:47:20.717423 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:20.717051    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qf6vd" event={"ID":"fefa6786-aef2-4952-b177-bf2c5da2840b","Type":"ContainerDied","Data":"c9f61d9cc95cf85e4de6f50b55328ebf3a4475ca69493abcf541044efb083660"}
Jul 20 09:47:20.717423 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:20.717086    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qf6vd" event={"ID":"fefa6786-aef2-4952-b177-bf2c5da2840b","Type":"ContainerDied","Data":"c4516024cb0f2ed70a870fe6608cceaff1b0937812c6732e366456013bbf4b69"}
Jul 20 09:47:20.717423 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:20.717105    2581 scope.go:117] "RemoveContainer" containerID="c9f61d9cc95cf85e4de6f50b55328ebf3a4475ca69493abcf541044efb083660"
Jul 20 09:47:20.725835 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:20.725817    2581 scope.go:117] "RemoveContainer" containerID="c9f61d9cc95cf85e4de6f50b55328ebf3a4475ca69493abcf541044efb083660"
Jul 20 09:47:20.726109 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:47:20.726091    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9f61d9cc95cf85e4de6f50b55328ebf3a4475ca69493abcf541044efb083660\": container with ID starting with c9f61d9cc95cf85e4de6f50b55328ebf3a4475ca69493abcf541044efb083660 not found: ID does not exist" containerID="c9f61d9cc95cf85e4de6f50b55328ebf3a4475ca69493abcf541044efb083660"
Jul 20 09:47:20.726185 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:20.726116    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9f61d9cc95cf85e4de6f50b55328ebf3a4475ca69493abcf541044efb083660"} err="failed to get container status \"c9f61d9cc95cf85e4de6f50b55328ebf3a4475ca69493abcf541044efb083660\": rpc error: code = NotFound desc = could not find container \"c9f61d9cc95cf85e4de6f50b55328ebf3a4475ca69493abcf541044efb083660\": container with ID starting with c9f61d9cc95cf85e4de6f50b55328ebf3a4475ca69493abcf541044efb083660 not found: ID does not exist"
Jul 20 09:47:20.740108 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:20.740086    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-qf6vd"]
Jul 20 09:47:20.749790 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:20.749768    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-qf6vd"]
Jul 20 09:47:21.464663 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:21.464631    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fefa6786-aef2-4952-b177-bf2c5da2840b" path="/var/lib/kubelet/pods/fefa6786-aef2-4952-b177-bf2c5da2840b/volumes"
Jul 20 09:47:26.696422 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:26.696392    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-ps89s"
Jul 20 09:47:29.161950 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:29.161915    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ps89s"]
Jul 20 09:47:29.162354 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:29.162145    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-ps89s" podUID="c184c1e6-5202-417d-b0a7-cbbec667ffd2" containerName="limitador" containerID="cri-o://94197dede9f045deb2a2db7fc091c7ad09ee06a3e83e0fdb7010ae1989217454" gracePeriod=30
Jul 20 09:47:29.758708 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:29.758629    2581 generic.go:356] "Generic (PLEG): container finished" podID="c184c1e6-5202-417d-b0a7-cbbec667ffd2" containerID="94197dede9f045deb2a2db7fc091c7ad09ee06a3e83e0fdb7010ae1989217454" exitCode=0
Jul 20 09:47:29.758846 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:29.758704    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ps89s" event={"ID":"c184c1e6-5202-417d-b0a7-cbbec667ffd2","Type":"ContainerDied","Data":"94197dede9f045deb2a2db7fc091c7ad09ee06a3e83e0fdb7010ae1989217454"}
Jul 20 09:47:30.098220 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:30.098196    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ps89s"
Jul 20 09:47:30.256004 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:30.255979    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46nzq\" (UniqueName: \"kubernetes.io/projected/c184c1e6-5202-417d-b0a7-cbbec667ffd2-kube-api-access-46nzq\") pod \"c184c1e6-5202-417d-b0a7-cbbec667ffd2\" (UID: \"c184c1e6-5202-417d-b0a7-cbbec667ffd2\") "
Jul 20 09:47:30.256437 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:30.256078    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c184c1e6-5202-417d-b0a7-cbbec667ffd2-config-file\") pod \"c184c1e6-5202-417d-b0a7-cbbec667ffd2\" (UID: \"c184c1e6-5202-417d-b0a7-cbbec667ffd2\") "
Jul 20 09:47:30.256502 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:30.256457    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c184c1e6-5202-417d-b0a7-cbbec667ffd2-config-file" (OuterVolumeSpecName: "config-file") pod "c184c1e6-5202-417d-b0a7-cbbec667ffd2" (UID: "c184c1e6-5202-417d-b0a7-cbbec667ffd2"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 09:47:30.257924 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:30.257894    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c184c1e6-5202-417d-b0a7-cbbec667ffd2-kube-api-access-46nzq" (OuterVolumeSpecName: "kube-api-access-46nzq") pod "c184c1e6-5202-417d-b0a7-cbbec667ffd2" (UID: "c184c1e6-5202-417d-b0a7-cbbec667ffd2"). InnerVolumeSpecName "kube-api-access-46nzq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 09:47:30.357440 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:30.357417    2581 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c184c1e6-5202-417d-b0a7-cbbec667ffd2-config-file\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 09:47:30.357440 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:30.357441    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46nzq\" (UniqueName: \"kubernetes.io/projected/c184c1e6-5202-417d-b0a7-cbbec667ffd2-kube-api-access-46nzq\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 09:47:30.763914 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:30.763843    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ps89s"
Jul 20 09:47:30.763914 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:30.763859    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ps89s" event={"ID":"c184c1e6-5202-417d-b0a7-cbbec667ffd2","Type":"ContainerDied","Data":"8963f4d062b821027e3a30745d677fadfd45e5f43d86f3718858a2aade62f187"}
Jul 20 09:47:30.763914 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:30.763912    2581 scope.go:117] "RemoveContainer" containerID="94197dede9f045deb2a2db7fc091c7ad09ee06a3e83e0fdb7010ae1989217454"
Jul 20 09:47:30.789526 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:30.789500    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ps89s"]
Jul 20 09:47:30.796308 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:30.796287    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ps89s"]
Jul 20 09:47:31.464654 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:31.464621    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c184c1e6-5202-417d-b0a7-cbbec667ffd2" path="/var/lib/kubelet/pods/c184c1e6-5202-417d-b0a7-cbbec667ffd2/volumes"
Jul 20 09:47:32.125237 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:32.125186    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:47:32.225801 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:32.225774    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:47:32.610688 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:32.610660    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fzgbv"]
Jul 20 09:47:32.611192 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:32.611173    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fefa6786-aef2-4952-b177-bf2c5da2840b" containerName="authorino"
Jul 20 09:47:32.611268 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:32.611194    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fefa6786-aef2-4952-b177-bf2c5da2840b" containerName="authorino"
Jul 20 09:47:32.611268 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:32.611226    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c184c1e6-5202-417d-b0a7-cbbec667ffd2" containerName="limitador"
Jul 20 09:47:32.611268 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:32.611236    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c184c1e6-5202-417d-b0a7-cbbec667ffd2" containerName="limitador"
Jul 20 09:47:32.611407 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:32.611332    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c184c1e6-5202-417d-b0a7-cbbec667ffd2" containerName="limitador"
Jul 20 09:47:32.611407 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:32.611350    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fefa6786-aef2-4952-b177-bf2c5da2840b" containerName="authorino"
Jul 20 09:47:32.614309 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:32.614291    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fzgbv"
Jul 20 09:47:32.616904 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:32.616885    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 20 09:47:32.617055 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:32.617039    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 09:47:32.617773 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:32.617758    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-msfzv\""
Jul 20 09:47:32.617815 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:32.617759    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 09:47:32.623303 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:32.623281    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fzgbv"]
Jul 20 09:47:32.641150 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:32.641130    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:47:32.677287 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:32.677268    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/960ce003-61c0-4c51-8ef2-f64808293f3c-data\") pod \"postgres-69fb4594cf-fzgbv\" (UID: \"960ce003-61c0-4c51-8ef2-f64808293f3c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fzgbv"
Jul 20 09:47:32.677377 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:32.677316    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z526j\" (UniqueName: \"kubernetes.io/projected/960ce003-61c0-4c51-8ef2-f64808293f3c-kube-api-access-z526j\") pod \"postgres-69fb4594cf-fzgbv\" (UID: \"960ce003-61c0-4c51-8ef2-f64808293f3c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fzgbv"
Jul 20 09:47:32.778177 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:32.778155    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/960ce003-61c0-4c51-8ef2-f64808293f3c-data\") pod \"postgres-69fb4594cf-fzgbv\" (UID: \"960ce003-61c0-4c51-8ef2-f64808293f3c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fzgbv"
Jul 20 09:47:32.778281 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:32.778203    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z526j\" (UniqueName: \"kubernetes.io/projected/960ce003-61c0-4c51-8ef2-f64808293f3c-kube-api-access-z526j\") pod \"postgres-69fb4594cf-fzgbv\" (UID: \"960ce003-61c0-4c51-8ef2-f64808293f3c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fzgbv"
Jul 20 09:47:32.778505 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:32.778490    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/960ce003-61c0-4c51-8ef2-f64808293f3c-data\") pod \"postgres-69fb4594cf-fzgbv\" (UID: \"960ce003-61c0-4c51-8ef2-f64808293f3c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fzgbv"
Jul 20 09:47:32.786714 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:32.786695    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z526j\" (UniqueName: \"kubernetes.io/projected/960ce003-61c0-4c51-8ef2-f64808293f3c-kube-api-access-z526j\") pod \"postgres-69fb4594cf-fzgbv\" (UID: \"960ce003-61c0-4c51-8ef2-f64808293f3c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fzgbv"
Jul 20 09:47:32.925650 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:32.925593    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fzgbv"
Jul 20 09:47:33.087299 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:33.087274    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fzgbv"]
Jul 20 09:47:33.089495 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:47:33.089470    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod960ce003_61c0_4c51_8ef2_f64808293f3c.slice/crio-33d0e5aa2c7e3a70ee95fd9a7a2f2b00263bcf93a2eb3a98c7590ae76afc5311 WatchSource:0}: Error finding container 33d0e5aa2c7e3a70ee95fd9a7a2f2b00263bcf93a2eb3a98c7590ae76afc5311: Status 404 returned error can't find the container with id 33d0e5aa2c7e3a70ee95fd9a7a2f2b00263bcf93a2eb3a98c7590ae76afc5311
Jul 20 09:47:33.778743 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:33.778710    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fzgbv" event={"ID":"960ce003-61c0-4c51-8ef2-f64808293f3c","Type":"ContainerStarted","Data":"33d0e5aa2c7e3a70ee95fd9a7a2f2b00263bcf93a2eb3a98c7590ae76afc5311"}
Jul 20 09:47:38.808978 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:38.808922    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fzgbv" event={"ID":"960ce003-61c0-4c51-8ef2-f64808293f3c","Type":"ContainerStarted","Data":"7aaef53146cc7c25703673a3067e128d808272126fb869598efa37785c37f8f2"}
Jul 20 09:47:38.809349 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:38.809007    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fzgbv"
Jul 20 09:47:38.827077 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:38.827028    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fzgbv" podStartSLOduration=1.851983084 podStartE2EDuration="6.827009963s" totalImagesPullingTime="4.975026879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:47:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:47:38.826624363 +0000 UTC m=+510.708070700" watchObservedRunningTime="2026-07-20 09:47:38.827009963 +0000 UTC m=+510.708456272"
Jul 20 09:47:44.845643 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:44.845616    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fzgbv"
Jul 20 09:47:45.173243 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:45.173192    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:47:45.322698 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:45.322660    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:47:52.446983 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:52.446939    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:47:52.449409 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:52.449376    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-546cd69f65-7889h"]
Jul 20 09:47:52.540643 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:52.540610    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:47:52.603394 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:52.603347    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:47:52.700676 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:52.700609    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-546cd69f65-7889h"]
Jul 20 09:47:52.700676 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:52.700645    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-67dc865778-dwlfp"]
Jul 20 09:47:52.700844 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:52.700700    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-546cd69f65-7889h"
Jul 20 09:47:52.703769 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:52.703748    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 20 09:47:52.704687 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:52.704664    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-gmv8v\""
Jul 20 09:47:52.704687 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:52.704668    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 20 09:47:52.723115 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:52.723091    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67dc865778-dwlfp"]
Jul 20 09:47:52.723208 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:52.723161    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67dc865778-dwlfp"
Jul 20 09:47:52.727504 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:52.727485    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:47:52.747862 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:52.747834    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72568a53-ca51-4430-abea-b3af6c6ff331-webhook-cert\") pod \"maas-controller-67dc865778-dwlfp\" (UID: \"72568a53-ca51-4430-abea-b3af6c6ff331\") " pod="opendatahub/maas-controller-67dc865778-dwlfp"
Jul 20 09:47:52.747986 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:52.747875    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf45m\" (UniqueName: \"kubernetes.io/projected/e8f5a2d6-465c-451a-8831-304a163676b1-kube-api-access-xf45m\") pod \"maas-controller-546cd69f65-7889h\" (UID: \"e8f5a2d6-465c-451a-8831-304a163676b1\") " pod="opendatahub/maas-controller-546cd69f65-7889h"
Jul 20 09:47:52.748064 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:52.748026    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kldh6\" (UniqueName: \"kubernetes.io/projected/72568a53-ca51-4430-abea-b3af6c6ff331-kube-api-access-kldh6\") pod \"maas-controller-67dc865778-dwlfp\" (UID: \"72568a53-ca51-4430-abea-b3af6c6ff331\") " pod="opendatahub/maas-controller-67dc865778-dwlfp"
Jul 20 09:47:52.748064 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:52.748054    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8f5a2d6-465c-451a-8831-304a163676b1-webhook-cert\") pod \"maas-controller-546cd69f65-7889h\" (UID: \"e8f5a2d6-465c-451a-8831-304a163676b1\") " pod="opendatahub/maas-controller-546cd69f65-7889h"
Jul 20 09:47:52.854492 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:52.854461    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72568a53-ca51-4430-abea-b3af6c6ff331-webhook-cert\") pod \"maas-controller-67dc865778-dwlfp\" (UID: \"72568a53-ca51-4430-abea-b3af6c6ff331\") " pod="opendatahub/maas-controller-67dc865778-dwlfp"
Jul 20 09:47:52.854652 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:52.854500    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf45m\" (UniqueName: \"kubernetes.io/projected/e8f5a2d6-465c-451a-8831-304a163676b1-kube-api-access-xf45m\") pod \"maas-controller-546cd69f65-7889h\" (UID: \"e8f5a2d6-465c-451a-8831-304a163676b1\") " pod="opendatahub/maas-controller-546cd69f65-7889h"
Jul 20 09:47:52.854652 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:52.854596    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kldh6\" (UniqueName: \"kubernetes.io/projected/72568a53-ca51-4430-abea-b3af6c6ff331-kube-api-access-kldh6\") pod \"maas-controller-67dc865778-dwlfp\" (UID: \"72568a53-ca51-4430-abea-b3af6c6ff331\") " pod="opendatahub/maas-controller-67dc865778-dwlfp"
Jul 20 09:47:52.854652 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:52.854639    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8f5a2d6-465c-451a-8831-304a163676b1-webhook-cert\") pod \"maas-controller-546cd69f65-7889h\" (UID: \"e8f5a2d6-465c-451a-8831-304a163676b1\") " pod="opendatahub/maas-controller-546cd69f65-7889h"
Jul 20 09:47:52.856904 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:52.856882    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72568a53-ca51-4430-abea-b3af6c6ff331-webhook-cert\") pod \"maas-controller-67dc865778-dwlfp\" (UID: \"72568a53-ca51-4430-abea-b3af6c6ff331\") " pod="opendatahub/maas-controller-67dc865778-dwlfp"
Jul 20 09:47:52.857066 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:52.857050    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8f5a2d6-465c-451a-8831-304a163676b1-webhook-cert\") pod \"maas-controller-546cd69f65-7889h\" (UID: \"e8f5a2d6-465c-451a-8831-304a163676b1\") " pod="opendatahub/maas-controller-546cd69f65-7889h"
Jul 20 09:47:52.871089 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:52.871070    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kldh6\" (UniqueName: \"kubernetes.io/projected/72568a53-ca51-4430-abea-b3af6c6ff331-kube-api-access-kldh6\") pod \"maas-controller-67dc865778-dwlfp\" (UID: \"72568a53-ca51-4430-abea-b3af6c6ff331\") " pod="opendatahub/maas-controller-67dc865778-dwlfp"
Jul 20 09:47:52.871280 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:52.871263    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf45m\" (UniqueName: \"kubernetes.io/projected/e8f5a2d6-465c-451a-8831-304a163676b1-kube-api-access-xf45m\") pod \"maas-controller-546cd69f65-7889h\" (UID: \"e8f5a2d6-465c-451a-8831-304a163676b1\") " pod="opendatahub/maas-controller-546cd69f65-7889h"
Jul 20 09:47:53.010858 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:53.010807    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-546cd69f65-7889h"
Jul 20 09:47:53.032451 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:53.032432    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67dc865778-dwlfp"
Jul 20 09:47:53.170895 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:53.170873    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-546cd69f65-7889h"]
Jul 20 09:47:53.172991 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:47:53.172926    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8f5a2d6_465c_451a_8831_304a163676b1.slice/crio-c490819c8730dd2e2e73b9d390f448cbbe56763638c6fe8592c36fe215203366 WatchSource:0}: Error finding container c490819c8730dd2e2e73b9d390f448cbbe56763638c6fe8592c36fe215203366: Status 404 returned error can't find the container with id c490819c8730dd2e2e73b9d390f448cbbe56763638c6fe8592c36fe215203366
Jul 20 09:47:53.203010 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:53.202980    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67dc865778-dwlfp"]
Jul 20 09:47:53.206751 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:47:53.206728    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72568a53_ca51_4430_abea_b3af6c6ff331.slice/crio-6d9ed15c8257c945705453fd7a151bf9fb76438f6c6b3a16cc5f430cf7857869 WatchSource:0}: Error finding container 6d9ed15c8257c945705453fd7a151bf9fb76438f6c6b3a16cc5f430cf7857869: Status 404 returned error can't find the container with id 6d9ed15c8257c945705453fd7a151bf9fb76438f6c6b3a16cc5f430cf7857869
Jul 20 09:47:53.886300 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:53.886263    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67dc865778-dwlfp" event={"ID":"72568a53-ca51-4430-abea-b3af6c6ff331","Type":"ContainerStarted","Data":"6d9ed15c8257c945705453fd7a151bf9fb76438f6c6b3a16cc5f430cf7857869"}
Jul 20 09:47:53.888374 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:53.888301    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-546cd69f65-7889h" event={"ID":"e8f5a2d6-465c-451a-8831-304a163676b1","Type":"ContainerStarted","Data":"c490819c8730dd2e2e73b9d390f448cbbe56763638c6fe8592c36fe215203366"}
Jul 20 09:47:55.788518 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:55.788483    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:47:55.892972 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:55.892938    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:47:55.897589 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:55.897565    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-546cd69f65-7889h" event={"ID":"e8f5a2d6-465c-451a-8831-304a163676b1","Type":"ContainerStarted","Data":"1f92aa4a6b4033ac8dcd474a5f33f74345de2d45f615015476a3b0b3327eb4c8"}
Jul 20 09:47:55.897720 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:55.897643    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-546cd69f65-7889h"
Jul 20 09:47:55.899053 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:55.899033    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67dc865778-dwlfp" event={"ID":"72568a53-ca51-4430-abea-b3af6c6ff331","Type":"ContainerStarted","Data":"1147b5778cf0560e4eacb09cbe09be746f9e525241a13ec5f73103631bd8de46"}
Jul 20 09:47:55.899137 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:55.899098    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-67dc865778-dwlfp"
Jul 20 09:47:55.930608 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:55.930194    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-546cd69f65-7889h" podStartSLOduration=1.494622387 podStartE2EDuration="3.930175109s" totalImagesPullingTime="2.435552722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:47:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:47:55.9266808 +0000 UTC m=+527.808127117" watchObservedRunningTime="2026-07-20 09:47:55.930175109 +0000 UTC m=+527.811621418"
Jul 20 09:47:57.324097 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:47:57.324061    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:48:06.906164 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:06.906134    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-67dc865778-dwlfp"
Jul 20 09:48:06.906597 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:06.906207    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-546cd69f65-7889h"
Jul 20 09:48:06.931263 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:06.931212    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-67dc865778-dwlfp" podStartSLOduration=12.538341891 podStartE2EDuration="14.931197059s" totalImagesPullingTime="2.392855168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:47:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:47:55.950898966 +0000 UTC m=+527.832345277" watchObservedRunningTime="2026-07-20 09:48:06.931197059 +0000 UTC m=+538.812643381"
Jul 20 09:48:06.992340 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:06.992310    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-546cd69f65-7889h"]
Jul 20 09:48:06.992680 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:06.992643    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-546cd69f65-7889h" podUID="e8f5a2d6-465c-451a-8831-304a163676b1" containerName="manager" containerID="cri-o://1f92aa4a6b4033ac8dcd474a5f33f74345de2d45f615015476a3b0b3327eb4c8" gracePeriod=30
Jul 20 09:48:07.235912 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:07.235882    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-546cd69f65-7889h"
Jul 20 09:48:07.283237 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:07.283208    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8f5a2d6-465c-451a-8831-304a163676b1-webhook-cert\") pod \"e8f5a2d6-465c-451a-8831-304a163676b1\" (UID: \"e8f5a2d6-465c-451a-8831-304a163676b1\") "
Jul 20 09:48:07.283351 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:07.283246    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xf45m\" (UniqueName: \"kubernetes.io/projected/e8f5a2d6-465c-451a-8831-304a163676b1-kube-api-access-xf45m\") pod \"e8f5a2d6-465c-451a-8831-304a163676b1\" (UID: \"e8f5a2d6-465c-451a-8831-304a163676b1\") "
Jul 20 09:48:07.285292 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:07.285261    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8f5a2d6-465c-451a-8831-304a163676b1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e8f5a2d6-465c-451a-8831-304a163676b1" (UID: "e8f5a2d6-465c-451a-8831-304a163676b1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 09:48:07.285399 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:07.285381    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8f5a2d6-465c-451a-8831-304a163676b1-kube-api-access-xf45m" (OuterVolumeSpecName: "kube-api-access-xf45m") pod "e8f5a2d6-465c-451a-8831-304a163676b1" (UID: "e8f5a2d6-465c-451a-8831-304a163676b1"). InnerVolumeSpecName "kube-api-access-xf45m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 09:48:07.384699 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:07.384672    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e8f5a2d6-465c-451a-8831-304a163676b1-webhook-cert\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 09:48:07.384699 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:07.384697    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xf45m\" (UniqueName: \"kubernetes.io/projected/e8f5a2d6-465c-451a-8831-304a163676b1-kube-api-access-xf45m\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 09:48:07.953204 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:07.953167    2581 generic.go:356] "Generic (PLEG): container finished" podID="e8f5a2d6-465c-451a-8831-304a163676b1" containerID="1f92aa4a6b4033ac8dcd474a5f33f74345de2d45f615015476a3b0b3327eb4c8" exitCode=0
Jul 20 09:48:07.953584 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:07.953220    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-546cd69f65-7889h"
Jul 20 09:48:07.953584 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:07.953214    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-546cd69f65-7889h" event={"ID":"e8f5a2d6-465c-451a-8831-304a163676b1","Type":"ContainerDied","Data":"1f92aa4a6b4033ac8dcd474a5f33f74345de2d45f615015476a3b0b3327eb4c8"}
Jul 20 09:48:07.953584 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:07.953343    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-546cd69f65-7889h" event={"ID":"e8f5a2d6-465c-451a-8831-304a163676b1","Type":"ContainerDied","Data":"c490819c8730dd2e2e73b9d390f448cbbe56763638c6fe8592c36fe215203366"}
Jul 20 09:48:07.953584 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:07.953365    2581 scope.go:117] "RemoveContainer" containerID="1f92aa4a6b4033ac8dcd474a5f33f74345de2d45f615015476a3b0b3327eb4c8"
Jul 20 09:48:07.963482 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:07.963464    2581 scope.go:117] "RemoveContainer" containerID="1f92aa4a6b4033ac8dcd474a5f33f74345de2d45f615015476a3b0b3327eb4c8"
Jul 20 09:48:07.963994 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:48:07.963932    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f92aa4a6b4033ac8dcd474a5f33f74345de2d45f615015476a3b0b3327eb4c8\": container with ID starting with 1f92aa4a6b4033ac8dcd474a5f33f74345de2d45f615015476a3b0b3327eb4c8 not found: ID does not exist" containerID="1f92aa4a6b4033ac8dcd474a5f33f74345de2d45f615015476a3b0b3327eb4c8"
Jul 20 09:48:07.964106 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:07.963990    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f92aa4a6b4033ac8dcd474a5f33f74345de2d45f615015476a3b0b3327eb4c8"} err="failed to get container status \"1f92aa4a6b4033ac8dcd474a5f33f74345de2d45f615015476a3b0b3327eb4c8\": rpc error: code = NotFound desc = could not find container \"1f92aa4a6b4033ac8dcd474a5f33f74345de2d45f615015476a3b0b3327eb4c8\": container with ID starting with 1f92aa4a6b4033ac8dcd474a5f33f74345de2d45f615015476a3b0b3327eb4c8 not found: ID does not exist"
Jul 20 09:48:07.979392 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:07.979367    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-546cd69f65-7889h"]
Jul 20 09:48:07.982939 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:07.982920    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-546cd69f65-7889h"]
Jul 20 09:48:08.341006 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:08.340920    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:48:08.404509 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:08.404475    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:48:09.464277 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:09.464239    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8f5a2d6-465c-451a-8831-304a163676b1" path="/var/lib/kubelet/pods/e8f5a2d6-465c-451a-8831-304a163676b1/volumes"
Jul 20 09:48:27.454087 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:27.454054    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:48:27.562894 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:27.562863    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:48:28.036994 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.036947    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:48:28.172304 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.172275    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6d6644bdf7-b4xts"]
Jul 20 09:48:28.172645 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.172632    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8f5a2d6-465c-451a-8831-304a163676b1" containerName="manager"
Jul 20 09:48:28.172692 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.172647    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8f5a2d6-465c-451a-8831-304a163676b1" containerName="manager"
Jul 20 09:48:28.172736 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.172726    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8f5a2d6-465c-451a-8831-304a163676b1" containerName="manager"
Jul 20 09:48:28.176236 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.176216    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d6644bdf7-b4xts"
Jul 20 09:48:28.180584 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.180559    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-6x95r\""
Jul 20 09:48:28.181500 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.181482    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 20 09:48:28.204890 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.204866    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d6644bdf7-b4xts"]
Jul 20 09:48:28.223253 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.223232    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:48:28.251393 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.251372    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcrv8\" (UniqueName: \"kubernetes.io/projected/ead6a79d-2d73-4b38-95de-3651c38dbeef-kube-api-access-vcrv8\") pod \"maas-api-6d6644bdf7-b4xts\" (UID: \"ead6a79d-2d73-4b38-95de-3651c38dbeef\") " pod="odh-ai-gateway-infra/maas-api-6d6644bdf7-b4xts"
Jul 20 09:48:28.251498 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.251429    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ead6a79d-2d73-4b38-95de-3651c38dbeef-maas-api-tls\") pod \"maas-api-6d6644bdf7-b4xts\" (UID: \"ead6a79d-2d73-4b38-95de-3651c38dbeef\") " pod="odh-ai-gateway-infra/maas-api-6d6644bdf7-b4xts"
Jul 20 09:48:28.251498 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.251469    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ead6a79d-2d73-4b38-95de-3651c38dbeef-openshift-service-ca\") pod \"maas-api-6d6644bdf7-b4xts\" (UID: \"ead6a79d-2d73-4b38-95de-3651c38dbeef\") " pod="odh-ai-gateway-infra/maas-api-6d6644bdf7-b4xts"
Jul 20 09:48:28.352179 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.352155    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ead6a79d-2d73-4b38-95de-3651c38dbeef-maas-api-tls\") pod \"maas-api-6d6644bdf7-b4xts\" (UID: \"ead6a79d-2d73-4b38-95de-3651c38dbeef\") " pod="odh-ai-gateway-infra/maas-api-6d6644bdf7-b4xts"
Jul 20 09:48:28.352279 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.352185    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ead6a79d-2d73-4b38-95de-3651c38dbeef-openshift-service-ca\") pod \"maas-api-6d6644bdf7-b4xts\" (UID: \"ead6a79d-2d73-4b38-95de-3651c38dbeef\") " pod="odh-ai-gateway-infra/maas-api-6d6644bdf7-b4xts"
Jul 20 09:48:28.352279 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.352247    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcrv8\" (UniqueName: \"kubernetes.io/projected/ead6a79d-2d73-4b38-95de-3651c38dbeef-kube-api-access-vcrv8\") pod \"maas-api-6d6644bdf7-b4xts\" (UID: \"ead6a79d-2d73-4b38-95de-3651c38dbeef\") " pod="odh-ai-gateway-infra/maas-api-6d6644bdf7-b4xts"
Jul 20 09:48:28.352909 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.352887    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ead6a79d-2d73-4b38-95de-3651c38dbeef-openshift-service-ca\") pod \"maas-api-6d6644bdf7-b4xts\" (UID: \"ead6a79d-2d73-4b38-95de-3651c38dbeef\") " pod="odh-ai-gateway-infra/maas-api-6d6644bdf7-b4xts"
Jul 20 09:48:28.354679 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.354657    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ead6a79d-2d73-4b38-95de-3651c38dbeef-maas-api-tls\") pod \"maas-api-6d6644bdf7-b4xts\" (UID: \"ead6a79d-2d73-4b38-95de-3651c38dbeef\") " pod="odh-ai-gateway-infra/maas-api-6d6644bdf7-b4xts"
Jul 20 09:48:28.360519 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.360498    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcrv8\" (UniqueName: \"kubernetes.io/projected/ead6a79d-2d73-4b38-95de-3651c38dbeef-kube-api-access-vcrv8\") pod \"maas-api-6d6644bdf7-b4xts\" (UID: \"ead6a79d-2d73-4b38-95de-3651c38dbeef\") " pod="odh-ai-gateway-infra/maas-api-6d6644bdf7-b4xts"
Jul 20 09:48:28.486590 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.486558    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d6644bdf7-b4xts"
Jul 20 09:48:28.580770 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.580741    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:48:28.629877 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.629855    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d6644bdf7-b4xts"]
Jul 20 09:48:28.631517 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:48:28.631493    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podead6a79d_2d73_4b38_95de_3651c38dbeef.slice/crio-0507fb8cb5791ee77c7782910197484429f9285c5ec6140866eda8d6ba87b8cf WatchSource:0}: Error finding container 0507fb8cb5791ee77c7782910197484429f9285c5ec6140866eda8d6ba87b8cf: Status 404 returned error can't find the container with id 0507fb8cb5791ee77c7782910197484429f9285c5ec6140866eda8d6ba87b8cf
Jul 20 09:48:28.686012 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.685955    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:48:28.732270 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.732243    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-rkhrh"]
Jul 20 09:48:28.735562 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.735540    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-rkhrh"
Jul 20 09:48:28.739147 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.739128    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-c6s82\""
Jul 20 09:48:28.742705 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.742686    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 20 09:48:28.753830 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.753809    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-rkhrh"]
Jul 20 09:48:28.762720 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.762697    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-kd4hm"]
Jul 20 09:48:28.765239 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.765223    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-kd4hm"
Jul 20 09:48:28.781800 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.781781    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-kd4hm"]
Jul 20 09:48:28.857864 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.857834    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mq5b\" (UniqueName: \"kubernetes.io/projected/463dac4a-ae6a-4b19-b65f-0b396e969ac9-kube-api-access-9mq5b\") pod \"payload-pre-processing-7677b774bb-kd4hm\" (UID: \"463dac4a-ae6a-4b19-b65f-0b396e969ac9\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-kd4hm"
Jul 20 09:48:28.858047 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.857875    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nmcd\" (UniqueName: \"kubernetes.io/projected/02516a90-6e7c-4e2d-ab87-6961953a355d-kube-api-access-5nmcd\") pod \"payload-processing-5bf47cd988-rkhrh\" (UID: \"02516a90-6e7c-4e2d-ab87-6961953a355d\") " pod="openshift-ingress/payload-processing-5bf47cd988-rkhrh"
Jul 20 09:48:28.858047 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.857908    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/463dac4a-ae6a-4b19-b65f-0b396e969ac9-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-kd4hm\" (UID: \"463dac4a-ae6a-4b19-b65f-0b396e969ac9\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-kd4hm"
Jul 20 09:48:28.858047 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.858014    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02516a90-6e7c-4e2d-ab87-6961953a355d-plugins-config-volume\") pod \"payload-processing-5bf47cd988-rkhrh\" (UID: \"02516a90-6e7c-4e2d-ab87-6961953a355d\") " pod="openshift-ingress/payload-processing-5bf47cd988-rkhrh"
Jul 20 09:48:28.958790 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.958717    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02516a90-6e7c-4e2d-ab87-6961953a355d-plugins-config-volume\") pod \"payload-processing-5bf47cd988-rkhrh\" (UID: \"02516a90-6e7c-4e2d-ab87-6961953a355d\") " pod="openshift-ingress/payload-processing-5bf47cd988-rkhrh"
Jul 20 09:48:28.958790 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.958754    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mq5b\" (UniqueName: \"kubernetes.io/projected/463dac4a-ae6a-4b19-b65f-0b396e969ac9-kube-api-access-9mq5b\") pod \"payload-pre-processing-7677b774bb-kd4hm\" (UID: \"463dac4a-ae6a-4b19-b65f-0b396e969ac9\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-kd4hm"
Jul 20 09:48:28.958790 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.958781    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nmcd\" (UniqueName: \"kubernetes.io/projected/02516a90-6e7c-4e2d-ab87-6961953a355d-kube-api-access-5nmcd\") pod \"payload-processing-5bf47cd988-rkhrh\" (UID: \"02516a90-6e7c-4e2d-ab87-6961953a355d\") " pod="openshift-ingress/payload-processing-5bf47cd988-rkhrh"
Jul 20 09:48:28.959034 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.958813    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/463dac4a-ae6a-4b19-b65f-0b396e969ac9-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-kd4hm\" (UID: \"463dac4a-ae6a-4b19-b65f-0b396e969ac9\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-kd4hm"
Jul 20 09:48:28.959743 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.959718    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/463dac4a-ae6a-4b19-b65f-0b396e969ac9-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-kd4hm\" (UID: \"463dac4a-ae6a-4b19-b65f-0b396e969ac9\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-kd4hm"
Jul 20 09:48:28.959794 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.959742    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02516a90-6e7c-4e2d-ab87-6961953a355d-plugins-config-volume\") pod \"payload-processing-5bf47cd988-rkhrh\" (UID: \"02516a90-6e7c-4e2d-ab87-6961953a355d\") " pod="openshift-ingress/payload-processing-5bf47cd988-rkhrh"
Jul 20 09:48:28.971383 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.971362    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mq5b\" (UniqueName: \"kubernetes.io/projected/463dac4a-ae6a-4b19-b65f-0b396e969ac9-kube-api-access-9mq5b\") pod \"payload-pre-processing-7677b774bb-kd4hm\" (UID: \"463dac4a-ae6a-4b19-b65f-0b396e969ac9\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-kd4hm"
Jul 20 09:48:28.971587 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:28.971570    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nmcd\" (UniqueName: \"kubernetes.io/projected/02516a90-6e7c-4e2d-ab87-6961953a355d-kube-api-access-5nmcd\") pod \"payload-processing-5bf47cd988-rkhrh\" (UID: \"02516a90-6e7c-4e2d-ab87-6961953a355d\") " pod="openshift-ingress/payload-processing-5bf47cd988-rkhrh"
Jul 20 09:48:29.048150 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:29.048115    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-rkhrh"
Jul 20 09:48:29.055665 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:29.055638    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d6644bdf7-b4xts" event={"ID":"ead6a79d-2d73-4b38-95de-3651c38dbeef","Type":"ContainerStarted","Data":"0507fb8cb5791ee77c7782910197484429f9285c5ec6140866eda8d6ba87b8cf"}
Jul 20 09:48:29.075035 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:29.075012    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-kd4hm"
Jul 20 09:48:29.191361 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:29.191332    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-rkhrh"]
Jul 20 09:48:29.194826 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:48:29.194797    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02516a90_6e7c_4e2d_ab87_6961953a355d.slice/crio-95b44d28fdd8f50767cc9a8aef2de20beda09f5d54f1c3be03eb1989f89df0c5 WatchSource:0}: Error finding container 95b44d28fdd8f50767cc9a8aef2de20beda09f5d54f1c3be03eb1989f89df0c5: Status 404 returned error can't find the container with id 95b44d28fdd8f50767cc9a8aef2de20beda09f5d54f1c3be03eb1989f89df0c5
Jul 20 09:48:29.213861 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:29.213839    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-kd4hm"]
Jul 20 09:48:29.216197 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:48:29.216176    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod463dac4a_ae6a_4b19_b65f_0b396e969ac9.slice/crio-937c9e2c88b5b975512a5bc067b6775741024f29e418c332e8e411c215e10adb WatchSource:0}: Error finding container 937c9e2c88b5b975512a5bc067b6775741024f29e418c332e8e411c215e10adb: Status 404 returned error can't find the container with id 937c9e2c88b5b975512a5bc067b6775741024f29e418c332e8e411c215e10adb
Jul 20 09:48:30.067515 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:30.067476    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-rkhrh" event={"ID":"02516a90-6e7c-4e2d-ab87-6961953a355d","Type":"ContainerStarted","Data":"95b44d28fdd8f50767cc9a8aef2de20beda09f5d54f1c3be03eb1989f89df0c5"}
Jul 20 09:48:30.071190 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:30.071157    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-kd4hm" event={"ID":"463dac4a-ae6a-4b19-b65f-0b396e969ac9","Type":"ContainerStarted","Data":"937c9e2c88b5b975512a5bc067b6775741024f29e418c332e8e411c215e10adb"}
Jul 20 09:48:31.078521 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:31.078475    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d6644bdf7-b4xts" event={"ID":"ead6a79d-2d73-4b38-95de-3651c38dbeef","Type":"ContainerStarted","Data":"551cb1a6490347e385ba983ff85e490ecf82ffc60d375d3eaf57444e8c7c53da"}
Jul 20 09:48:31.078984 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:31.078618    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6d6644bdf7-b4xts"
Jul 20 09:48:31.098429 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:31.098382    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6d6644bdf7-b4xts" podStartSLOduration=1.193779734 podStartE2EDuration="3.098362631s" totalImagesPullingTime="1.904582897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:48:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:48:31.096982204 +0000 UTC m=+562.978428735" watchObservedRunningTime="2026-07-20 09:48:31.098362631 +0000 UTC m=+562.979808933"
Jul 20 09:48:32.084703 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:32.084665    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-rkhrh" event={"ID":"02516a90-6e7c-4e2d-ab87-6961953a355d","Type":"ContainerStarted","Data":"10b978b20442f0a9367bb289d2ca0b400e12d5cd98785a8497e04a8d02360297"}
Jul 20 09:48:32.085136 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:32.084815    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-rkhrh"
Jul 20 09:48:32.086199 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:32.086177    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-kd4hm" event={"ID":"463dac4a-ae6a-4b19-b65f-0b396e969ac9","Type":"ContainerStarted","Data":"4e376daa22d8a90387988a8332f5bbe64723dea94f0df0f29cf073973a651c36"}
Jul 20 09:48:32.086282 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:32.086223    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-kd4hm"
Jul 20 09:48:32.103442 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:32.103402    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-rkhrh" podStartSLOduration=2.129992263 podStartE2EDuration="4.103389609s" totalImagesPullingTime="1.973397346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:48:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:48:32.101367005 +0000 UTC m=+563.982813337" watchObservedRunningTime="2026-07-20 09:48:32.103389609 +0000 UTC m=+563.984835918"
Jul 20 09:48:32.124061 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:32.124014    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-kd4hm" podStartSLOduration=2.164503427 podStartE2EDuration="4.124001458s" totalImagesPullingTime="1.959498031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:48:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:48:32.121258869 +0000 UTC m=+564.002705177" watchObservedRunningTime="2026-07-20 09:48:32.124001458 +0000 UTC m=+564.005447766"
Jul 20 09:48:37.092657 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:37.092629    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6d6644bdf7-b4xts"
Jul 20 09:48:38.809167 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:38.809133    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:48:38.906408 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:38.906366    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:48:43.093720 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:43.093691    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-rkhrh"
Jul 20 09:48:43.094198 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:43.094027    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-kd4hm"
Jul 20 09:48:43.096408 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:43.096384    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw"]
Jul 20 09:48:43.100025 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:43.100008    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw"
Jul 20 09:48:43.102322 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:43.102304    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 20 09:48:43.102430 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:43.102417    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 20 09:48:43.103109 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:43.103094    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 20 09:48:43.103192 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:43.103124    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hbv28\""
Jul 20 09:48:43.110271 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:43.110253    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw"]
Jul 20 09:48:43.125643 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:43.125623    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:48:43.182797 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:43.182765    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b826a498-1b7b-4085-b5b8-71f61f58907a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw\" (UID: \"b826a498-1b7b-4085-b5b8-71f61f58907a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw"
Jul 20 09:48:43.182990 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:43.182808    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b826a498-1b7b-4085-b5b8-71f61f58907a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw\" (UID: \"b826a498-1b7b-4085-b5b8-71f61f58907a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw"
Jul 20 09:48:43.182990 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:43.182862    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b826a498-1b7b-4085-b5b8-71f61f58907a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw\" (UID: \"b826a498-1b7b-4085-b5b8-71f61f58907a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw"
Jul 20 09:48:43.182990 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:43.182891    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b826a498-1b7b-4085-b5b8-71f61f58907a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw\" (UID: \"b826a498-1b7b-4085-b5b8-71f61f58907a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw"
Jul 20 09:48:43.182990 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:43.182916    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcpr4\" (UniqueName: \"kubernetes.io/projected/b826a498-1b7b-4085-b5b8-71f61f58907a-kube-api-access-dcpr4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw\" (UID: \"b826a498-1b7b-4085-b5b8-71f61f58907a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw"
Jul 20 09:48:43.183211 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:43.182996    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b826a498-1b7b-4085-b5b8-71f61f58907a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw\" (UID: \"b826a498-1b7b-4085-b5b8-71f61f58907a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw"
Jul 20 09:48:43.283680 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:43.283653    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b826a498-1b7b-4085-b5b8-71f61f58907a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw\" (UID: \"b826a498-1b7b-4085-b5b8-71f61f58907a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw"
Jul 20 09:48:43.283846 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:43.283683    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b826a498-1b7b-4085-b5b8-71f61f58907a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw\" (UID: \"b826a498-1b7b-4085-b5b8-71f61f58907a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw"
Jul 20 09:48:43.283846 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:43.283718    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b826a498-1b7b-4085-b5b8-71f61f58907a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw\" (UID: \"b826a498-1b7b-4085-b5b8-71f61f58907a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw"
Jul 20 09:48:43.283846 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:43.283741    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b826a498-1b7b-4085-b5b8-71f61f58907a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw\" (UID: \"b826a498-1b7b-4085-b5b8-71f61f58907a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw"
Jul 20 09:48:43.283846 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:43.283764    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcpr4\" (UniqueName: \"kubernetes.io/projected/b826a498-1b7b-4085-b5b8-71f61f58907a-kube-api-access-dcpr4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw\" (UID: \"b826a498-1b7b-4085-b5b8-71f61f58907a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw"
Jul 20 09:48:43.283846 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:43.283794    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b826a498-1b7b-4085-b5b8-71f61f58907a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw\" (UID: \"b826a498-1b7b-4085-b5b8-71f61f58907a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw"
Jul 20 09:48:43.284221 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:43.284108    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b826a498-1b7b-4085-b5b8-71f61f58907a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw\" (UID: \"b826a498-1b7b-4085-b5b8-71f61f58907a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw"
Jul 20 09:48:43.284221 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:43.284190    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b826a498-1b7b-4085-b5b8-71f61f58907a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw\" (UID: \"b826a498-1b7b-4085-b5b8-71f61f58907a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw"
Jul 20 09:48:43.284221 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:43.284216    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b826a498-1b7b-4085-b5b8-71f61f58907a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw\" (UID: \"b826a498-1b7b-4085-b5b8-71f61f58907a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw"
Jul 20 09:48:43.286003 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:43.285983    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b826a498-1b7b-4085-b5b8-71f61f58907a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw\" (UID: \"b826a498-1b7b-4085-b5b8-71f61f58907a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw"
Jul 20 09:48:43.286229 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:43.286214    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b826a498-1b7b-4085-b5b8-71f61f58907a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw\" (UID: \"b826a498-1b7b-4085-b5b8-71f61f58907a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw"
Jul 20 09:48:43.292208 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:43.292187    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcpr4\" (UniqueName: \"kubernetes.io/projected/b826a498-1b7b-4085-b5b8-71f61f58907a-kube-api-access-dcpr4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw\" (UID: \"b826a498-1b7b-4085-b5b8-71f61f58907a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw"
Jul 20 09:48:43.411265 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:43.411236    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw"
Jul 20 09:48:43.540481 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:43.540447    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw"]
Jul 20 09:48:43.543676 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:48:43.543650    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb826a498_1b7b_4085_b5b8_71f61f58907a.slice/crio-458e5df30b93f66c8220249637beb99a602faaa4b08afd4708520b200c2d1407 WatchSource:0}: Error finding container 458e5df30b93f66c8220249637beb99a602faaa4b08afd4708520b200c2d1407: Status 404 returned error can't find the container with id 458e5df30b93f66c8220249637beb99a602faaa4b08afd4708520b200c2d1407
Jul 20 09:48:44.149417 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:44.149378    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw" event={"ID":"b826a498-1b7b-4085-b5b8-71f61f58907a","Type":"ContainerStarted","Data":"458e5df30b93f66c8220249637beb99a602faaa4b08afd4708520b200c2d1407"}
Jul 20 09:48:45.155827 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:45.155790    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw" event={"ID":"b826a498-1b7b-4085-b5b8-71f61f58907a","Type":"ContainerStarted","Data":"17f33603846734a6ad76a4b53e8577e329b3083d81b6cac1bd5c3449a0c99e24"}
Jul 20 09:48:45.173862 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:45.173816    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw" podStartSLOduration=0.967472609 podStartE2EDuration="2.173802409s" totalImagesPullingTime="1.2063298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:48:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:48:45.173160016 +0000 UTC m=+577.054606342" watchObservedRunningTime="2026-07-20 09:48:45.173802409 +0000 UTC m=+577.055248717"
Jul 20 09:48:53.019916 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:53.019881    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dlcbm"]
Jul 20 09:48:53.024689 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:53.024668    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dlcbm"
Jul 20 09:48:53.031883 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:53.031860    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 20 09:48:53.039449 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:53.039429    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dlcbm"]
Jul 20 09:48:53.074673 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:53.074649    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ed77716-0b1c-4dc5-b60b-d34cb8e3386b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dlcbm\" (UID: \"7ed77716-0b1c-4dc5-b60b-d34cb8e3386b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dlcbm"
Jul 20 09:48:53.074788 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:53.074675    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ed77716-0b1c-4dc5-b60b-d34cb8e3386b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dlcbm\" (UID: \"7ed77716-0b1c-4dc5-b60b-d34cb8e3386b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dlcbm"
Jul 20 09:48:53.074788 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:53.074693    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvsl2\" (UniqueName: \"kubernetes.io/projected/7ed77716-0b1c-4dc5-b60b-d34cb8e3386b-kube-api-access-mvsl2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dlcbm\" (UID: \"7ed77716-0b1c-4dc5-b60b-d34cb8e3386b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dlcbm"
Jul 20 09:48:53.074788 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:53.074718    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ed77716-0b1c-4dc5-b60b-d34cb8e3386b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dlcbm\" (UID: \"7ed77716-0b1c-4dc5-b60b-d34cb8e3386b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dlcbm"
Jul 20 09:48:53.074943 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:53.074801    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ed77716-0b1c-4dc5-b60b-d34cb8e3386b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dlcbm\" (UID: \"7ed77716-0b1c-4dc5-b60b-d34cb8e3386b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dlcbm"
Jul 20 09:48:53.074943 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:53.074844    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ed77716-0b1c-4dc5-b60b-d34cb8e3386b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dlcbm\" (UID: \"7ed77716-0b1c-4dc5-b60b-d34cb8e3386b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dlcbm"
Jul 20 09:48:53.076212 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:53.076191    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:48:53.175979 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:53.175930    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ed77716-0b1c-4dc5-b60b-d34cb8e3386b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dlcbm\" (UID: \"7ed77716-0b1c-4dc5-b60b-d34cb8e3386b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dlcbm"
Jul 20 09:48:53.175979 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:53.175980    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ed77716-0b1c-4dc5-b60b-d34cb8e3386b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dlcbm\" (UID: \"7ed77716-0b1c-4dc5-b60b-d34cb8e3386b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dlcbm"
Jul 20 09:48:53.176235 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:53.176027    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvsl2\" (UniqueName: \"kubernetes.io/projected/7ed77716-0b1c-4dc5-b60b-d34cb8e3386b-kube-api-access-mvsl2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dlcbm\" (UID: \"7ed77716-0b1c-4dc5-b60b-d34cb8e3386b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dlcbm"
Jul 20 09:48:53.176235 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:53.176071    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ed77716-0b1c-4dc5-b60b-d34cb8e3386b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dlcbm\" (UID: \"7ed77716-0b1c-4dc5-b60b-d34cb8e3386b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dlcbm"
Jul 20 09:48:53.176235 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:53.176114    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ed77716-0b1c-4dc5-b60b-d34cb8e3386b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dlcbm\" (UID: \"7ed77716-0b1c-4dc5-b60b-d34cb8e3386b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dlcbm"
Jul 20 09:48:53.176235 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:53.176162    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ed77716-0b1c-4dc5-b60b-d34cb8e3386b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dlcbm\" (UID: \"7ed77716-0b1c-4dc5-b60b-d34cb8e3386b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dlcbm"
Jul 20 09:48:53.176418 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:53.176336    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ed77716-0b1c-4dc5-b60b-d34cb8e3386b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dlcbm\" (UID: \"7ed77716-0b1c-4dc5-b60b-d34cb8e3386b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dlcbm"
Jul 20 09:48:53.176526 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:53.176505    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ed77716-0b1c-4dc5-b60b-d34cb8e3386b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dlcbm\" (UID: \"7ed77716-0b1c-4dc5-b60b-d34cb8e3386b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dlcbm"
Jul 20 09:48:53.176569 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:53.176512    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ed77716-0b1c-4dc5-b60b-d34cb8e3386b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dlcbm\" (UID: \"7ed77716-0b1c-4dc5-b60b-d34cb8e3386b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dlcbm"
Jul 20 09:48:53.178525 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:53.178497    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ed77716-0b1c-4dc5-b60b-d34cb8e3386b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dlcbm\" (UID: \"7ed77716-0b1c-4dc5-b60b-d34cb8e3386b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dlcbm"
Jul 20 09:48:53.178831 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:53.178810    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ed77716-0b1c-4dc5-b60b-d34cb8e3386b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dlcbm\" (UID: \"7ed77716-0b1c-4dc5-b60b-d34cb8e3386b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dlcbm"
Jul 20 09:48:53.184983 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:53.184950    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvsl2\" (UniqueName: \"kubernetes.io/projected/7ed77716-0b1c-4dc5-b60b-d34cb8e3386b-kube-api-access-mvsl2\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dlcbm\" (UID: \"7ed77716-0b1c-4dc5-b60b-d34cb8e3386b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dlcbm"
Jul 20 09:48:53.336847 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:53.336770    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dlcbm"
Jul 20 09:48:53.411908 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:53.411882    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw"
Jul 20 09:48:53.412054 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:53.411947    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw"
Jul 20 09:48:53.425895 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:53.425870    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw"
Jul 20 09:48:53.470855 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:53.470833    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dlcbm"]
Jul 20 09:48:53.473052 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:48:53.473024    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ed77716_0b1c_4dc5_b60b_d34cb8e3386b.slice/crio-1b008240a28d6306f7b9abb09d0ed690255f2fe8461d9257d2befc2cdb02292b WatchSource:0}: Error finding container 1b008240a28d6306f7b9abb09d0ed690255f2fe8461d9257d2befc2cdb02292b: Status 404 returned error can't find the container with id 1b008240a28d6306f7b9abb09d0ed690255f2fe8461d9257d2befc2cdb02292b
Jul 20 09:48:54.201418 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:54.201378    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dlcbm" event={"ID":"7ed77716-0b1c-4dc5-b60b-d34cb8e3386b","Type":"ContainerStarted","Data":"89573c745dcd2f6036ed7d69e4d65543f316c6584a47acf1cf96531a3c7dcdb5"}
Jul 20 09:48:54.201883 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:54.201444    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dlcbm" event={"ID":"7ed77716-0b1c-4dc5-b60b-d34cb8e3386b","Type":"ContainerStarted","Data":"1b008240a28d6306f7b9abb09d0ed690255f2fe8461d9257d2befc2cdb02292b"}
Jul 20 09:48:54.213385 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:54.213359    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw"
Jul 20 09:48:54.220927 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:48:54.220885    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dlcbm" podStartSLOduration=2.054611928 podStartE2EDuration="2.22087053s" totalImagesPullingTime="166.258602ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:48:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:48:54.219222063 +0000 UTC m=+586.100668393" watchObservedRunningTime="2026-07-20 09:48:54.22087053 +0000 UTC m=+586.102316838"
Jul 20 09:49:02.430414 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:02.430377    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:49:03.337106 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:03.337069    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dlcbm"
Jul 20 09:49:03.337273 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:03.337141    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dlcbm"
Jul 20 09:49:03.349302 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:03.349274    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dlcbm"
Jul 20 09:49:04.258156 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:04.258077    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dlcbm"
Jul 20 09:49:06.138848 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:06.138817    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:49:08.599754 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:08.599728    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rgb4r_d6c73ac6-85c5-4b3f-aa58-71ac88099c0a/ovn-acl-logging/0.log"
Jul 20 09:49:08.600319 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:08.599910    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rgb4r_d6c73ac6-85c5-4b3f-aa58-71ac88099c0a/ovn-acl-logging/0.log"
Jul 20 09:49:13.108412 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:13.108379    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:49:19.335443 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:19.335403    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:49:29.095602 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:29.095569    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:49:36.518055 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:36.517952    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x"]
Jul 20 09:49:36.521727 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:36.521706    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x"
Jul 20 09:49:36.524092 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:36.524067    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 20 09:49:36.531772 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:36.531751    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x"]
Jul 20 09:49:36.546871 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:36.546845    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4b50805-a167-4567-bf86-1277717f9ae9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x\" (UID: \"e4b50805-a167-4567-bf86-1277717f9ae9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x"
Jul 20 09:49:36.547099 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:36.547073    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4b50805-a167-4567-bf86-1277717f9ae9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x\" (UID: \"e4b50805-a167-4567-bf86-1277717f9ae9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x"
Jul 20 09:49:36.547212 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:36.547117    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4b50805-a167-4567-bf86-1277717f9ae9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x\" (UID: \"e4b50805-a167-4567-bf86-1277717f9ae9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x"
Jul 20 09:49:36.547212 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:36.547144    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4b50805-a167-4567-bf86-1277717f9ae9-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x\" (UID: \"e4b50805-a167-4567-bf86-1277717f9ae9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x"
Jul 20 09:49:36.547327 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:36.547283    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqm5x\" (UniqueName: \"kubernetes.io/projected/e4b50805-a167-4567-bf86-1277717f9ae9-kube-api-access-gqm5x\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x\" (UID: \"e4b50805-a167-4567-bf86-1277717f9ae9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x"
Jul 20 09:49:36.547380 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:36.547332    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4b50805-a167-4567-bf86-1277717f9ae9-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x\" (UID: \"e4b50805-a167-4567-bf86-1277717f9ae9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x"
Jul 20 09:49:36.635760 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:36.635732    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:49:36.648697 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:36.648672    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4b50805-a167-4567-bf86-1277717f9ae9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x\" (UID: \"e4b50805-a167-4567-bf86-1277717f9ae9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x"
Jul 20 09:49:36.648821 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:36.648727    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4b50805-a167-4567-bf86-1277717f9ae9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x\" (UID: \"e4b50805-a167-4567-bf86-1277717f9ae9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x"
Jul 20 09:49:36.648821 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:36.648756    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4b50805-a167-4567-bf86-1277717f9ae9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x\" (UID: \"e4b50805-a167-4567-bf86-1277717f9ae9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x"
Jul 20 09:49:36.648821 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:36.648781    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4b50805-a167-4567-bf86-1277717f9ae9-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x\" (UID: \"e4b50805-a167-4567-bf86-1277717f9ae9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x"
Jul 20 09:49:36.649012 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:36.648848    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqm5x\" (UniqueName: \"kubernetes.io/projected/e4b50805-a167-4567-bf86-1277717f9ae9-kube-api-access-gqm5x\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x\" (UID: \"e4b50805-a167-4567-bf86-1277717f9ae9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x"
Jul 20 09:49:36.649012 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:36.648888    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4b50805-a167-4567-bf86-1277717f9ae9-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x\" (UID: \"e4b50805-a167-4567-bf86-1277717f9ae9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x"
Jul 20 09:49:36.649118 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:36.649078    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4b50805-a167-4567-bf86-1277717f9ae9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x\" (UID: \"e4b50805-a167-4567-bf86-1277717f9ae9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x"
Jul 20 09:49:36.649174 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:36.649119    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4b50805-a167-4567-bf86-1277717f9ae9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x\" (UID: \"e4b50805-a167-4567-bf86-1277717f9ae9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x"
Jul 20 09:49:36.649259 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:36.649235    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4b50805-a167-4567-bf86-1277717f9ae9-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x\" (UID: \"e4b50805-a167-4567-bf86-1277717f9ae9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x"
Jul 20 09:49:36.651014 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:36.650997    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4b50805-a167-4567-bf86-1277717f9ae9-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x\" (UID: \"e4b50805-a167-4567-bf86-1277717f9ae9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x"
Jul 20 09:49:36.651257 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:36.651240    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4b50805-a167-4567-bf86-1277717f9ae9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x\" (UID: \"e4b50805-a167-4567-bf86-1277717f9ae9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x"
Jul 20 09:49:36.657321 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:36.657298    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqm5x\" (UniqueName: \"kubernetes.io/projected/e4b50805-a167-4567-bf86-1277717f9ae9-kube-api-access-gqm5x\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x\" (UID: \"e4b50805-a167-4567-bf86-1277717f9ae9\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x"
Jul 20 09:49:36.832016 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:36.831936    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x"
Jul 20 09:49:36.987921 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:36.987763    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x"]
Jul 20 09:49:36.990785 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:49:36.990757    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode4b50805_a167_4567_bf86_1277717f9ae9.slice/crio-fb3309f60d14247db4575005b5743956f7be503f6d1083ee9b12426c7ef7de63 WatchSource:0}: Error finding container fb3309f60d14247db4575005b5743956f7be503f6d1083ee9b12426c7ef7de63: Status 404 returned error can't find the container with id fb3309f60d14247db4575005b5743956f7be503f6d1083ee9b12426c7ef7de63
Jul 20 09:49:36.994948 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:36.994929    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 09:49:37.408261 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:37.408222    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x" event={"ID":"e4b50805-a167-4567-bf86-1277717f9ae9","Type":"ContainerStarted","Data":"54ed86e83507d359ce07dc46e89d4ebb231ccc226dcac39ce94f9b1d9cdbde60"}
Jul 20 09:49:37.408261 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:37.408268    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x" event={"ID":"e4b50805-a167-4567-bf86-1277717f9ae9","Type":"ContainerStarted","Data":"fb3309f60d14247db4575005b5743956f7be503f6d1083ee9b12426c7ef7de63"}
Jul 20 09:49:37.427218 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:37.427138    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x" podStartSLOduration=1.260035098 podStartE2EDuration="1.427125236s" totalImagesPullingTime="167.090138ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:49:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:49:37.426390457 +0000 UTC m=+629.307836777" watchObservedRunningTime="2026-07-20 09:49:37.427125236 +0000 UTC m=+629.308571543"
Jul 20 09:49:46.832222 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:46.832183    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x"
Jul 20 09:49:46.832691 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:46.832241    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x"
Jul 20 09:49:46.844812 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:46.844784    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x"
Jul 20 09:49:47.467956 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:49:47.467926    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x"
Jul 20 09:50:01.822722 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:50:01.822685    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:50:01.926309 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:50:01.926280    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:50:03.845755 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:50:03.845717    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:50:03.946296 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:50:03.946267    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:50:11.444807 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:50:11.444767    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:50:33.058466 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:50:33.058426    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:50:55.796287 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:50:55.796247    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:50:55.907995 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:50:55.907953    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:50:57.124849 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:50:57.124805    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:50:57.248281 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:50:57.248248    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:51:18.070063 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:51:18.070018    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:51:18.171024 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:51:18.170948    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:52:02.380194 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:52:02.380161    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:52:02.479624 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:52:02.479590    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:52:09.168441 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:52:09.168407    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-67dc865778-dwlfp"]
Jul 20 09:52:09.168945 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:52:09.168619    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-67dc865778-dwlfp" podUID="72568a53-ca51-4430-abea-b3af6c6ff331" containerName="manager" containerID="cri-o://1147b5778cf0560e4eacb09cbe09be746f9e525241a13ec5f73103631bd8de46" gracePeriod=30
Jul 20 09:52:09.416747 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:52:09.416724    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67dc865778-dwlfp"
Jul 20 09:52:09.441237 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:52:09.441176    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72568a53-ca51-4430-abea-b3af6c6ff331-webhook-cert\") pod \"72568a53-ca51-4430-abea-b3af6c6ff331\" (UID: \"72568a53-ca51-4430-abea-b3af6c6ff331\") "
Jul 20 09:52:09.441348 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:52:09.441271    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kldh6\" (UniqueName: \"kubernetes.io/projected/72568a53-ca51-4430-abea-b3af6c6ff331-kube-api-access-kldh6\") pod \"72568a53-ca51-4430-abea-b3af6c6ff331\" (UID: \"72568a53-ca51-4430-abea-b3af6c6ff331\") "
Jul 20 09:52:09.443126 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:52:09.443097    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72568a53-ca51-4430-abea-b3af6c6ff331-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "72568a53-ca51-4430-abea-b3af6c6ff331" (UID: "72568a53-ca51-4430-abea-b3af6c6ff331"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 09:52:09.443218 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:52:09.443145    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72568a53-ca51-4430-abea-b3af6c6ff331-kube-api-access-kldh6" (OuterVolumeSpecName: "kube-api-access-kldh6") pod "72568a53-ca51-4430-abea-b3af6c6ff331" (UID: "72568a53-ca51-4430-abea-b3af6c6ff331"). InnerVolumeSpecName "kube-api-access-kldh6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 09:52:09.542672 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:52:09.542643    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kldh6\" (UniqueName: \"kubernetes.io/projected/72568a53-ca51-4430-abea-b3af6c6ff331-kube-api-access-kldh6\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 09:52:09.542672 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:52:09.542672    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72568a53-ca51-4430-abea-b3af6c6ff331-webhook-cert\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 09:52:10.133037 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:52:10.133002    2581 generic.go:356] "Generic (PLEG): container finished" podID="72568a53-ca51-4430-abea-b3af6c6ff331" containerID="1147b5778cf0560e4eacb09cbe09be746f9e525241a13ec5f73103631bd8de46" exitCode=0
Jul 20 09:52:10.133208 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:52:10.133045    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67dc865778-dwlfp"
Jul 20 09:52:10.133208 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:52:10.133086    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67dc865778-dwlfp" event={"ID":"72568a53-ca51-4430-abea-b3af6c6ff331","Type":"ContainerDied","Data":"1147b5778cf0560e4eacb09cbe09be746f9e525241a13ec5f73103631bd8de46"}
Jul 20 09:52:10.133208 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:52:10.133138    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67dc865778-dwlfp" event={"ID":"72568a53-ca51-4430-abea-b3af6c6ff331","Type":"ContainerDied","Data":"6d9ed15c8257c945705453fd7a151bf9fb76438f6c6b3a16cc5f430cf7857869"}
Jul 20 09:52:10.133208 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:52:10.133160    2581 scope.go:117] "RemoveContainer" containerID="1147b5778cf0560e4eacb09cbe09be746f9e525241a13ec5f73103631bd8de46"
Jul 20 09:52:10.143274 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:52:10.143243    2581 scope.go:117] "RemoveContainer" containerID="1147b5778cf0560e4eacb09cbe09be746f9e525241a13ec5f73103631bd8de46"
Jul 20 09:52:10.143684 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:52:10.143655    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1147b5778cf0560e4eacb09cbe09be746f9e525241a13ec5f73103631bd8de46\": container with ID starting with 1147b5778cf0560e4eacb09cbe09be746f9e525241a13ec5f73103631bd8de46 not found: ID does not exist" containerID="1147b5778cf0560e4eacb09cbe09be746f9e525241a13ec5f73103631bd8de46"
Jul 20 09:52:10.143784 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:52:10.143691    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1147b5778cf0560e4eacb09cbe09be746f9e525241a13ec5f73103631bd8de46"} err="failed to get container status \"1147b5778cf0560e4eacb09cbe09be746f9e525241a13ec5f73103631bd8de46\": rpc error: code = NotFound desc = could not find container \"1147b5778cf0560e4eacb09cbe09be746f9e525241a13ec5f73103631bd8de46\": container with ID starting with 1147b5778cf0560e4eacb09cbe09be746f9e525241a13ec5f73103631bd8de46 not found: ID does not exist"
Jul 20 09:52:10.155775 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:52:10.155749    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-67dc865778-dwlfp"]
Jul 20 09:52:10.160234 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:52:10.160215    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-67dc865778-dwlfp"]
Jul 20 09:52:11.464820 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:52:11.464787    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72568a53-ca51-4430-abea-b3af6c6ff331" path="/var/lib/kubelet/pods/72568a53-ca51-4430-abea-b3af6c6ff331/volumes"
Jul 20 09:53:10.987833 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:10.987794    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-67dc865778-tx7ls"]
Jul 20 09:53:10.988234 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:10.988216    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72568a53-ca51-4430-abea-b3af6c6ff331" containerName="manager"
Jul 20 09:53:10.988234 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:10.988228    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="72568a53-ca51-4430-abea-b3af6c6ff331" containerName="manager"
Jul 20 09:53:10.988315 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:10.988311    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="72568a53-ca51-4430-abea-b3af6c6ff331" containerName="manager"
Jul 20 09:53:10.991479 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:10.991464    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67dc865778-tx7ls"
Jul 20 09:53:10.994434 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:10.994412    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 20 09:53:10.995555 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:10.995534    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-gmv8v\""
Jul 20 09:53:10.995648 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:10.995537    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 20 09:53:11.004615 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:11.004592    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67dc865778-tx7ls"]
Jul 20 09:53:11.056934 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:11.056910    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv9wv\" (UniqueName: \"kubernetes.io/projected/c5a1ac79-db04-421b-bb08-1ed57bdf7e60-kube-api-access-hv9wv\") pod \"maas-controller-67dc865778-tx7ls\" (UID: \"c5a1ac79-db04-421b-bb08-1ed57bdf7e60\") " pod="opendatahub/maas-controller-67dc865778-tx7ls"
Jul 20 09:53:11.057046 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:11.057010    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c5a1ac79-db04-421b-bb08-1ed57bdf7e60-webhook-cert\") pod \"maas-controller-67dc865778-tx7ls\" (UID: \"c5a1ac79-db04-421b-bb08-1ed57bdf7e60\") " pod="opendatahub/maas-controller-67dc865778-tx7ls"
Jul 20 09:53:11.157934 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:11.157913    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c5a1ac79-db04-421b-bb08-1ed57bdf7e60-webhook-cert\") pod \"maas-controller-67dc865778-tx7ls\" (UID: \"c5a1ac79-db04-421b-bb08-1ed57bdf7e60\") " pod="opendatahub/maas-controller-67dc865778-tx7ls"
Jul 20 09:53:11.158044 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:11.157955    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv9wv\" (UniqueName: \"kubernetes.io/projected/c5a1ac79-db04-421b-bb08-1ed57bdf7e60-kube-api-access-hv9wv\") pod \"maas-controller-67dc865778-tx7ls\" (UID: \"c5a1ac79-db04-421b-bb08-1ed57bdf7e60\") " pod="opendatahub/maas-controller-67dc865778-tx7ls"
Jul 20 09:53:11.160357 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:11.160330    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c5a1ac79-db04-421b-bb08-1ed57bdf7e60-webhook-cert\") pod \"maas-controller-67dc865778-tx7ls\" (UID: \"c5a1ac79-db04-421b-bb08-1ed57bdf7e60\") " pod="opendatahub/maas-controller-67dc865778-tx7ls"
Jul 20 09:53:11.166498 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:11.166470    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv9wv\" (UniqueName: \"kubernetes.io/projected/c5a1ac79-db04-421b-bb08-1ed57bdf7e60-kube-api-access-hv9wv\") pod \"maas-controller-67dc865778-tx7ls\" (UID: \"c5a1ac79-db04-421b-bb08-1ed57bdf7e60\") " pod="opendatahub/maas-controller-67dc865778-tx7ls"
Jul 20 09:53:11.301208 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:11.301147    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67dc865778-tx7ls"
Jul 20 09:53:11.448218 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:11.448190    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67dc865778-tx7ls"]
Jul 20 09:53:11.450726 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:53:11.450703    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5a1ac79_db04_421b_bb08_1ed57bdf7e60.slice/crio-512b6941cef2c544af25bcace4df07c1cc64aaa4878a4313a528f3a40b15f7c6 WatchSource:0}: Error finding container 512b6941cef2c544af25bcace4df07c1cc64aaa4878a4313a528f3a40b15f7c6: Status 404 returned error can't find the container with id 512b6941cef2c544af25bcace4df07c1cc64aaa4878a4313a528f3a40b15f7c6
Jul 20 09:53:12.438206 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:12.438173    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67dc865778-tx7ls" event={"ID":"c5a1ac79-db04-421b-bb08-1ed57bdf7e60","Type":"ContainerStarted","Data":"316a9cc6b76038fab6c9b39d6549ac2212eb7749e4a9df0e5aebd62bdc814293"}
Jul 20 09:53:12.438566 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:12.438232    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-67dc865778-tx7ls"
Jul 20 09:53:12.438566 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:12.438248    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67dc865778-tx7ls" event={"ID":"c5a1ac79-db04-421b-bb08-1ed57bdf7e60","Type":"ContainerStarted","Data":"512b6941cef2c544af25bcace4df07c1cc64aaa4878a4313a528f3a40b15f7c6"}
Jul 20 09:53:12.458788 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:12.458741    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-67dc865778-tx7ls" podStartSLOduration=2.069765436 podStartE2EDuration="2.458725833s" totalImagesPullingTime="388.960397ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:53:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:53:12.456952422 +0000 UTC m=+844.338398759" watchObservedRunningTime="2026-07-20 09:53:12.458725833 +0000 UTC m=+844.340172141"
Jul 20 09:53:23.444948 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:23.444920    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-67dc865778-tx7ls"
Jul 20 09:53:28.024764 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:28.024727    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:53:28.118122 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:28.118090    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-67dc865778-tx7ls"]
Jul 20 09:53:28.118287 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:28.118266    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-67dc865778-tx7ls" podUID="c5a1ac79-db04-421b-bb08-1ed57bdf7e60" containerName="manager" containerID="cri-o://316a9cc6b76038fab6c9b39d6549ac2212eb7749e4a9df0e5aebd62bdc814293" gracePeriod=30
Jul 20 09:53:28.366293 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:28.366269    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67dc865778-tx7ls"
Jul 20 09:53:28.505819 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:28.505791    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c5a1ac79-db04-421b-bb08-1ed57bdf7e60-webhook-cert\") pod \"c5a1ac79-db04-421b-bb08-1ed57bdf7e60\" (UID: \"c5a1ac79-db04-421b-bb08-1ed57bdf7e60\") "
Jul 20 09:53:28.505989 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:28.505832    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hv9wv\" (UniqueName: \"kubernetes.io/projected/c5a1ac79-db04-421b-bb08-1ed57bdf7e60-kube-api-access-hv9wv\") pod \"c5a1ac79-db04-421b-bb08-1ed57bdf7e60\" (UID: \"c5a1ac79-db04-421b-bb08-1ed57bdf7e60\") "
Jul 20 09:53:28.507655 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:28.507629    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5a1ac79-db04-421b-bb08-1ed57bdf7e60-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c5a1ac79-db04-421b-bb08-1ed57bdf7e60" (UID: "c5a1ac79-db04-421b-bb08-1ed57bdf7e60"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 09:53:28.507796 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:28.507777    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5a1ac79-db04-421b-bb08-1ed57bdf7e60-kube-api-access-hv9wv" (OuterVolumeSpecName: "kube-api-access-hv9wv") pod "c5a1ac79-db04-421b-bb08-1ed57bdf7e60" (UID: "c5a1ac79-db04-421b-bb08-1ed57bdf7e60"). InnerVolumeSpecName "kube-api-access-hv9wv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 09:53:28.517709 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:28.517683    2581 generic.go:356] "Generic (PLEG): container finished" podID="c5a1ac79-db04-421b-bb08-1ed57bdf7e60" containerID="316a9cc6b76038fab6c9b39d6549ac2212eb7749e4a9df0e5aebd62bdc814293" exitCode=0
Jul 20 09:53:28.517864 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:28.517717    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67dc865778-tx7ls"
Jul 20 09:53:28.517864 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:28.517774    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67dc865778-tx7ls" event={"ID":"c5a1ac79-db04-421b-bb08-1ed57bdf7e60","Type":"ContainerDied","Data":"316a9cc6b76038fab6c9b39d6549ac2212eb7749e4a9df0e5aebd62bdc814293"}
Jul 20 09:53:28.517864 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:28.517843    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67dc865778-tx7ls" event={"ID":"c5a1ac79-db04-421b-bb08-1ed57bdf7e60","Type":"ContainerDied","Data":"512b6941cef2c544af25bcace4df07c1cc64aaa4878a4313a528f3a40b15f7c6"}
Jul 20 09:53:28.518041 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:28.517878    2581 scope.go:117] "RemoveContainer" containerID="316a9cc6b76038fab6c9b39d6549ac2212eb7749e4a9df0e5aebd62bdc814293"
Jul 20 09:53:28.526694 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:28.526680    2581 scope.go:117] "RemoveContainer" containerID="316a9cc6b76038fab6c9b39d6549ac2212eb7749e4a9df0e5aebd62bdc814293"
Jul 20 09:53:28.526941 ip-10-0-140-236 kubenswrapper[2581]: E0720 09:53:28.526925    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"316a9cc6b76038fab6c9b39d6549ac2212eb7749e4a9df0e5aebd62bdc814293\": container with ID starting with 316a9cc6b76038fab6c9b39d6549ac2212eb7749e4a9df0e5aebd62bdc814293 not found: ID does not exist" containerID="316a9cc6b76038fab6c9b39d6549ac2212eb7749e4a9df0e5aebd62bdc814293"
Jul 20 09:53:28.527172 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:28.526947    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"316a9cc6b76038fab6c9b39d6549ac2212eb7749e4a9df0e5aebd62bdc814293"} err="failed to get container status \"316a9cc6b76038fab6c9b39d6549ac2212eb7749e4a9df0e5aebd62bdc814293\": rpc error: code = NotFound desc = could not find container \"316a9cc6b76038fab6c9b39d6549ac2212eb7749e4a9df0e5aebd62bdc814293\": container with ID starting with 316a9cc6b76038fab6c9b39d6549ac2212eb7749e4a9df0e5aebd62bdc814293 not found: ID does not exist"
Jul 20 09:53:28.545102 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:28.545047    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-67dc865778-tx7ls"]
Jul 20 09:53:28.553305 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:28.553286    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-67dc865778-tx7ls"]
Jul 20 09:53:28.607343 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:28.607318    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c5a1ac79-db04-421b-bb08-1ed57bdf7e60-webhook-cert\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 09:53:28.607343 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:28.607341    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hv9wv\" (UniqueName: \"kubernetes.io/projected/c5a1ac79-db04-421b-bb08-1ed57bdf7e60-kube-api-access-hv9wv\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 09:53:29.260346 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:29.260315    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:53:29.392849 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:29.392817    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-67dc865778-2bf7n"]
Jul 20 09:53:29.393313 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:29.393297    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5a1ac79-db04-421b-bb08-1ed57bdf7e60" containerName="manager"
Jul 20 09:53:29.393374 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:29.393315    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5a1ac79-db04-421b-bb08-1ed57bdf7e60" containerName="manager"
Jul 20 09:53:29.393411 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:29.393378    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5a1ac79-db04-421b-bb08-1ed57bdf7e60" containerName="manager"
Jul 20 09:53:29.397689 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:29.397672    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67dc865778-2bf7n"
Jul 20 09:53:29.400027 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:29.400009    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 20 09:53:29.400848 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:29.400830    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 20 09:53:29.400942 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:29.400927    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-gmv8v\""
Jul 20 09:53:29.405827 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:29.405806    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67dc865778-2bf7n"]
Jul 20 09:53:29.469390 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:29.469360    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5a1ac79-db04-421b-bb08-1ed57bdf7e60" path="/var/lib/kubelet/pods/c5a1ac79-db04-421b-bb08-1ed57bdf7e60/volumes"
Jul 20 09:53:29.515090 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:29.515032    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0934e6b6-583c-48b1-b866-cd3fc3b7f2fd-webhook-cert\") pod \"maas-controller-67dc865778-2bf7n\" (UID: \"0934e6b6-583c-48b1-b866-cd3fc3b7f2fd\") " pod="opendatahub/maas-controller-67dc865778-2bf7n"
Jul 20 09:53:29.515090 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:29.515073    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p57mg\" (UniqueName: \"kubernetes.io/projected/0934e6b6-583c-48b1-b866-cd3fc3b7f2fd-kube-api-access-p57mg\") pod \"maas-controller-67dc865778-2bf7n\" (UID: \"0934e6b6-583c-48b1-b866-cd3fc3b7f2fd\") " pod="opendatahub/maas-controller-67dc865778-2bf7n"
Jul 20 09:53:29.615761 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:29.615726    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0934e6b6-583c-48b1-b866-cd3fc3b7f2fd-webhook-cert\") pod \"maas-controller-67dc865778-2bf7n\" (UID: \"0934e6b6-583c-48b1-b866-cd3fc3b7f2fd\") " pod="opendatahub/maas-controller-67dc865778-2bf7n"
Jul 20 09:53:29.615883 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:29.615777    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p57mg\" (UniqueName: \"kubernetes.io/projected/0934e6b6-583c-48b1-b866-cd3fc3b7f2fd-kube-api-access-p57mg\") pod \"maas-controller-67dc865778-2bf7n\" (UID: \"0934e6b6-583c-48b1-b866-cd3fc3b7f2fd\") " pod="opendatahub/maas-controller-67dc865778-2bf7n"
Jul 20 09:53:29.618083 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:29.618057    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0934e6b6-583c-48b1-b866-cd3fc3b7f2fd-webhook-cert\") pod \"maas-controller-67dc865778-2bf7n\" (UID: \"0934e6b6-583c-48b1-b866-cd3fc3b7f2fd\") " pod="opendatahub/maas-controller-67dc865778-2bf7n"
Jul 20 09:53:29.624089 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:29.624071    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p57mg\" (UniqueName: \"kubernetes.io/projected/0934e6b6-583c-48b1-b866-cd3fc3b7f2fd-kube-api-access-p57mg\") pod \"maas-controller-67dc865778-2bf7n\" (UID: \"0934e6b6-583c-48b1-b866-cd3fc3b7f2fd\") " pod="opendatahub/maas-controller-67dc865778-2bf7n"
Jul 20 09:53:29.710076 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:29.710049    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67dc865778-2bf7n"
Jul 20 09:53:29.840226 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:29.840204    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67dc865778-2bf7n"]
Jul 20 09:53:29.843001 ip-10-0-140-236 kubenswrapper[2581]: W0720 09:53:29.842956    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0934e6b6_583c_48b1_b866_cd3fc3b7f2fd.slice/crio-d1ed30cc9a3fd9cb3c8085985c41fcc2a19c6f91a2c8b507c1f080dec1501aad WatchSource:0}: Error finding container d1ed30cc9a3fd9cb3c8085985c41fcc2a19c6f91a2c8b507c1f080dec1501aad: Status 404 returned error can't find the container with id d1ed30cc9a3fd9cb3c8085985c41fcc2a19c6f91a2c8b507c1f080dec1501aad
Jul 20 09:53:30.529888 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:30.529791    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67dc865778-2bf7n" event={"ID":"0934e6b6-583c-48b1-b866-cd3fc3b7f2fd","Type":"ContainerStarted","Data":"4a6cb6770df7edf7157de5877557e11a83463fa1b8934946fe97aa794c28e9f1"}
Jul 20 09:53:30.529888 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:30.529843    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67dc865778-2bf7n" event={"ID":"0934e6b6-583c-48b1-b866-cd3fc3b7f2fd","Type":"ContainerStarted","Data":"d1ed30cc9a3fd9cb3c8085985c41fcc2a19c6f91a2c8b507c1f080dec1501aad"}
Jul 20 09:53:30.529888 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:30.529870    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-67dc865778-2bf7n"
Jul 20 09:53:30.550407 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:30.550358    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-67dc865778-2bf7n" podStartSLOduration=1.15537742 podStartE2EDuration="1.550342985s" totalImagesPullingTime="394.965565ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:53:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:53:30.548942739 +0000 UTC m=+862.430389048" watchObservedRunningTime="2026-07-20 09:53:30.550342985 +0000 UTC m=+862.431789292"
Jul 20 09:53:41.536414 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:53:41.536385    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-67dc865778-2bf7n"
Jul 20 09:54:05.061633 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:54:05.061543    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:54:06.551615 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:54:06.551568    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:54:08.631425 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:54:08.631398    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rgb4r_d6c73ac6-85c5-4b3f-aa58-71ac88099c0a/ovn-acl-logging/0.log"
Jul 20 09:54:08.633023 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:54:08.633005    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rgb4r_d6c73ac6-85c5-4b3f-aa58-71ac88099c0a/ovn-acl-logging/0.log"
Jul 20 09:54:11.229124 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:54:11.229086    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:54:11.360575 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:54:11.360537    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:54:11.460884 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:54:11.460850    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:54:11.633227 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:54:11.633195    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:54:17.349197 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:54:17.349161    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:54:17.448596 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:54:17.448562    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:57:19.380365 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:57:19.380333    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:57:48.774136 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:57:48.774096    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:58:27.012164 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:58:27.012130    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:58:47.958168 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:58:47.958083    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 09:59:08.664155 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:59:08.664126    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rgb4r_d6c73ac6-85c5-4b3f-aa58-71ac88099c0a/ovn-acl-logging/0.log"
Jul 20 09:59:08.665581 ip-10-0-140-236 kubenswrapper[2581]: I0720 09:59:08.665559    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rgb4r_d6c73ac6-85c5-4b3f-aa58-71ac88099c0a/ovn-acl-logging/0.log"
Jul 20 10:00:00.139085 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:00:00.139051    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742360-v27tt"]
Jul 20 10:00:00.142626 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:00:00.142607    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742360-v27tt"
Jul 20 10:00:00.145223 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:00:00.145203    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6jlzx\""
Jul 20 10:00:00.150620 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:00:00.150599    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742360-v27tt"]
Jul 20 10:00:00.153482 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:00:00.153468    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742360-v27tt"
Jul 20 10:00:00.291385 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:00:00.291288    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742360-v27tt"]
Jul 20 10:00:00.293766 ip-10-0-140-236 kubenswrapper[2581]: W0720 10:00:00.293735    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cbbc3b2_4fb2_4e5d_bec2_b41c3fad5dfd.slice/crio-16570259e28ce5f04228470a3cddd48761c3e3285e12b14d1639287d855bd153 WatchSource:0}: Error finding container 16570259e28ce5f04228470a3cddd48761c3e3285e12b14d1639287d855bd153: Status 404 returned error can't find the container with id 16570259e28ce5f04228470a3cddd48761c3e3285e12b14d1639287d855bd153
Jul 20 10:00:00.295691 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:00:00.295673    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 10:00:00.365521 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:00:00.365482    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742360-v27tt" event={"ID":"8cbbc3b2-4fb2-4e5d-bec2-b41c3fad5dfd","Type":"ContainerStarted","Data":"16570259e28ce5f04228470a3cddd48761c3e3285e12b14d1639287d855bd153"}
Jul 20 10:00:23.482926 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:00:23.482836    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742360-v27tt" event={"ID":"8cbbc3b2-4fb2-4e5d-bec2-b41c3fad5dfd","Type":"ContainerStarted","Data":"8bd900f9080aa032577a95fd9e402f48aecc0794024065ccf258d8b9afdc8717"}
Jul 20 10:00:23.499179 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:00:23.498999    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742360-v27tt" podStartSLOduration=0.930678083 podStartE2EDuration="23.498980096s" totalImagesPullingTime="22.568302013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:00:23.498357281 +0000 UTC m=+1275.379803589" watchObservedRunningTime="2026-07-20 10:00:23.498980096 +0000 UTC m=+1275.380426401"
Jul 20 10:00:24.489080 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:00:24.489046    2581 generic.go:356] "Generic (PLEG): container finished" podID="8cbbc3b2-4fb2-4e5d-bec2-b41c3fad5dfd" containerID="8bd900f9080aa032577a95fd9e402f48aecc0794024065ccf258d8b9afdc8717" exitCode=0
Jul 20 10:00:24.489450 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:00:24.489096    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742360-v27tt" event={"ID":"8cbbc3b2-4fb2-4e5d-bec2-b41c3fad5dfd","Type":"ContainerDied","Data":"8bd900f9080aa032577a95fd9e402f48aecc0794024065ccf258d8b9afdc8717"}
Jul 20 10:00:25.629749 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:00:25.629723    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742360-v27tt"
Jul 20 10:00:26.500234 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:00:26.500204    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742360-v27tt"
Jul 20 10:00:26.500234 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:00:26.500227    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742360-v27tt" event={"ID":"8cbbc3b2-4fb2-4e5d-bec2-b41c3fad5dfd","Type":"ContainerDied","Data":"16570259e28ce5f04228470a3cddd48761c3e3285e12b14d1639287d855bd153"}
Jul 20 10:00:26.500450 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:00:26.500266    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="16570259e28ce5f04228470a3cddd48761c3e3285e12b14d1639287d855bd153"
Jul 20 10:01:55.676470 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:01:55.676434    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:02:12.272481 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:02:12.272446    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:02:44.425195 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:02:44.425159    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:02:46.262757 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:02:46.262726    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:04:08.701237 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:04:08.701207    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rgb4r_d6c73ac6-85c5-4b3f-aa58-71ac88099c0a/ovn-acl-logging/0.log"
Jul 20 10:04:08.704950 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:04:08.704930    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rgb4r_d6c73ac6-85c5-4b3f-aa58-71ac88099c0a/ovn-acl-logging/0.log"
Jul 20 10:04:17.796120 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:04:17.796085    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:04:58.860767 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:04:58.860731    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:04:58.925913 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:04:58.925883    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:05:02.560949 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:05:02.560914    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:06:01.570284 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:01.570211    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:06:01.719227 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:01.719195    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:06:02.121713 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:02.121685    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:06:08.331747 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:08.331692    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:06:08.799215 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:08.799179    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:06:08.902217 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:08.902179    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:06:09.007609 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:09.007578    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:06:09.081257 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:09.081184    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:06:10.979422 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:10.979367    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:06:11.120738 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:11.120698    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:06:11.176193 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:11.176162    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5"]
Jul 20 10:06:11.176576 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:11.176563    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cbbc3b2-4fb2-4e5d-bec2-b41c3fad5dfd" containerName="cleanup"
Jul 20 10:06:11.176630 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:11.176578    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cbbc3b2-4fb2-4e5d-bec2-b41c3fad5dfd" containerName="cleanup"
Jul 20 10:06:11.176676 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:11.176667    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cbbc3b2-4fb2-4e5d-bec2-b41c3fad5dfd" containerName="cleanup"
Jul 20 10:06:11.179793 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:11.179773    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5"
Jul 20 10:06:11.202109 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:11.202084    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-d4aaf29e-serving-cert\""
Jul 20 10:06:11.207977 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:11.207936    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5"]
Jul 20 10:06:11.302860 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:11.302784    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg2rw\" (UniqueName: \"kubernetes.io/projected/facead98-40eb-48d8-9e4f-2547043582c1-kube-api-access-tg2rw\") pod \"maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5\" (UID: \"facead98-40eb-48d8-9e4f-2547043582c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5"
Jul 20 10:06:11.302860 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:11.302841    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/facead98-40eb-48d8-9e4f-2547043582c1-maas-api-tls\") pod \"maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5\" (UID: \"facead98-40eb-48d8-9e4f-2547043582c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5"
Jul 20 10:06:11.303056 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:11.302877    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/facead98-40eb-48d8-9e4f-2547043582c1-openshift-service-ca\") pod \"maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5\" (UID: \"facead98-40eb-48d8-9e4f-2547043582c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5"
Jul 20 10:06:11.335341 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:11.335308    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:06:11.403556 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:11.403522    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg2rw\" (UniqueName: \"kubernetes.io/projected/facead98-40eb-48d8-9e4f-2547043582c1-kube-api-access-tg2rw\") pod \"maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5\" (UID: \"facead98-40eb-48d8-9e4f-2547043582c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5"
Jul 20 10:06:11.403729 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:11.403597    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/facead98-40eb-48d8-9e4f-2547043582c1-maas-api-tls\") pod \"maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5\" (UID: \"facead98-40eb-48d8-9e4f-2547043582c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5"
Jul 20 10:06:11.403729 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:11.403638    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/facead98-40eb-48d8-9e4f-2547043582c1-openshift-service-ca\") pod \"maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5\" (UID: \"facead98-40eb-48d8-9e4f-2547043582c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5"
Jul 20 10:06:11.404309 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:11.404283    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/facead98-40eb-48d8-9e4f-2547043582c1-openshift-service-ca\") pod \"maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5\" (UID: \"facead98-40eb-48d8-9e4f-2547043582c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5"
Jul 20 10:06:11.406234 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:11.406209    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/facead98-40eb-48d8-9e4f-2547043582c1-maas-api-tls\") pod \"maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5\" (UID: \"facead98-40eb-48d8-9e4f-2547043582c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5"
Jul 20 10:06:11.416830 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:11.416807    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg2rw\" (UniqueName: \"kubernetes.io/projected/facead98-40eb-48d8-9e4f-2547043582c1-kube-api-access-tg2rw\") pod \"maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5\" (UID: \"facead98-40eb-48d8-9e4f-2547043582c1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5"
Jul 20 10:06:11.442733 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:11.442709    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:06:11.489589 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:11.489557    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5"
Jul 20 10:06:11.834651 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:11.834628    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5"]
Jul 20 10:06:11.836856 ip-10-0-140-236 kubenswrapper[2581]: W0720 10:06:11.836821    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfacead98_40eb_48d8_9e4f_2547043582c1.slice/crio-b3e6194e27785347e84d7c81ecfb419cb65260e8ce858d98b6fa96b9f49f9db6 WatchSource:0}: Error finding container b3e6194e27785347e84d7c81ecfb419cb65260e8ce858d98b6fa96b9f49f9db6: Status 404 returned error can't find the container with id b3e6194e27785347e84d7c81ecfb419cb65260e8ce858d98b6fa96b9f49f9db6
Jul 20 10:06:11.838254 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:11.838234    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 10:06:11.921624 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:11.921594    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:06:12.022004 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:12.021952    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:06:12.178271 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:12.178235    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5" event={"ID":"facead98-40eb-48d8-9e4f-2547043582c1","Type":"ContainerStarted","Data":"b3e6194e27785347e84d7c81ecfb419cb65260e8ce858d98b6fa96b9f49f9db6"}
Jul 20 10:06:13.184761 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:13.184729    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5" event={"ID":"facead98-40eb-48d8-9e4f-2547043582c1","Type":"ContainerStarted","Data":"6006c84712fc9359d1182b487e794d746c3316e3dbd07e0776d503417366d6bc"}
Jul 20 10:06:13.185156 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:13.184861    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5"
Jul 20 10:06:13.203759 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:13.203713    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5" podStartSLOduration=1.682655652 podStartE2EDuration="2.203697566s" totalImagesPullingTime="521.041914ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:06:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:06:13.202856071 +0000 UTC m=+1625.084302400" watchObservedRunningTime="2026-07-20 10:06:13.203697566 +0000 UTC m=+1625.085143911"
Jul 20 10:06:19.196958 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:19.196878    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5"
Jul 20 10:06:46.922409 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:46.922375    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5"]
Jul 20 10:06:46.923038 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:46.922623    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5" podUID="facead98-40eb-48d8-9e4f-2547043582c1" containerName="maas-api" containerID="cri-o://6006c84712fc9359d1182b487e794d746c3316e3dbd07e0776d503417366d6bc" gracePeriod=30
Jul 20 10:06:47.005094 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:47.005049    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:06:47.170750 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:47.170729    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5"
Jul 20 10:06:47.317226 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:47.317139    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/facead98-40eb-48d8-9e4f-2547043582c1-openshift-service-ca\") pod \"facead98-40eb-48d8-9e4f-2547043582c1\" (UID: \"facead98-40eb-48d8-9e4f-2547043582c1\") "
Jul 20 10:06:47.317399 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:47.317231    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/facead98-40eb-48d8-9e4f-2547043582c1-maas-api-tls\") pod \"facead98-40eb-48d8-9e4f-2547043582c1\" (UID: \"facead98-40eb-48d8-9e4f-2547043582c1\") "
Jul 20 10:06:47.317399 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:47.317259    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tg2rw\" (UniqueName: \"kubernetes.io/projected/facead98-40eb-48d8-9e4f-2547043582c1-kube-api-access-tg2rw\") pod \"facead98-40eb-48d8-9e4f-2547043582c1\" (UID: \"facead98-40eb-48d8-9e4f-2547043582c1\") "
Jul 20 10:06:47.317525 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:47.317482    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/facead98-40eb-48d8-9e4f-2547043582c1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "facead98-40eb-48d8-9e4f-2547043582c1" (UID: "facead98-40eb-48d8-9e4f-2547043582c1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 10:06:47.319461 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:47.319434    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/facead98-40eb-48d8-9e4f-2547043582c1-kube-api-access-tg2rw" (OuterVolumeSpecName: "kube-api-access-tg2rw") pod "facead98-40eb-48d8-9e4f-2547043582c1" (UID: "facead98-40eb-48d8-9e4f-2547043582c1"). InnerVolumeSpecName "kube-api-access-tg2rw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 10:06:47.319601 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:47.319584    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/facead98-40eb-48d8-9e4f-2547043582c1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "facead98-40eb-48d8-9e4f-2547043582c1" (UID: "facead98-40eb-48d8-9e4f-2547043582c1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 10:06:47.352045 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:47.352012    2581 generic.go:356] "Generic (PLEG): container finished" podID="facead98-40eb-48d8-9e4f-2547043582c1" containerID="6006c84712fc9359d1182b487e794d746c3316e3dbd07e0776d503417366d6bc" exitCode=0
Jul 20 10:06:47.352160 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:47.352053    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5" event={"ID":"facead98-40eb-48d8-9e4f-2547043582c1","Type":"ContainerDied","Data":"6006c84712fc9359d1182b487e794d746c3316e3dbd07e0776d503417366d6bc"}
Jul 20 10:06:47.352160 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:47.352066    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5"
Jul 20 10:06:47.352160 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:47.352106    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5" event={"ID":"facead98-40eb-48d8-9e4f-2547043582c1","Type":"ContainerDied","Data":"b3e6194e27785347e84d7c81ecfb419cb65260e8ce858d98b6fa96b9f49f9db6"}
Jul 20 10:06:47.352160 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:47.352135    2581 scope.go:117] "RemoveContainer" containerID="6006c84712fc9359d1182b487e794d746c3316e3dbd07e0776d503417366d6bc"
Jul 20 10:06:47.361875 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:47.361856    2581 scope.go:117] "RemoveContainer" containerID="6006c84712fc9359d1182b487e794d746c3316e3dbd07e0776d503417366d6bc"
Jul 20 10:06:47.362127 ip-10-0-140-236 kubenswrapper[2581]: E0720 10:06:47.362108    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6006c84712fc9359d1182b487e794d746c3316e3dbd07e0776d503417366d6bc\": container with ID starting with 6006c84712fc9359d1182b487e794d746c3316e3dbd07e0776d503417366d6bc not found: ID does not exist" containerID="6006c84712fc9359d1182b487e794d746c3316e3dbd07e0776d503417366d6bc"
Jul 20 10:06:47.362180 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:47.362136    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6006c84712fc9359d1182b487e794d746c3316e3dbd07e0776d503417366d6bc"} err="failed to get container status \"6006c84712fc9359d1182b487e794d746c3316e3dbd07e0776d503417366d6bc\": rpc error: code = NotFound desc = could not find container \"6006c84712fc9359d1182b487e794d746c3316e3dbd07e0776d503417366d6bc\": container with ID starting with 6006c84712fc9359d1182b487e794d746c3316e3dbd07e0776d503417366d6bc not found: ID does not exist"
Jul 20 10:06:47.374595 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:47.374575    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5"]
Jul 20 10:06:47.377647 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:47.377627    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d4aaf29e-858fbfb56b-k88t5"]
Jul 20 10:06:47.418248 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:47.418229    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/facead98-40eb-48d8-9e4f-2547043582c1-openshift-service-ca\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:06:47.418248 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:47.418248    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/facead98-40eb-48d8-9e4f-2547043582c1-maas-api-tls\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:06:47.418357 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:47.418258    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tg2rw\" (UniqueName: \"kubernetes.io/projected/facead98-40eb-48d8-9e4f-2547043582c1-kube-api-access-tg2rw\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:06:47.465575 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:47.465551    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="facead98-40eb-48d8-9e4f-2547043582c1" path="/var/lib/kubelet/pods/facead98-40eb-48d8-9e4f-2547043582c1/volumes"
Jul 20 10:06:51.595816 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:51.595785    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:06:51.758952 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:51.758914    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:06:51.997422 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:51.997388    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:06:52.215461 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:52.215424    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:06:52.357992 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:52.357948    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:06:52.501956 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:52.501925    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:06:52.814078 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:52.814002    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:06:52.916102 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:52.916067    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:06:55.362130 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:55.362081    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:06:55.576951 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:55.576914    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf"]
Jul 20 10:06:55.577432 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:55.577409    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="facead98-40eb-48d8-9e4f-2547043582c1" containerName="maas-api"
Jul 20 10:06:55.577432 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:55.577429    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="facead98-40eb-48d8-9e4f-2547043582c1" containerName="maas-api"
Jul 20 10:06:55.577593 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:55.577549    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="facead98-40eb-48d8-9e4f-2547043582c1" containerName="maas-api"
Jul 20 10:06:55.582408 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:55.582387    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf"
Jul 20 10:06:55.584626 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:55.584604    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-d95536fc-serving-cert\""
Jul 20 10:06:55.590790 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:55.590761    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf"]
Jul 20 10:06:55.608643 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:55.608611    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:06:55.691868 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:55.691795    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fbb5afb-a15a-4fc2-9a50-0805e7109170-openshift-service-ca\") pod \"maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf\" (UID: \"6fbb5afb-a15a-4fc2-9a50-0805e7109170\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf"
Jul 20 10:06:55.691868 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:55.691832    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5npz\" (UniqueName: \"kubernetes.io/projected/6fbb5afb-a15a-4fc2-9a50-0805e7109170-kube-api-access-z5npz\") pod \"maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf\" (UID: \"6fbb5afb-a15a-4fc2-9a50-0805e7109170\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf"
Jul 20 10:06:55.692108 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:55.691939    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6fbb5afb-a15a-4fc2-9a50-0805e7109170-maas-api-tls\") pod \"maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf\" (UID: \"6fbb5afb-a15a-4fc2-9a50-0805e7109170\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf"
Jul 20 10:06:55.792471 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:55.792439    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fbb5afb-a15a-4fc2-9a50-0805e7109170-openshift-service-ca\") pod \"maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf\" (UID: \"6fbb5afb-a15a-4fc2-9a50-0805e7109170\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf"
Jul 20 10:06:55.792611 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:55.792481    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5npz\" (UniqueName: \"kubernetes.io/projected/6fbb5afb-a15a-4fc2-9a50-0805e7109170-kube-api-access-z5npz\") pod \"maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf\" (UID: \"6fbb5afb-a15a-4fc2-9a50-0805e7109170\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf"
Jul 20 10:06:55.792611 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:55.792553    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6fbb5afb-a15a-4fc2-9a50-0805e7109170-maas-api-tls\") pod \"maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf\" (UID: \"6fbb5afb-a15a-4fc2-9a50-0805e7109170\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf"
Jul 20 10:06:55.793098 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:55.793077    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fbb5afb-a15a-4fc2-9a50-0805e7109170-openshift-service-ca\") pod \"maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf\" (UID: \"6fbb5afb-a15a-4fc2-9a50-0805e7109170\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf"
Jul 20 10:06:55.795129 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:55.795101    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6fbb5afb-a15a-4fc2-9a50-0805e7109170-maas-api-tls\") pod \"maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf\" (UID: \"6fbb5afb-a15a-4fc2-9a50-0805e7109170\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf"
Jul 20 10:06:55.800168 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:55.800147    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5npz\" (UniqueName: \"kubernetes.io/projected/6fbb5afb-a15a-4fc2-9a50-0805e7109170-kube-api-access-z5npz\") pod \"maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf\" (UID: \"6fbb5afb-a15a-4fc2-9a50-0805e7109170\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf"
Jul 20 10:06:55.827179 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:55.827151    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:06:55.894653 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:55.894633    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf"
Jul 20 10:06:56.150662 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:56.150629    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:06:56.235391 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:56.235374    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf"]
Jul 20 10:06:56.237514 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:56.237475    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:06:56.237785 ip-10-0-140-236 kubenswrapper[2581]: W0720 10:06:56.237761    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fbb5afb_a15a_4fc2_9a50_0805e7109170.slice/crio-6a4c2444d8c769c669c5146e66b1a8594d2df59c31f4af8754d935da4ee9a36b WatchSource:0}: Error finding container 6a4c2444d8c769c669c5146e66b1a8594d2df59c31f4af8754d935da4ee9a36b: Status 404 returned error can't find the container with id 6a4c2444d8c769c669c5146e66b1a8594d2df59c31f4af8754d935da4ee9a36b
Jul 20 10:06:56.399398 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:56.399369    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf" event={"ID":"6fbb5afb-a15a-4fc2-9a50-0805e7109170","Type":"ContainerStarted","Data":"6a4c2444d8c769c669c5146e66b1a8594d2df59c31f4af8754d935da4ee9a36b"}
Jul 20 10:06:57.406243 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:57.406205    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf" event={"ID":"6fbb5afb-a15a-4fc2-9a50-0805e7109170","Type":"ContainerStarted","Data":"ba964e61d897b4c78ec8f12f09ad6f8a27d1d5c8259389e607add99e4b9e64c6"}
Jul 20 10:06:57.406625 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:57.406265    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf"
Jul 20 10:06:57.423580 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:06:57.423527    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf" podStartSLOduration=1.973865427 podStartE2EDuration="2.42351341s" totalImagesPullingTime="449.647983ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:06:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:06:57.42191051 +0000 UTC m=+1669.303356855" watchObservedRunningTime="2026-07-20 10:06:57.42351341 +0000 UTC m=+1669.304959718"
Jul 20 10:07:03.418805 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:03.418779    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf"
Jul 20 10:07:30.735614 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:30.735532    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf"]
Jul 20 10:07:30.736137 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:30.735831    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf" podUID="6fbb5afb-a15a-4fc2-9a50-0805e7109170" containerName="maas-api" containerID="cri-o://ba964e61d897b4c78ec8f12f09ad6f8a27d1d5c8259389e607add99e4b9e64c6" gracePeriod=30
Jul 20 10:07:30.761049 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:30.761019    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:07:30.985878 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:30.985817    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf"
Jul 20 10:07:31.104731 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:31.104705    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fbb5afb-a15a-4fc2-9a50-0805e7109170-openshift-service-ca\") pod \"6fbb5afb-a15a-4fc2-9a50-0805e7109170\" (UID: \"6fbb5afb-a15a-4fc2-9a50-0805e7109170\") "
Jul 20 10:07:31.104867 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:31.104762    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6fbb5afb-a15a-4fc2-9a50-0805e7109170-maas-api-tls\") pod \"6fbb5afb-a15a-4fc2-9a50-0805e7109170\" (UID: \"6fbb5afb-a15a-4fc2-9a50-0805e7109170\") "
Jul 20 10:07:31.104867 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:31.104809    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5npz\" (UniqueName: \"kubernetes.io/projected/6fbb5afb-a15a-4fc2-9a50-0805e7109170-kube-api-access-z5npz\") pod \"6fbb5afb-a15a-4fc2-9a50-0805e7109170\" (UID: \"6fbb5afb-a15a-4fc2-9a50-0805e7109170\") "
Jul 20 10:07:31.105070 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:31.105049    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fbb5afb-a15a-4fc2-9a50-0805e7109170-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6fbb5afb-a15a-4fc2-9a50-0805e7109170" (UID: "6fbb5afb-a15a-4fc2-9a50-0805e7109170"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 10:07:31.105198 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:31.105177    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fbb5afb-a15a-4fc2-9a50-0805e7109170-openshift-service-ca\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:07:31.106804 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:31.106775    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fbb5afb-a15a-4fc2-9a50-0805e7109170-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6fbb5afb-a15a-4fc2-9a50-0805e7109170" (UID: "6fbb5afb-a15a-4fc2-9a50-0805e7109170"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 10:07:31.106902 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:31.106819    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fbb5afb-a15a-4fc2-9a50-0805e7109170-kube-api-access-z5npz" (OuterVolumeSpecName: "kube-api-access-z5npz") pod "6fbb5afb-a15a-4fc2-9a50-0805e7109170" (UID: "6fbb5afb-a15a-4fc2-9a50-0805e7109170"). InnerVolumeSpecName "kube-api-access-z5npz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 10:07:31.206033 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:31.206010    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6fbb5afb-a15a-4fc2-9a50-0805e7109170-maas-api-tls\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:07:31.206033 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:31.206030    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5npz\" (UniqueName: \"kubernetes.io/projected/6fbb5afb-a15a-4fc2-9a50-0805e7109170-kube-api-access-z5npz\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:07:31.574846 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:31.574814    2581 generic.go:356] "Generic (PLEG): container finished" podID="6fbb5afb-a15a-4fc2-9a50-0805e7109170" containerID="ba964e61d897b4c78ec8f12f09ad6f8a27d1d5c8259389e607add99e4b9e64c6" exitCode=0
Jul 20 10:07:31.575006 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:31.574851    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf"
Jul 20 10:07:31.575006 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:31.574846    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf" event={"ID":"6fbb5afb-a15a-4fc2-9a50-0805e7109170","Type":"ContainerDied","Data":"ba964e61d897b4c78ec8f12f09ad6f8a27d1d5c8259389e607add99e4b9e64c6"}
Jul 20 10:07:31.575006 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:31.574907    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf" event={"ID":"6fbb5afb-a15a-4fc2-9a50-0805e7109170","Type":"ContainerDied","Data":"6a4c2444d8c769c669c5146e66b1a8594d2df59c31f4af8754d935da4ee9a36b"}
Jul 20 10:07:31.575006 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:31.574937    2581 scope.go:117] "RemoveContainer" containerID="ba964e61d897b4c78ec8f12f09ad6f8a27d1d5c8259389e607add99e4b9e64c6"
Jul 20 10:07:31.585639 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:31.585620    2581 scope.go:117] "RemoveContainer" containerID="ba964e61d897b4c78ec8f12f09ad6f8a27d1d5c8259389e607add99e4b9e64c6"
Jul 20 10:07:31.586024 ip-10-0-140-236 kubenswrapper[2581]: E0720 10:07:31.586001    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba964e61d897b4c78ec8f12f09ad6f8a27d1d5c8259389e607add99e4b9e64c6\": container with ID starting with ba964e61d897b4c78ec8f12f09ad6f8a27d1d5c8259389e607add99e4b9e64c6 not found: ID does not exist" containerID="ba964e61d897b4c78ec8f12f09ad6f8a27d1d5c8259389e607add99e4b9e64c6"
Jul 20 10:07:31.586102 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:31.586035    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba964e61d897b4c78ec8f12f09ad6f8a27d1d5c8259389e607add99e4b9e64c6"} err="failed to get container status \"ba964e61d897b4c78ec8f12f09ad6f8a27d1d5c8259389e607add99e4b9e64c6\": rpc error: code = NotFound desc = could not find container \"ba964e61d897b4c78ec8f12f09ad6f8a27d1d5c8259389e607add99e4b9e64c6\": container with ID starting with ba964e61d897b4c78ec8f12f09ad6f8a27d1d5c8259389e607add99e4b9e64c6 not found: ID does not exist"
Jul 20 10:07:31.590785 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:31.590766    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf"]
Jul 20 10:07:31.594146 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:31.594127    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-d95536fc-c5fbf548b-srsgf"]
Jul 20 10:07:33.464789 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:33.464760    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fbb5afb-a15a-4fc2-9a50-0805e7109170" path="/var/lib/kubelet/pods/6fbb5afb-a15a-4fc2-9a50-0805e7109170/volumes"
Jul 20 10:07:35.407415 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:35.407383    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:07:35.568043 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:35.568010    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:07:35.797776 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:35.797702    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:07:36.018387 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:36.018320    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:07:36.330768 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:36.330711    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:07:36.497457 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:36.497410    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:07:38.448666 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:38.448629    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:07:38.550277 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:38.550248    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:07:38.704828 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:38.704753    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg"]
Jul 20 10:07:38.705304 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:38.705281    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fbb5afb-a15a-4fc2-9a50-0805e7109170" containerName="maas-api"
Jul 20 10:07:38.705304 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:38.705304    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fbb5afb-a15a-4fc2-9a50-0805e7109170" containerName="maas-api"
Jul 20 10:07:38.705514 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:38.705417    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fbb5afb-a15a-4fc2-9a50-0805e7109170" containerName="maas-api"
Jul 20 10:07:38.709740 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:38.709722    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg"
Jul 20 10:07:38.712243 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:38.712224    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-c5c080c1-serving-cert\""
Jul 20 10:07:38.718193 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:38.718171    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg"]
Jul 20 10:07:38.737068 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:38.737043    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:07:38.873545 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:38.873519    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9bxb\" (UniqueName: \"kubernetes.io/projected/82c9477b-db17-4818-8f53-2f76cf00af9a-kube-api-access-k9bxb\") pod \"maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg\" (UID: \"82c9477b-db17-4818-8f53-2f76cf00af9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg"
Jul 20 10:07:38.873655 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:38.873567    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82c9477b-db17-4818-8f53-2f76cf00af9a-maas-api-tls\") pod \"maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg\" (UID: \"82c9477b-db17-4818-8f53-2f76cf00af9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg"
Jul 20 10:07:38.873740 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:38.873649    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82c9477b-db17-4818-8f53-2f76cf00af9a-openshift-service-ca\") pod \"maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg\" (UID: \"82c9477b-db17-4818-8f53-2f76cf00af9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg"
Jul 20 10:07:38.974602 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:38.974526    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82c9477b-db17-4818-8f53-2f76cf00af9a-openshift-service-ca\") pod \"maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg\" (UID: \"82c9477b-db17-4818-8f53-2f76cf00af9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg"
Jul 20 10:07:38.974602 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:38.974599    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9bxb\" (UniqueName: \"kubernetes.io/projected/82c9477b-db17-4818-8f53-2f76cf00af9a-kube-api-access-k9bxb\") pod \"maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg\" (UID: \"82c9477b-db17-4818-8f53-2f76cf00af9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg"
Jul 20 10:07:38.974781 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:38.974635    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82c9477b-db17-4818-8f53-2f76cf00af9a-maas-api-tls\") pod \"maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg\" (UID: \"82c9477b-db17-4818-8f53-2f76cf00af9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg"
Jul 20 10:07:38.974781 ip-10-0-140-236 kubenswrapper[2581]: E0720 10:07:38.974734    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-c5c080c1-serving-cert: secret "maas-api-e2e-ait-c5c080c1-serving-cert" not found
Jul 20 10:07:38.974899 ip-10-0-140-236 kubenswrapper[2581]: E0720 10:07:38.974799    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82c9477b-db17-4818-8f53-2f76cf00af9a-maas-api-tls podName:82c9477b-db17-4818-8f53-2f76cf00af9a nodeName:}" failed. No retries permitted until 2026-07-20 10:07:39.474779048 +0000 UTC m=+1711.356225334 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/82c9477b-db17-4818-8f53-2f76cf00af9a-maas-api-tls") pod "maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg" (UID: "82c9477b-db17-4818-8f53-2f76cf00af9a") : secret "maas-api-e2e-ait-c5c080c1-serving-cert" not found
Jul 20 10:07:38.975260 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:38.975239    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82c9477b-db17-4818-8f53-2f76cf00af9a-openshift-service-ca\") pod \"maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg\" (UID: \"82c9477b-db17-4818-8f53-2f76cf00af9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg"
Jul 20 10:07:38.984545 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:38.984521    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9bxb\" (UniqueName: \"kubernetes.io/projected/82c9477b-db17-4818-8f53-2f76cf00af9a-kube-api-access-k9bxb\") pod \"maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg\" (UID: \"82c9477b-db17-4818-8f53-2f76cf00af9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg"
Jul 20 10:07:39.143202 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:39.143170    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:07:39.296979 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:39.296893    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:07:39.399343 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:39.399311    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:07:39.478954 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:39.478918    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82c9477b-db17-4818-8f53-2f76cf00af9a-maas-api-tls\") pod \"maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg\" (UID: \"82c9477b-db17-4818-8f53-2f76cf00af9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg"
Jul 20 10:07:39.481299 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:39.481279    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82c9477b-db17-4818-8f53-2f76cf00af9a-maas-api-tls\") pod \"maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg\" (UID: \"82c9477b-db17-4818-8f53-2f76cf00af9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg"
Jul 20 10:07:39.621482 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:39.621458    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg"
Jul 20 10:07:39.750120 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:39.750090    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg"]
Jul 20 10:07:39.752448 ip-10-0-140-236 kubenswrapper[2581]: W0720 10:07:39.752420    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82c9477b_db17_4818_8f53_2f76cf00af9a.slice/crio-c658156230f5aad2fce90dbd675ff3367cc715747122d1f434840cd82fa1f8d8 WatchSource:0}: Error finding container c658156230f5aad2fce90dbd675ff3367cc715747122d1f434840cd82fa1f8d8: Status 404 returned error can't find the container with id c658156230f5aad2fce90dbd675ff3367cc715747122d1f434840cd82fa1f8d8
Jul 20 10:07:40.619520 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:40.619480    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg" event={"ID":"82c9477b-db17-4818-8f53-2f76cf00af9a","Type":"ContainerStarted","Data":"9ca87746559ab0635a038c11fb6324d8f8ef3d857c955d7fcb9eaaea6942955f"}
Jul 20 10:07:40.619943 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:40.619576    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg" event={"ID":"82c9477b-db17-4818-8f53-2f76cf00af9a","Type":"ContainerStarted","Data":"c658156230f5aad2fce90dbd675ff3367cc715747122d1f434840cd82fa1f8d8"}
Jul 20 10:07:40.619943 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:40.619606    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg"
Jul 20 10:07:40.635381 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:40.635340    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg" podStartSLOduration=2.20646496 podStartE2EDuration="2.635326228s" totalImagesPullingTime="428.861268ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:07:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:07:40.6342639 +0000 UTC m=+1712.515710234" watchObservedRunningTime="2026-07-20 10:07:40.635326228 +0000 UTC m=+1712.516772592"
Jul 20 10:07:46.630187 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:07:46.630158    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg"
Jul 20 10:08:14.652381 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:14.652350    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg"]
Jul 20 10:08:14.652944 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:14.652543    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg" podUID="82c9477b-db17-4818-8f53-2f76cf00af9a" containerName="maas-api" containerID="cri-o://9ca87746559ab0635a038c11fb6324d8f8ef3d857c955d7fcb9eaaea6942955f" gracePeriod=30
Jul 20 10:08:14.676907 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:14.676881    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:08:14.790703 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:14.790666    2581 generic.go:356] "Generic (PLEG): container finished" podID="82c9477b-db17-4818-8f53-2f76cf00af9a" containerID="9ca87746559ab0635a038c11fb6324d8f8ef3d857c955d7fcb9eaaea6942955f" exitCode=0
Jul 20 10:08:14.790817 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:14.790735    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg" event={"ID":"82c9477b-db17-4818-8f53-2f76cf00af9a","Type":"ContainerDied","Data":"9ca87746559ab0635a038c11fb6324d8f8ef3d857c955d7fcb9eaaea6942955f"}
Jul 20 10:08:14.896760 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:14.896738    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg"
Jul 20 10:08:14.987292 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:14.987225    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9bxb\" (UniqueName: \"kubernetes.io/projected/82c9477b-db17-4818-8f53-2f76cf00af9a-kube-api-access-k9bxb\") pod \"82c9477b-db17-4818-8f53-2f76cf00af9a\" (UID: \"82c9477b-db17-4818-8f53-2f76cf00af9a\") "
Jul 20 10:08:14.987292 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:14.987271    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82c9477b-db17-4818-8f53-2f76cf00af9a-openshift-service-ca\") pod \"82c9477b-db17-4818-8f53-2f76cf00af9a\" (UID: \"82c9477b-db17-4818-8f53-2f76cf00af9a\") "
Jul 20 10:08:14.987478 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:14.987357    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82c9477b-db17-4818-8f53-2f76cf00af9a-maas-api-tls\") pod \"82c9477b-db17-4818-8f53-2f76cf00af9a\" (UID: \"82c9477b-db17-4818-8f53-2f76cf00af9a\") "
Jul 20 10:08:14.987683 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:14.987660    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82c9477b-db17-4818-8f53-2f76cf00af9a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "82c9477b-db17-4818-8f53-2f76cf00af9a" (UID: "82c9477b-db17-4818-8f53-2f76cf00af9a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 10:08:14.989193 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:14.989168    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82c9477b-db17-4818-8f53-2f76cf00af9a-kube-api-access-k9bxb" (OuterVolumeSpecName: "kube-api-access-k9bxb") pod "82c9477b-db17-4818-8f53-2f76cf00af9a" (UID: "82c9477b-db17-4818-8f53-2f76cf00af9a"). InnerVolumeSpecName "kube-api-access-k9bxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 10:08:14.989255 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:14.989218    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82c9477b-db17-4818-8f53-2f76cf00af9a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "82c9477b-db17-4818-8f53-2f76cf00af9a" (UID: "82c9477b-db17-4818-8f53-2f76cf00af9a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 10:08:15.088515 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:15.088485    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9bxb\" (UniqueName: \"kubernetes.io/projected/82c9477b-db17-4818-8f53-2f76cf00af9a-kube-api-access-k9bxb\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:08:15.088515 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:15.088510    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/82c9477b-db17-4818-8f53-2f76cf00af9a-openshift-service-ca\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:08:15.088650 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:15.088524    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/82c9477b-db17-4818-8f53-2f76cf00af9a-maas-api-tls\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:08:15.797375 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:15.797301    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg"
Jul 20 10:08:15.797375 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:15.797328    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg" event={"ID":"82c9477b-db17-4818-8f53-2f76cf00af9a","Type":"ContainerDied","Data":"c658156230f5aad2fce90dbd675ff3367cc715747122d1f434840cd82fa1f8d8"}
Jul 20 10:08:15.797819 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:15.797383    2581 scope.go:117] "RemoveContainer" containerID="9ca87746559ab0635a038c11fb6324d8f8ef3d857c955d7fcb9eaaea6942955f"
Jul 20 10:08:15.814416 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:15.814394    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg"]
Jul 20 10:08:15.819884 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:15.819859    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c5c080c1-5d5dfdc997-f2bvg"]
Jul 20 10:08:17.465492 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:17.465456    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82c9477b-db17-4818-8f53-2f76cf00af9a" path="/var/lib/kubelet/pods/82c9477b-db17-4818-8f53-2f76cf00af9a/volumes"
Jul 20 10:08:19.348523 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:19.348449    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:08:20.536444 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:20.536411    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:08:20.774211 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:20.774178    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:08:21.000280 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:21.000249    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:08:21.329588 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:21.329516    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:08:21.391888 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:21.391862    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:08:23.352087 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:23.352059    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:08:23.452749 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:23.452716    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:08:23.715517 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:23.715427    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:08:23.812256 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:23.812221    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:08:23.891083 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:23.891050    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb"]
Jul 20 10:08:23.891699 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:23.891679    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82c9477b-db17-4818-8f53-2f76cf00af9a" containerName="maas-api"
Jul 20 10:08:23.891773 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:23.891704    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="82c9477b-db17-4818-8f53-2f76cf00af9a" containerName="maas-api"
Jul 20 10:08:23.891878 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:23.891865    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="82c9477b-db17-4818-8f53-2f76cf00af9a" containerName="maas-api"
Jul 20 10:08:23.896651 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:23.896628    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb"
Jul 20 10:08:23.899423 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:23.899402    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-26b8b528-serving-cert\""
Jul 20 10:08:23.907806 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:23.907786    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb"]
Jul 20 10:08:23.956041 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:23.956019    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:08:24.066835 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:24.066760    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5b7x\" (UniqueName: \"kubernetes.io/projected/9f8e5936-92da-4c81-b25b-c7754092076b-kube-api-access-p5b7x\") pod \"maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb\" (UID: \"9f8e5936-92da-4c81-b25b-c7754092076b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb"
Jul 20 10:08:24.066835 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:24.066807    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f8e5936-92da-4c81-b25b-c7754092076b-maas-api-tls\") pod \"maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb\" (UID: \"9f8e5936-92da-4c81-b25b-c7754092076b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb"
Jul 20 10:08:24.067038 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:24.066838    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f8e5936-92da-4c81-b25b-c7754092076b-openshift-service-ca\") pod \"maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb\" (UID: \"9f8e5936-92da-4c81-b25b-c7754092076b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb"
Jul 20 10:08:24.167507 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:24.167479    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5b7x\" (UniqueName: \"kubernetes.io/projected/9f8e5936-92da-4c81-b25b-c7754092076b-kube-api-access-p5b7x\") pod \"maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb\" (UID: \"9f8e5936-92da-4c81-b25b-c7754092076b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb"
Jul 20 10:08:24.167671 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:24.167515    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f8e5936-92da-4c81-b25b-c7754092076b-maas-api-tls\") pod \"maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb\" (UID: \"9f8e5936-92da-4c81-b25b-c7754092076b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb"
Jul 20 10:08:24.167671 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:24.167536    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f8e5936-92da-4c81-b25b-c7754092076b-openshift-service-ca\") pod \"maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb\" (UID: \"9f8e5936-92da-4c81-b25b-c7754092076b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb"
Jul 20 10:08:24.168388 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:24.168360    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f8e5936-92da-4c81-b25b-c7754092076b-openshift-service-ca\") pod \"maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb\" (UID: \"9f8e5936-92da-4c81-b25b-c7754092076b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb"
Jul 20 10:08:24.169832 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:24.169809    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f8e5936-92da-4c81-b25b-c7754092076b-maas-api-tls\") pod \"maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb\" (UID: \"9f8e5936-92da-4c81-b25b-c7754092076b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb"
Jul 20 10:08:24.176287 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:24.176266    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5b7x\" (UniqueName: \"kubernetes.io/projected/9f8e5936-92da-4c81-b25b-c7754092076b-kube-api-access-p5b7x\") pod \"maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb\" (UID: \"9f8e5936-92da-4c81-b25b-c7754092076b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb"
Jul 20 10:08:24.207067 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:24.207042    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb"
Jul 20 10:08:24.228214 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:24.228178    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:08:24.345215 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:24.345140    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb"]
Jul 20 10:08:24.348464 ip-10-0-140-236 kubenswrapper[2581]: W0720 10:08:24.348441    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f8e5936_92da_4c81_b25b_c7754092076b.slice/crio-d469c53aa8b18266a89ba14e728e9e990b4a3cb68eeaae7d02ecdadf1f857fb3 WatchSource:0}: Error finding container d469c53aa8b18266a89ba14e728e9e990b4a3cb68eeaae7d02ecdadf1f857fb3: Status 404 returned error can't find the container with id d469c53aa8b18266a89ba14e728e9e990b4a3cb68eeaae7d02ecdadf1f857fb3
Jul 20 10:08:24.537279 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:24.537247    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:08:24.637492 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:24.637465    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:08:24.842781 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:24.842741    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb" event={"ID":"9f8e5936-92da-4c81-b25b-c7754092076b","Type":"ContainerStarted","Data":"c465ccd93aa5c85ec858a4fce395ac808cb75170b5bbb79b99f6d68bb6f821bc"}
Jul 20 10:08:24.842939 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:24.842805    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb" event={"ID":"9f8e5936-92da-4c81-b25b-c7754092076b","Type":"ContainerStarted","Data":"d469c53aa8b18266a89ba14e728e9e990b4a3cb68eeaae7d02ecdadf1f857fb3"}
Jul 20 10:08:24.843269 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:24.843218    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb"
Jul 20 10:08:24.861016 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:24.860953    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb" podStartSLOduration=1.458666281 podStartE2EDuration="1.860938657s" totalImagesPullingTime="402.272376ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:08:24.858765884 +0000 UTC m=+1756.740212223" watchObservedRunningTime="2026-07-20 10:08:24.860938657 +0000 UTC m=+1756.742385007"
Jul 20 10:08:30.853072 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:30.853045    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb"
Jul 20 10:08:52.009888 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:52.009852    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:08:52.107803 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:52.107775    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:08:59.137195 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:59.137161    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:08:59.235892 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:59.235859    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:08:59.343575 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:59.343543    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb"]
Jul 20 10:08:59.343877 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:59.343783    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb" podUID="9f8e5936-92da-4c81-b25b-c7754092076b" containerName="maas-api" containerID="cri-o://c465ccd93aa5c85ec858a4fce395ac808cb75170b5bbb79b99f6d68bb6f821bc" gracePeriod=30
Jul 20 10:08:59.376066 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:59.376041    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:08:59.589399 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:59.589376    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb"
Jul 20 10:08:59.670481 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:59.670442    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5b7x\" (UniqueName: \"kubernetes.io/projected/9f8e5936-92da-4c81-b25b-c7754092076b-kube-api-access-p5b7x\") pod \"9f8e5936-92da-4c81-b25b-c7754092076b\" (UID: \"9f8e5936-92da-4c81-b25b-c7754092076b\") "
Jul 20 10:08:59.670665 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:59.670509    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f8e5936-92da-4c81-b25b-c7754092076b-maas-api-tls\") pod \"9f8e5936-92da-4c81-b25b-c7754092076b\" (UID: \"9f8e5936-92da-4c81-b25b-c7754092076b\") "
Jul 20 10:08:59.670665 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:59.670542    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f8e5936-92da-4c81-b25b-c7754092076b-openshift-service-ca\") pod \"9f8e5936-92da-4c81-b25b-c7754092076b\" (UID: \"9f8e5936-92da-4c81-b25b-c7754092076b\") "
Jul 20 10:08:59.670951 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:59.670920    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f8e5936-92da-4c81-b25b-c7754092076b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9f8e5936-92da-4c81-b25b-c7754092076b" (UID: "9f8e5936-92da-4c81-b25b-c7754092076b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 10:08:59.672522 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:59.672494    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f8e5936-92da-4c81-b25b-c7754092076b-kube-api-access-p5b7x" (OuterVolumeSpecName: "kube-api-access-p5b7x") pod "9f8e5936-92da-4c81-b25b-c7754092076b" (UID: "9f8e5936-92da-4c81-b25b-c7754092076b"). InnerVolumeSpecName "kube-api-access-p5b7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 10:08:59.672632 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:59.672605    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f8e5936-92da-4c81-b25b-c7754092076b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9f8e5936-92da-4c81-b25b-c7754092076b" (UID: "9f8e5936-92da-4c81-b25b-c7754092076b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 10:08:59.772154 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:59.772094    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f8e5936-92da-4c81-b25b-c7754092076b-openshift-service-ca\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:08:59.772154 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:59.772115    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5b7x\" (UniqueName: \"kubernetes.io/projected/9f8e5936-92da-4c81-b25b-c7754092076b-kube-api-access-p5b7x\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:08:59.772154 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:08:59.772124    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9f8e5936-92da-4c81-b25b-c7754092076b-maas-api-tls\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:09:00.017636 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:09:00.017603    2581 generic.go:356] "Generic (PLEG): container finished" podID="9f8e5936-92da-4c81-b25b-c7754092076b" containerID="c465ccd93aa5c85ec858a4fce395ac808cb75170b5bbb79b99f6d68bb6f821bc" exitCode=0
Jul 20 10:09:00.017828 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:09:00.017653    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb"
Jul 20 10:09:00.017828 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:09:00.017655    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb" event={"ID":"9f8e5936-92da-4c81-b25b-c7754092076b","Type":"ContainerDied","Data":"c465ccd93aa5c85ec858a4fce395ac808cb75170b5bbb79b99f6d68bb6f821bc"}
Jul 20 10:09:00.017828 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:09:00.017769    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb" event={"ID":"9f8e5936-92da-4c81-b25b-c7754092076b","Type":"ContainerDied","Data":"d469c53aa8b18266a89ba14e728e9e990b4a3cb68eeaae7d02ecdadf1f857fb3"}
Jul 20 10:09:00.017828 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:09:00.017814    2581 scope.go:117] "RemoveContainer" containerID="c465ccd93aa5c85ec858a4fce395ac808cb75170b5bbb79b99f6d68bb6f821bc"
Jul 20 10:09:00.026653 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:09:00.026634    2581 scope.go:117] "RemoveContainer" containerID="c465ccd93aa5c85ec858a4fce395ac808cb75170b5bbb79b99f6d68bb6f821bc"
Jul 20 10:09:00.026931 ip-10-0-140-236 kubenswrapper[2581]: E0720 10:09:00.026915    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c465ccd93aa5c85ec858a4fce395ac808cb75170b5bbb79b99f6d68bb6f821bc\": container with ID starting with c465ccd93aa5c85ec858a4fce395ac808cb75170b5bbb79b99f6d68bb6f821bc not found: ID does not exist" containerID="c465ccd93aa5c85ec858a4fce395ac808cb75170b5bbb79b99f6d68bb6f821bc"
Jul 20 10:09:00.026985 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:09:00.026941    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c465ccd93aa5c85ec858a4fce395ac808cb75170b5bbb79b99f6d68bb6f821bc"} err="failed to get container status \"c465ccd93aa5c85ec858a4fce395ac808cb75170b5bbb79b99f6d68bb6f821bc\": rpc error: code = NotFound desc = could not find container \"c465ccd93aa5c85ec858a4fce395ac808cb75170b5bbb79b99f6d68bb6f821bc\": container with ID starting with c465ccd93aa5c85ec858a4fce395ac808cb75170b5bbb79b99f6d68bb6f821bc not found: ID does not exist"
Jul 20 10:09:00.038516 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:09:00.038496    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb"]
Jul 20 10:09:00.042259 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:09:00.042241    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-26b8b528-77f4479b66-sxrkb"]
Jul 20 10:09:01.465142 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:09:01.465074    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f8e5936-92da-4c81-b25b-c7754092076b" path="/var/lib/kubelet/pods/9f8e5936-92da-4c81-b25b-c7754092076b/volumes"
Jul 20 10:09:03.660288 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:09:03.660255    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:09:03.822527 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:09:03.822492    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:09:04.051743 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:09:04.051670    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:09:04.543294 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:09:04.543253    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:09:04.642380 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:09:04.642348    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:09:04.742685 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:09:04.742653    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:09:06.176542 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:09:06.176508    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:09:08.738661 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:09:08.738635    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rgb4r_d6c73ac6-85c5-4b3f-aa58-71ac88099c0a/ovn-acl-logging/0.log"
Jul 20 10:09:08.742189 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:09:08.742170    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rgb4r_d6c73ac6-85c5-4b3f-aa58-71ac88099c0a/ovn-acl-logging/0.log"
Jul 20 10:09:12.130704 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:09:12.130667    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:09:12.229167 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:09:12.229128    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:09:12.328787 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:09:12.328750    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:09:12.758593 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:09:12.758568    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:09:38.767565 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:09:38.767525    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:09:45.437521 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:09:45.437487    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:09:45.544769 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:09:45.544733    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:09:45.637607 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:09:45.637575    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:10:01.568347 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:01.568302    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:10:07.589710 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:07.589655    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:10:07.698384 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:07.698346    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:10:07.789696 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:07.789667    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:10:18.388688 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:18.388659    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:10:19.195801 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:19.195772    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:10:25.051753 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:25.051712    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:10:25.160266 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:25.160233    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:10:25.252765 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:25.252738    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:10:25.352078 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:25.352038    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:10:26.301890 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:26.301856    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:10:26.417980 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:26.417933    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:10:28.139865 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:28.139831    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:10:33.863591 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:33.863500    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:10:33.936140 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:33.936114    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:10:34.547698 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:34.547666    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:10:40.157828 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:40.157780    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:10:40.258854 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:40.258822    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:10:40.419563 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:40.419459    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:10:40.738213 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:40.738133    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:10:40.920354 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:40.920317    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:10:44.064121 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:44.064087    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:10:44.139194 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:44.139160    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:10:44.139807 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:44.139789    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx"]
Jul 20 10:10:44.140204 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:44.140191    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f8e5936-92da-4c81-b25b-c7754092076b" containerName="maas-api"
Jul 20 10:10:44.140258 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:44.140206    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f8e5936-92da-4c81-b25b-c7754092076b" containerName="maas-api"
Jul 20 10:10:44.140294 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:44.140278    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f8e5936-92da-4c81-b25b-c7754092076b" containerName="maas-api"
Jul 20 10:10:44.143274 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:44.143259    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx"
Jul 20 10:10:44.146137 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:44.146114    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-bc2fab5a-serving-cert\""
Jul 20 10:10:44.155810 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:44.155789    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx"]
Jul 20 10:10:44.205288 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:44.205263    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:10:44.280407 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:44.280382    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5tm9\" (UniqueName: \"kubernetes.io/projected/1396088f-88a4-4831-8dc4-047f1af1cffa-kube-api-access-f5tm9\") pod \"maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx\" (UID: \"1396088f-88a4-4831-8dc4-047f1af1cffa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx"
Jul 20 10:10:44.280554 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:44.280430    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1396088f-88a4-4831-8dc4-047f1af1cffa-maas-api-tls\") pod \"maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx\" (UID: \"1396088f-88a4-4831-8dc4-047f1af1cffa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx"
Jul 20 10:10:44.280554 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:44.280473    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1396088f-88a4-4831-8dc4-047f1af1cffa-openshift-service-ca\") pod \"maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx\" (UID: \"1396088f-88a4-4831-8dc4-047f1af1cffa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx"
Jul 20 10:10:44.381265 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:44.381239    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1396088f-88a4-4831-8dc4-047f1af1cffa-openshift-service-ca\") pod \"maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx\" (UID: \"1396088f-88a4-4831-8dc4-047f1af1cffa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx"
Jul 20 10:10:44.381376 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:44.381316    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5tm9\" (UniqueName: \"kubernetes.io/projected/1396088f-88a4-4831-8dc4-047f1af1cffa-kube-api-access-f5tm9\") pod \"maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx\" (UID: \"1396088f-88a4-4831-8dc4-047f1af1cffa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx"
Jul 20 10:10:44.381376 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:44.381336    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1396088f-88a4-4831-8dc4-047f1af1cffa-maas-api-tls\") pod \"maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx\" (UID: \"1396088f-88a4-4831-8dc4-047f1af1cffa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx"
Jul 20 10:10:44.381460 ip-10-0-140-236 kubenswrapper[2581]: E0720 10:10:44.381424    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-bc2fab5a-serving-cert: secret "maas-api-e2e-mt-bc2fab5a-serving-cert" not found
Jul 20 10:10:44.381503 ip-10-0-140-236 kubenswrapper[2581]: E0720 10:10:44.381475    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1396088f-88a4-4831-8dc4-047f1af1cffa-maas-api-tls podName:1396088f-88a4-4831-8dc4-047f1af1cffa nodeName:}" failed. No retries permitted until 2026-07-20 10:10:44.881459128 +0000 UTC m=+1896.762905415 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1396088f-88a4-4831-8dc4-047f1af1cffa-maas-api-tls") pod "maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx" (UID: "1396088f-88a4-4831-8dc4-047f1af1cffa") : secret "maas-api-e2e-mt-bc2fab5a-serving-cert" not found
Jul 20 10:10:44.381850 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:44.381832    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1396088f-88a4-4831-8dc4-047f1af1cffa-openshift-service-ca\") pod \"maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx\" (UID: \"1396088f-88a4-4831-8dc4-047f1af1cffa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx"
Jul 20 10:10:44.392253 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:44.392232    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5tm9\" (UniqueName: \"kubernetes.io/projected/1396088f-88a4-4831-8dc4-047f1af1cffa-kube-api-access-f5tm9\") pod \"maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx\" (UID: \"1396088f-88a4-4831-8dc4-047f1af1cffa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx"
Jul 20 10:10:44.489137 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:44.489112    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:10:44.639868 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:44.639795    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:10:44.743511 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:44.743484    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:10:44.886616 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:44.886589    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1396088f-88a4-4831-8dc4-047f1af1cffa-maas-api-tls\") pod \"maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx\" (UID: \"1396088f-88a4-4831-8dc4-047f1af1cffa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx"
Jul 20 10:10:44.888875 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:44.888852    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1396088f-88a4-4831-8dc4-047f1af1cffa-maas-api-tls\") pod \"maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx\" (UID: \"1396088f-88a4-4831-8dc4-047f1af1cffa\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx"
Jul 20 10:10:45.054717 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:45.054639    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx"
Jul 20 10:10:45.390680 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:45.390658    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx"]
Jul 20 10:10:45.393935 ip-10-0-140-236 kubenswrapper[2581]: W0720 10:10:45.393908    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1396088f_88a4_4831_8dc4_047f1af1cffa.slice/crio-8552d937f9f9e36eb0500e2f61ca7921b85a82bd6cd06d230f5d859996c496c1 WatchSource:0}: Error finding container 8552d937f9f9e36eb0500e2f61ca7921b85a82bd6cd06d230f5d859996c496c1: Status 404 returned error can't find the container with id 8552d937f9f9e36eb0500e2f61ca7921b85a82bd6cd06d230f5d859996c496c1
Jul 20 10:10:45.547079 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:45.547047    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx" event={"ID":"1396088f-88a4-4831-8dc4-047f1af1cffa","Type":"ContainerStarted","Data":"8552d937f9f9e36eb0500e2f61ca7921b85a82bd6cd06d230f5d859996c496c1"}
Jul 20 10:10:46.553176 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:46.553134    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx" event={"ID":"1396088f-88a4-4831-8dc4-047f1af1cffa","Type":"ContainerStarted","Data":"591b95e987e6be82a38a5c9cacb6e970d46a308564d2c99c1a3567cddea028df"}
Jul 20 10:10:46.553534 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:46.553288    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx"
Jul 20 10:10:46.571659 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:46.571620    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx" podStartSLOduration=1.979967844 podStartE2EDuration="2.571605439s" totalImagesPullingTime="591.637595ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:10:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:10:46.570307119 +0000 UTC m=+1898.451753464" watchObservedRunningTime="2026-07-20 10:10:46.571605439 +0000 UTC m=+1898.453051770"
Jul 20 10:10:48.599549 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:48.599516    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:10:49.295037 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:49.294955    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:10:49.394983 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:49.394933    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:10:49.732068 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:49.732038    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:10:52.563067 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:52.563042    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx"
Jul 20 10:10:55.437735 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:55.437703    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:10:55.538149 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:10:55.538118    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:11:01.079685 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:01.079646    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:11:06.229766 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:06.229732    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx"]
Jul 20 10:11:06.230252 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:06.229990    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx" podUID="1396088f-88a4-4831-8dc4-047f1af1cffa" containerName="maas-api" containerID="cri-o://591b95e987e6be82a38a5c9cacb6e970d46a308564d2c99c1a3567cddea028df" gracePeriod=30
Jul 20 10:11:06.258165 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:06.258142    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:11:06.486693 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:06.486640    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx"
Jul 20 10:11:06.582935 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:06.582910    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1396088f-88a4-4831-8dc4-047f1af1cffa-openshift-service-ca\") pod \"1396088f-88a4-4831-8dc4-047f1af1cffa\" (UID: \"1396088f-88a4-4831-8dc4-047f1af1cffa\") "
Jul 20 10:11:06.583082 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:06.582945    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1396088f-88a4-4831-8dc4-047f1af1cffa-maas-api-tls\") pod \"1396088f-88a4-4831-8dc4-047f1af1cffa\" (UID: \"1396088f-88a4-4831-8dc4-047f1af1cffa\") "
Jul 20 10:11:06.583124 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:06.583077    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5tm9\" (UniqueName: \"kubernetes.io/projected/1396088f-88a4-4831-8dc4-047f1af1cffa-kube-api-access-f5tm9\") pod \"1396088f-88a4-4831-8dc4-047f1af1cffa\" (UID: \"1396088f-88a4-4831-8dc4-047f1af1cffa\") "
Jul 20 10:11:06.583313 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:06.583292    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1396088f-88a4-4831-8dc4-047f1af1cffa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1396088f-88a4-4831-8dc4-047f1af1cffa" (UID: "1396088f-88a4-4831-8dc4-047f1af1cffa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 10:11:06.585010 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:06.584987    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1396088f-88a4-4831-8dc4-047f1af1cffa-kube-api-access-f5tm9" (OuterVolumeSpecName: "kube-api-access-f5tm9") pod "1396088f-88a4-4831-8dc4-047f1af1cffa" (UID: "1396088f-88a4-4831-8dc4-047f1af1cffa"). InnerVolumeSpecName "kube-api-access-f5tm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 10:11:06.585098 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:06.585040    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1396088f-88a4-4831-8dc4-047f1af1cffa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1396088f-88a4-4831-8dc4-047f1af1cffa" (UID: "1396088f-88a4-4831-8dc4-047f1af1cffa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 10:11:06.653809 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:06.653785    2581 generic.go:356] "Generic (PLEG): container finished" podID="1396088f-88a4-4831-8dc4-047f1af1cffa" containerID="591b95e987e6be82a38a5c9cacb6e970d46a308564d2c99c1a3567cddea028df" exitCode=0
Jul 20 10:11:06.653931 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:06.653824    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx"
Jul 20 10:11:06.653931 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:06.653829    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx" event={"ID":"1396088f-88a4-4831-8dc4-047f1af1cffa","Type":"ContainerDied","Data":"591b95e987e6be82a38a5c9cacb6e970d46a308564d2c99c1a3567cddea028df"}
Jul 20 10:11:06.653931 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:06.653870    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx" event={"ID":"1396088f-88a4-4831-8dc4-047f1af1cffa","Type":"ContainerDied","Data":"8552d937f9f9e36eb0500e2f61ca7921b85a82bd6cd06d230f5d859996c496c1"}
Jul 20 10:11:06.653931 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:06.653893    2581 scope.go:117] "RemoveContainer" containerID="591b95e987e6be82a38a5c9cacb6e970d46a308564d2c99c1a3567cddea028df"
Jul 20 10:11:06.662442 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:06.662425    2581 scope.go:117] "RemoveContainer" containerID="591b95e987e6be82a38a5c9cacb6e970d46a308564d2c99c1a3567cddea028df"
Jul 20 10:11:06.662681 ip-10-0-140-236 kubenswrapper[2581]: E0720 10:11:06.662662    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"591b95e987e6be82a38a5c9cacb6e970d46a308564d2c99c1a3567cddea028df\": container with ID starting with 591b95e987e6be82a38a5c9cacb6e970d46a308564d2c99c1a3567cddea028df not found: ID does not exist" containerID="591b95e987e6be82a38a5c9cacb6e970d46a308564d2c99c1a3567cddea028df"
Jul 20 10:11:06.662732 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:06.662688    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"591b95e987e6be82a38a5c9cacb6e970d46a308564d2c99c1a3567cddea028df"} err="failed to get container status \"591b95e987e6be82a38a5c9cacb6e970d46a308564d2c99c1a3567cddea028df\": rpc error: code = NotFound desc = could not find container \"591b95e987e6be82a38a5c9cacb6e970d46a308564d2c99c1a3567cddea028df\": container with ID starting with 591b95e987e6be82a38a5c9cacb6e970d46a308564d2c99c1a3567cddea028df not found: ID does not exist"
Jul 20 10:11:06.674026 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:06.674004    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx"]
Jul 20 10:11:06.677272 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:06.677252    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bc2fab5a-6b46b947c9-mb4tx"]
Jul 20 10:11:06.684603 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:06.684585    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5tm9\" (UniqueName: \"kubernetes.io/projected/1396088f-88a4-4831-8dc4-047f1af1cffa-kube-api-access-f5tm9\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:11:06.684672 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:06.684606    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1396088f-88a4-4831-8dc4-047f1af1cffa-openshift-service-ca\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:11:06.684672 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:06.684617    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1396088f-88a4-4831-8dc4-047f1af1cffa-maas-api-tls\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:11:07.465613 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:07.465579    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1396088f-88a4-4831-8dc4-047f1af1cffa" path="/var/lib/kubelet/pods/1396088f-88a4-4831-8dc4-047f1af1cffa/volumes"
Jul 20 10:11:10.909926 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:10.909896    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:11:11.293066 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:11.292990    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:11:17.030919 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:17.030888    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:11:17.132925 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:17.132890    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:11:17.307500 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:17.307408    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:11:17.551912 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:17.551881    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:11:17.668728 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:17.668688    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:11:17.763382 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:17.763351    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:11:17.905945 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:17.905892    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:11:23.522562 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:23.522532    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:11:23.627391 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:23.627335    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:11:23.723090 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:23.723064    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:11:23.882341 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:23.882314    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:11:29.504416 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:29.504381    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:11:29.604127 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:29.604098    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:11:36.398759 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:36.398719    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:11:36.686758 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:36.686681    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:11:36.785003 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:36.784946    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:11:39.450760 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:39.450724    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:11:39.547058 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:39.547027    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:11:39.683640 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:39.683607    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3a0aa251-648b799947-hzmh9"]
Jul 20 10:11:39.684042 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:39.684026    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1396088f-88a4-4831-8dc4-047f1af1cffa" containerName="maas-api"
Jul 20 10:11:39.684042 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:39.684041    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1396088f-88a4-4831-8dc4-047f1af1cffa" containerName="maas-api"
Jul 20 10:11:39.684210 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:39.684109    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1396088f-88a4-4831-8dc4-047f1af1cffa" containerName="maas-api"
Jul 20 10:11:39.687535 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:39.687511    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0aa251-648b799947-hzmh9"
Jul 20 10:11:39.689866 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:39.689845    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-3a0aa251-serving-cert\""
Jul 20 10:11:39.698381 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:39.698354    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3a0aa251-648b799947-hzmh9"]
Jul 20 10:11:39.726552 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:39.726482    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:11:39.766379 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:39.766355    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hjxs\" (UniqueName: \"kubernetes.io/projected/8c3369cc-26a6-4b27-8caf-700f1355fcdb-kube-api-access-6hjxs\") pod \"maas-api-e2e-mt-3a0aa251-648b799947-hzmh9\" (UID: \"8c3369cc-26a6-4b27-8caf-700f1355fcdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0aa251-648b799947-hzmh9"
Jul 20 10:11:39.766510 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:39.766394    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c3369cc-26a6-4b27-8caf-700f1355fcdb-openshift-service-ca\") pod \"maas-api-e2e-mt-3a0aa251-648b799947-hzmh9\" (UID: \"8c3369cc-26a6-4b27-8caf-700f1355fcdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0aa251-648b799947-hzmh9"
Jul 20 10:11:39.766510 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:39.766432    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c3369cc-26a6-4b27-8caf-700f1355fcdb-maas-api-tls\") pod \"maas-api-e2e-mt-3a0aa251-648b799947-hzmh9\" (UID: \"8c3369cc-26a6-4b27-8caf-700f1355fcdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0aa251-648b799947-hzmh9"
Jul 20 10:11:39.867040 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:39.867009    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c3369cc-26a6-4b27-8caf-700f1355fcdb-maas-api-tls\") pod \"maas-api-e2e-mt-3a0aa251-648b799947-hzmh9\" (UID: \"8c3369cc-26a6-4b27-8caf-700f1355fcdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0aa251-648b799947-hzmh9"
Jul 20 10:11:39.867209 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:39.867089    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hjxs\" (UniqueName: \"kubernetes.io/projected/8c3369cc-26a6-4b27-8caf-700f1355fcdb-kube-api-access-6hjxs\") pod \"maas-api-e2e-mt-3a0aa251-648b799947-hzmh9\" (UID: \"8c3369cc-26a6-4b27-8caf-700f1355fcdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0aa251-648b799947-hzmh9"
Jul 20 10:11:39.867209 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:39.867124    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c3369cc-26a6-4b27-8caf-700f1355fcdb-openshift-service-ca\") pod \"maas-api-e2e-mt-3a0aa251-648b799947-hzmh9\" (UID: \"8c3369cc-26a6-4b27-8caf-700f1355fcdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0aa251-648b799947-hzmh9"
Jul 20 10:11:39.867209 ip-10-0-140-236 kubenswrapper[2581]: E0720 10:11:39.867177    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-3a0aa251-serving-cert: secret "maas-api-e2e-mt-3a0aa251-serving-cert" not found
Jul 20 10:11:39.867316 ip-10-0-140-236 kubenswrapper[2581]: E0720 10:11:39.867245    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c3369cc-26a6-4b27-8caf-700f1355fcdb-maas-api-tls podName:8c3369cc-26a6-4b27-8caf-700f1355fcdb nodeName:}" failed. No retries permitted until 2026-07-20 10:11:40.367224104 +0000 UTC m=+1952.248670411 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8c3369cc-26a6-4b27-8caf-700f1355fcdb-maas-api-tls") pod "maas-api-e2e-mt-3a0aa251-648b799947-hzmh9" (UID: "8c3369cc-26a6-4b27-8caf-700f1355fcdb") : secret "maas-api-e2e-mt-3a0aa251-serving-cert" not found
Jul 20 10:11:39.867726 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:39.867709    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c3369cc-26a6-4b27-8caf-700f1355fcdb-openshift-service-ca\") pod \"maas-api-e2e-mt-3a0aa251-648b799947-hzmh9\" (UID: \"8c3369cc-26a6-4b27-8caf-700f1355fcdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0aa251-648b799947-hzmh9"
Jul 20 10:11:39.875442 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:39.875420    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hjxs\" (UniqueName: \"kubernetes.io/projected/8c3369cc-26a6-4b27-8caf-700f1355fcdb-kube-api-access-6hjxs\") pod \"maas-api-e2e-mt-3a0aa251-648b799947-hzmh9\" (UID: \"8c3369cc-26a6-4b27-8caf-700f1355fcdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0aa251-648b799947-hzmh9"
Jul 20 10:11:39.968223 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:39.968192    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:11:40.175539 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:40.175516    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:11:40.277114 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:40.277083    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:11:40.372102 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:40.372075    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c3369cc-26a6-4b27-8caf-700f1355fcdb-maas-api-tls\") pod \"maas-api-e2e-mt-3a0aa251-648b799947-hzmh9\" (UID: \"8c3369cc-26a6-4b27-8caf-700f1355fcdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0aa251-648b799947-hzmh9"
Jul 20 10:11:40.374526 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:40.374507    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c3369cc-26a6-4b27-8caf-700f1355fcdb-maas-api-tls\") pod \"maas-api-e2e-mt-3a0aa251-648b799947-hzmh9\" (UID: \"8c3369cc-26a6-4b27-8caf-700f1355fcdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0aa251-648b799947-hzmh9"
Jul 20 10:11:40.599475 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:40.599444    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0aa251-648b799947-hzmh9"
Jul 20 10:11:40.732725 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:40.732630    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3a0aa251-648b799947-hzmh9"]
Jul 20 10:11:40.735251 ip-10-0-140-236 kubenswrapper[2581]: W0720 10:11:40.735222    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c3369cc_26a6_4b27_8caf_700f1355fcdb.slice/crio-d3eff89f392674210328aa295fea98e7b2457b714547b6b95827a30bd54d837c WatchSource:0}: Error finding container d3eff89f392674210328aa295fea98e7b2457b714547b6b95827a30bd54d837c: Status 404 returned error can't find the container with id d3eff89f392674210328aa295fea98e7b2457b714547b6b95827a30bd54d837c
Jul 20 10:11:40.736654 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:40.736635    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 10:11:40.822309 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:40.822282    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0aa251-648b799947-hzmh9" event={"ID":"8c3369cc-26a6-4b27-8caf-700f1355fcdb","Type":"ContainerStarted","Data":"d3eff89f392674210328aa295fea98e7b2457b714547b6b95827a30bd54d837c"}
Jul 20 10:11:41.830166 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:41.830120    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0aa251-648b799947-hzmh9" event={"ID":"8c3369cc-26a6-4b27-8caf-700f1355fcdb","Type":"ContainerStarted","Data":"44e6b0c978e455758f7462a47ec558e347594ea8162172462b94bf51293775f5"}
Jul 20 10:11:41.830536 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:41.830188    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0aa251-648b799947-hzmh9"
Jul 20 10:11:41.848218 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:41.848174    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0aa251-648b799947-hzmh9" podStartSLOduration=2.530802568 podStartE2EDuration="2.848158281s" totalImagesPullingTime="317.355713ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:11:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:11:41.846055619 +0000 UTC m=+1953.727501968" watchObservedRunningTime="2026-07-20 10:11:41.848158281 +0000 UTC m=+1953.729604589"
Jul 20 10:11:43.908468 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:43.908435    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:11:47.840681 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:47.840651    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0aa251-648b799947-hzmh9"
Jul 20 10:11:54.297709 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:11:54.297679    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:12:27.587762 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:12:27.587725    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3a0aa251-648b799947-hzmh9"]
Jul 20 10:12:27.588410 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:12:27.587928    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0aa251-648b799947-hzmh9" podUID="8c3369cc-26a6-4b27-8caf-700f1355fcdb" containerName="maas-api" containerID="cri-o://44e6b0c978e455758f7462a47ec558e347594ea8162172462b94bf51293775f5" gracePeriod=30
Jul 20 10:12:27.619400 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:12:27.619378    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:12:27.832457 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:12:27.832435    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0aa251-648b799947-hzmh9"
Jul 20 10:12:27.877927 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:12:27.877905    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hjxs\" (UniqueName: \"kubernetes.io/projected/8c3369cc-26a6-4b27-8caf-700f1355fcdb-kube-api-access-6hjxs\") pod \"8c3369cc-26a6-4b27-8caf-700f1355fcdb\" (UID: \"8c3369cc-26a6-4b27-8caf-700f1355fcdb\") "
Jul 20 10:12:27.878076 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:12:27.877972    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c3369cc-26a6-4b27-8caf-700f1355fcdb-maas-api-tls\") pod \"8c3369cc-26a6-4b27-8caf-700f1355fcdb\" (UID: \"8c3369cc-26a6-4b27-8caf-700f1355fcdb\") "
Jul 20 10:12:27.878076 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:12:27.878066    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c3369cc-26a6-4b27-8caf-700f1355fcdb-openshift-service-ca\") pod \"8c3369cc-26a6-4b27-8caf-700f1355fcdb\" (UID: \"8c3369cc-26a6-4b27-8caf-700f1355fcdb\") "
Jul 20 10:12:27.878390 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:12:27.878367    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c3369cc-26a6-4b27-8caf-700f1355fcdb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8c3369cc-26a6-4b27-8caf-700f1355fcdb" (UID: "8c3369cc-26a6-4b27-8caf-700f1355fcdb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 10:12:27.879859 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:12:27.879838    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c3369cc-26a6-4b27-8caf-700f1355fcdb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8c3369cc-26a6-4b27-8caf-700f1355fcdb" (UID: "8c3369cc-26a6-4b27-8caf-700f1355fcdb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 10:12:27.879936 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:12:27.879919    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c3369cc-26a6-4b27-8caf-700f1355fcdb-kube-api-access-6hjxs" (OuterVolumeSpecName: "kube-api-access-6hjxs") pod "8c3369cc-26a6-4b27-8caf-700f1355fcdb" (UID: "8c3369cc-26a6-4b27-8caf-700f1355fcdb"). InnerVolumeSpecName "kube-api-access-6hjxs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 10:12:27.979282 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:12:27.979259    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c3369cc-26a6-4b27-8caf-700f1355fcdb-openshift-service-ca\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:12:27.979282 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:12:27.979279    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hjxs\" (UniqueName: \"kubernetes.io/projected/8c3369cc-26a6-4b27-8caf-700f1355fcdb-kube-api-access-6hjxs\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:12:27.979417 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:12:27.979289    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c3369cc-26a6-4b27-8caf-700f1355fcdb-maas-api-tls\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:12:28.051829 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:12:28.051798    2581 generic.go:356] "Generic (PLEG): container finished" podID="8c3369cc-26a6-4b27-8caf-700f1355fcdb" containerID="44e6b0c978e455758f7462a47ec558e347594ea8162172462b94bf51293775f5" exitCode=0
Jul 20 10:12:28.051929 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:12:28.051848    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0aa251-648b799947-hzmh9"
Jul 20 10:12:28.051929 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:12:28.051860    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0aa251-648b799947-hzmh9" event={"ID":"8c3369cc-26a6-4b27-8caf-700f1355fcdb","Type":"ContainerDied","Data":"44e6b0c978e455758f7462a47ec558e347594ea8162172462b94bf51293775f5"}
Jul 20 10:12:28.051929 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:12:28.051914    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0aa251-648b799947-hzmh9" event={"ID":"8c3369cc-26a6-4b27-8caf-700f1355fcdb","Type":"ContainerDied","Data":"d3eff89f392674210328aa295fea98e7b2457b714547b6b95827a30bd54d837c"}
Jul 20 10:12:28.052082 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:12:28.051946    2581 scope.go:117] "RemoveContainer" containerID="44e6b0c978e455758f7462a47ec558e347594ea8162172462b94bf51293775f5"
Jul 20 10:12:28.061765 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:12:28.061750    2581 scope.go:117] "RemoveContainer" containerID="44e6b0c978e455758f7462a47ec558e347594ea8162172462b94bf51293775f5"
Jul 20 10:12:28.062036 ip-10-0-140-236 kubenswrapper[2581]: E0720 10:12:28.062017    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44e6b0c978e455758f7462a47ec558e347594ea8162172462b94bf51293775f5\": container with ID starting with 44e6b0c978e455758f7462a47ec558e347594ea8162172462b94bf51293775f5 not found: ID does not exist" containerID="44e6b0c978e455758f7462a47ec558e347594ea8162172462b94bf51293775f5"
Jul 20 10:12:28.062103 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:12:28.062044    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44e6b0c978e455758f7462a47ec558e347594ea8162172462b94bf51293775f5"} err="failed to get container status \"44e6b0c978e455758f7462a47ec558e347594ea8162172462b94bf51293775f5\": rpc error: code = NotFound desc = could not find container \"44e6b0c978e455758f7462a47ec558e347594ea8162172462b94bf51293775f5\": container with ID starting with 44e6b0c978e455758f7462a47ec558e347594ea8162172462b94bf51293775f5 not found: ID does not exist"
Jul 20 10:12:28.074014 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:12:28.073995    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3a0aa251-648b799947-hzmh9"]
Jul 20 10:12:28.075722 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:12:28.075703    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3a0aa251-648b799947-hzmh9"]
Jul 20 10:12:29.464643 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:12:29.464611    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c3369cc-26a6-4b27-8caf-700f1355fcdb" path="/var/lib/kubelet/pods/8c3369cc-26a6-4b27-8caf-700f1355fcdb/volumes"
Jul 20 10:12:32.274989 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:12:32.274941    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:12:34.471539 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:12:34.471502    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:12:39.543668 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:12:39.543635    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:13:16.456398 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:13:16.456351    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:13:16.580810 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:13:16.580782    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:13:22.131765 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:13:22.131730    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:13:22.195281 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:13:22.195243    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:13:22.434418 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:13:22.434328    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:13:22.746249 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:13:22.746146    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:13:23.807797 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:13:23.807766    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:13:23.900186 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:13:23.900154    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:13:24.000257 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:13:24.000223    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:13:24.737231 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:13:24.737185    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:13:24.836503 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:13:24.836454    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:13:24.935702 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:13:24.935668    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:13:26.370428 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:13:26.370394    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:13:32.005798 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:13:32.005697    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:13:32.107165 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:13:32.107136    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:13:32.702774 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:13:32.702729    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:13:38.342494 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:13:38.342455    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:13:38.408267 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:13:38.408217    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:13:38.498614 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:13:38.498583    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:13:38.596650 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:13:38.596575    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:13:49.112501 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:13:49.112466    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:13:49.468449 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:13:49.468380    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:13:52.906043 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:13:52.906010    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:13:53.003253 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:13:53.003221    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:13:53.489740 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:13:53.489711    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:14:08.768321 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:08.768293    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rgb4r_d6c73ac6-85c5-4b3f-aa58-71ac88099c0a/ovn-acl-logging/0.log"
Jul 20 10:14:08.773953 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:08.773931    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rgb4r_d6c73ac6-85c5-4b3f-aa58-71ac88099c0a/ovn-acl-logging/0.log"
Jul 20 10:14:10.474364 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:10.474328    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:14:16.707088 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:16.707055    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:14:16.806606 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:16.806576    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:14:17.108160 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:17.108126    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:14:17.420432 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:17.420344    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:14:17.626357 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:17.626320    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:14:20.320466 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:20.320426    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:14:20.402899 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:20.402869    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t"]
Jul 20 10:14:20.403283 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:20.403271    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c3369cc-26a6-4b27-8caf-700f1355fcdb" containerName="maas-api"
Jul 20 10:14:20.403333 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:20.403285    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c3369cc-26a6-4b27-8caf-700f1355fcdb" containerName="maas-api"
Jul 20 10:14:20.403375 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:20.403363    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c3369cc-26a6-4b27-8caf-700f1355fcdb" containerName="maas-api"
Jul 20 10:14:20.406357 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:20.406340    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t"
Jul 20 10:14:20.408003 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:20.407948    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:14:20.409866 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:20.409849    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-11ee60-serving-cert\""
Jul 20 10:14:20.429443 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:20.429425    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t"]
Jul 20 10:14:20.505288 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:20.505264    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:14:20.551177 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:20.551148    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84-maas-api-tls\") pod \"maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t\" (UID: \"9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t"
Jul 20 10:14:20.551310 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:20.551193    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84-openshift-service-ca\") pod \"maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t\" (UID: \"9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t"
Jul 20 10:14:20.551310 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:20.551276    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m49r8\" (UniqueName: \"kubernetes.io/projected/9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84-kube-api-access-m49r8\") pod \"maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t\" (UID: \"9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t"
Jul 20 10:14:20.604318 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:20.604296    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:14:20.652369 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:20.652350    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84-maas-api-tls\") pod \"maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t\" (UID: \"9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t"
Jul 20 10:14:20.652485 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:20.652390    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84-openshift-service-ca\") pod \"maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t\" (UID: \"9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t"
Jul 20 10:14:20.652485 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:20.652433    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m49r8\" (UniqueName: \"kubernetes.io/projected/9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84-kube-api-access-m49r8\") pod \"maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t\" (UID: \"9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t"
Jul 20 10:14:20.653144 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:20.653128    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84-openshift-service-ca\") pod \"maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t\" (UID: \"9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t"
Jul 20 10:14:20.654873 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:20.654857    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84-maas-api-tls\") pod \"maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t\" (UID: \"9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t"
Jul 20 10:14:20.662557 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:20.662532    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m49r8\" (UniqueName: \"kubernetes.io/projected/9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84-kube-api-access-m49r8\") pod \"maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t\" (UID: \"9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t"
Jul 20 10:14:20.717326 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:20.717302    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t"
Jul 20 10:14:21.010217 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:21.010134    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:14:21.070777 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:21.070754    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t"]
Jul 20 10:14:21.072936 ip-10-0-140-236 kubenswrapper[2581]: W0720 10:14:21.072910    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bd94e3c_6e24_4f69_9c77_53ca1ec3fb84.slice/crio-10bdf407f765a2057c4081534e58fccee572e19231ccd4471ee7c0f87fcd2764 WatchSource:0}: Error finding container 10bdf407f765a2057c4081534e58fccee572e19231ccd4471ee7c0f87fcd2764: Status 404 returned error can't find the container with id 10bdf407f765a2057c4081534e58fccee572e19231ccd4471ee7c0f87fcd2764
Jul 20 10:14:21.113191 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:21.113162    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:14:21.623602 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:21.623571    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t" event={"ID":"9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84","Type":"ContainerStarted","Data":"10bdf407f765a2057c4081534e58fccee572e19231ccd4471ee7c0f87fcd2764"}
Jul 20 10:14:22.629401 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:22.629367    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t" event={"ID":"9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84","Type":"ContainerStarted","Data":"b00018a3c75c81c42542344e03bba695915fd1162c601e17894f2c9be06c5df7"}
Jul 20 10:14:22.629869 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:22.629432    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t"
Jul 20 10:14:22.646708 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:22.646661    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t" podStartSLOduration=1.972641597 podStartE2EDuration="2.646646183s" totalImagesPullingTime="674.004586ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:14:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:14:22.644754418 +0000 UTC m=+2114.526200727" watchObservedRunningTime="2026-07-20 10:14:22.646646183 +0000 UTC m=+2114.528092481"
Jul 20 10:14:24.828591 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:24.828558    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:14:25.179004 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:25.178976    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:14:25.509162 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:25.509061    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:14:25.827344 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:25.827233    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:14:28.556842 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:28.556807    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm"]
Jul 20 10:14:28.560844 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:28.560822    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm"
Jul 20 10:14:28.563013 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:28.562979    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-8a2a58-serving-cert\""
Jul 20 10:14:28.573874 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:28.573844    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm"]
Jul 20 10:14:28.620864 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:28.620841    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1d8f529-3da8-44a3-81f8-c59e9a918f68-maas-api-tls\") pod \"maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm\" (UID: \"a1d8f529-3da8-44a3-81f8-c59e9a918f68\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm"
Jul 20 10:14:28.621019 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:28.620909    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rdpx\" (UniqueName: \"kubernetes.io/projected/a1d8f529-3da8-44a3-81f8-c59e9a918f68-kube-api-access-6rdpx\") pod \"maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm\" (UID: \"a1d8f529-3da8-44a3-81f8-c59e9a918f68\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm"
Jul 20 10:14:28.621019 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:28.620995    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1d8f529-3da8-44a3-81f8-c59e9a918f68-openshift-service-ca\") pod \"maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm\" (UID: \"a1d8f529-3da8-44a3-81f8-c59e9a918f68\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm"
Jul 20 10:14:28.639194 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:28.639174    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t"
Jul 20 10:14:28.722129 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:28.722099    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1d8f529-3da8-44a3-81f8-c59e9a918f68-maas-api-tls\") pod \"maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm\" (UID: \"a1d8f529-3da8-44a3-81f8-c59e9a918f68\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm"
Jul 20 10:14:28.722270 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:28.722170    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rdpx\" (UniqueName: \"kubernetes.io/projected/a1d8f529-3da8-44a3-81f8-c59e9a918f68-kube-api-access-6rdpx\") pod \"maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm\" (UID: \"a1d8f529-3da8-44a3-81f8-c59e9a918f68\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm"
Jul 20 10:14:28.722321 ip-10-0-140-236 kubenswrapper[2581]: E0720 10:14:28.722304    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-8a2a58-serving-cert: secret "maas-api-e2e-inf-b-8a2a58-serving-cert" not found
Jul 20 10:14:28.722373 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:28.722349    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1d8f529-3da8-44a3-81f8-c59e9a918f68-openshift-service-ca\") pod \"maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm\" (UID: \"a1d8f529-3da8-44a3-81f8-c59e9a918f68\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm"
Jul 20 10:14:28.722410 ip-10-0-140-236 kubenswrapper[2581]: E0720 10:14:28.722374    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1d8f529-3da8-44a3-81f8-c59e9a918f68-maas-api-tls podName:a1d8f529-3da8-44a3-81f8-c59e9a918f68 nodeName:}" failed. No retries permitted until 2026-07-20 10:14:29.222351245 +0000 UTC m=+2121.103797545 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a1d8f529-3da8-44a3-81f8-c59e9a918f68-maas-api-tls") pod "maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm" (UID: "a1d8f529-3da8-44a3-81f8-c59e9a918f68") : secret "maas-api-e2e-inf-b-8a2a58-serving-cert" not found
Jul 20 10:14:28.722894 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:28.722877    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1d8f529-3da8-44a3-81f8-c59e9a918f68-openshift-service-ca\") pod \"maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm\" (UID: \"a1d8f529-3da8-44a3-81f8-c59e9a918f68\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm"
Jul 20 10:14:28.730458 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:28.730442    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rdpx\" (UniqueName: \"kubernetes.io/projected/a1d8f529-3da8-44a3-81f8-c59e9a918f68-kube-api-access-6rdpx\") pod \"maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm\" (UID: \"a1d8f529-3da8-44a3-81f8-c59e9a918f68\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm"
Jul 20 10:14:28.988060 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:28.988031    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:14:29.088038 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:29.088012    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:14:29.185110 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:29.185081    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:14:29.226310 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:29.226278    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1d8f529-3da8-44a3-81f8-c59e9a918f68-maas-api-tls\") pod \"maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm\" (UID: \"a1d8f529-3da8-44a3-81f8-c59e9a918f68\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm"
Jul 20 10:14:29.228569 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:29.228549    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1d8f529-3da8-44a3-81f8-c59e9a918f68-maas-api-tls\") pod \"maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm\" (UID: \"a1d8f529-3da8-44a3-81f8-c59e9a918f68\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm"
Jul 20 10:14:29.474172 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:29.474147    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm"
Jul 20 10:14:29.608588 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:29.608559    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm"]
Jul 20 10:14:29.611954 ip-10-0-140-236 kubenswrapper[2581]: W0720 10:14:29.611931    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1d8f529_3da8_44a3_81f8_c59e9a918f68.slice/crio-bc52f83f14f796bf5fe8c9f108befb1ecb7d582f79e0c605ae643038df7bc6d8 WatchSource:0}: Error finding container bc52f83f14f796bf5fe8c9f108befb1ecb7d582f79e0c605ae643038df7bc6d8: Status 404 returned error can't find the container with id bc52f83f14f796bf5fe8c9f108befb1ecb7d582f79e0c605ae643038df7bc6d8
Jul 20 10:14:29.662812 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:29.662777    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm" event={"ID":"a1d8f529-3da8-44a3-81f8-c59e9a918f68","Type":"ContainerStarted","Data":"bc52f83f14f796bf5fe8c9f108befb1ecb7d582f79e0c605ae643038df7bc6d8"}
Jul 20 10:14:30.669302 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:30.669265    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm" event={"ID":"a1d8f529-3da8-44a3-81f8-c59e9a918f68","Type":"ContainerStarted","Data":"d03901f3a5b0aae4d0dfec640d05f993665baa0a41f1cef7e28ec1e439ba652d"}
Jul 20 10:14:30.669699 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:30.669334    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm"
Jul 20 10:14:30.686796 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:30.686748    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm" podStartSLOduration=2.357822448 podStartE2EDuration="2.686733576s" totalImagesPullingTime="328.911128ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:14:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:14:30.68463132 +0000 UTC m=+2122.566077629" watchObservedRunningTime="2026-07-20 10:14:30.686733576 +0000 UTC m=+2122.568179884"
Jul 20 10:14:33.096772 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:33.096740    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:14:36.681698 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:36.681667    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm"
Jul 20 10:14:41.898274 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:41.898237    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:14:42.005782 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:42.005753    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:14:45.936275 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:45.936228    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:14:50.680225 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:50.680187    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:14:50.777851 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:14:50.777824    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:15:00.131203 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:00.131173    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-11ee60-29742375-b5wbz"]
Jul 20 10:15:00.134770 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:00.134753    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-11ee60-29742375-b5wbz"
Jul 20 10:15:00.136759 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:00.136739    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6jlzx\""
Jul 20 10:15:00.141067 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:00.141037    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-11ee60-29742375-b5wbz"]
Jul 20 10:15:00.146151 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:00.146132    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-11ee60-29742375-b5wbz"
Jul 20 10:15:00.275634 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:00.275606    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-11ee60-29742375-b5wbz"]
Jul 20 10:15:00.277903 ip-10-0-140-236 kubenswrapper[2581]: W0720 10:15:00.277868    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aa6e800_d235_4afa_87f5_b8e12bb28379.slice/crio-0eaf2bb29934b6f7b25e0250e87ad9926fb1b45675e751de130a1c7102d18faa WatchSource:0}: Error finding container 0eaf2bb29934b6f7b25e0250e87ad9926fb1b45675e751de130a1c7102d18faa: Status 404 returned error can't find the container with id 0eaf2bb29934b6f7b25e0250e87ad9926fb1b45675e751de130a1c7102d18faa
Jul 20 10:15:00.822163 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:00.822086    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-11ee60-29742375-b5wbz" event={"ID":"9aa6e800-d235-4afa-87f5-b8e12bb28379","Type":"ContainerStarted","Data":"d007783030df8de3affe599b232206866ac438c299b99e139dc654ca332c3f39"}
Jul 20 10:15:00.822163 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:00.822135    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-11ee60-29742375-b5wbz" event={"ID":"9aa6e800-d235-4afa-87f5-b8e12bb28379","Type":"ContainerStarted","Data":"0eaf2bb29934b6f7b25e0250e87ad9926fb1b45675e751de130a1c7102d18faa"}
Jul 20 10:15:00.837107 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:00.837062    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-11ee60-29742375-b5wbz" podStartSLOduration=0.837047577 podStartE2EDuration="837.047577ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:15:00.835003219 +0000 UTC m=+2152.716449554" watchObservedRunningTime="2026-07-20 10:15:00.837047577 +0000 UTC m=+2152.718493918"
Jul 20 10:15:01.828163 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:01.828124    2581 generic.go:356] "Generic (PLEG): container finished" podID="9aa6e800-d235-4afa-87f5-b8e12bb28379" containerID="d007783030df8de3affe599b232206866ac438c299b99e139dc654ca332c3f39" exitCode=0
Jul 20 10:15:01.830432 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:01.828206    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-11ee60-29742375-b5wbz" event={"ID":"9aa6e800-d235-4afa-87f5-b8e12bb28379","Type":"ContainerDied","Data":"d007783030df8de3affe599b232206866ac438c299b99e139dc654ca332c3f39"}
Jul 20 10:15:02.962278 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:02.962257    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-11ee60-29742375-b5wbz"
Jul 20 10:15:03.839286 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:03.839213    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-11ee60-29742375-b5wbz"
Jul 20 10:15:03.839426 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:03.839214    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-11ee60-29742375-b5wbz" event={"ID":"9aa6e800-d235-4afa-87f5-b8e12bb28379","Type":"ContainerDied","Data":"0eaf2bb29934b6f7b25e0250e87ad9926fb1b45675e751de130a1c7102d18faa"}
Jul 20 10:15:03.839426 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:03.839346    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0eaf2bb29934b6f7b25e0250e87ad9926fb1b45675e751de130a1c7102d18faa"
Jul 20 10:15:06.106427 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:06.106394    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd"]
Jul 20 10:15:06.107111 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:06.107093    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9aa6e800-d235-4afa-87f5-b8e12bb28379" containerName="cleanup"
Jul 20 10:15:06.107184 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:06.107114    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aa6e800-d235-4afa-87f5-b8e12bb28379" containerName="cleanup"
Jul 20 10:15:06.107230 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:06.107219    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9aa6e800-d235-4afa-87f5-b8e12bb28379" containerName="cleanup"
Jul 20 10:15:06.110615 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:06.110597    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd"
Jul 20 10:15:06.113211 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:06.113176    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-8a2a58\"/\"openshift-service-ca.crt\""
Jul 20 10:15:06.114015 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:06.113995    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-8a2a58\"/\"kube-root-ca.crt\""
Jul 20 10:15:06.114131 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:06.114022    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-8a2a58\"/\"test-model-8a2a58-kserve-self-signed-certs\""
Jul 20 10:15:06.114131 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:06.114105    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-8a2a58\"/\"default-dockercfg-vxnj8\""
Jul 20 10:15:06.119700 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:06.119679    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd"]
Jul 20 10:15:06.144849 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:06.144825    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:15:06.245545 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:06.245516    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr9kt\" (UniqueName: \"kubernetes.io/projected/aad7a5a8-0c7d-4747-9052-703246c3ee55-kube-api-access-sr9kt\") pod \"test-model-8a2a58-kserve-66c7f5fcd7-9w5nd\" (UID: \"aad7a5a8-0c7d-4747-9052-703246c3ee55\") " pod="ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd"
Jul 20 10:15:06.245676 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:06.245553    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aad7a5a8-0c7d-4747-9052-703246c3ee55-tls-certs\") pod \"test-model-8a2a58-kserve-66c7f5fcd7-9w5nd\" (UID: \"aad7a5a8-0c7d-4747-9052-703246c3ee55\") " pod="ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd"
Jul 20 10:15:06.245676 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:06.245624    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aad7a5a8-0c7d-4747-9052-703246c3ee55-dshm\") pod \"test-model-8a2a58-kserve-66c7f5fcd7-9w5nd\" (UID: \"aad7a5a8-0c7d-4747-9052-703246c3ee55\") " pod="ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd"
Jul 20 10:15:06.245676 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:06.245645    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aad7a5a8-0c7d-4747-9052-703246c3ee55-tmp-dir\") pod \"test-model-8a2a58-kserve-66c7f5fcd7-9w5nd\" (UID: \"aad7a5a8-0c7d-4747-9052-703246c3ee55\") " pod="ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd"
Jul 20 10:15:06.245789 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:06.245723    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aad7a5a8-0c7d-4747-9052-703246c3ee55-model-cache\") pod \"test-model-8a2a58-kserve-66c7f5fcd7-9w5nd\" (UID: \"aad7a5a8-0c7d-4747-9052-703246c3ee55\") " pod="ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd"
Jul 20 10:15:06.245789 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:06.245751    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aad7a5a8-0c7d-4747-9052-703246c3ee55-home\") pod \"test-model-8a2a58-kserve-66c7f5fcd7-9w5nd\" (UID: \"aad7a5a8-0c7d-4747-9052-703246c3ee55\") " pod="ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd"
Jul 20 10:15:06.346853 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:06.346813    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sr9kt\" (UniqueName: \"kubernetes.io/projected/aad7a5a8-0c7d-4747-9052-703246c3ee55-kube-api-access-sr9kt\") pod \"test-model-8a2a58-kserve-66c7f5fcd7-9w5nd\" (UID: \"aad7a5a8-0c7d-4747-9052-703246c3ee55\") " pod="ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd"
Jul 20 10:15:06.346853 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:06.346861    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aad7a5a8-0c7d-4747-9052-703246c3ee55-tls-certs\") pod \"test-model-8a2a58-kserve-66c7f5fcd7-9w5nd\" (UID: \"aad7a5a8-0c7d-4747-9052-703246c3ee55\") " pod="ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd"
Jul 20 10:15:06.347132 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:06.346915    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aad7a5a8-0c7d-4747-9052-703246c3ee55-dshm\") pod \"test-model-8a2a58-kserve-66c7f5fcd7-9w5nd\" (UID: \"aad7a5a8-0c7d-4747-9052-703246c3ee55\") " pod="ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd"
Jul 20 10:15:06.347132 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:06.346937    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aad7a5a8-0c7d-4747-9052-703246c3ee55-tmp-dir\") pod \"test-model-8a2a58-kserve-66c7f5fcd7-9w5nd\" (UID: \"aad7a5a8-0c7d-4747-9052-703246c3ee55\") " pod="ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd"
Jul 20 10:15:06.347132 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:06.347009    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aad7a5a8-0c7d-4747-9052-703246c3ee55-model-cache\") pod \"test-model-8a2a58-kserve-66c7f5fcd7-9w5nd\" (UID: \"aad7a5a8-0c7d-4747-9052-703246c3ee55\") " pod="ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd"
Jul 20 10:15:06.347132 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:06.347036    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aad7a5a8-0c7d-4747-9052-703246c3ee55-home\") pod \"test-model-8a2a58-kserve-66c7f5fcd7-9w5nd\" (UID: \"aad7a5a8-0c7d-4747-9052-703246c3ee55\") " pod="ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd"
Jul 20 10:15:06.347441 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:06.347417    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aad7a5a8-0c7d-4747-9052-703246c3ee55-model-cache\") pod \"test-model-8a2a58-kserve-66c7f5fcd7-9w5nd\" (UID: \"aad7a5a8-0c7d-4747-9052-703246c3ee55\") " pod="ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd"
Jul 20 10:15:06.347514 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:06.347453    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aad7a5a8-0c7d-4747-9052-703246c3ee55-tmp-dir\") pod \"test-model-8a2a58-kserve-66c7f5fcd7-9w5nd\" (UID: \"aad7a5a8-0c7d-4747-9052-703246c3ee55\") " pod="ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd"
Jul 20 10:15:06.347514 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:06.347477    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aad7a5a8-0c7d-4747-9052-703246c3ee55-home\") pod \"test-model-8a2a58-kserve-66c7f5fcd7-9w5nd\" (UID: \"aad7a5a8-0c7d-4747-9052-703246c3ee55\") " pod="ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd"
Jul 20 10:15:06.349204 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:06.349186    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aad7a5a8-0c7d-4747-9052-703246c3ee55-dshm\") pod \"test-model-8a2a58-kserve-66c7f5fcd7-9w5nd\" (UID: \"aad7a5a8-0c7d-4747-9052-703246c3ee55\") " pod="ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd"
Jul 20 10:15:06.349483 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:06.349465    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aad7a5a8-0c7d-4747-9052-703246c3ee55-tls-certs\") pod \"test-model-8a2a58-kserve-66c7f5fcd7-9w5nd\" (UID: \"aad7a5a8-0c7d-4747-9052-703246c3ee55\") " pod="ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd"
Jul 20 10:15:06.355361 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:06.355340    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr9kt\" (UniqueName: \"kubernetes.io/projected/aad7a5a8-0c7d-4747-9052-703246c3ee55-kube-api-access-sr9kt\") pod \"test-model-8a2a58-kserve-66c7f5fcd7-9w5nd\" (UID: \"aad7a5a8-0c7d-4747-9052-703246c3ee55\") " pod="ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd"
Jul 20 10:15:06.422292 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:06.422230    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd"
Jul 20 10:15:06.551666 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:06.551643    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd"]
Jul 20 10:15:06.553839 ip-10-0-140-236 kubenswrapper[2581]: W0720 10:15:06.553810    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaad7a5a8_0c7d_4747_9052_703246c3ee55.slice/crio-edd34f611b860f60c3682a6c4405e8b0009798874429203b3334e6b3c40a3ca1 WatchSource:0}: Error finding container edd34f611b860f60c3682a6c4405e8b0009798874429203b3334e6b3c40a3ca1: Status 404 returned error can't find the container with id edd34f611b860f60c3682a6c4405e8b0009798874429203b3334e6b3c40a3ca1
Jul 20 10:15:06.856694 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:06.856662    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd" event={"ID":"aad7a5a8-0c7d-4747-9052-703246c3ee55","Type":"ContainerStarted","Data":"e26632ff716d07ef99cbfce24bc6e0ca801827ad73bff2231f70d9c8f02282f3"}
Jul 20 10:15:06.856883 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:06.856706    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd" event={"ID":"aad7a5a8-0c7d-4747-9052-703246c3ee55","Type":"ContainerStarted","Data":"edd34f611b860f60c3682a6c4405e8b0009798874429203b3334e6b3c40a3ca1"}
Jul 20 10:15:06.875334 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:06.875287    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd" podStartSLOduration=0.875273187 podStartE2EDuration="875.273187ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:15:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:15:06.874866697 +0000 UTC m=+2158.756313040" watchObservedRunningTime="2026-07-20 10:15:06.875273187 +0000 UTC m=+2158.756719495"
Jul 20 10:15:16.423145 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:16.423107    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd"
Jul 20 10:15:16.423538 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:16.423160    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd"
Jul 20 10:15:16.435698 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:16.435675    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd"
Jul 20 10:15:16.916538 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:16.916503    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd"
Jul 20 10:15:42.122152 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:42.122123    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:15:43.167888 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:43.167858    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd"]
Jul 20 10:15:43.186412 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:43.186384    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:15:43.789700 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:43.789667    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:15:43.891461 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:43.891428    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:15:53.876140 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:53.876104    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t"]
Jul 20 10:15:53.876657 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:53.876351    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t" podUID="9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84" containerName="maas-api" containerID="cri-o://b00018a3c75c81c42542344e03bba695915fd1162c601e17894f2c9be06c5df7" gracePeriod=30
Jul 20 10:15:53.892147 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:53.892121    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-11ee60-29742375-b5wbz"]
Jul 20 10:15:53.897370 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:53.897347    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-11ee60-29742375-b5wbz"]
Jul 20 10:15:53.898507 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:53.898486    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:15:54.093391 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:54.093358    2581 generic.go:356] "Generic (PLEG): container finished" podID="9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84" containerID="b00018a3c75c81c42542344e03bba695915fd1162c601e17894f2c9be06c5df7" exitCode=0
Jul 20 10:15:54.093542 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:54.093430    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t" event={"ID":"9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84","Type":"ContainerDied","Data":"b00018a3c75c81c42542344e03bba695915fd1162c601e17894f2c9be06c5df7"}
Jul 20 10:15:54.123741 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:54.123722    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t"
Jul 20 10:15:54.179410 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:54.179342    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m49r8\" (UniqueName: \"kubernetes.io/projected/9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84-kube-api-access-m49r8\") pod \"9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84\" (UID: \"9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84\") "
Jul 20 10:15:54.181169 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:54.181139    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84-kube-api-access-m49r8" (OuterVolumeSpecName: "kube-api-access-m49r8") pod "9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84" (UID: "9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84"). InnerVolumeSpecName "kube-api-access-m49r8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 10:15:54.280419 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:54.280398    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84-maas-api-tls\") pod \"9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84\" (UID: \"9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84\") "
Jul 20 10:15:54.280533 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:54.280443    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84-openshift-service-ca\") pod \"9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84\" (UID: \"9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84\") "
Jul 20 10:15:54.280673 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:54.280657    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m49r8\" (UniqueName: \"kubernetes.io/projected/9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84-kube-api-access-m49r8\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:15:54.280820 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:54.280803    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84" (UID: "9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 10:15:54.282368 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:54.282336    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84" (UID: "9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 10:15:54.381704 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:54.381684    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84-maas-api-tls\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:15:54.381704 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:54.381704    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84-openshift-service-ca\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:15:55.099546 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:55.099518    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t"
Jul 20 10:15:55.099546 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:55.099527    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t" event={"ID":"9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84","Type":"ContainerDied","Data":"10bdf407f765a2057c4081534e58fccee572e19231ccd4471ee7c0f87fcd2764"}
Jul 20 10:15:55.100005 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:55.099590    2581 scope.go:117] "RemoveContainer" containerID="b00018a3c75c81c42542344e03bba695915fd1162c601e17894f2c9be06c5df7"
Jul 20 10:15:55.120652 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:55.120627    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t"]
Jul 20 10:15:55.124976 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:55.124944    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-11ee60-6dccb8b94f-qdw5t"]
Jul 20 10:15:55.464607 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:55.464535    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9aa6e800-d235-4afa-87f5-b8e12bb28379" path="/var/lib/kubelet/pods/9aa6e800-d235-4afa-87f5-b8e12bb28379/volumes"
Jul 20 10:15:55.464884 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:55.464870    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84" path="/var/lib/kubelet/pods/9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84/volumes"
Jul 20 10:15:58.188429 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:58.188389    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd" podUID="aad7a5a8-0c7d-4747-9052-703246c3ee55" containerName="main" containerID="cri-o://e26632ff716d07ef99cbfce24bc6e0ca801827ad73bff2231f70d9c8f02282f3" gracePeriod=45
Jul 20 10:15:58.362392 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:58.362343    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:15:58.446804 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:58.446745    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd"
Jul 20 10:15:58.517070 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:58.517038    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aad7a5a8-0c7d-4747-9052-703246c3ee55-tmp-dir\") pod \"aad7a5a8-0c7d-4747-9052-703246c3ee55\" (UID: \"aad7a5a8-0c7d-4747-9052-703246c3ee55\") "
Jul 20 10:15:58.517241 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:58.517110    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sr9kt\" (UniqueName: \"kubernetes.io/projected/aad7a5a8-0c7d-4747-9052-703246c3ee55-kube-api-access-sr9kt\") pod \"aad7a5a8-0c7d-4747-9052-703246c3ee55\" (UID: \"aad7a5a8-0c7d-4747-9052-703246c3ee55\") "
Jul 20 10:15:58.517241 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:58.517179    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aad7a5a8-0c7d-4747-9052-703246c3ee55-tls-certs\") pod \"aad7a5a8-0c7d-4747-9052-703246c3ee55\" (UID: \"aad7a5a8-0c7d-4747-9052-703246c3ee55\") "
Jul 20 10:15:58.517241 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:58.517201    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aad7a5a8-0c7d-4747-9052-703246c3ee55-home\") pod \"aad7a5a8-0c7d-4747-9052-703246c3ee55\" (UID: \"aad7a5a8-0c7d-4747-9052-703246c3ee55\") "
Jul 20 10:15:58.517241 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:58.517239    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aad7a5a8-0c7d-4747-9052-703246c3ee55-dshm\") pod \"aad7a5a8-0c7d-4747-9052-703246c3ee55\" (UID: \"aad7a5a8-0c7d-4747-9052-703246c3ee55\") "
Jul 20 10:15:58.517455 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:58.517284    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aad7a5a8-0c7d-4747-9052-703246c3ee55-model-cache\") pod \"aad7a5a8-0c7d-4747-9052-703246c3ee55\" (UID: \"aad7a5a8-0c7d-4747-9052-703246c3ee55\") "
Jul 20 10:15:58.517455 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:58.517321    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aad7a5a8-0c7d-4747-9052-703246c3ee55-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "aad7a5a8-0c7d-4747-9052-703246c3ee55" (UID: "aad7a5a8-0c7d-4747-9052-703246c3ee55"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 10:15:58.517455 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:58.517431    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aad7a5a8-0c7d-4747-9052-703246c3ee55-home" (OuterVolumeSpecName: "home") pod "aad7a5a8-0c7d-4747-9052-703246c3ee55" (UID: "aad7a5a8-0c7d-4747-9052-703246c3ee55"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 10:15:58.517580 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:58.517565    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aad7a5a8-0c7d-4747-9052-703246c3ee55-model-cache" (OuterVolumeSpecName: "model-cache") pod "aad7a5a8-0c7d-4747-9052-703246c3ee55" (UID: "aad7a5a8-0c7d-4747-9052-703246c3ee55"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 10:15:58.517626 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:58.517584    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aad7a5a8-0c7d-4747-9052-703246c3ee55-home\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:15:58.517626 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:58.517604    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aad7a5a8-0c7d-4747-9052-703246c3ee55-tmp-dir\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:15:58.519402 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:58.519372    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aad7a5a8-0c7d-4747-9052-703246c3ee55-dshm" (OuterVolumeSpecName: "dshm") pod "aad7a5a8-0c7d-4747-9052-703246c3ee55" (UID: "aad7a5a8-0c7d-4747-9052-703246c3ee55"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 10:15:58.519510 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:58.519417    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aad7a5a8-0c7d-4747-9052-703246c3ee55-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "aad7a5a8-0c7d-4747-9052-703246c3ee55" (UID: "aad7a5a8-0c7d-4747-9052-703246c3ee55"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 10:15:58.519510 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:58.519441    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aad7a5a8-0c7d-4747-9052-703246c3ee55-kube-api-access-sr9kt" (OuterVolumeSpecName: "kube-api-access-sr9kt") pod "aad7a5a8-0c7d-4747-9052-703246c3ee55" (UID: "aad7a5a8-0c7d-4747-9052-703246c3ee55"). InnerVolumeSpecName "kube-api-access-sr9kt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 10:15:58.618201 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:58.618176    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sr9kt\" (UniqueName: \"kubernetes.io/projected/aad7a5a8-0c7d-4747-9052-703246c3ee55-kube-api-access-sr9kt\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:15:58.618201 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:58.618197    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aad7a5a8-0c7d-4747-9052-703246c3ee55-tls-certs\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:15:58.618201 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:58.618206    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aad7a5a8-0c7d-4747-9052-703246c3ee55-dshm\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:15:58.618377 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:58.618214    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aad7a5a8-0c7d-4747-9052-703246c3ee55-model-cache\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:15:58.813370 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:58.813306    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:15:59.123360 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:59.123327    2581 generic.go:356] "Generic (PLEG): container finished" podID="aad7a5a8-0c7d-4747-9052-703246c3ee55" containerID="e26632ff716d07ef99cbfce24bc6e0ca801827ad73bff2231f70d9c8f02282f3" exitCode=0
Jul 20 10:15:59.123528 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:59.123363    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd"
Jul 20 10:15:59.123528 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:59.123409    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd" event={"ID":"aad7a5a8-0c7d-4747-9052-703246c3ee55","Type":"ContainerDied","Data":"e26632ff716d07ef99cbfce24bc6e0ca801827ad73bff2231f70d9c8f02282f3"}
Jul 20 10:15:59.123528 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:59.123444    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd" event={"ID":"aad7a5a8-0c7d-4747-9052-703246c3ee55","Type":"ContainerDied","Data":"edd34f611b860f60c3682a6c4405e8b0009798874429203b3334e6b3c40a3ca1"}
Jul 20 10:15:59.123528 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:59.123464    2581 scope.go:117] "RemoveContainer" containerID="e26632ff716d07ef99cbfce24bc6e0ca801827ad73bff2231f70d9c8f02282f3"
Jul 20 10:15:59.139873 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:59.139851    2581 scope.go:117] "RemoveContainer" containerID="e26632ff716d07ef99cbfce24bc6e0ca801827ad73bff2231f70d9c8f02282f3"
Jul 20 10:15:59.140137 ip-10-0-140-236 kubenswrapper[2581]: E0720 10:15:59.140118    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e26632ff716d07ef99cbfce24bc6e0ca801827ad73bff2231f70d9c8f02282f3\": container with ID starting with e26632ff716d07ef99cbfce24bc6e0ca801827ad73bff2231f70d9c8f02282f3 not found: ID does not exist" containerID="e26632ff716d07ef99cbfce24bc6e0ca801827ad73bff2231f70d9c8f02282f3"
Jul 20 10:15:59.140218 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:59.140143    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e26632ff716d07ef99cbfce24bc6e0ca801827ad73bff2231f70d9c8f02282f3"} err="failed to get container status \"e26632ff716d07ef99cbfce24bc6e0ca801827ad73bff2231f70d9c8f02282f3\": rpc error: code = NotFound desc = could not find container \"e26632ff716d07ef99cbfce24bc6e0ca801827ad73bff2231f70d9c8f02282f3\": container with ID starting with e26632ff716d07ef99cbfce24bc6e0ca801827ad73bff2231f70d9c8f02282f3 not found: ID does not exist"
Jul 20 10:15:59.147672 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:59.147649    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd"]
Jul 20 10:15:59.153106 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:59.153085    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-8a2a58/test-model-8a2a58-kserve-66c7f5fcd7-9w5nd"]
Jul 20 10:15:59.465469 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:59.465393    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aad7a5a8-0c7d-4747-9052-703246c3ee55" path="/var/lib/kubelet/pods/aad7a5a8-0c7d-4747-9052-703246c3ee55/volumes"
Jul 20 10:15:59.974439 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:15:59.974407    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:04.698366 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:04.698331    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:04.762859 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:04.762828    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:05.082937 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:05.082858    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:05.270512 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:05.270483    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:06.033017 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:06.032987    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:06.133441 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:06.133409    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:15.798861 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:15.798795    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm"]
Jul 20 10:16:15.799389 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:15.799095    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm" podUID="a1d8f529-3da8-44a3-81f8-c59e9a918f68" containerName="maas-api" containerID="cri-o://d03901f3a5b0aae4d0dfec640d05f993665baa0a41f1cef7e28ec1e439ba652d" gracePeriod=30
Jul 20 10:16:15.828488 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:15.828457    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:16.675298 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:16.675249    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm" podUID="a1d8f529-3da8-44a3-81f8-c59e9a918f68" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.48:8443/health\": dial tcp 10.134.0.48:8443: connect: connection refused"
Jul 20 10:16:17.057819 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:17.057782    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm"
Jul 20 10:16:17.077459 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:17.077399    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1d8f529-3da8-44a3-81f8-c59e9a918f68-maas-api-tls\") pod \"a1d8f529-3da8-44a3-81f8-c59e9a918f68\" (UID: \"a1d8f529-3da8-44a3-81f8-c59e9a918f68\") "
Jul 20 10:16:17.077635 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:17.077483    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rdpx\" (UniqueName: \"kubernetes.io/projected/a1d8f529-3da8-44a3-81f8-c59e9a918f68-kube-api-access-6rdpx\") pod \"a1d8f529-3da8-44a3-81f8-c59e9a918f68\" (UID: \"a1d8f529-3da8-44a3-81f8-c59e9a918f68\") "
Jul 20 10:16:17.077635 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:17.077531    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1d8f529-3da8-44a3-81f8-c59e9a918f68-openshift-service-ca\") pod \"a1d8f529-3da8-44a3-81f8-c59e9a918f68\" (UID: \"a1d8f529-3da8-44a3-81f8-c59e9a918f68\") "
Jul 20 10:16:17.078281 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:17.078242    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1d8f529-3da8-44a3-81f8-c59e9a918f68-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a1d8f529-3da8-44a3-81f8-c59e9a918f68" (UID: "a1d8f529-3da8-44a3-81f8-c59e9a918f68"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 10:16:17.082391 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:17.082354    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1d8f529-3da8-44a3-81f8-c59e9a918f68-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a1d8f529-3da8-44a3-81f8-c59e9a918f68" (UID: "a1d8f529-3da8-44a3-81f8-c59e9a918f68"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 10:16:17.082892 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:17.082857    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1d8f529-3da8-44a3-81f8-c59e9a918f68-kube-api-access-6rdpx" (OuterVolumeSpecName: "kube-api-access-6rdpx") pod "a1d8f529-3da8-44a3-81f8-c59e9a918f68" (UID: "a1d8f529-3da8-44a3-81f8-c59e9a918f68"). InnerVolumeSpecName "kube-api-access-6rdpx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 10:16:17.178404 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:17.178369    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1d8f529-3da8-44a3-81f8-c59e9a918f68-maas-api-tls\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:16:17.178404 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:17.178397    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rdpx\" (UniqueName: \"kubernetes.io/projected/a1d8f529-3da8-44a3-81f8-c59e9a918f68-kube-api-access-6rdpx\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:16:17.178404 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:17.178407    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1d8f529-3da8-44a3-81f8-c59e9a918f68-openshift-service-ca\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:16:17.217107 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:17.217072    2581 generic.go:356] "Generic (PLEG): container finished" podID="a1d8f529-3da8-44a3-81f8-c59e9a918f68" containerID="d03901f3a5b0aae4d0dfec640d05f993665baa0a41f1cef7e28ec1e439ba652d" exitCode=0
Jul 20 10:16:17.217274 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:17.217113    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm" event={"ID":"a1d8f529-3da8-44a3-81f8-c59e9a918f68","Type":"ContainerDied","Data":"d03901f3a5b0aae4d0dfec640d05f993665baa0a41f1cef7e28ec1e439ba652d"}
Jul 20 10:16:17.217274 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:17.217162    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm" event={"ID":"a1d8f529-3da8-44a3-81f8-c59e9a918f68","Type":"ContainerDied","Data":"bc52f83f14f796bf5fe8c9f108befb1ecb7d582f79e0c605ae643038df7bc6d8"}
Jul 20 10:16:17.217274 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:17.217189    2581 scope.go:117] "RemoveContainer" containerID="d03901f3a5b0aae4d0dfec640d05f993665baa0a41f1cef7e28ec1e439ba652d"
Jul 20 10:16:17.217274 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:17.217117    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm"
Jul 20 10:16:17.226935 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:17.226918    2581 scope.go:117] "RemoveContainer" containerID="d03901f3a5b0aae4d0dfec640d05f993665baa0a41f1cef7e28ec1e439ba652d"
Jul 20 10:16:17.227231 ip-10-0-140-236 kubenswrapper[2581]: E0720 10:16:17.227212    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d03901f3a5b0aae4d0dfec640d05f993665baa0a41f1cef7e28ec1e439ba652d\": container with ID starting with d03901f3a5b0aae4d0dfec640d05f993665baa0a41f1cef7e28ec1e439ba652d not found: ID does not exist" containerID="d03901f3a5b0aae4d0dfec640d05f993665baa0a41f1cef7e28ec1e439ba652d"
Jul 20 10:16:17.227296 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:17.227246    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d03901f3a5b0aae4d0dfec640d05f993665baa0a41f1cef7e28ec1e439ba652d"} err="failed to get container status \"d03901f3a5b0aae4d0dfec640d05f993665baa0a41f1cef7e28ec1e439ba652d\": rpc error: code = NotFound desc = could not find container \"d03901f3a5b0aae4d0dfec640d05f993665baa0a41f1cef7e28ec1e439ba652d\": container with ID starting with d03901f3a5b0aae4d0dfec640d05f993665baa0a41f1cef7e28ec1e439ba652d not found: ID does not exist"
Jul 20 10:16:17.241580 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:17.241561    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm"]
Jul 20 10:16:17.245511 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:17.245490    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8a2a58-54f5d87dff-mvsbm"]
Jul 20 10:16:17.465859 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:17.465823    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1d8f529-3da8-44a3-81f8-c59e9a918f68" path="/var/lib/kubelet/pods/a1d8f529-3da8-44a3-81f8-c59e9a918f68/volumes"
Jul 20 10:16:20.532843 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:20.532808    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:21.230954 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:21.230883    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:26.620231 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:26.620159    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:26.721128 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:26.721092    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:26.890057 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:26.889921    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:27.183448 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:27.183340    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:27.550191 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:27.550108    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:27.871715 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:27.871669    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:27.933372 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:27.933343    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:27.997883 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:27.997856    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:31.144620 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:31.144520    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:31.209828 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:31.209800    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx"]
Jul 20 10:16:31.210205 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:31.210192    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aad7a5a8-0c7d-4747-9052-703246c3ee55" containerName="main"
Jul 20 10:16:31.210260 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:31.210207    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="aad7a5a8-0c7d-4747-9052-703246c3ee55" containerName="main"
Jul 20 10:16:31.210260 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:31.210216    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84" containerName="maas-api"
Jul 20 10:16:31.210260 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:31.210221    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84" containerName="maas-api"
Jul 20 10:16:31.210260 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:31.210241    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1d8f529-3da8-44a3-81f8-c59e9a918f68" containerName="maas-api"
Jul 20 10:16:31.210260 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:31.210247    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1d8f529-3da8-44a3-81f8-c59e9a918f68" containerName="maas-api"
Jul 20 10:16:31.210436 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:31.210307    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bd94e3c-6e24-4f69-9c77-53ca1ec3fb84" containerName="maas-api"
Jul 20 10:16:31.210436 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:31.210319    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="aad7a5a8-0c7d-4747-9052-703246c3ee55" containerName="main"
Jul 20 10:16:31.210436 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:31.210330    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1d8f529-3da8-44a3-81f8-c59e9a918f68" containerName="maas-api"
Jul 20 10:16:31.214815 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:31.214794    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx"
Jul 20 10:16:31.217323 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:31.217304    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-817a64-serving-cert\""
Jul 20 10:16:31.228715 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:31.228695    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx"]
Jul 20 10:16:31.248052 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:31.248030    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:31.298095 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:31.298066    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b251bb7a-624b-477e-93da-9862ff6b8391-openshift-service-ca\") pod \"maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx\" (UID: \"b251bb7a-624b-477e-93da-9862ff6b8391\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx"
Jul 20 10:16:31.298212 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:31.298137    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56kch\" (UniqueName: \"kubernetes.io/projected/b251bb7a-624b-477e-93da-9862ff6b8391-kube-api-access-56kch\") pod \"maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx\" (UID: \"b251bb7a-624b-477e-93da-9862ff6b8391\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx"
Jul 20 10:16:31.298212 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:31.298173    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b251bb7a-624b-477e-93da-9862ff6b8391-maas-api-tls\") pod \"maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx\" (UID: \"b251bb7a-624b-477e-93da-9862ff6b8391\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx"
Jul 20 10:16:31.344460 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:31.344435    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:31.399265 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:31.399208    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56kch\" (UniqueName: \"kubernetes.io/projected/b251bb7a-624b-477e-93da-9862ff6b8391-kube-api-access-56kch\") pod \"maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx\" (UID: \"b251bb7a-624b-477e-93da-9862ff6b8391\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx"
Jul 20 10:16:31.399265 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:31.399235    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b251bb7a-624b-477e-93da-9862ff6b8391-maas-api-tls\") pod \"maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx\" (UID: \"b251bb7a-624b-477e-93da-9862ff6b8391\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx"
Jul 20 10:16:31.399397 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:31.399291    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b251bb7a-624b-477e-93da-9862ff6b8391-openshift-service-ca\") pod \"maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx\" (UID: \"b251bb7a-624b-477e-93da-9862ff6b8391\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx"
Jul 20 10:16:31.407406 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:31.400489    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b251bb7a-624b-477e-93da-9862ff6b8391-openshift-service-ca\") pod \"maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx\" (UID: \"b251bb7a-624b-477e-93da-9862ff6b8391\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx"
Jul 20 10:16:31.408113 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:31.408089    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b251bb7a-624b-477e-93da-9862ff6b8391-maas-api-tls\") pod \"maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx\" (UID: \"b251bb7a-624b-477e-93da-9862ff6b8391\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx"
Jul 20 10:16:31.408584 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:31.408565    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56kch\" (UniqueName: \"kubernetes.io/projected/b251bb7a-624b-477e-93da-9862ff6b8391-kube-api-access-56kch\") pod \"maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx\" (UID: \"b251bb7a-624b-477e-93da-9862ff6b8391\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx"
Jul 20 10:16:31.524451 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:31.524424    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx"
Jul 20 10:16:31.656276 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:31.656202    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx"]
Jul 20 10:16:31.660058 ip-10-0-140-236 kubenswrapper[2581]: W0720 10:16:31.660033    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb251bb7a_624b_477e_93da_9862ff6b8391.slice/crio-b28c684ee2506709a29205e2a84e70486e74bd428ba71f4cbc7d4cdd9e052d51 WatchSource:0}: Error finding container b28c684ee2506709a29205e2a84e70486e74bd428ba71f4cbc7d4cdd9e052d51: Status 404 returned error can't find the container with id b28c684ee2506709a29205e2a84e70486e74bd428ba71f4cbc7d4cdd9e052d51
Jul 20 10:16:31.700129 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:31.700104    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:31.803450 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:31.803425    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:31.901103 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:31.901073    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:32.296264 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:32.296225    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx" event={"ID":"b251bb7a-624b-477e-93da-9862ff6b8391","Type":"ContainerStarted","Data":"9463a57e24d47d04296c5920734022c7a29e3597b0c06b850441a227572403f0"}
Jul 20 10:16:32.296701 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:32.296302    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx" event={"ID":"b251bb7a-624b-477e-93da-9862ff6b8391","Type":"ContainerStarted","Data":"b28c684ee2506709a29205e2a84e70486e74bd428ba71f4cbc7d4cdd9e052d51"}
Jul 20 10:16:32.296701 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:32.296458    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx"
Jul 20 10:16:32.311692 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:32.311649    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx" podStartSLOduration=0.829490488 podStartE2EDuration="1.311635647s" totalImagesPullingTime="482.145159ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:16:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:16:32.310816435 +0000 UTC m=+2244.192262771" watchObservedRunningTime="2026-07-20 10:16:32.311635647 +0000 UTC m=+2244.193081954"
Jul 20 10:16:35.656859 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:35.656826    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:36.466719 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:36.466675    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:36.563833 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:36.563802    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:37.198187 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:37.198151    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:38.306679 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:38.306650    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx"
Jul 20 10:16:39.154484 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:39.154448    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:39.257201 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:39.257166    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:39.378262 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:39.378233    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-39467e-655848d6c-m4dkl"]
Jul 20 10:16:39.382168 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:39.382145    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-39467e-655848d6c-m4dkl"
Jul 20 10:16:39.384368 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:39.384349    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-39467e-serving-cert\""
Jul 20 10:16:39.392795 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:39.392770    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-39467e-655848d6c-m4dkl"]
Jul 20 10:16:39.412660 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:39.412593    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:39.472954 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:39.472927    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkvks\" (UniqueName: \"kubernetes.io/projected/967a1d34-bac0-4a78-8f3e-836528c008a2-kube-api-access-vkvks\") pod \"maas-api-e2e-api-b-39467e-655848d6c-m4dkl\" (UID: \"967a1d34-bac0-4a78-8f3e-836528c008a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-39467e-655848d6c-m4dkl"
Jul 20 10:16:39.473106 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:39.472980    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/967a1d34-bac0-4a78-8f3e-836528c008a2-maas-api-tls\") pod \"maas-api-e2e-api-b-39467e-655848d6c-m4dkl\" (UID: \"967a1d34-bac0-4a78-8f3e-836528c008a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-39467e-655848d6c-m4dkl"
Jul 20 10:16:39.473154 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:39.473109    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/967a1d34-bac0-4a78-8f3e-836528c008a2-openshift-service-ca\") pod \"maas-api-e2e-api-b-39467e-655848d6c-m4dkl\" (UID: \"967a1d34-bac0-4a78-8f3e-836528c008a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-39467e-655848d6c-m4dkl"
Jul 20 10:16:39.547071 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:39.547043    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:39.574330 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:39.574300    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/967a1d34-bac0-4a78-8f3e-836528c008a2-openshift-service-ca\") pod \"maas-api-e2e-api-b-39467e-655848d6c-m4dkl\" (UID: \"967a1d34-bac0-4a78-8f3e-836528c008a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-39467e-655848d6c-m4dkl"
Jul 20 10:16:39.574454 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:39.574346    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkvks\" (UniqueName: \"kubernetes.io/projected/967a1d34-bac0-4a78-8f3e-836528c008a2-kube-api-access-vkvks\") pod \"maas-api-e2e-api-b-39467e-655848d6c-m4dkl\" (UID: \"967a1d34-bac0-4a78-8f3e-836528c008a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-39467e-655848d6c-m4dkl"
Jul 20 10:16:39.574454 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:39.574402    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/967a1d34-bac0-4a78-8f3e-836528c008a2-maas-api-tls\") pod \"maas-api-e2e-api-b-39467e-655848d6c-m4dkl\" (UID: \"967a1d34-bac0-4a78-8f3e-836528c008a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-39467e-655848d6c-m4dkl"
Jul 20 10:16:39.575031 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:39.575013    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/967a1d34-bac0-4a78-8f3e-836528c008a2-openshift-service-ca\") pod \"maas-api-e2e-api-b-39467e-655848d6c-m4dkl\" (UID: \"967a1d34-bac0-4a78-8f3e-836528c008a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-39467e-655848d6c-m4dkl"
Jul 20 10:16:39.576774 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:39.576754    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/967a1d34-bac0-4a78-8f3e-836528c008a2-maas-api-tls\") pod \"maas-api-e2e-api-b-39467e-655848d6c-m4dkl\" (UID: \"967a1d34-bac0-4a78-8f3e-836528c008a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-39467e-655848d6c-m4dkl"
Jul 20 10:16:39.581941 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:39.581921    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkvks\" (UniqueName: \"kubernetes.io/projected/967a1d34-bac0-4a78-8f3e-836528c008a2-kube-api-access-vkvks\") pod \"maas-api-e2e-api-b-39467e-655848d6c-m4dkl\" (UID: \"967a1d34-bac0-4a78-8f3e-836528c008a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-39467e-655848d6c-m4dkl"
Jul 20 10:16:39.695789 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:39.695701    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-39467e-655848d6c-m4dkl"
Jul 20 10:16:39.830480 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:39.830457    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-39467e-655848d6c-m4dkl"]
Jul 20 10:16:39.832741 ip-10-0-140-236 kubenswrapper[2581]: W0720 10:16:39.832717    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod967a1d34_bac0_4a78_8f3e_836528c008a2.slice/crio-728b8ed7a7fc2a569d1d4f3eb26d2b12565e6ea28fd8c14ac7a711f214a56302 WatchSource:0}: Error finding container 728b8ed7a7fc2a569d1d4f3eb26d2b12565e6ea28fd8c14ac7a711f214a56302: Status 404 returned error can't find the container with id 728b8ed7a7fc2a569d1d4f3eb26d2b12565e6ea28fd8c14ac7a711f214a56302
Jul 20 10:16:39.849027 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:39.849002    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:39.953194 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:39.953112    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:40.337154 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:40.337069    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-39467e-655848d6c-m4dkl" event={"ID":"967a1d34-bac0-4a78-8f3e-836528c008a2","Type":"ContainerStarted","Data":"728b8ed7a7fc2a569d1d4f3eb26d2b12565e6ea28fd8c14ac7a711f214a56302"}
Jul 20 10:16:41.344085 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:41.344052    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-39467e-655848d6c-m4dkl" event={"ID":"967a1d34-bac0-4a78-8f3e-836528c008a2","Type":"ContainerStarted","Data":"4c686812855265a4ea7a98e868435294188d1fc8f2dd3f5c4185ba17b3dd75cc"}
Jul 20 10:16:41.344492 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:41.344171    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-39467e-655848d6c-m4dkl"
Jul 20 10:16:41.360498 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:41.360452    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-39467e-655848d6c-m4dkl" podStartSLOduration=1.620850253 podStartE2EDuration="2.360437524s" totalImagesPullingTime="739.587271ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:16:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:16:41.359265918 +0000 UTC m=+2253.240712227" watchObservedRunningTime="2026-07-20 10:16:41.360437524 +0000 UTC m=+2253.241883832"
Jul 20 10:16:43.720730 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:43.720699    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:47.355193 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:47.355164    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-39467e-655848d6c-m4dkl"
Jul 20 10:16:51.671618 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:51.671578    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:52.620356 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:52.620321    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:16:52.720570 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:16:52.720541    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:01.400087 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:01.400056    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:01.502545 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:01.502509    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:07.150523 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:07.150479    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx"]
Jul 20 10:17:07.151030 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:07.150700    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx" podUID="b251bb7a-624b-477e-93da-9862ff6b8391" containerName="maas-api" containerID="cri-o://9463a57e24d47d04296c5920734022c7a29e3597b0c06b850441a227572403f0" gracePeriod=30
Jul 20 10:17:07.178260 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:07.178231    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:07.400018 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:07.399991    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx"
Jul 20 10:17:07.415055 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:07.414952    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b251bb7a-624b-477e-93da-9862ff6b8391-openshift-service-ca\") pod \"b251bb7a-624b-477e-93da-9862ff6b8391\" (UID: \"b251bb7a-624b-477e-93da-9862ff6b8391\") "
Jul 20 10:17:07.415204 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:07.415080    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56kch\" (UniqueName: \"kubernetes.io/projected/b251bb7a-624b-477e-93da-9862ff6b8391-kube-api-access-56kch\") pod \"b251bb7a-624b-477e-93da-9862ff6b8391\" (UID: \"b251bb7a-624b-477e-93da-9862ff6b8391\") "
Jul 20 10:17:07.415283 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:07.415242    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b251bb7a-624b-477e-93da-9862ff6b8391-maas-api-tls\") pod \"b251bb7a-624b-477e-93da-9862ff6b8391\" (UID: \"b251bb7a-624b-477e-93da-9862ff6b8391\") "
Jul 20 10:17:07.415718 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:07.415693    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b251bb7a-624b-477e-93da-9862ff6b8391-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b251bb7a-624b-477e-93da-9862ff6b8391" (UID: "b251bb7a-624b-477e-93da-9862ff6b8391"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 10:17:07.417612 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:07.417588    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b251bb7a-624b-477e-93da-9862ff6b8391-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b251bb7a-624b-477e-93da-9862ff6b8391" (UID: "b251bb7a-624b-477e-93da-9862ff6b8391"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 10:17:07.417721 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:07.417666    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b251bb7a-624b-477e-93da-9862ff6b8391-kube-api-access-56kch" (OuterVolumeSpecName: "kube-api-access-56kch") pod "b251bb7a-624b-477e-93da-9862ff6b8391" (UID: "b251bb7a-624b-477e-93da-9862ff6b8391"). InnerVolumeSpecName "kube-api-access-56kch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 10:17:07.473805 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:07.473779    2581 generic.go:356] "Generic (PLEG): container finished" podID="b251bb7a-624b-477e-93da-9862ff6b8391" containerID="9463a57e24d47d04296c5920734022c7a29e3597b0c06b850441a227572403f0" exitCode=0
Jul 20 10:17:07.473893 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:07.473813    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx"
Jul 20 10:17:07.473893 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:07.473830    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx" event={"ID":"b251bb7a-624b-477e-93da-9862ff6b8391","Type":"ContainerDied","Data":"9463a57e24d47d04296c5920734022c7a29e3597b0c06b850441a227572403f0"}
Jul 20 10:17:07.473893 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:07.473875    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx" event={"ID":"b251bb7a-624b-477e-93da-9862ff6b8391","Type":"ContainerDied","Data":"b28c684ee2506709a29205e2a84e70486e74bd428ba71f4cbc7d4cdd9e052d51"}
Jul 20 10:17:07.474027 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:07.473897    2581 scope.go:117] "RemoveContainer" containerID="9463a57e24d47d04296c5920734022c7a29e3597b0c06b850441a227572403f0"
Jul 20 10:17:07.482938 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:07.482915    2581 scope.go:117] "RemoveContainer" containerID="9463a57e24d47d04296c5920734022c7a29e3597b0c06b850441a227572403f0"
Jul 20 10:17:07.483219 ip-10-0-140-236 kubenswrapper[2581]: E0720 10:17:07.483197    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9463a57e24d47d04296c5920734022c7a29e3597b0c06b850441a227572403f0\": container with ID starting with 9463a57e24d47d04296c5920734022c7a29e3597b0c06b850441a227572403f0 not found: ID does not exist" containerID="9463a57e24d47d04296c5920734022c7a29e3597b0c06b850441a227572403f0"
Jul 20 10:17:07.483281 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:07.483227    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9463a57e24d47d04296c5920734022c7a29e3597b0c06b850441a227572403f0"} err="failed to get container status \"9463a57e24d47d04296c5920734022c7a29e3597b0c06b850441a227572403f0\": rpc error: code = NotFound desc = could not find container \"9463a57e24d47d04296c5920734022c7a29e3597b0c06b850441a227572403f0\": container with ID starting with 9463a57e24d47d04296c5920734022c7a29e3597b0c06b850441a227572403f0 not found: ID does not exist"
Jul 20 10:17:07.490354 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:07.490335    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx"]
Jul 20 10:17:07.494284 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:07.494265    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-817a64-7d7fd45c8c-2whfx"]
Jul 20 10:17:07.517077 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:07.517058    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b251bb7a-624b-477e-93da-9862ff6b8391-maas-api-tls\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:17:07.517144 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:07.517077    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b251bb7a-624b-477e-93da-9862ff6b8391-openshift-service-ca\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:17:07.517144 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:07.517088    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56kch\" (UniqueName: \"kubernetes.io/projected/b251bb7a-624b-477e-93da-9862ff6b8391-kube-api-access-56kch\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:17:09.465234 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:09.465203    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b251bb7a-624b-477e-93da-9862ff6b8391" path="/var/lib/kubelet/pods/b251bb7a-624b-477e-93da-9862ff6b8391/volumes"
Jul 20 10:17:12.109314 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:12.109283    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:12.510847 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:12.510771    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:18.223800 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:18.223760    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:18.279480 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:18.279447    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:18.490637 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:18.490541    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:18.736133 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:18.736102    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:34.228338 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:34.228299    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-39467e-655848d6c-m4dkl"]
Jul 20 10:17:34.228786 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:34.228551    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-39467e-655848d6c-m4dkl" podUID="967a1d34-bac0-4a78-8f3e-836528c008a2" containerName="maas-api" containerID="cri-o://4c686812855265a4ea7a98e868435294188d1fc8f2dd3f5c4185ba17b3dd75cc" gracePeriod=30
Jul 20 10:17:34.255852 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:34.255823    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:34.481828 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:34.481772    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-39467e-655848d6c-m4dkl"
Jul 20 10:17:34.547048 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:34.547019    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/967a1d34-bac0-4a78-8f3e-836528c008a2-maas-api-tls\") pod \"967a1d34-bac0-4a78-8f3e-836528c008a2\" (UID: \"967a1d34-bac0-4a78-8f3e-836528c008a2\") "
Jul 20 10:17:34.547184 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:34.547144    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkvks\" (UniqueName: \"kubernetes.io/projected/967a1d34-bac0-4a78-8f3e-836528c008a2-kube-api-access-vkvks\") pod \"967a1d34-bac0-4a78-8f3e-836528c008a2\" (UID: \"967a1d34-bac0-4a78-8f3e-836528c008a2\") "
Jul 20 10:17:34.547231 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:34.547187    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/967a1d34-bac0-4a78-8f3e-836528c008a2-openshift-service-ca\") pod \"967a1d34-bac0-4a78-8f3e-836528c008a2\" (UID: \"967a1d34-bac0-4a78-8f3e-836528c008a2\") "
Jul 20 10:17:34.547568 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:34.547542    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/967a1d34-bac0-4a78-8f3e-836528c008a2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "967a1d34-bac0-4a78-8f3e-836528c008a2" (UID: "967a1d34-bac0-4a78-8f3e-836528c008a2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 10:17:34.549114 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:34.549092    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/967a1d34-bac0-4a78-8f3e-836528c008a2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "967a1d34-bac0-4a78-8f3e-836528c008a2" (UID: "967a1d34-bac0-4a78-8f3e-836528c008a2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 10:17:34.549210 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:34.549117    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/967a1d34-bac0-4a78-8f3e-836528c008a2-kube-api-access-vkvks" (OuterVolumeSpecName: "kube-api-access-vkvks") pod "967a1d34-bac0-4a78-8f3e-836528c008a2" (UID: "967a1d34-bac0-4a78-8f3e-836528c008a2"). InnerVolumeSpecName "kube-api-access-vkvks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 10:17:34.607304 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:34.607270    2581 generic.go:356] "Generic (PLEG): container finished" podID="967a1d34-bac0-4a78-8f3e-836528c008a2" containerID="4c686812855265a4ea7a98e868435294188d1fc8f2dd3f5c4185ba17b3dd75cc" exitCode=0
Jul 20 10:17:34.607418 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:34.607298    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-39467e-655848d6c-m4dkl" event={"ID":"967a1d34-bac0-4a78-8f3e-836528c008a2","Type":"ContainerDied","Data":"4c686812855265a4ea7a98e868435294188d1fc8f2dd3f5c4185ba17b3dd75cc"}
Jul 20 10:17:34.607418 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:34.607317    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-39467e-655848d6c-m4dkl"
Jul 20 10:17:34.607418 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:34.607395    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-39467e-655848d6c-m4dkl" event={"ID":"967a1d34-bac0-4a78-8f3e-836528c008a2","Type":"ContainerDied","Data":"728b8ed7a7fc2a569d1d4f3eb26d2b12565e6ea28fd8c14ac7a711f214a56302"}
Jul 20 10:17:34.607582 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:34.607429    2581 scope.go:117] "RemoveContainer" containerID="4c686812855265a4ea7a98e868435294188d1fc8f2dd3f5c4185ba17b3dd75cc"
Jul 20 10:17:34.616686 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:34.616669    2581 scope.go:117] "RemoveContainer" containerID="4c686812855265a4ea7a98e868435294188d1fc8f2dd3f5c4185ba17b3dd75cc"
Jul 20 10:17:34.616894 ip-10-0-140-236 kubenswrapper[2581]: E0720 10:17:34.616873    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c686812855265a4ea7a98e868435294188d1fc8f2dd3f5c4185ba17b3dd75cc\": container with ID starting with 4c686812855265a4ea7a98e868435294188d1fc8f2dd3f5c4185ba17b3dd75cc not found: ID does not exist" containerID="4c686812855265a4ea7a98e868435294188d1fc8f2dd3f5c4185ba17b3dd75cc"
Jul 20 10:17:34.616955 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:34.616902    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c686812855265a4ea7a98e868435294188d1fc8f2dd3f5c4185ba17b3dd75cc"} err="failed to get container status \"4c686812855265a4ea7a98e868435294188d1fc8f2dd3f5c4185ba17b3dd75cc\": rpc error: code = NotFound desc = could not find container \"4c686812855265a4ea7a98e868435294188d1fc8f2dd3f5c4185ba17b3dd75cc\": container with ID starting with 4c686812855265a4ea7a98e868435294188d1fc8f2dd3f5c4185ba17b3dd75cc not found: ID does not exist"
Jul 20 10:17:34.630892 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:34.630872    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-39467e-655848d6c-m4dkl"]
Jul 20 10:17:34.635047 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:34.635028    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-39467e-655848d6c-m4dkl"]
Jul 20 10:17:34.648282 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:34.648265    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/967a1d34-bac0-4a78-8f3e-836528c008a2-openshift-service-ca\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:17:34.648374 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:34.648284    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/967a1d34-bac0-4a78-8f3e-836528c008a2-maas-api-tls\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:17:34.648374 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:34.648294    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkvks\" (UniqueName: \"kubernetes.io/projected/967a1d34-bac0-4a78-8f3e-836528c008a2-kube-api-access-vkvks\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:17:35.464513 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:35.464476    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="967a1d34-bac0-4a78-8f3e-836528c008a2" path="/var/lib/kubelet/pods/967a1d34-bac0-4a78-8f3e-836528c008a2/volumes"
Jul 20 10:17:38.899174 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:38.899139    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:39.281501 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:39.281426    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:45.157743 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:45.157709    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:45.258500 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:45.258469    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:45.437597 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:45.437526    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:45.662473 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:45.662442    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:46.029984 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:46.029923    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:46.392865 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:46.392831    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:46.786860 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:46.786783    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:49.682574 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:49.682533    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:49.692366 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:49.692341    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x"]
Jul 20 10:17:49.692786 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:49.692770    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="967a1d34-bac0-4a78-8f3e-836528c008a2" containerName="maas-api"
Jul 20 10:17:49.692786 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:49.692787    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="967a1d34-bac0-4a78-8f3e-836528c008a2" containerName="maas-api"
Jul 20 10:17:49.692912 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:49.692815    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b251bb7a-624b-477e-93da-9862ff6b8391" containerName="maas-api"
Jul 20 10:17:49.692912 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:49.692821    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b251bb7a-624b-477e-93da-9862ff6b8391" containerName="maas-api"
Jul 20 10:17:49.692912 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:49.692890    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b251bb7a-624b-477e-93da-9862ff6b8391" containerName="maas-api"
Jul 20 10:17:49.692912 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:49.692902    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="967a1d34-bac0-4a78-8f3e-836528c008a2" containerName="maas-api"
Jul 20 10:17:49.696016 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:49.695998    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x"
Jul 20 10:17:49.698483 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:49.698464    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-b7ed4c-serving-cert\""
Jul 20 10:17:49.707336 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:49.707314    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x"]
Jul 20 10:17:49.774626 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:49.774600    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:49.876162 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:49.876134    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54bc6d87-996a-4d73-af01-4e4383815373-openshift-service-ca\") pod \"maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x\" (UID: \"54bc6d87-996a-4d73-af01-4e4383815373\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x"
Jul 20 10:17:49.876301 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:49.876190    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54bc6d87-996a-4d73-af01-4e4383815373-maas-api-tls\") pod \"maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x\" (UID: \"54bc6d87-996a-4d73-af01-4e4383815373\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x"
Jul 20 10:17:49.876301 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:49.876290    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr8mh\" (UniqueName: \"kubernetes.io/projected/54bc6d87-996a-4d73-af01-4e4383815373-kube-api-access-dr8mh\") pod \"maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x\" (UID: \"54bc6d87-996a-4d73-af01-4e4383815373\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x"
Jul 20 10:17:49.977008 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:49.976928    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr8mh\" (UniqueName: \"kubernetes.io/projected/54bc6d87-996a-4d73-af01-4e4383815373-kube-api-access-dr8mh\") pod \"maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x\" (UID: \"54bc6d87-996a-4d73-af01-4e4383815373\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x"
Jul 20 10:17:49.977109 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:49.977023    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54bc6d87-996a-4d73-af01-4e4383815373-openshift-service-ca\") pod \"maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x\" (UID: \"54bc6d87-996a-4d73-af01-4e4383815373\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x"
Jul 20 10:17:49.977109 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:49.977059    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54bc6d87-996a-4d73-af01-4e4383815373-maas-api-tls\") pod \"maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x\" (UID: \"54bc6d87-996a-4d73-af01-4e4383815373\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x"
Jul 20 10:17:49.977730 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:49.977715    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54bc6d87-996a-4d73-af01-4e4383815373-openshift-service-ca\") pod \"maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x\" (UID: \"54bc6d87-996a-4d73-af01-4e4383815373\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x"
Jul 20 10:17:49.979345 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:49.979322    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54bc6d87-996a-4d73-af01-4e4383815373-maas-api-tls\") pod \"maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x\" (UID: \"54bc6d87-996a-4d73-af01-4e4383815373\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x"
Jul 20 10:17:49.984439 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:49.984421    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr8mh\" (UniqueName: \"kubernetes.io/projected/54bc6d87-996a-4d73-af01-4e4383815373-kube-api-access-dr8mh\") pod \"maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x\" (UID: \"54bc6d87-996a-4d73-af01-4e4383815373\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x"
Jul 20 10:17:50.006079 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:50.006055    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:50.008010 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:50.007993    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x"
Jul 20 10:17:50.152927 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:50.152904    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x"]
Jul 20 10:17:50.154873 ip-10-0-140-236 kubenswrapper[2581]: W0720 10:17:50.154846    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54bc6d87_996a_4d73_af01_4e4383815373.slice/crio-94ddbc83cefb77ccafb3c07dd4e4688cb8239ebd81df5f1acb2cf1a69af3a340 WatchSource:0}: Error finding container 94ddbc83cefb77ccafb3c07dd4e4688cb8239ebd81df5f1acb2cf1a69af3a340: Status 404 returned error can't find the container with id 94ddbc83cefb77ccafb3c07dd4e4688cb8239ebd81df5f1acb2cf1a69af3a340
Jul 20 10:17:50.156289 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:50.156268    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 10:17:50.438265 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:50.438239    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:50.537077 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:50.537051    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:50.690075 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:50.690003    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x" event={"ID":"54bc6d87-996a-4d73-af01-4e4383815373","Type":"ContainerStarted","Data":"94ddbc83cefb77ccafb3c07dd4e4688cb8239ebd81df5f1acb2cf1a69af3a340"}
Jul 20 10:17:51.696040 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:51.696002    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x" event={"ID":"54bc6d87-996a-4d73-af01-4e4383815373","Type":"ContainerStarted","Data":"3475a7a373bdc852a7410dcd534aa4932c5674284e556a4d6a98d5e2c9818c40"}
Jul 20 10:17:51.696506 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:51.696077    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x"
Jul 20 10:17:51.711753 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:51.711702    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x" podStartSLOduration=2.218437761 podStartE2EDuration="2.711687033s" totalImagesPullingTime="493.249272ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:17:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:17:51.711385392 +0000 UTC m=+2323.592831701" watchObservedRunningTime="2026-07-20 10:17:51.711687033 +0000 UTC m=+2323.593133362"
Jul 20 10:17:54.104411 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:54.104378    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:54.451672 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:54.451600    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:54.753589 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:54.753512    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:54.995648 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:54.995614    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:55.152787 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:55.152759    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:55.253849 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:55.253815    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:57.626217 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:57.626183    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:57.691400 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:57.691369    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw"]
Jul 20 10:17:57.695242 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:57.695218    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw"
Jul 20 10:17:57.697650 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:57.697631    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-186a7e-serving-cert\""
Jul 20 10:17:57.706036 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:57.705955    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw"]
Jul 20 10:17:57.707782 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:57.707762    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x"
Jul 20 10:17:57.710872 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:57.710850    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:57.785201 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:57.785176    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:57.844560 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:57.844520    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwcmd\" (UniqueName: \"kubernetes.io/projected/b6d70a4d-ea57-42e6-8637-999733924106-kube-api-access-zwcmd\") pod \"maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw\" (UID: \"b6d70a4d-ea57-42e6-8637-999733924106\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw"
Jul 20 10:17:57.844696 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:57.844569    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6d70a4d-ea57-42e6-8637-999733924106-maas-api-tls\") pod \"maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw\" (UID: \"b6d70a4d-ea57-42e6-8637-999733924106\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw"
Jul 20 10:17:57.844781 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:57.844761    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6d70a4d-ea57-42e6-8637-999733924106-openshift-service-ca\") pod \"maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw\" (UID: \"b6d70a4d-ea57-42e6-8637-999733924106\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw"
Jul 20 10:17:57.939149 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:57.939074    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:57.945675 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:57.945651    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6d70a4d-ea57-42e6-8637-999733924106-openshift-service-ca\") pod \"maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw\" (UID: \"b6d70a4d-ea57-42e6-8637-999733924106\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw"
Jul 20 10:17:57.945803 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:57.945692    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwcmd\" (UniqueName: \"kubernetes.io/projected/b6d70a4d-ea57-42e6-8637-999733924106-kube-api-access-zwcmd\") pod \"maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw\" (UID: \"b6d70a4d-ea57-42e6-8637-999733924106\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw"
Jul 20 10:17:57.945803 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:57.945717    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6d70a4d-ea57-42e6-8637-999733924106-maas-api-tls\") pod \"maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw\" (UID: \"b6d70a4d-ea57-42e6-8637-999733924106\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw"
Jul 20 10:17:57.946353 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:57.946334    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6d70a4d-ea57-42e6-8637-999733924106-openshift-service-ca\") pod \"maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw\" (UID: \"b6d70a4d-ea57-42e6-8637-999733924106\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw"
Jul 20 10:17:57.948183 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:57.948165    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6d70a4d-ea57-42e6-8637-999733924106-maas-api-tls\") pod \"maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw\" (UID: \"b6d70a4d-ea57-42e6-8637-999733924106\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw"
Jul 20 10:17:57.957134 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:57.957105    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwcmd\" (UniqueName: \"kubernetes.io/projected/b6d70a4d-ea57-42e6-8637-999733924106-kube-api-access-zwcmd\") pod \"maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw\" (UID: \"b6d70a4d-ea57-42e6-8637-999733924106\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw"
Jul 20 10:17:58.008143 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:58.008124    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw"
Jul 20 10:17:58.140460 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:58.140438    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw"]
Jul 20 10:17:58.140983 ip-10-0-140-236 kubenswrapper[2581]: W0720 10:17:58.140936    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6d70a4d_ea57_42e6_8637_999733924106.slice/crio-3db27d6dd40ed7330d465e8776ef9727cd847e1d801f56f4419207ae42394199 WatchSource:0}: Error finding container 3db27d6dd40ed7330d465e8776ef9727cd847e1d801f56f4419207ae42394199: Status 404 returned error can't find the container with id 3db27d6dd40ed7330d465e8776ef9727cd847e1d801f56f4419207ae42394199
Jul 20 10:17:58.386234 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:58.386203    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:58.487656 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:58.487632    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:17:58.735719 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:58.735618    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw" event={"ID":"b6d70a4d-ea57-42e6-8637-999733924106","Type":"ContainerStarted","Data":"60419ff42ea1afc0e0e3caa87a4793ae98df9860c38101ebdba9843f3a2fb9d3"}
Jul 20 10:17:58.736121 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:58.735823    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw"
Jul 20 10:17:58.736121 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:58.735862    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw" event={"ID":"b6d70a4d-ea57-42e6-8637-999733924106","Type":"ContainerStarted","Data":"3db27d6dd40ed7330d465e8776ef9727cd847e1d801f56f4419207ae42394199"}
Jul 20 10:17:58.756167 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:17:58.756118    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw" podStartSLOduration=1.435103333 podStartE2EDuration="1.756099964s" totalImagesPullingTime="320.996631ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:17:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:17:58.753851436 +0000 UTC m=+2330.635297745" watchObservedRunningTime="2026-07-20 10:17:58.756099964 +0000 UTC m=+2330.637546274"
Jul 20 10:18:02.171480 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:18:02.171370    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:18:04.747618 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:18:04.747593    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw"
Jul 20 10:18:12.074337 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:18:12.074293    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:18:12.175465 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:18:12.175436    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:18:20.003940 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:18:20.003886    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:18:20.102202 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:18:20.102171    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:18:33.948971 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:18:33.948940    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:18:53.635358 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:18:53.635320    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:18:53.736520 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:18:53.736477    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:19:08.800169 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:08.800141    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rgb4r_d6c73ac6-85c5-4b3f-aa58-71ac88099c0a/ovn-acl-logging/0.log"
Jul 20 10:19:08.806307 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:08.806286    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rgb4r_d6c73ac6-85c5-4b3f-aa58-71ac88099c0a/ovn-acl-logging/0.log"
Jul 20 10:19:09.977557 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:09.977491    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:19:26.421539 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:26.421504    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2"]
Jul 20 10:19:26.425421 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:26.425398    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2"
Jul 20 10:19:26.427812 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:26.427789    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-186a7e\"/\"openshift-service-ca.crt\""
Jul 20 10:19:26.428620 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:26.428603    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-186a7e\"/\"kube-root-ca.crt\""
Jul 20 10:19:26.428747 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:26.428645    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-186a7e\"/\"auth-test-model-186a7e-kserve-self-signed-certs\""
Jul 20 10:19:26.428747 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:26.428712    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-186a7e\"/\"default-dockercfg-bzhsd\""
Jul 20 10:19:26.434705 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:26.434660    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2"]
Jul 20 10:19:26.440169 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:26.440127    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:19:26.609498 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:26.609475    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-dshm\") pod \"auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2\" (UID: \"88cb987d-0ee0-4520-8a6b-e3859cacc3f5\") " pod="ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2"
Jul 20 10:19:26.609659 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:26.609519    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-tls-certs\") pod \"auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2\" (UID: \"88cb987d-0ee0-4520-8a6b-e3859cacc3f5\") " pod="ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2"
Jul 20 10:19:26.609736 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:26.609672    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-home\") pod \"auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2\" (UID: \"88cb987d-0ee0-4520-8a6b-e3859cacc3f5\") " pod="ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2"
Jul 20 10:19:26.609843 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:26.609821    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l856\" (UniqueName: \"kubernetes.io/projected/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-kube-api-access-5l856\") pod \"auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2\" (UID: \"88cb987d-0ee0-4520-8a6b-e3859cacc3f5\") " pod="ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2"
Jul 20 10:19:26.609918 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:26.609900    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-model-cache\") pod \"auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2\" (UID: \"88cb987d-0ee0-4520-8a6b-e3859cacc3f5\") " pod="ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2"
Jul 20 10:19:26.610073 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:26.610052    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-tmp-dir\") pod \"auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2\" (UID: \"88cb987d-0ee0-4520-8a6b-e3859cacc3f5\") " pod="ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2"
Jul 20 10:19:26.711536 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:26.711481    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-tmp-dir\") pod \"auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2\" (UID: \"88cb987d-0ee0-4520-8a6b-e3859cacc3f5\") " pod="ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2"
Jul 20 10:19:26.711536 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:26.711528    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-dshm\") pod \"auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2\" (UID: \"88cb987d-0ee0-4520-8a6b-e3859cacc3f5\") " pod="ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2"
Jul 20 10:19:26.711661 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:26.711551    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-tls-certs\") pod \"auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2\" (UID: \"88cb987d-0ee0-4520-8a6b-e3859cacc3f5\") " pod="ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2"
Jul 20 10:19:26.711661 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:26.711573    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-home\") pod \"auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2\" (UID: \"88cb987d-0ee0-4520-8a6b-e3859cacc3f5\") " pod="ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2"
Jul 20 10:19:26.711661 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:26.711611    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l856\" (UniqueName: \"kubernetes.io/projected/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-kube-api-access-5l856\") pod \"auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2\" (UID: \"88cb987d-0ee0-4520-8a6b-e3859cacc3f5\") " pod="ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2"
Jul 20 10:19:26.711661 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:26.711632    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-model-cache\") pod \"auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2\" (UID: \"88cb987d-0ee0-4520-8a6b-e3859cacc3f5\") " pod="ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2"
Jul 20 10:19:26.711916 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:26.711896    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-tmp-dir\") pod \"auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2\" (UID: \"88cb987d-0ee0-4520-8a6b-e3859cacc3f5\") " pod="ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2"
Jul 20 10:19:26.712028 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:26.712010    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-home\") pod \"auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2\" (UID: \"88cb987d-0ee0-4520-8a6b-e3859cacc3f5\") " pod="ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2"
Jul 20 10:19:26.712089 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:26.712038    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-model-cache\") pod \"auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2\" (UID: \"88cb987d-0ee0-4520-8a6b-e3859cacc3f5\") " pod="ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2"
Jul 20 10:19:26.713885 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:26.713865    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-dshm\") pod \"auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2\" (UID: \"88cb987d-0ee0-4520-8a6b-e3859cacc3f5\") " pod="ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2"
Jul 20 10:19:26.714077 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:26.714060    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-tls-certs\") pod \"auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2\" (UID: \"88cb987d-0ee0-4520-8a6b-e3859cacc3f5\") " pod="ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2"
Jul 20 10:19:26.719131 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:26.719111    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l856\" (UniqueName: \"kubernetes.io/projected/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-kube-api-access-5l856\") pod \"auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2\" (UID: \"88cb987d-0ee0-4520-8a6b-e3859cacc3f5\") " pod="ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2"
Jul 20 10:19:26.736664 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:26.736647    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2"
Jul 20 10:19:26.883403 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:26.883379    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2"]
Jul 20 10:19:26.885335 ip-10-0-140-236 kubenswrapper[2581]: W0720 10:19:26.885306    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88cb987d_0ee0_4520_8a6b_e3859cacc3f5.slice/crio-6af23152620656954c9eabf72c6e89933ac36dcc05529c0c9a4d035909040fe1 WatchSource:0}: Error finding container 6af23152620656954c9eabf72c6e89933ac36dcc05529c0c9a4d035909040fe1: Status 404 returned error can't find the container with id 6af23152620656954c9eabf72c6e89933ac36dcc05529c0c9a4d035909040fe1
Jul 20 10:19:27.173304 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:27.173265    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2" event={"ID":"88cb987d-0ee0-4520-8a6b-e3859cacc3f5","Type":"ContainerStarted","Data":"ead71d56475ff95b19e93ebcf9e305b4c9034ef2db7bee7bcefc0a2a621acaed"}
Jul 20 10:19:27.173304 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:27.173304    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2" event={"ID":"88cb987d-0ee0-4520-8a6b-e3859cacc3f5","Type":"ContainerStarted","Data":"6af23152620656954c9eabf72c6e89933ac36dcc05529c0c9a4d035909040fe1"}
Jul 20 10:19:27.191773 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:27.191726    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2" podStartSLOduration=1.191710735 podStartE2EDuration="1.191710735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:19:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:19:27.189854683 +0000 UTC m=+2419.071301015" watchObservedRunningTime="2026-07-20 10:19:27.191710735 +0000 UTC m=+2419.073157042"
Jul 20 10:19:36.736943 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:36.736864    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2"
Jul 20 10:19:36.736943 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:36.736903    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2"
Jul 20 10:19:36.749576 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:36.749551    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2"
Jul 20 10:19:37.236412 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:19:37.236387    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2"
Jul 20 10:21:08.896014 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:21:08.895892    2581 scope.go:117] "RemoveContainer" containerID="d007783030df8de3affe599b232206866ac438c299b99e139dc654ca332c3f39"
Jul 20 10:21:38.559667 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:21:38.559625    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:21:39.502529 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:21:39.502496    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2"]
Jul 20 10:21:39.522132 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:21:39.522100    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:21:54.522634 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:21:54.522577    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2" podUID="88cb987d-0ee0-4520-8a6b-e3859cacc3f5" containerName="main" containerID="cri-o://ead71d56475ff95b19e93ebcf9e305b4c9034ef2db7bee7bcefc0a2a621acaed" gracePeriod=45
Jul 20 10:21:54.767653 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:21:54.767631    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2"
Jul 20 10:21:54.803496 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:21:54.803435    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-model-cache\") pod \"88cb987d-0ee0-4520-8a6b-e3859cacc3f5\" (UID: \"88cb987d-0ee0-4520-8a6b-e3859cacc3f5\") "
Jul 20 10:21:54.803496 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:21:54.803469    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5l856\" (UniqueName: \"kubernetes.io/projected/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-kube-api-access-5l856\") pod \"88cb987d-0ee0-4520-8a6b-e3859cacc3f5\" (UID: \"88cb987d-0ee0-4520-8a6b-e3859cacc3f5\") "
Jul 20 10:21:54.803681 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:21:54.803519    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-tls-certs\") pod \"88cb987d-0ee0-4520-8a6b-e3859cacc3f5\" (UID: \"88cb987d-0ee0-4520-8a6b-e3859cacc3f5\") "
Jul 20 10:21:54.803681 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:21:54.803565    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-dshm\") pod \"88cb987d-0ee0-4520-8a6b-e3859cacc3f5\" (UID: \"88cb987d-0ee0-4520-8a6b-e3859cacc3f5\") "
Jul 20 10:21:54.803681 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:21:54.803624    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-home\") pod \"88cb987d-0ee0-4520-8a6b-e3859cacc3f5\" (UID: \"88cb987d-0ee0-4520-8a6b-e3859cacc3f5\") "
Jul 20 10:21:54.803681 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:21:54.803648    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-tmp-dir\") pod \"88cb987d-0ee0-4520-8a6b-e3859cacc3f5\" (UID: \"88cb987d-0ee0-4520-8a6b-e3859cacc3f5\") "
Jul 20 10:21:54.803892 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:21:54.803714    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-model-cache" (OuterVolumeSpecName: "model-cache") pod "88cb987d-0ee0-4520-8a6b-e3859cacc3f5" (UID: "88cb987d-0ee0-4520-8a6b-e3859cacc3f5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 10:21:54.804043 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:21:54.803949    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-home" (OuterVolumeSpecName: "home") pod "88cb987d-0ee0-4520-8a6b-e3859cacc3f5" (UID: "88cb987d-0ee0-4520-8a6b-e3859cacc3f5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 10:21:54.804043 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:21:54.803990    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-model-cache\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:21:54.804043 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:21:54.803994    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "88cb987d-0ee0-4520-8a6b-e3859cacc3f5" (UID: "88cb987d-0ee0-4520-8a6b-e3859cacc3f5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 10:21:54.806242 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:21:54.806218    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-dshm" (OuterVolumeSpecName: "dshm") pod "88cb987d-0ee0-4520-8a6b-e3859cacc3f5" (UID: "88cb987d-0ee0-4520-8a6b-e3859cacc3f5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 10:21:54.806339 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:21:54.806241    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "88cb987d-0ee0-4520-8a6b-e3859cacc3f5" (UID: "88cb987d-0ee0-4520-8a6b-e3859cacc3f5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 10:21:54.806339 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:21:54.806323    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-kube-api-access-5l856" (OuterVolumeSpecName: "kube-api-access-5l856") pod "88cb987d-0ee0-4520-8a6b-e3859cacc3f5" (UID: "88cb987d-0ee0-4520-8a6b-e3859cacc3f5"). InnerVolumeSpecName "kube-api-access-5l856". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 10:21:54.904490 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:21:54.904466    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-dshm\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:21:54.904490 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:21:54.904488    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-home\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:21:54.904641 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:21:54.904497    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-tmp-dir\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:21:54.904641 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:21:54.904507    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5l856\" (UniqueName: \"kubernetes.io/projected/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-kube-api-access-5l856\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:21:54.904641 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:21:54.904514    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88cb987d-0ee0-4520-8a6b-e3859cacc3f5-tls-certs\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:21:54.917281 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:21:54.917253    2581 generic.go:356] "Generic (PLEG): container finished" podID="88cb987d-0ee0-4520-8a6b-e3859cacc3f5" containerID="ead71d56475ff95b19e93ebcf9e305b4c9034ef2db7bee7bcefc0a2a621acaed" exitCode=0
Jul 20 10:21:54.917377 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:21:54.917299    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2"
Jul 20 10:21:54.917377 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:21:54.917342    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2" event={"ID":"88cb987d-0ee0-4520-8a6b-e3859cacc3f5","Type":"ContainerDied","Data":"ead71d56475ff95b19e93ebcf9e305b4c9034ef2db7bee7bcefc0a2a621acaed"}
Jul 20 10:21:54.917450 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:21:54.917380    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2" event={"ID":"88cb987d-0ee0-4520-8a6b-e3859cacc3f5","Type":"ContainerDied","Data":"6af23152620656954c9eabf72c6e89933ac36dcc05529c0c9a4d035909040fe1"}
Jul 20 10:21:54.917450 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:21:54.917400    2581 scope.go:117] "RemoveContainer" containerID="ead71d56475ff95b19e93ebcf9e305b4c9034ef2db7bee7bcefc0a2a621acaed"
Jul 20 10:21:54.925875 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:21:54.925860    2581 scope.go:117] "RemoveContainer" containerID="ead71d56475ff95b19e93ebcf9e305b4c9034ef2db7bee7bcefc0a2a621acaed"
Jul 20 10:21:54.926153 ip-10-0-140-236 kubenswrapper[2581]: E0720 10:21:54.926129    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ead71d56475ff95b19e93ebcf9e305b4c9034ef2db7bee7bcefc0a2a621acaed\": container with ID starting with ead71d56475ff95b19e93ebcf9e305b4c9034ef2db7bee7bcefc0a2a621acaed not found: ID does not exist" containerID="ead71d56475ff95b19e93ebcf9e305b4c9034ef2db7bee7bcefc0a2a621acaed"
Jul 20 10:21:54.926233 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:21:54.926158    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ead71d56475ff95b19e93ebcf9e305b4c9034ef2db7bee7bcefc0a2a621acaed"} err="failed to get container status \"ead71d56475ff95b19e93ebcf9e305b4c9034ef2db7bee7bcefc0a2a621acaed\": rpc error: code = NotFound desc = could not find container \"ead71d56475ff95b19e93ebcf9e305b4c9034ef2db7bee7bcefc0a2a621acaed\": container with ID starting with ead71d56475ff95b19e93ebcf9e305b4c9034ef2db7bee7bcefc0a2a621acaed not found: ID does not exist"
Jul 20 10:21:54.939552 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:21:54.939532    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2"]
Jul 20 10:21:54.942893 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:21:54.942875    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-186a7e/auth-test-model-186a7e-kserve-58c8bc49ff-zj6m2"]
Jul 20 10:21:55.465148 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:21:55.465109    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88cb987d-0ee0-4520-8a6b-e3859cacc3f5" path="/var/lib/kubelet/pods/88cb987d-0ee0-4520-8a6b-e3859cacc3f5/volumes"
Jul 20 10:22:06.227370 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:06.227332    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:22:45.222138 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:45.222046    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f"]
Jul 20 10:22:45.222716 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:45.222479    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88cb987d-0ee0-4520-8a6b-e3859cacc3f5" containerName="main"
Jul 20 10:22:45.222716 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:45.222490    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="88cb987d-0ee0-4520-8a6b-e3859cacc3f5" containerName="main"
Jul 20 10:22:45.222716 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:45.222553    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="88cb987d-0ee0-4520-8a6b-e3859cacc3f5" containerName="main"
Jul 20 10:22:45.225827 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:45.225806    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f"
Jul 20 10:22:45.229471 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:45.229447    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-186a7e\"/\"sub-test-model-186a7e-kserve-self-signed-certs\""
Jul 20 10:22:45.229584 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:45.229480    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-186a7e\"/\"default-dockercfg-bzhsd\""
Jul 20 10:22:45.229584 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:45.229510    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-186a7e\"/\"kube-root-ca.crt\""
Jul 20 10:22:45.229689 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:45.229603    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-186a7e\"/\"openshift-service-ca.crt\""
Jul 20 10:22:45.236125 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:45.236103    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f"]
Jul 20 10:22:45.254125 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:45.254092    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:22:45.336863 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:45.336834    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb89c7b9-abec-4cff-8042-54415bfc02c4-tmp-dir\") pod \"sub-test-model-186a7e-kserve-6bcf75494c-rh28f\" (UID: \"bb89c7b9-abec-4cff-8042-54415bfc02c4\") " pod="ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f"
Jul 20 10:22:45.336996 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:45.336888    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb89c7b9-abec-4cff-8042-54415bfc02c4-tls-certs\") pod \"sub-test-model-186a7e-kserve-6bcf75494c-rh28f\" (UID: \"bb89c7b9-abec-4cff-8042-54415bfc02c4\") " pod="ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f"
Jul 20 10:22:45.336996 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:45.336926    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb89c7b9-abec-4cff-8042-54415bfc02c4-dshm\") pod \"sub-test-model-186a7e-kserve-6bcf75494c-rh28f\" (UID: \"bb89c7b9-abec-4cff-8042-54415bfc02c4\") " pod="ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f"
Jul 20 10:22:45.337080 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:45.337004    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb89c7b9-abec-4cff-8042-54415bfc02c4-home\") pod \"sub-test-model-186a7e-kserve-6bcf75494c-rh28f\" (UID: \"bb89c7b9-abec-4cff-8042-54415bfc02c4\") " pod="ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f"
Jul 20 10:22:45.337080 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:45.337040    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb89c7b9-abec-4cff-8042-54415bfc02c4-model-cache\") pod \"sub-test-model-186a7e-kserve-6bcf75494c-rh28f\" (UID: \"bb89c7b9-abec-4cff-8042-54415bfc02c4\") " pod="ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f"
Jul 20 10:22:45.337145 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:45.337080    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptdlk\" (UniqueName: \"kubernetes.io/projected/bb89c7b9-abec-4cff-8042-54415bfc02c4-kube-api-access-ptdlk\") pod \"sub-test-model-186a7e-kserve-6bcf75494c-rh28f\" (UID: \"bb89c7b9-abec-4cff-8042-54415bfc02c4\") " pod="ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f"
Jul 20 10:22:45.438117 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:45.438087    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb89c7b9-abec-4cff-8042-54415bfc02c4-tls-certs\") pod \"sub-test-model-186a7e-kserve-6bcf75494c-rh28f\" (UID: \"bb89c7b9-abec-4cff-8042-54415bfc02c4\") " pod="ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f"
Jul 20 10:22:45.438247 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:45.438124    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb89c7b9-abec-4cff-8042-54415bfc02c4-dshm\") pod \"sub-test-model-186a7e-kserve-6bcf75494c-rh28f\" (UID: \"bb89c7b9-abec-4cff-8042-54415bfc02c4\") " pod="ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f"
Jul 20 10:22:45.438247 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:45.438159    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb89c7b9-abec-4cff-8042-54415bfc02c4-home\") pod \"sub-test-model-186a7e-kserve-6bcf75494c-rh28f\" (UID: \"bb89c7b9-abec-4cff-8042-54415bfc02c4\") " pod="ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f"
Jul 20 10:22:45.438247 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:45.438183    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb89c7b9-abec-4cff-8042-54415bfc02c4-model-cache\") pod \"sub-test-model-186a7e-kserve-6bcf75494c-rh28f\" (UID: \"bb89c7b9-abec-4cff-8042-54415bfc02c4\") " pod="ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f"
Jul 20 10:22:45.438247 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:45.438231    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptdlk\" (UniqueName: \"kubernetes.io/projected/bb89c7b9-abec-4cff-8042-54415bfc02c4-kube-api-access-ptdlk\") pod \"sub-test-model-186a7e-kserve-6bcf75494c-rh28f\" (UID: \"bb89c7b9-abec-4cff-8042-54415bfc02c4\") " pod="ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f"
Jul 20 10:22:45.438461 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:45.438293    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb89c7b9-abec-4cff-8042-54415bfc02c4-tmp-dir\") pod \"sub-test-model-186a7e-kserve-6bcf75494c-rh28f\" (UID: \"bb89c7b9-abec-4cff-8042-54415bfc02c4\") " pod="ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f"
Jul 20 10:22:45.438638 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:45.438602    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb89c7b9-abec-4cff-8042-54415bfc02c4-model-cache\") pod \"sub-test-model-186a7e-kserve-6bcf75494c-rh28f\" (UID: \"bb89c7b9-abec-4cff-8042-54415bfc02c4\") " pod="ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f"
Jul 20 10:22:45.438713 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:45.438636    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb89c7b9-abec-4cff-8042-54415bfc02c4-home\") pod \"sub-test-model-186a7e-kserve-6bcf75494c-rh28f\" (UID: \"bb89c7b9-abec-4cff-8042-54415bfc02c4\") " pod="ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f"
Jul 20 10:22:45.438713 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:45.438667    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb89c7b9-abec-4cff-8042-54415bfc02c4-tmp-dir\") pod \"sub-test-model-186a7e-kserve-6bcf75494c-rh28f\" (UID: \"bb89c7b9-abec-4cff-8042-54415bfc02c4\") " pod="ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f"
Jul 20 10:22:45.440524 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:45.440504    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb89c7b9-abec-4cff-8042-54415bfc02c4-dshm\") pod \"sub-test-model-186a7e-kserve-6bcf75494c-rh28f\" (UID: \"bb89c7b9-abec-4cff-8042-54415bfc02c4\") " pod="ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f"
Jul 20 10:22:45.440663 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:45.440646    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb89c7b9-abec-4cff-8042-54415bfc02c4-tls-certs\") pod \"sub-test-model-186a7e-kserve-6bcf75494c-rh28f\" (UID: \"bb89c7b9-abec-4cff-8042-54415bfc02c4\") " pod="ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f"
Jul 20 10:22:45.446039 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:45.446012    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptdlk\" (UniqueName: \"kubernetes.io/projected/bb89c7b9-abec-4cff-8042-54415bfc02c4-kube-api-access-ptdlk\") pod \"sub-test-model-186a7e-kserve-6bcf75494c-rh28f\" (UID: \"bb89c7b9-abec-4cff-8042-54415bfc02c4\") " pod="ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f"
Jul 20 10:22:45.537869 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:45.537796    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f"
Jul 20 10:22:45.668652 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:45.668623    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f"]
Jul 20 10:22:45.670300 ip-10-0-140-236 kubenswrapper[2581]: W0720 10:22:45.670275    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb89c7b9_abec_4cff_8042_54415bfc02c4.slice/crio-d7cabefd4846b475c14a98e80f783959f75b4feea8d747095e1b8712800785a7 WatchSource:0}: Error finding container d7cabefd4846b475c14a98e80f783959f75b4feea8d747095e1b8712800785a7: Status 404 returned error can't find the container with id d7cabefd4846b475c14a98e80f783959f75b4feea8d747095e1b8712800785a7
Jul 20 10:22:46.190136 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:46.190100    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f" event={"ID":"bb89c7b9-abec-4cff-8042-54415bfc02c4","Type":"ContainerStarted","Data":"5f7b54c2f7d91d2541329e4a2ccec2ac5d6d97f4232c76ec850e181106e637e3"}
Jul 20 10:22:46.190136 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:46.190147    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f" event={"ID":"bb89c7b9-abec-4cff-8042-54415bfc02c4","Type":"ContainerStarted","Data":"d7cabefd4846b475c14a98e80f783959f75b4feea8d747095e1b8712800785a7"}
Jul 20 10:22:46.207442 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:46.207396    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f" podStartSLOduration=1.207380801 podStartE2EDuration="1.207380801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:22:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:22:46.205133774 +0000 UTC m=+2618.086580104" watchObservedRunningTime="2026-07-20 10:22:46.207380801 +0000 UTC m=+2618.088827108"
Jul 20 10:22:50.666589 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:50.666556    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:22:55.538057 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:55.538030    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f"
Jul 20 10:22:55.538471 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:55.538289    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f"
Jul 20 10:22:55.550657 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:55.550631    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f"
Jul 20 10:22:56.252401 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:22:56.252373    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f"
Jul 20 10:23:12.803343 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:12.803308    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:23:12.904538 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:12.904505    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:23:20.739847 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:20.739810    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:23:20.822785 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:20.822753    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:23:31.729212 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:31.729171    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:23:32.816117 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:32.816084    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f"]
Jul 20 10:23:32.835182 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:32.835151    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:23:42.840499 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:42.840466    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:23:47.836667 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:47.836627    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f" podUID="bb89c7b9-abec-4cff-8042-54415bfc02c4" containerName="main" containerID="cri-o://5f7b54c2f7d91d2541329e4a2ccec2ac5d6d97f4232c76ec850e181106e637e3" gracePeriod=45
Jul 20 10:23:48.082427 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:48.082403    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f"
Jul 20 10:23:48.173523 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:48.173495    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb89c7b9-abec-4cff-8042-54415bfc02c4-tls-certs\") pod \"bb89c7b9-abec-4cff-8042-54415bfc02c4\" (UID: \"bb89c7b9-abec-4cff-8042-54415bfc02c4\") "
Jul 20 10:23:48.173651 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:48.173558    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb89c7b9-abec-4cff-8042-54415bfc02c4-dshm\") pod \"bb89c7b9-abec-4cff-8042-54415bfc02c4\" (UID: \"bb89c7b9-abec-4cff-8042-54415bfc02c4\") "
Jul 20 10:23:48.173709 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:48.173668    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb89c7b9-abec-4cff-8042-54415bfc02c4-model-cache\") pod \"bb89c7b9-abec-4cff-8042-54415bfc02c4\" (UID: \"bb89c7b9-abec-4cff-8042-54415bfc02c4\") "
Jul 20 10:23:48.173745 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:48.173713    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb89c7b9-abec-4cff-8042-54415bfc02c4-tmp-dir\") pod \"bb89c7b9-abec-4cff-8042-54415bfc02c4\" (UID: \"bb89c7b9-abec-4cff-8042-54415bfc02c4\") "
Jul 20 10:23:48.173745 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:48.173737    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb89c7b9-abec-4cff-8042-54415bfc02c4-home\") pod \"bb89c7b9-abec-4cff-8042-54415bfc02c4\" (UID: \"bb89c7b9-abec-4cff-8042-54415bfc02c4\") "
Jul 20 10:23:48.173835 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:48.173781    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptdlk\" (UniqueName: \"kubernetes.io/projected/bb89c7b9-abec-4cff-8042-54415bfc02c4-kube-api-access-ptdlk\") pod \"bb89c7b9-abec-4cff-8042-54415bfc02c4\" (UID: \"bb89c7b9-abec-4cff-8042-54415bfc02c4\") "
Jul 20 10:23:48.174013 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:48.173936    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb89c7b9-abec-4cff-8042-54415bfc02c4-model-cache" (OuterVolumeSpecName: "model-cache") pod "bb89c7b9-abec-4cff-8042-54415bfc02c4" (UID: "bb89c7b9-abec-4cff-8042-54415bfc02c4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 10:23:48.174013 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:48.173944    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb89c7b9-abec-4cff-8042-54415bfc02c4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bb89c7b9-abec-4cff-8042-54415bfc02c4" (UID: "bb89c7b9-abec-4cff-8042-54415bfc02c4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 10:23:48.174173 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:48.174021    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb89c7b9-abec-4cff-8042-54415bfc02c4-home" (OuterVolumeSpecName: "home") pod "bb89c7b9-abec-4cff-8042-54415bfc02c4" (UID: "bb89c7b9-abec-4cff-8042-54415bfc02c4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 10:23:48.174173 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:48.174153    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb89c7b9-abec-4cff-8042-54415bfc02c4-model-cache\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:23:48.174173 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:48.174166    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb89c7b9-abec-4cff-8042-54415bfc02c4-tmp-dir\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:23:48.174173 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:48.174174    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb89c7b9-abec-4cff-8042-54415bfc02c4-home\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:23:48.175639 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:48.175621    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb89c7b9-abec-4cff-8042-54415bfc02c4-dshm" (OuterVolumeSpecName: "dshm") pod "bb89c7b9-abec-4cff-8042-54415bfc02c4" (UID: "bb89c7b9-abec-4cff-8042-54415bfc02c4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 10:23:48.175815 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:48.175800    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb89c7b9-abec-4cff-8042-54415bfc02c4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bb89c7b9-abec-4cff-8042-54415bfc02c4" (UID: "bb89c7b9-abec-4cff-8042-54415bfc02c4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 10:23:48.175975 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:48.175939    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb89c7b9-abec-4cff-8042-54415bfc02c4-kube-api-access-ptdlk" (OuterVolumeSpecName: "kube-api-access-ptdlk") pod "bb89c7b9-abec-4cff-8042-54415bfc02c4" (UID: "bb89c7b9-abec-4cff-8042-54415bfc02c4"). InnerVolumeSpecName "kube-api-access-ptdlk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 10:23:48.275539 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:48.275507    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb89c7b9-abec-4cff-8042-54415bfc02c4-tls-certs\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:23:48.275539 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:48.275538    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb89c7b9-abec-4cff-8042-54415bfc02c4-dshm\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:23:48.275539 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:48.275548    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptdlk\" (UniqueName: \"kubernetes.io/projected/bb89c7b9-abec-4cff-8042-54415bfc02c4-kube-api-access-ptdlk\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:23:48.501188 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:48.501159    2581 generic.go:356] "Generic (PLEG): container finished" podID="bb89c7b9-abec-4cff-8042-54415bfc02c4" containerID="5f7b54c2f7d91d2541329e4a2ccec2ac5d6d97f4232c76ec850e181106e637e3" exitCode=0
Jul 20 10:23:48.501330 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:48.501198    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f"
Jul 20 10:23:48.501330 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:48.501240    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f" event={"ID":"bb89c7b9-abec-4cff-8042-54415bfc02c4","Type":"ContainerDied","Data":"5f7b54c2f7d91d2541329e4a2ccec2ac5d6d97f4232c76ec850e181106e637e3"}
Jul 20 10:23:48.501330 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:48.501280    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f" event={"ID":"bb89c7b9-abec-4cff-8042-54415bfc02c4","Type":"ContainerDied","Data":"d7cabefd4846b475c14a98e80f783959f75b4feea8d747095e1b8712800785a7"}
Jul 20 10:23:48.501330 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:48.501296    2581 scope.go:117] "RemoveContainer" containerID="5f7b54c2f7d91d2541329e4a2ccec2ac5d6d97f4232c76ec850e181106e637e3"
Jul 20 10:23:48.510496 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:48.510477    2581 scope.go:117] "RemoveContainer" containerID="5f7b54c2f7d91d2541329e4a2ccec2ac5d6d97f4232c76ec850e181106e637e3"
Jul 20 10:23:48.510739 ip-10-0-140-236 kubenswrapper[2581]: E0720 10:23:48.510721    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f7b54c2f7d91d2541329e4a2ccec2ac5d6d97f4232c76ec850e181106e637e3\": container with ID starting with 5f7b54c2f7d91d2541329e4a2ccec2ac5d6d97f4232c76ec850e181106e637e3 not found: ID does not exist" containerID="5f7b54c2f7d91d2541329e4a2ccec2ac5d6d97f4232c76ec850e181106e637e3"
Jul 20 10:23:48.510784 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:48.510747    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f7b54c2f7d91d2541329e4a2ccec2ac5d6d97f4232c76ec850e181106e637e3"} err="failed to get container status \"5f7b54c2f7d91d2541329e4a2ccec2ac5d6d97f4232c76ec850e181106e637e3\": rpc error: code = NotFound desc = could not find container \"5f7b54c2f7d91d2541329e4a2ccec2ac5d6d97f4232c76ec850e181106e637e3\": container with ID starting with 5f7b54c2f7d91d2541329e4a2ccec2ac5d6d97f4232c76ec850e181106e637e3 not found: ID does not exist"
Jul 20 10:23:48.521375 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:48.521351    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f"]
Jul 20 10:23:48.525304 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:48.525285    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-186a7e/sub-test-model-186a7e-kserve-6bcf75494c-rh28f"]
Jul 20 10:23:49.464694 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:49.464661    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb89c7b9-abec-4cff-8042-54415bfc02c4" path="/var/lib/kubelet/pods/bb89c7b9-abec-4cff-8042-54415bfc02c4/volumes"
Jul 20 10:23:54.337741 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:54.337709    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:23:54.437950 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:23:54.437912    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:24:08.832708 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:08.832628    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rgb4r_d6c73ac6-85c5-4b3f-aa58-71ac88099c0a/ovn-acl-logging/0.log"
Jul 20 10:24:08.839558 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:08.839539    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rgb4r_d6c73ac6-85c5-4b3f-aa58-71ac88099c0a/ovn-acl-logging/0.log"
Jul 20 10:24:12.199712 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:12.199682    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z"]
Jul 20 10:24:12.200107 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:12.200093    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb89c7b9-abec-4cff-8042-54415bfc02c4" containerName="main"
Jul 20 10:24:12.200107 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:12.200106    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb89c7b9-abec-4cff-8042-54415bfc02c4" containerName="main"
Jul 20 10:24:12.200192 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:12.200180    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb89c7b9-abec-4cff-8042-54415bfc02c4" containerName="main"
Jul 20 10:24:12.204772 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:12.204753    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z"
Jul 20 10:24:12.208303 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:12.208270    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-186a7e\"/\"rate-test-model-186a7e-kserve-self-signed-certs\""
Jul 20 10:24:12.208433 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:12.208274    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-186a7e\"/\"openshift-service-ca.crt\""
Jul 20 10:24:12.208433 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:12.208314    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-186a7e\"/\"kube-root-ca.crt\""
Jul 20 10:24:12.208433 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:12.208339    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-186a7e\"/\"default-dockercfg-bzhsd\""
Jul 20 10:24:12.212703 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:12.212672    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z"]
Jul 20 10:24:12.231828 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:12.231792    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:24:12.378793 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:12.378763    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26210339-4962-4a46-ba4a-8516c301bbd9-tls-certs\") pod \"rate-test-model-186a7e-kserve-c467df799-cf75z\" (UID: \"26210339-4962-4a46-ba4a-8516c301bbd9\") " pod="ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z"
Jul 20 10:24:12.378943 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:12.378803    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26210339-4962-4a46-ba4a-8516c301bbd9-dshm\") pod \"rate-test-model-186a7e-kserve-c467df799-cf75z\" (UID: \"26210339-4962-4a46-ba4a-8516c301bbd9\") " pod="ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z"
Jul 20 10:24:12.378943 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:12.378832    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8nj8\" (UniqueName: \"kubernetes.io/projected/26210339-4962-4a46-ba4a-8516c301bbd9-kube-api-access-w8nj8\") pod \"rate-test-model-186a7e-kserve-c467df799-cf75z\" (UID: \"26210339-4962-4a46-ba4a-8516c301bbd9\") " pod="ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z"
Jul 20 10:24:12.378943 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:12.378874    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26210339-4962-4a46-ba4a-8516c301bbd9-home\") pod \"rate-test-model-186a7e-kserve-c467df799-cf75z\" (UID: \"26210339-4962-4a46-ba4a-8516c301bbd9\") " pod="ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z"
Jul 20 10:24:12.378943 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:12.378894    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26210339-4962-4a46-ba4a-8516c301bbd9-model-cache\") pod \"rate-test-model-186a7e-kserve-c467df799-cf75z\" (UID: \"26210339-4962-4a46-ba4a-8516c301bbd9\") " pod="ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z"
Jul 20 10:24:12.379145 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:12.378997    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26210339-4962-4a46-ba4a-8516c301bbd9-tmp-dir\") pod \"rate-test-model-186a7e-kserve-c467df799-cf75z\" (UID: \"26210339-4962-4a46-ba4a-8516c301bbd9\") " pod="ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z"
Jul 20 10:24:12.480260 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:12.480180    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26210339-4962-4a46-ba4a-8516c301bbd9-tls-certs\") pod \"rate-test-model-186a7e-kserve-c467df799-cf75z\" (UID: \"26210339-4962-4a46-ba4a-8516c301bbd9\") " pod="ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z"
Jul 20 10:24:12.480260 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:12.480228    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26210339-4962-4a46-ba4a-8516c301bbd9-dshm\") pod \"rate-test-model-186a7e-kserve-c467df799-cf75z\" (UID: \"26210339-4962-4a46-ba4a-8516c301bbd9\") " pod="ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z"
Jul 20 10:24:12.480470 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:12.480266    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8nj8\" (UniqueName: \"kubernetes.io/projected/26210339-4962-4a46-ba4a-8516c301bbd9-kube-api-access-w8nj8\") pod \"rate-test-model-186a7e-kserve-c467df799-cf75z\" (UID: \"26210339-4962-4a46-ba4a-8516c301bbd9\") " pod="ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z"
Jul 20 10:24:12.480470 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:12.480307    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26210339-4962-4a46-ba4a-8516c301bbd9-home\") pod \"rate-test-model-186a7e-kserve-c467df799-cf75z\" (UID: \"26210339-4962-4a46-ba4a-8516c301bbd9\") " pod="ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z"
Jul 20 10:24:12.480470 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:12.480335    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26210339-4962-4a46-ba4a-8516c301bbd9-model-cache\") pod \"rate-test-model-186a7e-kserve-c467df799-cf75z\" (UID: \"26210339-4962-4a46-ba4a-8516c301bbd9\") " pod="ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z"
Jul 20 10:24:12.480470 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:12.480394    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26210339-4962-4a46-ba4a-8516c301bbd9-tmp-dir\") pod \"rate-test-model-186a7e-kserve-c467df799-cf75z\" (UID: \"26210339-4962-4a46-ba4a-8516c301bbd9\") " pod="ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z"
Jul 20 10:24:12.480715 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:12.480689    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26210339-4962-4a46-ba4a-8516c301bbd9-model-cache\") pod \"rate-test-model-186a7e-kserve-c467df799-cf75z\" (UID: \"26210339-4962-4a46-ba4a-8516c301bbd9\") " pod="ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z"
Jul 20 10:24:12.480816 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:12.480768    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26210339-4962-4a46-ba4a-8516c301bbd9-home\") pod \"rate-test-model-186a7e-kserve-c467df799-cf75z\" (UID: \"26210339-4962-4a46-ba4a-8516c301bbd9\") " pod="ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z"
Jul 20 10:24:12.480870 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:12.480844    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26210339-4962-4a46-ba4a-8516c301bbd9-tmp-dir\") pod \"rate-test-model-186a7e-kserve-c467df799-cf75z\" (UID: \"26210339-4962-4a46-ba4a-8516c301bbd9\") " pod="ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z"
Jul 20 10:24:12.482585 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:12.482562    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26210339-4962-4a46-ba4a-8516c301bbd9-dshm\") pod \"rate-test-model-186a7e-kserve-c467df799-cf75z\" (UID: \"26210339-4962-4a46-ba4a-8516c301bbd9\") " pod="ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z"
Jul 20 10:24:12.482828 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:12.482813    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26210339-4962-4a46-ba4a-8516c301bbd9-tls-certs\") pod \"rate-test-model-186a7e-kserve-c467df799-cf75z\" (UID: \"26210339-4962-4a46-ba4a-8516c301bbd9\") " pod="ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z"
Jul 20 10:24:12.489257 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:12.489236    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8nj8\" (UniqueName: \"kubernetes.io/projected/26210339-4962-4a46-ba4a-8516c301bbd9-kube-api-access-w8nj8\") pod \"rate-test-model-186a7e-kserve-c467df799-cf75z\" (UID: \"26210339-4962-4a46-ba4a-8516c301bbd9\") " pod="ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z"
Jul 20 10:24:12.516374 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:12.516355    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z"
Jul 20 10:24:12.643755 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:12.643727    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z"]
Jul 20 10:24:12.646251 ip-10-0-140-236 kubenswrapper[2581]: W0720 10:24:12.646228    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26210339_4962_4a46_ba4a_8516c301bbd9.slice/crio-0004a5e4a03e67e5ed95466ec7c6221f74ffcf6ad08b94b1b3cbc842264474ef WatchSource:0}: Error finding container 0004a5e4a03e67e5ed95466ec7c6221f74ffcf6ad08b94b1b3cbc842264474ef: Status 404 returned error can't find the container with id 0004a5e4a03e67e5ed95466ec7c6221f74ffcf6ad08b94b1b3cbc842264474ef
Jul 20 10:24:13.635704 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:13.635670    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z" event={"ID":"26210339-4962-4a46-ba4a-8516c301bbd9","Type":"ContainerStarted","Data":"a46a3c8d0971945a64cb79f8783cf1f5df6e8224f5f44dad1df34064ca58565f"}
Jul 20 10:24:13.635704 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:13.635710    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z" event={"ID":"26210339-4962-4a46-ba4a-8516c301bbd9","Type":"ContainerStarted","Data":"0004a5e4a03e67e5ed95466ec7c6221f74ffcf6ad08b94b1b3cbc842264474ef"}
Jul 20 10:24:13.652089 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:13.652040    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z" podStartSLOduration=1.652026636 podStartE2EDuration="1.652026636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:24:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:24:13.650517832 +0000 UTC m=+2705.531964161" watchObservedRunningTime="2026-07-20 10:24:13.652026636 +0000 UTC m=+2705.533472943"
Jul 20 10:24:22.517045 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:22.517011    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z"
Jul 20 10:24:22.517045 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:22.517052    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z"
Jul 20 10:24:22.529172 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:22.529149    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z"
Jul 20 10:24:22.696235 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:22.696208    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z"
Jul 20 10:24:58.667427 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:58.667395    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:24:59.597107 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:59.597076    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z"]
Jul 20 10:24:59.618517 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:24:59.618484    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:25:13.009105 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:13.009067    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:25:14.618111 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:14.618077    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z" podUID="26210339-4962-4a46-ba4a-8516c301bbd9" containerName="main" containerID="cri-o://a46a3c8d0971945a64cb79f8783cf1f5df6e8224f5f44dad1df34064ca58565f" gracePeriod=45
Jul 20 10:25:14.864874 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:14.864851    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z"
Jul 20 10:25:14.947254 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:14.947184    2581 generic.go:356] "Generic (PLEG): container finished" podID="26210339-4962-4a46-ba4a-8516c301bbd9" containerID="a46a3c8d0971945a64cb79f8783cf1f5df6e8224f5f44dad1df34064ca58565f" exitCode=0
Jul 20 10:25:14.947254 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:14.947227    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z"
Jul 20 10:25:14.947399 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:14.947274    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z" event={"ID":"26210339-4962-4a46-ba4a-8516c301bbd9","Type":"ContainerDied","Data":"a46a3c8d0971945a64cb79f8783cf1f5df6e8224f5f44dad1df34064ca58565f"}
Jul 20 10:25:14.947399 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:14.947318    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z" event={"ID":"26210339-4962-4a46-ba4a-8516c301bbd9","Type":"ContainerDied","Data":"0004a5e4a03e67e5ed95466ec7c6221f74ffcf6ad08b94b1b3cbc842264474ef"}
Jul 20 10:25:14.947399 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:14.947336    2581 scope.go:117] "RemoveContainer" containerID="a46a3c8d0971945a64cb79f8783cf1f5df6e8224f5f44dad1df34064ca58565f"
Jul 20 10:25:14.955468 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:14.955449    2581 scope.go:117] "RemoveContainer" containerID="a46a3c8d0971945a64cb79f8783cf1f5df6e8224f5f44dad1df34064ca58565f"
Jul 20 10:25:14.955725 ip-10-0-140-236 kubenswrapper[2581]: E0720 10:25:14.955706    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a46a3c8d0971945a64cb79f8783cf1f5df6e8224f5f44dad1df34064ca58565f\": container with ID starting with a46a3c8d0971945a64cb79f8783cf1f5df6e8224f5f44dad1df34064ca58565f not found: ID does not exist" containerID="a46a3c8d0971945a64cb79f8783cf1f5df6e8224f5f44dad1df34064ca58565f"
Jul 20 10:25:14.955771 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:14.955733    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a46a3c8d0971945a64cb79f8783cf1f5df6e8224f5f44dad1df34064ca58565f"} err="failed to get container status \"a46a3c8d0971945a64cb79f8783cf1f5df6e8224f5f44dad1df34064ca58565f\": rpc error: code = NotFound desc = could not find container \"a46a3c8d0971945a64cb79f8783cf1f5df6e8224f5f44dad1df34064ca58565f\": container with ID starting with a46a3c8d0971945a64cb79f8783cf1f5df6e8224f5f44dad1df34064ca58565f not found: ID does not exist"
Jul 20 10:25:15.014265 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:15.014244    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26210339-4962-4a46-ba4a-8516c301bbd9-tls-certs\") pod \"26210339-4962-4a46-ba4a-8516c301bbd9\" (UID: \"26210339-4962-4a46-ba4a-8516c301bbd9\") "
Jul 20 10:25:15.014353 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:15.014280    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26210339-4962-4a46-ba4a-8516c301bbd9-home\") pod \"26210339-4962-4a46-ba4a-8516c301bbd9\" (UID: \"26210339-4962-4a46-ba4a-8516c301bbd9\") "
Jul 20 10:25:15.014353 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:15.014318    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26210339-4962-4a46-ba4a-8516c301bbd9-tmp-dir\") pod \"26210339-4962-4a46-ba4a-8516c301bbd9\" (UID: \"26210339-4962-4a46-ba4a-8516c301bbd9\") "
Jul 20 10:25:15.014353 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:15.014338    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26210339-4962-4a46-ba4a-8516c301bbd9-model-cache\") pod \"26210339-4962-4a46-ba4a-8516c301bbd9\" (UID: \"26210339-4962-4a46-ba4a-8516c301bbd9\") "
Jul 20 10:25:15.014477 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:15.014400    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8nj8\" (UniqueName: \"kubernetes.io/projected/26210339-4962-4a46-ba4a-8516c301bbd9-kube-api-access-w8nj8\") pod \"26210339-4962-4a46-ba4a-8516c301bbd9\" (UID: \"26210339-4962-4a46-ba4a-8516c301bbd9\") "
Jul 20 10:25:15.014477 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:15.014461    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26210339-4962-4a46-ba4a-8516c301bbd9-dshm\") pod \"26210339-4962-4a46-ba4a-8516c301bbd9\" (UID: \"26210339-4962-4a46-ba4a-8516c301bbd9\") "
Jul 20 10:25:15.014579 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:15.014528    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26210339-4962-4a46-ba4a-8516c301bbd9-home" (OuterVolumeSpecName: "home") pod "26210339-4962-4a46-ba4a-8516c301bbd9" (UID: "26210339-4962-4a46-ba4a-8516c301bbd9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 10:25:15.014636 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:15.014561    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26210339-4962-4a46-ba4a-8516c301bbd9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "26210339-4962-4a46-ba4a-8516c301bbd9" (UID: "26210339-4962-4a46-ba4a-8516c301bbd9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 10:25:15.014636 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:15.014609    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26210339-4962-4a46-ba4a-8516c301bbd9-model-cache" (OuterVolumeSpecName: "model-cache") pod "26210339-4962-4a46-ba4a-8516c301bbd9" (UID: "26210339-4962-4a46-ba4a-8516c301bbd9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 10:25:15.014799 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:15.014779    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26210339-4962-4a46-ba4a-8516c301bbd9-home\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:25:15.014799 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:15.014799    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26210339-4962-4a46-ba4a-8516c301bbd9-tmp-dir\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:25:15.014919 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:15.014808    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26210339-4962-4a46-ba4a-8516c301bbd9-model-cache\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:25:15.016255 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:15.016232    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26210339-4962-4a46-ba4a-8516c301bbd9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "26210339-4962-4a46-ba4a-8516c301bbd9" (UID: "26210339-4962-4a46-ba4a-8516c301bbd9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 10:25:15.016484 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:15.016466    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26210339-4962-4a46-ba4a-8516c301bbd9-dshm" (OuterVolumeSpecName: "dshm") pod "26210339-4962-4a46-ba4a-8516c301bbd9" (UID: "26210339-4962-4a46-ba4a-8516c301bbd9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 10:25:15.016484 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:15.016475    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26210339-4962-4a46-ba4a-8516c301bbd9-kube-api-access-w8nj8" (OuterVolumeSpecName: "kube-api-access-w8nj8") pod "26210339-4962-4a46-ba4a-8516c301bbd9" (UID: "26210339-4962-4a46-ba4a-8516c301bbd9"). InnerVolumeSpecName "kube-api-access-w8nj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 10:25:15.115994 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:15.115952    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8nj8\" (UniqueName: \"kubernetes.io/projected/26210339-4962-4a46-ba4a-8516c301bbd9-kube-api-access-w8nj8\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:25:15.116084 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:15.115995    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26210339-4962-4a46-ba4a-8516c301bbd9-dshm\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:25:15.116084 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:15.116006    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26210339-4962-4a46-ba4a-8516c301bbd9-tls-certs\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:25:15.268969 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:15.268945    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z"]
Jul 20 10:25:15.272415 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:15.272394    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-186a7e/rate-test-model-186a7e-kserve-c467df799-cf75z"]
Jul 20 10:25:15.464976 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:15.464938    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26210339-4962-4a46-ba4a-8516c301bbd9" path="/var/lib/kubelet/pods/26210339-4962-4a46-ba4a-8516c301bbd9/volumes"
Jul 20 10:25:19.094108 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:19.094071    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:25:19.194453 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:19.194416    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:25:28.987981 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:28.987927    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x"]
Jul 20 10:25:28.988471 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:28.988178    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x" podUID="54bc6d87-996a-4d73-af01-4e4383815373" containerName="maas-api" containerID="cri-o://3475a7a373bdc852a7410dcd534aa4932c5674284e556a4d6a98d5e2c9818c40" gracePeriod=30
Jul 20 10:25:29.014659 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:29.014615    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:25:29.239407 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:29.239346    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x"
Jul 20 10:25:29.337680 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:29.337654    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54bc6d87-996a-4d73-af01-4e4383815373-maas-api-tls\") pod \"54bc6d87-996a-4d73-af01-4e4383815373\" (UID: \"54bc6d87-996a-4d73-af01-4e4383815373\") "
Jul 20 10:25:29.337817 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:29.337736    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54bc6d87-996a-4d73-af01-4e4383815373-openshift-service-ca\") pod \"54bc6d87-996a-4d73-af01-4e4383815373\" (UID: \"54bc6d87-996a-4d73-af01-4e4383815373\") "
Jul 20 10:25:29.337924 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:29.337905    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dr8mh\" (UniqueName: \"kubernetes.io/projected/54bc6d87-996a-4d73-af01-4e4383815373-kube-api-access-dr8mh\") pod \"54bc6d87-996a-4d73-af01-4e4383815373\" (UID: \"54bc6d87-996a-4d73-af01-4e4383815373\") "
Jul 20 10:25:29.338024 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:29.338005    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54bc6d87-996a-4d73-af01-4e4383815373-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "54bc6d87-996a-4d73-af01-4e4383815373" (UID: "54bc6d87-996a-4d73-af01-4e4383815373"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 10:25:29.338244 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:29.338227    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54bc6d87-996a-4d73-af01-4e4383815373-openshift-service-ca\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:25:29.339672 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:29.339650    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54bc6d87-996a-4d73-af01-4e4383815373-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "54bc6d87-996a-4d73-af01-4e4383815373" (UID: "54bc6d87-996a-4d73-af01-4e4383815373"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 10:25:29.339835 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:29.339816    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54bc6d87-996a-4d73-af01-4e4383815373-kube-api-access-dr8mh" (OuterVolumeSpecName: "kube-api-access-dr8mh") pod "54bc6d87-996a-4d73-af01-4e4383815373" (UID: "54bc6d87-996a-4d73-af01-4e4383815373"). InnerVolumeSpecName "kube-api-access-dr8mh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 10:25:29.439535 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:29.439501    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dr8mh\" (UniqueName: \"kubernetes.io/projected/54bc6d87-996a-4d73-af01-4e4383815373-kube-api-access-dr8mh\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:25:29.439535 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:29.439534    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54bc6d87-996a-4d73-af01-4e4383815373-maas-api-tls\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:25:30.024771 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:30.024736    2581 generic.go:356] "Generic (PLEG): container finished" podID="54bc6d87-996a-4d73-af01-4e4383815373" containerID="3475a7a373bdc852a7410dcd534aa4932c5674284e556a4d6a98d5e2c9818c40" exitCode=0
Jul 20 10:25:30.025334 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:30.024781    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x"
Jul 20 10:25:30.025334 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:30.024823    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x" event={"ID":"54bc6d87-996a-4d73-af01-4e4383815373","Type":"ContainerDied","Data":"3475a7a373bdc852a7410dcd534aa4932c5674284e556a4d6a98d5e2c9818c40"}
Jul 20 10:25:30.025334 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:30.024885    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x" event={"ID":"54bc6d87-996a-4d73-af01-4e4383815373","Type":"ContainerDied","Data":"94ddbc83cefb77ccafb3c07dd4e4688cb8239ebd81df5f1acb2cf1a69af3a340"}
Jul 20 10:25:30.025334 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:30.024921    2581 scope.go:117] "RemoveContainer" containerID="3475a7a373bdc852a7410dcd534aa4932c5674284e556a4d6a98d5e2c9818c40"
Jul 20 10:25:30.033777 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:30.033758    2581 scope.go:117] "RemoveContainer" containerID="3475a7a373bdc852a7410dcd534aa4932c5674284e556a4d6a98d5e2c9818c40"
Jul 20 10:25:30.034069 ip-10-0-140-236 kubenswrapper[2581]: E0720 10:25:30.034047    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3475a7a373bdc852a7410dcd534aa4932c5674284e556a4d6a98d5e2c9818c40\": container with ID starting with 3475a7a373bdc852a7410dcd534aa4932c5674284e556a4d6a98d5e2c9818c40 not found: ID does not exist" containerID="3475a7a373bdc852a7410dcd534aa4932c5674284e556a4d6a98d5e2c9818c40"
Jul 20 10:25:30.034172 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:30.034072    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3475a7a373bdc852a7410dcd534aa4932c5674284e556a4d6a98d5e2c9818c40"} err="failed to get container status \"3475a7a373bdc852a7410dcd534aa4932c5674284e556a4d6a98d5e2c9818c40\": rpc error: code = NotFound desc = could not find container \"3475a7a373bdc852a7410dcd534aa4932c5674284e556a4d6a98d5e2c9818c40\": container with ID starting with 3475a7a373bdc852a7410dcd534aa4932c5674284e556a4d6a98d5e2c9818c40 not found: ID does not exist"
Jul 20 10:25:30.040852 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:30.040832    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x"]
Jul 20 10:25:30.044086 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:30.044067    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-b7ed4c-6447fb9fb-tlp7x"]
Jul 20 10:25:31.464512 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:31.464438    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54bc6d87-996a-4d73-af01-4e4383815373" path="/var/lib/kubelet/pods/54bc6d87-996a-4d73-af01-4e4383815373/volumes"
Jul 20 10:25:33.678325 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:33.678294    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:25:34.099069 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:34.099038    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:25:39.854506 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:39.854471    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:25:39.920413 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:39.920383    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:25:40.149339 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:40.149263    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:25:40.400926 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:40.400823    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:25:41.204313 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:41.204266    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:25:41.305108 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:41.305077    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:25:51.023478 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:51.023437    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw"]
Jul 20 10:25:51.023955 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:51.023671    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw" podUID="b6d70a4d-ea57-42e6-8637-999733924106" containerName="maas-api" containerID="cri-o://60419ff42ea1afc0e0e3caa87a4793ae98df9860c38101ebdba9843f3a2fb9d3" gracePeriod=30
Jul 20 10:25:51.047586 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:51.047561    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:25:51.268100 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:51.268077    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw"
Jul 20 10:25:51.422904 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:51.422872    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6d70a4d-ea57-42e6-8637-999733924106-maas-api-tls\") pod \"b6d70a4d-ea57-42e6-8637-999733924106\" (UID: \"b6d70a4d-ea57-42e6-8637-999733924106\") "
Jul 20 10:25:51.423085 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:51.422922    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6d70a4d-ea57-42e6-8637-999733924106-openshift-service-ca\") pod \"b6d70a4d-ea57-42e6-8637-999733924106\" (UID: \"b6d70a4d-ea57-42e6-8637-999733924106\") "
Jul 20 10:25:51.423085 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:51.422991    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwcmd\" (UniqueName: \"kubernetes.io/projected/b6d70a4d-ea57-42e6-8637-999733924106-kube-api-access-zwcmd\") pod \"b6d70a4d-ea57-42e6-8637-999733924106\" (UID: \"b6d70a4d-ea57-42e6-8637-999733924106\") "
Jul 20 10:25:51.423299 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:51.423277    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6d70a4d-ea57-42e6-8637-999733924106-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b6d70a4d-ea57-42e6-8637-999733924106" (UID: "b6d70a4d-ea57-42e6-8637-999733924106"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 10:25:51.425113 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:51.425085    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6d70a4d-ea57-42e6-8637-999733924106-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b6d70a4d-ea57-42e6-8637-999733924106" (UID: "b6d70a4d-ea57-42e6-8637-999733924106"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 10:25:51.425229 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:51.425135    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6d70a4d-ea57-42e6-8637-999733924106-kube-api-access-zwcmd" (OuterVolumeSpecName: "kube-api-access-zwcmd") pod "b6d70a4d-ea57-42e6-8637-999733924106" (UID: "b6d70a4d-ea57-42e6-8637-999733924106"). InnerVolumeSpecName "kube-api-access-zwcmd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 10:25:51.523928 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:51.523903    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6d70a4d-ea57-42e6-8637-999733924106-maas-api-tls\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:25:51.523928 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:51.523927    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6d70a4d-ea57-42e6-8637-999733924106-openshift-service-ca\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:25:51.524098 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:51.523936    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwcmd\" (UniqueName: \"kubernetes.io/projected/b6d70a4d-ea57-42e6-8637-999733924106-kube-api-access-zwcmd\") on node \"ip-10-0-140-236.ec2.internal\" DevicePath \"\""
Jul 20 10:25:52.132666 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:52.132632    2581 generic.go:356] "Generic (PLEG): container finished" podID="b6d70a4d-ea57-42e6-8637-999733924106" containerID="60419ff42ea1afc0e0e3caa87a4793ae98df9860c38101ebdba9843f3a2fb9d3" exitCode=0
Jul 20 10:25:52.133079 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:52.132674    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw"
Jul 20 10:25:52.133079 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:52.132715    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw" event={"ID":"b6d70a4d-ea57-42e6-8637-999733924106","Type":"ContainerDied","Data":"60419ff42ea1afc0e0e3caa87a4793ae98df9860c38101ebdba9843f3a2fb9d3"}
Jul 20 10:25:52.133079 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:52.132759    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw" event={"ID":"b6d70a4d-ea57-42e6-8637-999733924106","Type":"ContainerDied","Data":"3db27d6dd40ed7330d465e8776ef9727cd847e1d801f56f4419207ae42394199"}
Jul 20 10:25:52.133079 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:52.132780    2581 scope.go:117] "RemoveContainer" containerID="60419ff42ea1afc0e0e3caa87a4793ae98df9860c38101ebdba9843f3a2fb9d3"
Jul 20 10:25:52.141100 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:52.141084    2581 scope.go:117] "RemoveContainer" containerID="60419ff42ea1afc0e0e3caa87a4793ae98df9860c38101ebdba9843f3a2fb9d3"
Jul 20 10:25:52.141348 ip-10-0-140-236 kubenswrapper[2581]: E0720 10:25:52.141321    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60419ff42ea1afc0e0e3caa87a4793ae98df9860c38101ebdba9843f3a2fb9d3\": container with ID starting with 60419ff42ea1afc0e0e3caa87a4793ae98df9860c38101ebdba9843f3a2fb9d3 not found: ID does not exist" containerID="60419ff42ea1afc0e0e3caa87a4793ae98df9860c38101ebdba9843f3a2fb9d3"
Jul 20 10:25:52.141400 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:52.141356    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60419ff42ea1afc0e0e3caa87a4793ae98df9860c38101ebdba9843f3a2fb9d3"} err="failed to get container status \"60419ff42ea1afc0e0e3caa87a4793ae98df9860c38101ebdba9843f3a2fb9d3\": rpc error: code = NotFound desc = could not find container \"60419ff42ea1afc0e0e3caa87a4793ae98df9860c38101ebdba9843f3a2fb9d3\": container with ID starting with 60419ff42ea1afc0e0e3caa87a4793ae98df9860c38101ebdba9843f3a2fb9d3 not found: ID does not exist"
Jul 20 10:25:52.148207 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:52.148187    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw"]
Jul 20 10:25:52.151741 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:52.151722    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-186a7e-5b6f4545cb-x9znw"]
Jul 20 10:25:53.464514 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:53.464481    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6d70a4d-ea57-42e6-8637-999733924106" path="/var/lib/kubelet/pods/b6d70a4d-ea57-42e6-8637-999733924106/volumes"
Jul 20 10:25:55.624398 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:55.624353    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:25:56.017331 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:25:56.017250    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:26:01.961752 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:01.961716    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:26:02.062554 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:02.062524    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:26:02.275803 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:02.275723    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:26:02.557236 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:02.557149    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:26:10.040530 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:10.040496    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-67dc865778-2bf7n_0934e6b6-583c-48b1-b866-cd3fc3b7f2fd/manager/0.log"
Jul 20 10:26:10.436372 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:10.436340    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc4dbfcf4-9l42d_f0fb549f-d2ce-4875-ad55-f315acdd1ddb/manager/0.log"
Jul 20 10:26:10.446302 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:10.446280    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc4dbfcf4-9l42d_f0fb549f-d2ce-4875-ad55-f315acdd1ddb/copy-manifests/0.log"
Jul 20 10:26:11.093380 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:11.093344    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6d6644bdf7-b4xts_ead6a79d-2d73-4b38-95de-3651c38dbeef/maas-api/0.log"
Jul 20 10:26:11.224003 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:11.223945    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29742360-v27tt_8cbbc3b2-4fb2-4e5d-bec2-b41c3fad5dfd/cleanup/0.log"
Jul 20 10:26:11.452230 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:11.452195    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-fzgbv_960ce003-61c0-4c51-8ef2-f64808293f3c/postgres/0.log"
Jul 20 10:26:14.489097 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:14.489071    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b6cfc896b-l2tmx_885575b4-da20-4d53-9914-456331abe1a2/kube-auth-proxy/0.log"
Jul 20 10:26:14.786312 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:14.786219    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-kd4hm_463dac4a-ae6a-4b19-b65f-0b396e969ac9/payload-pre-processing/0.log"
Jul 20 10:26:14.940839 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:14.940808    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-rkhrh_02516a90-6e7c-4e2d-ab87-6961953a355d/payload-processing/0.log"
Jul 20 10:26:15.439190 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:15.439158    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-wgqqw_b826a498-1b7b-4085-b5b8-71f61f58907a/main/0.log"
Jul 20 10:26:15.580313 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:15.580282    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-dlcbm_7ed77716-0b1c-4dc5-b60b-d34cb8e3386b/main/0.log"
Jul 20 10:26:16.091155 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:16.091123    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-qfj9x_e4b50805-a167-4567-bf86-1277717f9ae9/main/0.log"
Jul 20 10:26:21.781103 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:21.781069    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t6zgv/must-gather-mqztt"]
Jul 20 10:26:21.781489 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:21.781460    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54bc6d87-996a-4d73-af01-4e4383815373" containerName="maas-api"
Jul 20 10:26:21.781489 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:21.781470    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="54bc6d87-996a-4d73-af01-4e4383815373" containerName="maas-api"
Jul 20 10:26:21.781489 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:21.781480    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26210339-4962-4a46-ba4a-8516c301bbd9" containerName="main"
Jul 20 10:26:21.781489 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:21.781486    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="26210339-4962-4a46-ba4a-8516c301bbd9" containerName="main"
Jul 20 10:26:21.781620 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:21.781495    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6d70a4d-ea57-42e6-8637-999733924106" containerName="maas-api"
Jul 20 10:26:21.781620 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:21.781502    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6d70a4d-ea57-42e6-8637-999733924106" containerName="maas-api"
Jul 20 10:26:21.781620 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:21.781566    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6d70a4d-ea57-42e6-8637-999733924106" containerName="maas-api"
Jul 20 10:26:21.781620 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:21.781575    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="54bc6d87-996a-4d73-af01-4e4383815373" containerName="maas-api"
Jul 20 10:26:21.781620 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:21.781582    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="26210339-4962-4a46-ba4a-8516c301bbd9" containerName="main"
Jul 20 10:26:21.784634 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:21.784607    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t6zgv/must-gather-mqztt"
Jul 20 10:26:21.787133 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:21.787111    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t6zgv\"/\"kube-root-ca.crt\""
Jul 20 10:26:21.787253 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:21.787169    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t6zgv\"/\"openshift-service-ca.crt\""
Jul 20 10:26:21.788057 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:21.788040    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-t6zgv\"/\"default-dockercfg-5qqbj\""
Jul 20 10:26:21.794442 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:21.794420    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t6zgv/must-gather-mqztt"]
Jul 20 10:26:21.797319 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:21.797295    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:26:21.879302 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:21.879274    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6ceb28d9-2257-403d-8d4e-67a990aa8c29-must-gather-output\") pod \"must-gather-mqztt\" (UID: \"6ceb28d9-2257-403d-8d4e-67a990aa8c29\") " pod="openshift-must-gather-t6zgv/must-gather-mqztt"
Jul 20 10:26:21.879431 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:21.879387    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4962j\" (UniqueName: \"kubernetes.io/projected/6ceb28d9-2257-403d-8d4e-67a990aa8c29-kube-api-access-4962j\") pod \"must-gather-mqztt\" (UID: \"6ceb28d9-2257-403d-8d4e-67a990aa8c29\") " pod="openshift-must-gather-t6zgv/must-gather-mqztt"
Jul 20 10:26:21.980364 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:21.980338    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4962j\" (UniqueName: \"kubernetes.io/projected/6ceb28d9-2257-403d-8d4e-67a990aa8c29-kube-api-access-4962j\") pod \"must-gather-mqztt\" (UID: \"6ceb28d9-2257-403d-8d4e-67a990aa8c29\") " pod="openshift-must-gather-t6zgv/must-gather-mqztt"
Jul 20 10:26:21.980490 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:21.980402    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6ceb28d9-2257-403d-8d4e-67a990aa8c29-must-gather-output\") pod \"must-gather-mqztt\" (UID: \"6ceb28d9-2257-403d-8d4e-67a990aa8c29\") " pod="openshift-must-gather-t6zgv/must-gather-mqztt"
Jul 20 10:26:21.980700 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:21.980686    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6ceb28d9-2257-403d-8d4e-67a990aa8c29-must-gather-output\") pod \"must-gather-mqztt\" (UID: \"6ceb28d9-2257-403d-8d4e-67a990aa8c29\") " pod="openshift-must-gather-t6zgv/must-gather-mqztt"
Jul 20 10:26:21.995145 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:21.995110    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:26:22.004061 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:22.004033    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4962j\" (UniqueName: \"kubernetes.io/projected/6ceb28d9-2257-403d-8d4e-67a990aa8c29-kube-api-access-4962j\") pod \"must-gather-mqztt\" (UID: \"6ceb28d9-2257-403d-8d4e-67a990aa8c29\") " pod="openshift-must-gather-t6zgv/must-gather-mqztt"
Jul 20 10:26:22.093976 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:22.093901    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t6zgv/must-gather-mqztt"
Jul 20 10:26:22.222177 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:22.222151    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t6zgv/must-gather-mqztt"]
Jul 20 10:26:22.224433 ip-10-0-140-236 kubenswrapper[2581]: W0720 10:26:22.224407    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ceb28d9_2257_403d_8d4e_67a990aa8c29.slice/crio-f99622529950c4bc0580d6d0e99f64ea601fd2481266e68412899d9d134b4d48 WatchSource:0}: Error finding container f99622529950c4bc0580d6d0e99f64ea601fd2481266e68412899d9d134b4d48: Status 404 returned error can't find the container with id f99622529950c4bc0580d6d0e99f64ea601fd2481266e68412899d9d134b4d48
Jul 20 10:26:22.226345 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:22.226329    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 10:26:22.277322 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:22.277289    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t6zgv/must-gather-mqztt" event={"ID":"6ceb28d9-2257-403d-8d4e-67a990aa8c29","Type":"ContainerStarted","Data":"f99622529950c4bc0580d6d0e99f64ea601fd2481266e68412899d9d134b4d48"}
Jul 20 10:26:23.285176 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:23.285087    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t6zgv/must-gather-mqztt" event={"ID":"6ceb28d9-2257-403d-8d4e-67a990aa8c29","Type":"ContainerStarted","Data":"b97168acbf9512055513f38370f76d073c14873ce7a8a12381cd9d25226866f8"}
Jul 20 10:26:23.285176 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:23.285149    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t6zgv/must-gather-mqztt" event={"ID":"6ceb28d9-2257-403d-8d4e-67a990aa8c29","Type":"ContainerStarted","Data":"20f035dd3055abe65b7ab922be7cdb3d67d2ee3c31b9b85a2049d9e14d8455cf"}
Jul 20 10:26:23.302728 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:23.302670    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-t6zgv/must-gather-mqztt" podStartSLOduration=1.602024329 podStartE2EDuration="2.302647147s" totalImagesPullingTime="700.622818ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:26:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:26:23.299900001 +0000 UTC m=+2835.181346310" watchObservedRunningTime="2026-07-20 10:26:23.302647147 +0000 UTC m=+2835.184093480"
Jul 20 10:26:24.586465 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:24.586436    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xqb2z_82e7c25c-d929-4258-8f87-ddfadcf5042e/global-pull-secret-syncer/0.log"
Jul 20 10:26:24.649190 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:24.649137    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log"
Jul 20 10:26:24.786482 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:24.786454    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-236.ec2.internal_b2bd58dc38956b1c8ecf2cf823b81fbf/haproxy/0.log"
Jul 20 10:26:30.735785 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:30.735735    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:26:30.792081 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:30.792028    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:26:32.562495 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:32.562411    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_71d8d9f0-e21b-41de-8093-a4300123cd61/alertmanager/0.log"
Jul 20 10:26:32.584218 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:32.584151    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_71d8d9f0-e21b-41de-8093-a4300123cd61/config-reloader/0.log"
Jul 20 10:26:32.604051 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:32.604012    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_71d8d9f0-e21b-41de-8093-a4300123cd61/kube-rbac-proxy-web/0.log"
Jul 20 10:26:32.623593 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:32.623562    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_71d8d9f0-e21b-41de-8093-a4300123cd61/kube-rbac-proxy/0.log"
Jul 20 10:26:32.658251 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:32.658067    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_71d8d9f0-e21b-41de-8093-a4300123cd61/kube-rbac-proxy-metric/0.log"
Jul 20 10:26:32.675558 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:32.675534    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_71d8d9f0-e21b-41de-8093-a4300123cd61/prom-label-proxy/0.log"
Jul 20 10:26:32.699715 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:32.699675    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_71d8d9f0-e21b-41de-8093-a4300123cd61/init-config-reloader/0.log"
Jul 20 10:26:32.782861 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:32.782831    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-2gm4f_0c7a1564-d312-4a6a-968b-7872adce776f/kube-state-metrics/0.log"
Jul 20 10:26:32.797829 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:32.797799    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-2gm4f_0c7a1564-d312-4a6a-968b-7872adce776f/kube-rbac-proxy-main/0.log"
Jul 20 10:26:32.825026 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:32.824933    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-2gm4f_0c7a1564-d312-4a6a-968b-7872adce776f/kube-rbac-proxy-self/0.log"
Jul 20 10:26:32.850733 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:32.850708    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-f84cffc44-x9447_6c7dabf5-4e59-4cae-a967-da3a783217be/metrics-server/0.log"
Jul 20 10:26:32.872432 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:32.872402    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-2j97h_9daca065-4948-48cb-939c-3ea28dfcb862/monitoring-plugin/0.log"
Jul 20 10:26:32.900213 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:32.900185    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c88hw_de328f9c-a1a4-46d4-944c-f35a939e79e7/node-exporter/0.log"
Jul 20 10:26:32.922809 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:32.922779    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c88hw_de328f9c-a1a4-46d4-944c-f35a939e79e7/kube-rbac-proxy/0.log"
Jul 20 10:26:32.941890 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:32.941864    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c88hw_de328f9c-a1a4-46d4-944c-f35a939e79e7/init-textfile/0.log"
Jul 20 10:26:33.098380 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:33.098302    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-vtnmg_c5206388-28f6-4b47-ad2a-b9ece3507289/kube-rbac-proxy-main/0.log"
Jul 20 10:26:33.116762 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:33.116723    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-vtnmg_c5206388-28f6-4b47-ad2a-b9ece3507289/kube-rbac-proxy-self/0.log"
Jul 20 10:26:33.142411 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:33.142384    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-vtnmg_c5206388-28f6-4b47-ad2a-b9ece3507289/openshift-state-metrics/0.log"
Jul 20 10:26:33.177744 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:33.177717    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680/prometheus/0.log"
Jul 20 10:26:33.197409 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:33.197381    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680/config-reloader/0.log"
Jul 20 10:26:33.226933 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:33.226905    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680/thanos-sidecar/0.log"
Jul 20 10:26:33.265611 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:33.265573    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680/kube-rbac-proxy-web/0.log"
Jul 20 10:26:33.305836 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:33.305804    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680/kube-rbac-proxy/0.log"
Jul 20 10:26:33.343626 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:33.343587    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680/kube-rbac-proxy-thanos/0.log"
Jul 20 10:26:33.383615 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:33.383577    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0aeac0e7-3ed6-4f5a-98c3-12f7d5b40680/init-config-reloader/0.log"
Jul 20 10:26:33.422254 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:33.422228    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-5mnl8_3065b42b-2720-4e98-9e2e-a86a36da5ba0/prometheus-operator/0.log"
Jul 20 10:26:33.449740 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:33.449712    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-5mnl8_3065b42b-2720-4e98-9e2e-a86a36da5ba0/kube-rbac-proxy/0.log"
Jul 20 10:26:33.515879 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:33.515833    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-bc44f749-jjxm5_1222f686-ed8e-49b1-bdab-3da2a1cd2549/telemeter-client/0.log"
Jul 20 10:26:33.551572 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:33.551545    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-bc44f749-jjxm5_1222f686-ed8e-49b1-bdab-3da2a1cd2549/reload/0.log"
Jul 20 10:26:33.589749 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:33.589718    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-bc44f749-jjxm5_1222f686-ed8e-49b1-bdab-3da2a1cd2549/kube-rbac-proxy/0.log"
Jul 20 10:26:33.631885 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:33.631855    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66f4d847f-mv478_674f9c86-0221-4d03-905c-c548fdd91ef2/thanos-query/0.log"
Jul 20 10:26:33.669855 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:33.669787    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66f4d847f-mv478_674f9c86-0221-4d03-905c-c548fdd91ef2/kube-rbac-proxy-web/0.log"
Jul 20 10:26:33.711503 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:33.711464    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66f4d847f-mv478_674f9c86-0221-4d03-905c-c548fdd91ef2/kube-rbac-proxy/0.log"
Jul 20 10:26:33.751460 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:33.751419    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66f4d847f-mv478_674f9c86-0221-4d03-905c-c548fdd91ef2/prom-label-proxy/0.log"
Jul 20 10:26:33.790652 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:33.790616    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66f4d847f-mv478_674f9c86-0221-4d03-905c-c548fdd91ef2/kube-rbac-proxy-rules/0.log"
Jul 20 10:26:33.828104 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:33.828076    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66f4d847f-mv478_674f9c86-0221-4d03-905c-c548fdd91ef2/kube-rbac-proxy-metrics/0.log"
Jul 20 10:26:36.541800 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:36.541762    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t6zgv/perf-node-gather-daemonset-jg7tm"]
Jul 20 10:26:36.554733 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:36.554701    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t6zgv/perf-node-gather-daemonset-jg7tm"]
Jul 20 10:26:36.554902 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:36.554815    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-jg7tm"
Jul 20 10:26:36.646199 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:36.646164    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef5c7273-8e33-4278-9d88-38f01482f816-lib-modules\") pod \"perf-node-gather-daemonset-jg7tm\" (UID: \"ef5c7273-8e33-4278-9d88-38f01482f816\") " pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-jg7tm"
Jul 20 10:26:36.646574 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:36.646552    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef5c7273-8e33-4278-9d88-38f01482f816-sys\") pod \"perf-node-gather-daemonset-jg7tm\" (UID: \"ef5c7273-8e33-4278-9d88-38f01482f816\") " pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-jg7tm"
Jul 20 10:26:36.646787 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:36.646770    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m72mf\" (UniqueName: \"kubernetes.io/projected/ef5c7273-8e33-4278-9d88-38f01482f816-kube-api-access-m72mf\") pod \"perf-node-gather-daemonset-jg7tm\" (UID: \"ef5c7273-8e33-4278-9d88-38f01482f816\") " pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-jg7tm"
Jul 20 10:26:36.646978 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:36.646946    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ef5c7273-8e33-4278-9d88-38f01482f816-podres\") pod \"perf-node-gather-daemonset-jg7tm\" (UID: \"ef5c7273-8e33-4278-9d88-38f01482f816\") " pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-jg7tm"
Jul 20 10:26:36.647123 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:36.647107    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ef5c7273-8e33-4278-9d88-38f01482f816-proc\") pod \"perf-node-gather-daemonset-jg7tm\" (UID: \"ef5c7273-8e33-4278-9d88-38f01482f816\") " pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-jg7tm"
Jul 20 10:26:36.748430 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:36.748392    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m72mf\" (UniqueName: \"kubernetes.io/projected/ef5c7273-8e33-4278-9d88-38f01482f816-kube-api-access-m72mf\") pod \"perf-node-gather-daemonset-jg7tm\" (UID: \"ef5c7273-8e33-4278-9d88-38f01482f816\") " pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-jg7tm"
Jul 20 10:26:36.749121 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:36.749094    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ef5c7273-8e33-4278-9d88-38f01482f816-podres\") pod \"perf-node-gather-daemonset-jg7tm\" (UID: \"ef5c7273-8e33-4278-9d88-38f01482f816\") " pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-jg7tm"
Jul 20 10:26:36.749251 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:36.749224    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ef5c7273-8e33-4278-9d88-38f01482f816-proc\") pod \"perf-node-gather-daemonset-jg7tm\" (UID: \"ef5c7273-8e33-4278-9d88-38f01482f816\") " pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-jg7tm"
Jul 20 10:26:36.749320 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:36.749309    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef5c7273-8e33-4278-9d88-38f01482f816-lib-modules\") pod \"perf-node-gather-daemonset-jg7tm\" (UID: \"ef5c7273-8e33-4278-9d88-38f01482f816\") " pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-jg7tm"
Jul 20 10:26:36.749465 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:36.749396    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef5c7273-8e33-4278-9d88-38f01482f816-sys\") pod \"perf-node-gather-daemonset-jg7tm\" (UID: \"ef5c7273-8e33-4278-9d88-38f01482f816\") " pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-jg7tm"
Jul 20 10:26:36.749538 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:36.749520    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef5c7273-8e33-4278-9d88-38f01482f816-sys\") pod \"perf-node-gather-daemonset-jg7tm\" (UID: \"ef5c7273-8e33-4278-9d88-38f01482f816\") " pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-jg7tm"
Jul 20 10:26:36.749603 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:36.749577    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ef5c7273-8e33-4278-9d88-38f01482f816-proc\") pod \"perf-node-gather-daemonset-jg7tm\" (UID: \"ef5c7273-8e33-4278-9d88-38f01482f816\") " pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-jg7tm"
Jul 20 10:26:36.749694 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:36.749673    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef5c7273-8e33-4278-9d88-38f01482f816-lib-modules\") pod \"perf-node-gather-daemonset-jg7tm\" (UID: \"ef5c7273-8e33-4278-9d88-38f01482f816\") " pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-jg7tm"
Jul 20 10:26:36.749779 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:36.749765    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ef5c7273-8e33-4278-9d88-38f01482f816-podres\") pod \"perf-node-gather-daemonset-jg7tm\" (UID: \"ef5c7273-8e33-4278-9d88-38f01482f816\") " pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-jg7tm"
Jul 20 10:26:36.757523 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:36.757502    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m72mf\" (UniqueName: \"kubernetes.io/projected/ef5c7273-8e33-4278-9d88-38f01482f816-kube-api-access-m72mf\") pod \"perf-node-gather-daemonset-jg7tm\" (UID: \"ef5c7273-8e33-4278-9d88-38f01482f816\") " pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-jg7tm"
Jul 20 10:26:36.869060 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:36.869005    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-jg7tm"
Jul 20 10:26:37.049577 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:37.047458    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t6zgv/perf-node-gather-daemonset-jg7tm"]
Jul 20 10:26:37.398322 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:37.398230    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-jg7tm" event={"ID":"ef5c7273-8e33-4278-9d88-38f01482f816","Type":"ContainerStarted","Data":"1f0160c208846639b4893ae824357be10ce92dcd6d023d55c1f03843fb7d49b9"}
Jul 20 10:26:37.398322 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:37.398303    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-jg7tm" event={"ID":"ef5c7273-8e33-4278-9d88-38f01482f816","Type":"ContainerStarted","Data":"af80648df6d7a6d1ad15bc9830a3477d7e2543888b0d574bc104ee7286d1444d"}
Jul 20 10:26:37.398552 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:37.398416    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-jg7tm"
Jul 20 10:26:37.415744 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:37.415695    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-jg7tm" podStartSLOduration=1.415679548 podStartE2EDuration="1.415679548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 10:26:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:26:37.414561751 +0000 UTC m=+2849.296008060" watchObservedRunningTime="2026-07-20 10:26:37.415679548 +0000 UTC m=+2849.297125891"
Jul 20 10:26:37.583611 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:37.583578    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v9ns4_e604f9a4-6af8-4110-b748-4760445401d3/dns/0.log"
Jul 20 10:26:37.603635 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:37.603602    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v9ns4_e604f9a4-6af8-4110-b748-4760445401d3/kube-rbac-proxy/0.log"
Jul 20 10:26:37.675776 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:37.675687    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pxtqn_99b0f7f9-46d3-4e18-a6b2-adf14bf396ea/dns-node-resolver/0.log"
Jul 20 10:26:38.256513 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:38.256482    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nk6p8_6475a644-97bb-467b-9bc6-b5482c92779c/node-ca/0.log"
Jul 20 10:26:39.398162 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:39.398127    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b6cfc896b-l2tmx_885575b4-da20-4d53-9914-456331abe1a2/kube-auth-proxy/0.log"
Jul 20 10:26:39.515529 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:39.515480    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-kd4hm_463dac4a-ae6a-4b19-b65f-0b396e969ac9/payload-pre-processing/0.log"
Jul 20 10:26:39.553045 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:39.553005    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-rkhrh_02516a90-6e7c-4e2d-ab87-6961953a355d/payload-processing/0.log"
Jul 20 10:26:40.246881 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:40.246855    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9d2xv_9dcbaa05-de0c-4ffd-b71f-e9fd807b187b/serve-healthcheck-canary/0.log"
Jul 20 10:26:40.806520 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:40.806488    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n9bd9_90ea7755-183e-4a0d-b30d-eb9459261ae9/kube-rbac-proxy/0.log"
Jul 20 10:26:40.825793 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:40.825765    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n9bd9_90ea7755-183e-4a0d-b30d-eb9459261ae9/exporter/0.log"
Jul 20 10:26:40.845850 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:40.845818    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n9bd9_90ea7755-183e-4a0d-b30d-eb9459261ae9/extractor/0.log"
Jul 20 10:26:43.417952 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:43.417922    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-t6zgv/perf-node-gather-daemonset-jg7tm"
Jul 20 10:26:43.661314 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:43.661279    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-67dc865778-2bf7n_0934e6b6-583c-48b1-b866-cd3fc3b7f2fd/manager/0.log"
Jul 20 10:26:43.944316 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:43.944277    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc4dbfcf4-9l42d_f0fb549f-d2ce-4875-ad55-f315acdd1ddb/manager/0.log"
Jul 20 10:26:43.960919 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:43.960890    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bc4dbfcf4-9l42d_f0fb549f-d2ce-4875-ad55-f315acdd1ddb/copy-manifests/0.log"
Jul 20 10:26:44.315804 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:44.315714    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b6cfc896b-l2tmx_885575b4-da20-4d53-9914-456331abe1a2/kube-auth-proxy/0.log"
Jul 20 10:26:44.414936 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:44.414902    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-kd4hm_463dac4a-ae6a-4b19-b65f-0b396e969ac9/payload-pre-processing/0.log"
Jul 20 10:26:44.440118 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:44.440092    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-rkhrh_02516a90-6e7c-4e2d-ab87-6961953a355d/payload-processing/0.log"
Jul 20 10:26:45.411703 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:45.411670    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6d9fcc6574-v7kmp_fde56948-1449-4eb3-a401-2782c4bd1adb/manager/0.log"
Jul 20 10:26:46.026184 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:46.026112    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b6cfc896b-l2tmx_885575b4-da20-4d53-9914-456331abe1a2/kube-auth-proxy/0.log"
Jul 20 10:26:46.125248 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:46.125209    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-kd4hm_463dac4a-ae6a-4b19-b65f-0b396e969ac9/payload-pre-processing/0.log"
Jul 20 10:26:46.150635 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:46.150602    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-rkhrh_02516a90-6e7c-4e2d-ab87-6961953a355d/payload-processing/0.log"
Jul 20 10:26:51.559640 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:51.559606    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q9d8_39085fd7-7be1-4a24-9096-a11447449c89/konnectivity-agent/0.log" limit=1024
Jul 20 10:26:51.680479 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:51.680449    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fvswj_41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b/kube-multus-additional-cni-plugins/0.log"
Jul 20 10:26:51.702222 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:51.702198    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fvswj_41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b/egress-router-binary-copy/0.log"
Jul 20 10:26:51.720392 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:51.720369    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fvswj_41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b/cni-plugins/0.log"
Jul 20 10:26:51.739781 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:51.739755    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fvswj_41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b/bond-cni-plugin/0.log"
Jul 20 10:26:51.759122 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:51.759100    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fvswj_41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b/routeoverride-cni/0.log"
Jul 20 10:26:51.778229 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:51.778209    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fvswj_41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b/whereabouts-cni-bincopy/0.log"
Jul 20 10:26:51.797128 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:51.797107    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fvswj_41ea0fc1-c719-40ae-9c83-1b9d7dcc7d4b/whereabouts-cni/0.log"
Jul 20 10:26:52.184059 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:52.184029    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rrbzg_3e6fb336-81aa-448d-8532-860ff0916089/kube-multus/0.log"
Jul 20 10:26:52.283698 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:52.283666    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fnzkg_2450d682-ad31-4104-b469-603d43b7b1b2/network-metrics-daemon/0.log"
Jul 20 10:26:52.299753 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:52.299723    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fnzkg_2450d682-ad31-4104-b469-603d43b7b1b2/kube-rbac-proxy/0.log"
Jul 20 10:26:53.619379 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:53.619319    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rgb4r_d6c73ac6-85c5-4b3f-aa58-71ac88099c0a/ovn-controller/0.log"
Jul 20 10:26:53.637662 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:53.637630    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rgb4r_d6c73ac6-85c5-4b3f-aa58-71ac88099c0a/ovn-acl-logging/1.log"
Jul 20 10:26:53.637803 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:53.637636    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rgb4r_d6c73ac6-85c5-4b3f-aa58-71ac88099c0a/ovn-acl-logging/0.log"
Jul 20 10:26:53.654376 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:53.654357    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rgb4r_d6c73ac6-85c5-4b3f-aa58-71ac88099c0a/kube-rbac-proxy-node/0.log"
Jul 20 10:26:53.672453 ip-10-0-140-236 kubenswrapper[2581]: I0720 10:26:53.672432    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rgb4r_d6c73ac6-85c5-4b3f-aa58-71ac88099c0a/kube-rbac-proxy-ovn-metrics/0.log"