Jul 09 18:57:28.415670 ip-10-0-137-233 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 09 18:57:28.415682 ip-10-0-137-233 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 09 18:57:28.415689 ip-10-0-137-233 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 09 18:57:28.415928 ip-10-0-137-233 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 09 18:57:38.503771 ip-10-0-137-233 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 09 18:57:38.503795 ip-10-0-137-233 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot b03b0948e920436183591f155abadce8 --
Jul 09 18:59:40.213181 ip-10-0-137-233 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 18:59:42.095917 ip-10-0-137-233 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 18:59:42.095917 ip-10-0-137-233 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 18:59:42.095917 ip-10-0-137-233 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 18:59:42.095917 ip-10-0-137-233 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 18:59:42.095917 ip-10-0-137-233 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 18:59:42.095917 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.072839    2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 18:59:42.095917 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077319    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:59:42.095917 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077335    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:59:42.095917 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077338    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:59:42.095917 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077342    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:59:42.095917 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077344    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:59:42.095917 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077348    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:59:42.095917 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077352    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:59:42.095917 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077355    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:59:42.099207 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077358    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:59:42.099207 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077362    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:59:42.099207 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077365    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:59:42.099207 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077369    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:59:42.099207 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077373    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:59:42.099207 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077376    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:59:42.099207 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077379    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:59:42.099207 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077384    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:59:42.099207 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077388    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:59:42.099207 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077392    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:59:42.099207 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077395    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:59:42.099207 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077398    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:59:42.099207 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077400    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:59:42.099207 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077403    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:59:42.099207 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077407    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:59:42.099207 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077411    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:59:42.099207 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077414    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:59:42.099207 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077416    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:59:42.099207 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077419    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:59:42.099950 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077422    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:59:42.099950 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077424    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:59:42.099950 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077428    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:59:42.099950 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077431    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:59:42.099950 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077434    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:59:42.099950 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077437    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:59:42.099950 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077440    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:59:42.099950 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077442    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:59:42.099950 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077445    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:59:42.099950 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077449    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:59:42.099950 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077453    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:59:42.099950 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077456    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:59:42.099950 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077458    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:59:42.099950 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077461    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:59:42.099950 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077465    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:59:42.099950 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077469    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:59:42.099950 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077473    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:59:42.099950 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077475    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:59:42.099950 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077478    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:59:42.099950 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077483    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:59:42.102527 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077488    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:59:42.102527 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077493    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:59:42.102527 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077497    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:59:42.102527 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077500    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:59:42.102527 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077502    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:59:42.102527 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077505    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:59:42.102527 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077508    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:59:42.102527 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077512    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:59:42.102527 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077515    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:59:42.102527 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077518    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:59:42.102527 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077520    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:59:42.102527 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077523    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:59:42.102527 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077526    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:59:42.102527 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077529    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:59:42.102527 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077533    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:59:42.102527 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077536    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:59:42.102527 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077539    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:59:42.102527 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077542    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:59:42.102527 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077545    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:59:42.102527 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077548    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:59:42.103257 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077551    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:59:42.103257 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077556    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:59:42.103257 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077558    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:59:42.103257 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077562    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:59:42.103257 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077566    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:59:42.103257 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077569    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:59:42.103257 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077574    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:59:42.103257 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077578    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:59:42.103257 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077581    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:59:42.103257 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077584    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:59:42.103257 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077586    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:59:42.103257 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077590    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:59:42.103257 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077594    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:59:42.103257 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077596    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:59:42.103257 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077600    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:59:42.103257 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077604    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:59:42.103257 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077606    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:59:42.103257 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077609    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:59:42.103257 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077612    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:59:42.106940 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077617    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:59:42.106940 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077620    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:59:42.106940 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077624    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:59:42.106940 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077628    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:59:42.106940 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077631    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:59:42.106940 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077635    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:59:42.106940 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077638    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:59:42.106940 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077640    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:59:42.106940 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077644    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:59:42.106940 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077647    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:59:42.106940 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077649    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:59:42.106940 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077653    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:59:42.106940 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.077657    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:59:42.106940 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078475    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:59:42.106940 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078484    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:59:42.106940 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078487    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:59:42.106940 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078490    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:59:42.106940 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078493    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:59:42.106940 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078499    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:59:42.107663 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078504    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:59:42.107663 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078507    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:59:42.107663 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078510    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:59:42.107663 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078514    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:59:42.107663 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078518    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:59:42.107663 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078522    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:59:42.107663 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078525    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:59:42.107663 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078528    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:59:42.107663 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078531    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:59:42.107663 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078535    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:59:42.107663 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078540    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:59:42.107663 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078543    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:59:42.107663 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078546    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:59:42.107663 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078550    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:59:42.107663 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078553    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:59:42.107663 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078558    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:59:42.107663 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078562    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:59:42.107663 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078565    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:59:42.107663 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078568    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:59:42.107663 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078571    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:59:42.112124 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078574    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:59:42.112124 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078578    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:59:42.112124 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078581    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:59:42.112124 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078584    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:59:42.112124 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078587    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:59:42.112124 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078590    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:59:42.112124 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078593    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:59:42.112124 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078596    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:59:42.112124 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078600    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:59:42.112124 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078603    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:59:42.112124 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078605    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:59:42.112124 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078608    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:59:42.112124 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078611    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:59:42.112124 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078613    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:59:42.112124 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078616    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:59:42.112124 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078620    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:59:42.112124 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078623    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:59:42.112124 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078625    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:59:42.112124 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078628    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:59:42.112124 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078630    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:59:42.112859 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078633    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:59:42.112859 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078636    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:59:42.112859 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078641    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:59:42.112859 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078644    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:59:42.112859 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078646    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:59:42.112859 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078649    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:59:42.112859 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078651    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:59:42.112859 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078656    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:59:42.112859 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078661    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:59:42.112859 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078664    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:59:42.112859 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078667    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:59:42.112859 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078670    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:59:42.112859 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078672    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:59:42.112859 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078677    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:59:42.112859 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078680    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:59:42.112859 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078683    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:59:42.112859 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078686    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:59:42.112859 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078689    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:59:42.112859 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078691    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:59:42.113578 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078694    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:59:42.113578 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078697    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:59:42.113578 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078701    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:59:42.113578 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078704    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:59:42.113578 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078707    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:59:42.113578 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078709    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:59:42.113578 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078712    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:59:42.113578 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078716    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:59:42.113578 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078720    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:59:42.113578 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078723    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:59:42.113578 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078725    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:59:42.113578 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078729    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:59:42.113578 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078733    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:59:42.113578 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078736    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:59:42.113578 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078739    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:59:42.113578 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078745    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:59:42.113578 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078750    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:59:42.113578 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078753    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:59:42.113578 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078756    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:59:42.117643 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078759    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:59:42.117643 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078762    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:59:42.117643 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078766    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:59:42.117643 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078769    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:59:42.117643 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078772    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:59:42.117643 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078774    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:59:42.117643 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078777    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:59:42.117643 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078779    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:59:42.117643 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078782    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:59:42.117643 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078787    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:59:42.117643 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078791    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:59:42.117643 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078794    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:59:42.117643 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078796    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:59:42.117643 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078799    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:59:42.117643 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.078801    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:59:42.117643 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079242    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:59:42.117643 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079249    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:59:42.117643 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079252    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:59:42.117643 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079255    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:59:42.117643 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079258    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:59:42.118382 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079261    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:59:42.118382 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079264    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:59:42.118382 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079268    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:59:42.118382 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079272    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:59:42.118382 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079274    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:59:42.118382 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079277    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:59:42.118382 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079280    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:59:42.118382 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079283    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:59:42.118382 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079286    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:59:42.118382 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079290    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:59:42.118382 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079293    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:59:42.118382 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079296    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:59:42.118382 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079299    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:59:42.118382 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079303    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:59:42.118382 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079308    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:59:42.118382 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079312    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:59:42.118382 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079316    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:59:42.118382 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079319    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:59:42.118382 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079321    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:59:42.119113 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079325    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:59:42.119113 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079329    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:59:42.119113 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079332    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:59:42.119113 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079335    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:59:42.119113 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079338    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:59:42.119113 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079340    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:59:42.119113 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079343    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:59:42.119113 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079346    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:59:42.119113 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079350    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:59:42.119113 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079353    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:59:42.119113 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079355    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:59:42.119113 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079357    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:59:42.119113 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079360    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:59:42.119113 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079363    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:59:42.119113 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079365    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:59:42.119113 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079369    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:59:42.119113 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079372    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:59:42.119113 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079374    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:59:42.119113 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079377    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:59:42.119113 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079379    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:59:42.121316 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079382    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:59:42.121316 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079387    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:59:42.121316 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079391    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:59:42.121316 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079395    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:59:42.121316 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079398    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:59:42.121316 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079401    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:59:42.121316 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079404    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:59:42.121316 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079407    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:59:42.121316 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079411    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:59:42.121316 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079413    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:59:42.121316 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079416    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:59:42.121316 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079418    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:59:42.121316 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079421    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:59:42.121316 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079424    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:59:42.121316 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079426    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:59:42.121316 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079429    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:59:42.121316 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079431    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:59:42.121316 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079434    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:59:42.121316 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079437    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:59:42.121316 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079441    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:59:42.122071 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079444    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:59:42.122071 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079446    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:59:42.122071 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079449    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:59:42.122071 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079451    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:59:42.122071 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079454    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:59:42.122071 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079457    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:59:42.122071 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079460    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:59:42.122071 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079464    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:59:42.122071 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079466    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:59:42.122071 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079468    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:59:42.122071 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079472    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:59:42.122071 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079475    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:59:42.122071 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079483    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:59:42.122071 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079487    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:59:42.122071 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079490    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:59:42.122071 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079493    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:59:42.122071 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079496    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:59:42.122071 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079500    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:59:42.122071 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079504    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:59:42.213550 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079506    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:59:42.213550 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079509    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:59:42.213550 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079512    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:59:42.213550 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079515    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:59:42.213550 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079518    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:59:42.213550 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079522    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:59:42.213550 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079526    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:59:42.213550 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079529    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:59:42.213550 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079532    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:59:42.213550 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079534    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:59:42.213550 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079537    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:59:42.213550 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079540    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:59:42.213550 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079545    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:59:42.213550 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079547    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:59:42.213550 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079550    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:59:42.213550 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.079552    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:59:42.213550 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079631    2577 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 18:59:42.213550 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079647    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 18:59:42.213550 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079655    2577 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 18:59:42.213550 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079659    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 18:59:42.213550 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079664    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 18:59:42.214294 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079668    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 18:59:42.214294 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079673    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 18:59:42.214294 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079677    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 18:59:42.214294 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079681    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 18:59:42.214294 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079686    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 18:59:42.214294 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079691    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 18:59:42.214294 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079695    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 18:59:42.214294 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079698    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 18:59:42.214294 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079701    2577 flags.go:64] FLAG: --cgroup-root=""
Jul 09 18:59:42.214294 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079709    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 18:59:42.214294 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079712    2577 flags.go:64] FLAG: --client-ca-file=""
Jul 09 18:59:42.214294 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079717    2577 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 18:59:42.214294 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079720    2577 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 18:59:42.214294 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079724    2577 flags.go:64] FLAG: --cluster-domain=""
Jul 09 18:59:42.214294 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079727    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 18:59:42.214294 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079730    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 18:59:42.214294 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079733    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 18:59:42.214294 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079737    2577 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 18:59:42.214294 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079742    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 18:59:42.214294 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079746    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 18:59:42.214294 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079750    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 18:59:42.214294 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079753    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 18:59:42.214294 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079757    2577 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 18:59:42.214294 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079761    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 18:59:42.217297 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079764    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 18:59:42.217297 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079768    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 18:59:42.217297 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079771    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 18:59:42.217297 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079776    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 18:59:42.217297 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079779    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 18:59:42.217297 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079782    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 18:59:42.217297 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079785    2577 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 18:59:42.217297 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079789    2577 flags.go:64] FLAG: --enable-server="true"
Jul 09 18:59:42.217297 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079793    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 18:59:42.217297 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079799    2577 flags.go:64] FLAG: --event-burst="100"
Jul 09 18:59:42.217297 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079803    2577 flags.go:64] FLAG: --event-qps="50"
Jul 09 18:59:42.217297 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079819    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 18:59:42.217297 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079824    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 18:59:42.217297 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079828    2577 flags.go:64] FLAG: --eviction-hard=""
Jul 09 18:59:42.217297 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079835    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 18:59:42.217297 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079838    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 18:59:42.217297 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079841    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 18:59:42.217297 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079845    2577 flags.go:64] FLAG: --eviction-soft=""
Jul 09 18:59:42.217297 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079850    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 18:59:42.217297 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079853    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 18:59:42.217297 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079856    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 18:59:42.217297 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079859    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 18:59:42.217297 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079863    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 18:59:42.217297 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079867    2577 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 18:59:42.217297 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079869    2577 flags.go:64] FLAG: --feature-gates=""
Jul 09 18:59:42.218040 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079874    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 18:59:42.218040 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079877    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 18:59:42.218040 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079881    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 18:59:42.218040 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079885    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 18:59:42.218040 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079889    2577 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 18:59:42.218040 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079892    2577 flags.go:64] FLAG: --help="false"
Jul 09 18:59:42.218040 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079895    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-137-233.ec2.internal"
Jul 09 18:59:42.218040 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079898    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 18:59:42.218040 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079901    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 18:59:42.218040 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079905    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 18:59:42.218040 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079910    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 18:59:42.218040 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079914    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 18:59:42.218040 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079917    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 18:59:42.218040 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079920    2577 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 18:59:42.218040 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079924    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 18:59:42.218040 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079928    2577 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 18:59:42.218040 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079931    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 18:59:42.218040 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079934    2577 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 18:59:42.218040 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079937    2577 flags.go:64] FLAG: --kube-reserved=""
Jul 09 18:59:42.218040 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079942    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 18:59:42.218040 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079947    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 18:59:42.218040 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079950    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 18:59:42.218040 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079953    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 18:59:42.218040 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079956    2577 flags.go:64] FLAG: --lock-file=""
Jul 09 18:59:42.314170 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079959    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 18:59:42.314170 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079963    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 18:59:42.314170 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079967    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 18:59:42.314170 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079973    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 18:59:42.314170 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079976    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 18:59:42.314170 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079979    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 18:59:42.314170 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079983    2577 flags.go:64] FLAG: --logging-format="text"
Jul 09 18:59:42.314170 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079987    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 18:59:42.314170 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079990    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 18:59:42.314170 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079993    2577 flags.go:64] FLAG: --manifest-url=""
Jul 09 18:59:42.314170 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.079996    2577 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 18:59:42.314170 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080002    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 18:59:42.314170 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080007    2577 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 18:59:42.314170 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080011    2577 flags.go:64] FLAG: --max-pods="110"
Jul 09 18:59:42.314170 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080014    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 18:59:42.314170 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080017    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 18:59:42.314170 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080020    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 18:59:42.314170 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080024    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 18:59:42.314170 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080030    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 18:59:42.314170 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080033    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 18:59:42.314170 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080037    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 18:59:42.314170 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080045    2577 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 18:59:42.314170 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080050    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 18:59:42.314170 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080053    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 18:59:42.314170 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080056    2577 flags.go:64] FLAG: --pod-cidr=""
Jul 09 18:59:42.315250 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080059    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 09 18:59:42.315250 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080065    2577 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 18:59:42.315250 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080070    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 18:59:42.315250 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080075    2577 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 18:59:42.315250 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080078    2577 flags.go:64] FLAG: --port="10250"
Jul 09 18:59:42.315250 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080081    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 18:59:42.315250 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080084    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c6788f40f7b31ad5"
Jul 09 18:59:42.315250 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080088    2577 flags.go:64] FLAG: --qos-reserved=""
Jul 09 18:59:42.315250 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080092    2577 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 18:59:42.315250 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080096    2577 flags.go:64] FLAG: --register-node="true"
Jul 09 18:59:42.315250 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080100    2577 flags.go:64] FLAG: --register-with-taints=""
Jul 09 18:59:42.315250 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080104    2577 flags.go:64] FLAG: --registry-burst="10"
Jul 09 18:59:42.315250 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080109    2577 flags.go:64] FLAG: --registry-qps="5"
Jul 09 18:59:42.315250 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080112    2577 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 18:59:42.315250 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080114    2577 flags.go:64] FLAG: --reserved-memory=""
Jul 09 18:59:42.315250 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080118    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 18:59:42.315250 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080121    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 18:59:42.315250 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080124    2577 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 18:59:42.315250 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080127    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 18:59:42.315250 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080130    2577 flags.go:64] FLAG: --runonce="false"
Jul 09 18:59:42.315250 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080134    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 18:59:42.315250 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080138    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 18:59:42.315250 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080141    2577 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 18:59:42.315250 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080144    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 18:59:42.315250 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080147    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 18:59:42.316015 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080152    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 18:59:42.316015 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080156    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 18:59:42.316015 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080160    2577 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 18:59:42.316015 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080163    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 18:59:42.316015 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080165    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 18:59:42.316015 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080168    2577 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 18:59:42.316015 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080171    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 18:59:42.316015 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080176    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 18:59:42.316015 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080179    2577 flags.go:64] FLAG: --system-cgroups=""
Jul 09 18:59:42.316015 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080182    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 18:59:42.316015 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080190    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 18:59:42.316015 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080195    2577 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 18:59:42.316015 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080199    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 18:59:42.316015 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080203    2577 flags.go:64] FLAG: --tls-min-version=""
Jul 09 18:59:42.316015 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080206    2577 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 18:59:42.316015 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080209    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 18:59:42.316015 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080212    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 18:59:42.316015 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080216    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 18:59:42.316015 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080220    2577 flags.go:64] FLAG: --v="2"
Jul 09 18:59:42.316015 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080224    2577 flags.go:64] FLAG: --version="false"
Jul 09 18:59:42.316015 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080229    2577 flags.go:64] FLAG: --vmodule=""
Jul 09 18:59:42.316015 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080234    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 18:59:42.316015 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.080238    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 18:59:42.316015 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080364    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:59:42.316015 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080369    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:59:42.317481 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080374    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:59:42.317481 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080377    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:59:42.317481 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080380    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:59:42.317481 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080383    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:59:42.317481 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080386    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:59:42.317481 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080388    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:59:42.317481 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080391    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:59:42.317481 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080395    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:59:42.317481 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080397    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:59:42.317481 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080400    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:59:42.317481 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080403    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:59:42.317481 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080407    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:59:42.317481 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080410    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:59:42.317481 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080412    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:59:42.317481 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080415    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:59:42.317481 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080418    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:59:42.317481 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080420    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:59:42.317481 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080425    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:59:42.317481 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080428    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:59:42.317481 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080431    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:59:42.318228 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080434    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:59:42.318228 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080436    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:59:42.318228 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080440    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:59:42.318228 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080444    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:59:42.318228 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080447    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:59:42.318228 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080450    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:59:42.318228 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080453    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:59:42.318228 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080455    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:59:42.318228 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080458    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:59:42.318228 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080460    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:59:42.318228 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080463    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:59:42.318228 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080465    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:59:42.318228 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080468    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:59:42.318228 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080470    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:59:42.318228 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080474    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:59:42.318228 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080478    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:59:42.318228 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080480    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:59:42.318228 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080482    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:59:42.318228 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080485    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:59:42.318228 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080489    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:59:42.318228 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080492    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:59:42.319351 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080496    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:59:42.319351 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080498    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:59:42.319351 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080501    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:59:42.319351 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080503    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:59:42.319351 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080506    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:59:42.319351 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080508    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:59:42.319351 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080512    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:59:42.319351 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080516    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:59:42.319351 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080520    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:59:42.319351 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080522    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:59:42.319351 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080525    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:59:42.319351 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080528    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:59:42.319351 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080531    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:59:42.319351 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080534    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:59:42.319351 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080537    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:59:42.319351 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080540    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:59:42.319351 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080544    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:59:42.319351 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080548    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:59:42.319351 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080552    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:59:42.320081 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080557    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:59:42.320081 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080560    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:59:42.320081 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080563    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:59:42.320081 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080566    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:59:42.320081 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080569    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:59:42.320081 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080572    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:59:42.320081 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080577    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:59:42.320081 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080581    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:59:42.320081 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080584    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:59:42.320081 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080586    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:59:42.320081 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080589    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:59:42.320081 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080596    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:59:42.320081 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080600    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:59:42.320081 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080603    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:59:42.320081 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080606    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:59:42.320081 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080608    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:59:42.320081 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080611    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:59:42.320081 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080614    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:59:42.320081 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080618    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:59:42.321219 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080621    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:59:42.321219 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080623    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:59:42.321219 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080628    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:59:42.321219 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080631    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:59:42.321219 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080634    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:59:42.321219 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080638    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:59:42.321219 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080640    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:59:42.321219 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080643    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:59:42.321219 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080646    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:59:42.321219 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080648    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:59:42.321219 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080651    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:59:42.321219 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080654    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:59:42.321219 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080658    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:59:42.321219 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080662    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:59:42.321219 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080665    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:59:42.321219 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080668    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:59:42.321219 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080671    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:59:42.321219 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.080673    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:59:42.323042 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.081288    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 18:59:42.389590 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.389561    2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 09 18:59:42.389590 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.389586    2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 18:59:42.390404 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.390394    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 18:59:42.390444 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.390404    2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 18:59:42.390508 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390499    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:59:42.390508 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390508    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:59:42.390567 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390511    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:59:42.390567 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390515    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:59:42.390567 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390518    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:59:42.390567 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390521    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:59:42.390567 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390524    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:59:42.390567 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390527    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:59:42.390567 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390529    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:59:42.390567 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390541    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:59:42.390567 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390544    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:59:42.390567 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390547    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:59:42.390567 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390550    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:59:42.390567 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390553    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:59:42.390567 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390555    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:59:42.390567 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390559    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:59:42.390567 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390562    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:59:42.390567 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390565    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:59:42.390567 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390568    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:59:42.390567 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390571    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:59:42.390567 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390574    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:59:42.390567 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390577    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:59:42.391061 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390580    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:59:42.391061 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390583    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:59:42.391061 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390586    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:59:42.391061 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390588    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:59:42.391061 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390591    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:59:42.391061 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390593    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:59:42.391061 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390595    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:59:42.391061 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390598    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:59:42.391061 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390601    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:59:42.391061 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390603    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:59:42.391061 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390606    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:59:42.391061 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390608    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:59:42.391061 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390611    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:59:42.391061 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390613    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:59:42.391061 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390616    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:59:42.391061 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390619    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:59:42.391061 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390621    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:59:42.391061 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390624    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:59:42.391061 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390626    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:59:42.391061 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390629    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:59:42.391529 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390632    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:59:42.391529 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390634    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:59:42.391529 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390637    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:59:42.391529 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390639    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:59:42.391529 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390642    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:59:42.391529 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390645    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:59:42.391529 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390648    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:59:42.391529 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390650    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:59:42.391529 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390653    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:59:42.391529 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390655    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:59:42.391529 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390658    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:59:42.391529 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390660    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:59:42.391529 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390663    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:59:42.391529 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390666    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:59:42.391529 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390669    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:59:42.391529 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390671    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:59:42.391529 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390674    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:59:42.391529 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390677    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:59:42.391529 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390679    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:59:42.391529 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390682    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:59:42.392016 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390684    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:59:42.392016 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390687    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:59:42.392016 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390689    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:59:42.392016 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390692    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:59:42.392016 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390695    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:59:42.392016 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390698    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:59:42.392016 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390700    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:59:42.392016 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390705    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:59:42.392016 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390709    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:59:42.392016 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390712    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:59:42.392016 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390714    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:59:42.392016 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390717    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:59:42.392016 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390719    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:59:42.392016 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390722    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:59:42.392016 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390725    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:59:42.392016 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390728    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:59:42.392016 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390730    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:59:42.392016 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390735    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:59:42.392016 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390737    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:59:42.392474 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390740    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:59:42.392474 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390742    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:59:42.392474 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390745    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:59:42.392474 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390748    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:59:42.392474 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390750    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:59:42.392474 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390753    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:59:42.392474 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390756    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:59:42.392474 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390759    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:59:42.392474 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390762    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:59:42.392474 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390764    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:59:42.392474 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390767    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:59:42.392474 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390771    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:59:42.392474 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390774    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:59:42.392474 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390777    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:59:42.392474 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390781    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:59:42.392474 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390785    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:59:42.392474 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390788    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:59:42.392474 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390790    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:59:42.393262 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.390796    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 18:59:42.393262 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.390991    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:59:42.393262 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391000    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:59:42.393262 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391004    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:59:42.393262 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391007    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:59:42.393262 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391010    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:59:42.393262 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391013    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:59:42.393262 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391016    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:59:42.393262 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391019    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:59:42.393262 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391022    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:59:42.393262 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391026    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:59:42.393262 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391031    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:59:42.393262 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391034    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:59:42.393262 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391039    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:59:42.393647 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391042    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:59:42.393647 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391045    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:59:42.393647 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391048    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:59:42.393647 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391050    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:59:42.393647 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391053    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:59:42.393647 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391056    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:59:42.393647 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391059    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:59:42.393647 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391061    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:59:42.393647 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391064    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:59:42.393647 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391067    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:59:42.393647 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391070    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:59:42.393647 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391072    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:59:42.393647 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391075    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:59:42.393647 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391078    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:59:42.393647 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391081    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:59:42.393647 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391083    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:59:42.393647 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391086    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:59:42.393647 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391088    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:59:42.393647 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391092    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:59:42.393647 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391095    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:59:42.394132 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391098    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:59:42.394132 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391101    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:59:42.394132 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391103    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:59:42.394132 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391106    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:59:42.394132 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391109    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:59:42.394132 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391112    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:59:42.394132 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391114    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:59:42.394132 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391117    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:59:42.394132 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391120    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:59:42.394132 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391122    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:59:42.394132 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391125    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:59:42.394132 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391127    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:59:42.394132 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391131    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:59:42.394132 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391135    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:59:42.394132 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391139    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:59:42.394132 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391142    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:59:42.394132 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391145    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:59:42.394132 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391148    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:59:42.394132 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391150    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:59:42.394597 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391153    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:59:42.394597 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391155    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:59:42.394597 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391158    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:59:42.394597 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391160    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:59:42.394597 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391163    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:59:42.394597 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391166    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:59:42.394597 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391169    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:59:42.394597 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391171    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:59:42.394597 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391174    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:59:42.394597 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391176    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:59:42.394597 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391179    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:59:42.394597 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391182    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:59:42.394597 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391185    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:59:42.394597 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391188    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:59:42.394597 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391191    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:59:42.394597 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391193    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:59:42.394597 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391196    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:59:42.394597 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391198    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:59:42.394597 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391201    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:59:42.394597 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391203    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:59:42.395080 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391206    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:59:42.395080 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391208    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:59:42.395080 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391211    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:59:42.395080 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391213    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:59:42.395080 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391216    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:59:42.395080 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391219    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:59:42.395080 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391222    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:59:42.395080 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391225    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:59:42.395080 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391227    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:59:42.395080 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391230    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:59:42.395080 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391232    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:59:42.395080 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391235    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:59:42.395080 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391238    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:59:42.395080 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391241    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:59:42.395080 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391244    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:59:42.395080 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391247    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:59:42.395080 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391250    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:59:42.395080 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391253    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:59:42.395080 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391255    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:59:42.395531 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391258    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:59:42.395531 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391260    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:59:42.395531 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391263    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:59:42.395531 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391265    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:59:42.395531 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391268    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:59:42.395531 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391271    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:59:42.395531 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391274    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:59:42.395531 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:42.391277    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:59:42.395531 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.391283    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 18:59:42.395531 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.391417    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 18:59:42.395531 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.394631    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 18:59:42.396042 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.396030    2577 server.go:1019] "Starting client certificate rotation"
Jul 09 18:59:42.396156 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.396138    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 18:59:42.396192 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.396182    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 18:59:42.398960 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.398946    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 18:59:42.400513 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.400501    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 18:59:42.414820 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.414783    2577 log.go:25] "Validated CRI v1 runtime API"
Jul 09 18:59:42.417228 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.417208    2577 log.go:25] "Validated CRI v1 image API"
Jul 09 18:59:42.418009 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.417992    2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 18:59:42.421073 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.421050    2577 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a91a34a8-ccbc-4bd7-ae86-e9d603781206:/dev/nvme0n1p4 ad3f4455-28ec-4608-a727-5b26b07b08c2:/dev/nvme0n1p3]
Jul 09 18:59:42.421177 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.421071    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 18:59:42.424297 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.424273    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 18:59:42.427511 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.427399    2577 manager.go:216] Machine: {Timestamp:2026-07-09 18:59:42.425171638 +0000 UTC m=+0.810241904 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101223 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec293a4f281c6329a3b59b8a0270036a SystemUUID:ec293a4f-281c-6329-a3b5-9b8a0270036a BootID:b03b0948-e920-4361-8359-1f155abadce8 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ce:ca:61:c2:59 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ce:ca:61:c2:59 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:e2:5b:75:35:f9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 18:59:42.427511 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.427505    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 18:59:42.427648 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.427636    2577 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 18:59:42.430635 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.430610    2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 18:59:42.430766 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.430637    2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-233.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 18:59:42.431375 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.431364    2577 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 18:59:42.431375 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.431376    2577 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 18:59:42.431445 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.431384    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 18:59:42.432235 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.432223    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 18:59:42.433411 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.433401    2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 18:59:42.436097 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.436085    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 18:59:42.436221 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.436212    2577 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 18:59:42.436251 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.436243    2577 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 18:59:42.436278 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.436253    2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 18:59:42.436315 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.436291    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 18:59:42.436315 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.436300    2577 kubelet.go:398] "Adding apiserver pod source"
Jul 09 18:59:42.436390 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.436319    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 18:59:42.436736 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.436723    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 18:59:42.436773 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.436744    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 18:59:42.438994 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.438976    2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 09 18:59:42.440799 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.440785    2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 18:59:42.440883 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.440855    2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 18:59:42.441083 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.441069    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 18:59:42.441148 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.441090    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 18:59:42.441148 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.441099    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 18:59:42.441148 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.441108    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 18:59:42.441148 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.441124    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 18:59:42.441148 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.441133    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 18:59:42.441703 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.441690    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 18:59:42.441703 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.441704    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 18:59:42.441838 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.441716    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 18:59:42.441838 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.441726    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 18:59:42.441838 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.441747    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 18:59:42.441838 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.441760    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 18:59:42.443204 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.443192    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 18:59:42.443258 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.443207    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 18:59:42.446348 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.446332    2577 server.go:1268] "Started kubelet"
Jul 09 18:59:42.446500 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.446467    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 18:59:42.446736 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.446472    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 18:59:42.446736 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.446618    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 18:59:42.447292 ip-10-0-137-233 systemd[1]: Started Kubernetes Kubelet.
Jul 09 18:59:42.447551 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:42.447501    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 18:59:42.447551 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:42.447504    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-233.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 18:59:42.447551 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.447545    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-233.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 18:59:42.447712 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.447700    2577 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 18:59:42.447899 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.447871    2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 18:59:42.448144 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.448126    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zwm86"
Jul 09 18:59:42.451742 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:42.451723    2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 18:59:42.453632 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.453610    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 18:59:42.454296 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.454266    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 18:59:42.454451 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:42.454434    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-233.ec2.internal\" not found"
Jul 09 18:59:42.454976 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.454948    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 18:59:42.454976 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.454949    2577 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 18:59:42.454976 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.454974    2577 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 18:59:42.455200 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.455094    2577 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 18:59:42.455200 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.455103    2577 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 18:59:42.455200 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.455184    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 18:59:42.455200 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.455194    2577 factory.go:55] Registering systemd factory
Jul 09 18:59:42.455200 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.455200    2577 factory.go:223] Registration of the systemd container factory successfully
Jul 09 18:59:42.455420 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.455403    2577 factory.go:153] Registering CRI-O factory
Jul 09 18:59:42.455420 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.455422    2577 factory.go:223] Registration of the crio container factory successfully
Jul 09 18:59:42.455420 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.455444    2577 factory.go:103] Registering Raw factory
Jul 09 18:59:42.455576 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.455460    2577 manager.go:1196] Started watching for new ooms in manager
Jul 09 18:59:42.456762 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.456266    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zwm86"
Jul 09 18:59:42.456762 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.456366    2577 manager.go:349] Starting recovery of all containers
Jul 09 18:59:42.457270 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:42.456370    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-233.ec2.internal.18c0b432bcb8c4aa  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-233.ec2.internal,UID:ip-10-0-137-233.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-233.ec2.internal,},FirstTimestamp:2026-07-09 18:59:42.446306474 +0000 UTC m=+0.831376739,LastTimestamp:2026-07-09 18:59:42.446306474 +0000 UTC m=+0.831376739,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-233.ec2.internal,}"
Jul 09 18:59:42.464447 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:42.464422    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 09 18:59:42.464554 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:42.464515    2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-233.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 09 18:59:42.469122 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.469100    2577 manager.go:354] Recovery completed
Jul 09 18:59:42.470258 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:42.470231    2577 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 09 18:59:42.473274 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.473261    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:59:42.475494 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.475479    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:59:42.475556 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.475506    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:59:42.475556 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.475516    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:59:42.476057 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.476041    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 18:59:42.476057 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.476054    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:59:42.476142 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.476057    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 18:59:42.476142 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.476076    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 18:59:42.476734 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.476719    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:59:42.476784 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.476745    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:59:42.476784 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.476754    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:59:42.477104 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.477093    2577 policy_none.go:49] "None policy: Start"
Jul 09 18:59:42.477178 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.477108    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 18:59:42.477178 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.477119    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 18:59:42.478021 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.478011    2577 policy_none.go:47] "Start"
Jul 09 18:59:42.520601 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.520430    2577 manager.go:337] "Starting Device Plugin manager"
Jul 09 18:59:42.520706 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:42.520643    2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 18:59:42.520706 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.520659    2577 server.go:87] "Starting device plugin registration server"
Jul 09 18:59:42.520929 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.520916    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 18:59:42.520962 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.520933    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 18:59:42.521037 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.521021    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 18:59:42.521157 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.521140    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 18:59:42.521157 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.521153    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 18:59:42.521766 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:42.521749    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 18:59:42.521860 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:42.521803    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-233.ec2.internal\" not found"
Jul 09 18:59:42.621299 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.621260    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:59:42.622532 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.622277    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:59:42.622532 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.622307    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:59:42.622532 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.622318    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:59:42.622532 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.622352    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-233.ec2.internal"
Jul 09 18:59:42.629572 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.629555    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-233.ec2.internal"
Jul 09 18:59:42.629572 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:42.629576    2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-233.ec2.internal\": node \"ip-10-0-137-233.ec2.internal\" not found"
Jul 09 18:59:42.630882 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.630856    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 18:59:42.632114 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.632100    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 18:59:42.632184 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.632141    2577 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 18:59:42.632184 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.632166    2577 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 18:59:42.632274 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:42.632206    2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 09 18:59:42.634159 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.634143    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:59:42.680000 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:42.679914    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-233.ec2.internal\" not found"
Jul 09 18:59:42.733369 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.733323    2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-233.ec2.internal"]
Jul 09 18:59:42.733454 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.733415    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:59:42.734371 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.734356    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:59:42.734428 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.734386    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:59:42.734428 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.734397    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:59:42.735592 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.735579    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:59:42.735712 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.735699    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal"
Jul 09 18:59:42.735750 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.735734    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:59:42.736347 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.736328    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:59:42.736347 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.736351    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:59:42.736516 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.736362    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:59:42.736516 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.736329    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:59:42.736516 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.736434    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:59:42.736516 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.736451    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:59:42.737485 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.737470    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-233.ec2.internal"
Jul 09 18:59:42.737537 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.737496    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:59:42.738236 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.738209    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:59:42.738236 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.738236    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:59:42.738365 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.738250    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:59:42.757419 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.757394    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3e5d0c8fd52f7be4f7ee3a0e3f7fbf93-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal\" (UID: \"3e5d0c8fd52f7be4f7ee3a0e3f7fbf93\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal"
Jul 09 18:59:42.757527 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.757432    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e5d0c8fd52f7be4f7ee3a0e3f7fbf93-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal\" (UID: \"3e5d0c8fd52f7be4f7ee3a0e3f7fbf93\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal"
Jul 09 18:59:42.757527 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.757454    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dfaa49bed4f018674f19ee2e2bb3d341-config\") pod \"kube-apiserver-proxy-ip-10-0-137-233.ec2.internal\" (UID: \"dfaa49bed4f018674f19ee2e2bb3d341\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-233.ec2.internal"
Jul 09 18:59:42.759533 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:42.759513    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-233.ec2.internal\" not found" node="ip-10-0-137-233.ec2.internal"
Jul 09 18:59:42.764917 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:42.764894    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-233.ec2.internal\" not found" node="ip-10-0-137-233.ec2.internal"
Jul 09 18:59:42.780488 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:42.780461    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-233.ec2.internal\" not found"
Jul 09 18:59:42.858225 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.858194    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3e5d0c8fd52f7be4f7ee3a0e3f7fbf93-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal\" (UID: \"3e5d0c8fd52f7be4f7ee3a0e3f7fbf93\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal"
Jul 09 18:59:42.858314 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.858229    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e5d0c8fd52f7be4f7ee3a0e3f7fbf93-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal\" (UID: \"3e5d0c8fd52f7be4f7ee3a0e3f7fbf93\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal"
Jul 09 18:59:42.858314 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.858248    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dfaa49bed4f018674f19ee2e2bb3d341-config\") pod \"kube-apiserver-proxy-ip-10-0-137-233.ec2.internal\" (UID: \"dfaa49bed4f018674f19ee2e2bb3d341\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-233.ec2.internal"
Jul 09 18:59:42.858314 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.858291    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dfaa49bed4f018674f19ee2e2bb3d341-config\") pod \"kube-apiserver-proxy-ip-10-0-137-233.ec2.internal\" (UID: \"dfaa49bed4f018674f19ee2e2bb3d341\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-233.ec2.internal"
Jul 09 18:59:42.858405 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.858311    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3e5d0c8fd52f7be4f7ee3a0e3f7fbf93-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal\" (UID: \"3e5d0c8fd52f7be4f7ee3a0e3f7fbf93\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal"
Jul 09 18:59:42.858405 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:42.858311    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3e5d0c8fd52f7be4f7ee3a0e3f7fbf93-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal\" (UID: \"3e5d0c8fd52f7be4f7ee3a0e3f7fbf93\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal"
Jul 09 18:59:42.881322 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:42.881292    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-233.ec2.internal\" not found"
Jul 09 18:59:42.982242 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:42.982184    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-233.ec2.internal\" not found"
Jul 09 18:59:43.061732 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:43.061694    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal"
Jul 09 18:59:43.068537 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:43.068517    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-233.ec2.internal"
Jul 09 18:59:43.082837 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:43.082797    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-233.ec2.internal\" not found"
Jul 09 18:59:43.183400 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:43.183358    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-233.ec2.internal\" not found"
Jul 09 18:59:43.283995 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:43.283918    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-233.ec2.internal\" not found"
Jul 09 18:59:43.384540 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:43.384509    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-233.ec2.internal\" not found"
Jul 09 18:59:43.386927 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:43.386910    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:59:43.395511 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:43.395486    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 18:59:43.395644 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:43.395625    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 18:59:43.395679 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:43.395654    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 18:59:43.460753 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:43.460719    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:59:43.461658 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:43.461634    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 18:54:42 +0000 UTC" deadline="2027-12-10 09:26:37.119353516 +0000 UTC"
Jul 09 18:59:43.461708 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:43.461658    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12446h26m53.657697944s"
Jul 09 18:59:43.554695 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:43.554629    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal"
Jul 09 18:59:43.568244 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:43.568221    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 18:59:43.570361 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:43.570346    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-233.ec2.internal"
Jul 09 18:59:43.577115 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:43.577098    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 18:59:43.600544 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:43.600505    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfaa49bed4f018674f19ee2e2bb3d341.slice/crio-8af8176dcd68132e5584acef88ded46f2b5b46ac28a4a71b6db33cb5ba46952e WatchSource:0}: Error finding container 8af8176dcd68132e5584acef88ded46f2b5b46ac28a4a71b6db33cb5ba46952e: Status 404 returned error can't find the container with id 8af8176dcd68132e5584acef88ded46f2b5b46ac28a4a71b6db33cb5ba46952e
Jul 09 18:59:43.605142 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:43.605123    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 18:59:43.619716 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:43.619686    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e5d0c8fd52f7be4f7ee3a0e3f7fbf93.slice/crio-9cde581e85130d2e835809a862e2501b6fdd1f3676b6af6f129951cff4935eeb WatchSource:0}: Error finding container 9cde581e85130d2e835809a862e2501b6fdd1f3676b6af6f129951cff4935eeb: Status 404 returned error can't find the container with id 9cde581e85130d2e835809a862e2501b6fdd1f3676b6af6f129951cff4935eeb
Jul 09 18:59:43.635621 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:43.635565    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal" event={"ID":"3e5d0c8fd52f7be4f7ee3a0e3f7fbf93","Type":"ContainerStarted","Data":"9cde581e85130d2e835809a862e2501b6fdd1f3676b6af6f129951cff4935eeb"}
Jul 09 18:59:43.636633 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:43.636613    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-233.ec2.internal" event={"ID":"dfaa49bed4f018674f19ee2e2bb3d341","Type":"ContainerStarted","Data":"8af8176dcd68132e5584acef88ded46f2b5b46ac28a4a71b6db33cb5ba46952e"}
Jul 09 18:59:43.703150 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:43.703129    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:59:44.437397 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.437369    2577 apiserver.go:52] "Watching apiserver"
Jul 09 18:59:44.447575 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.447543    2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 18:59:44.448724 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.448694    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-svvql","openshift-network-operator/iptables-alerter-cdn7k","openshift-ovn-kubernetes/ovnkube-node-bw97f","kube-system/global-pull-secret-syncer-b5s6c","kube-system/konnectivity-agent-d9whc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmdc7","openshift-cluster-node-tuning-operator/tuned-5dbgc","openshift-image-registry/node-ca-vbqbv","openshift-network-diagnostics/network-check-target-fl7kb","kube-system/kube-apiserver-proxy-ip-10-0-137-233.ec2.internal","openshift-dns/node-resolver-d4hjs","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal","openshift-multus/multus-additional-cni-plugins-pfhlb","openshift-multus/multus-gtbdq"]
Jul 09 18:59:44.450349 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.450331    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.451913 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.451890    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pfhlb"
Jul 09 18:59:44.453506 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.453377    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lkwqp\""
Jul 09 18:59:44.453506 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.453385    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 18:59:44.453506 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.453463    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 18:59:44.453858 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.453841    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 18:59:44.454013 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.453994    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.455280 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.455164    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-w7qxw\""
Jul 09 18:59:44.455503 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.455481    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 18:59:44.455707 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.455690    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 18:59:44.456018 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.456001    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 18:59:44.456429 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.456412    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 18:59:44.456792 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.456776    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 18:59:44.456872 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.456855    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dzkpn\""
Jul 09 18:59:44.457129 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.457114    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 18:59:44.457220 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.457205    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 18:59:44.457393 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.457378    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 18:59:44.457447 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.457417    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 18:59:44.458377 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.457685    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 18:59:44.458377 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.458296    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 18:59:44.458545 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:44.458438    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5s6c" podUID="67dae793-bded-46b5-8237-b38edbebdc47"
Jul 09 18:59:44.458606 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.458589    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 18:59:44.459729 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.459711    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d9whc"
Jul 09 18:59:44.461291 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.461270    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmdc7"
Jul 09 18:59:44.462401 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.462379    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 18:59:44.462509 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.462487    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-q6cpk\""
Jul 09 18:59:44.462754 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.462740    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 18:59:44.463909 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.463890    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 18:59:44.463998 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.463927    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2vtnp\""
Jul 09 18:59:44.464166 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.464149    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 18:59:44.464239 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.464182    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 18:59:44.464239 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:44.464203    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fl7kb" podUID="17f98f01-8fb0-47b4-887f-b0de9d0ccade"
Jul 09 18:59:44.464346 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.464287    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 18:59:44.465298 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.465276    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mrwq\" (UniqueName: \"kubernetes.io/projected/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-kube-api-access-7mrwq\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.465385 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.465307    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-host-run-netns\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.465385 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.465332    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/67dae793-bded-46b5-8237-b38edbebdc47-dbus\") pod \"global-pull-secret-syncer-b5s6c\" (UID: \"67dae793-bded-46b5-8237-b38edbebdc47\") " pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 18:59:44.465385 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.465375    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-etc-systemd\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.465519 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.465431    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-run\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.465519 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.465463    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-etc-tuned\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.465519 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.465486    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-node-log\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.465659 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.465526    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/89f43e21-1536-46e8-b2d6-f0dd1584613c-ovnkube-config\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.465659 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.465553    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/89f43e21-1536-46e8-b2d6-f0dd1584613c-ovnkube-script-lib\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.465659 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.465589    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-etc-sysctl-conf\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.465659 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.465611    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-systemd-units\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.465659 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.465634    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-run-systemd\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.465659 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.465656    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-run-ovn\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.466013 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.465680    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2d7a4519-2a09-4b32-9aba-6caa03ed8d37-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pfhlb\" (UID: \"2d7a4519-2a09-4b32-9aba-6caa03ed8d37\") " pod="openshift-multus/multus-additional-cni-plugins-pfhlb"
Jul 09 18:59:44.466013 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.465711    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-etc-modprobe-d\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.466013 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.465734    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-sys\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.466013 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.465749    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2d7a4519-2a09-4b32-9aba-6caa03ed8d37-os-release\") pod \"multus-additional-cni-plugins-pfhlb\" (UID: \"2d7a4519-2a09-4b32-9aba-6caa03ed8d37\") " pod="openshift-multus/multus-additional-cni-plugins-pfhlb"
Jul 09 18:59:44.466013 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.465765    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d7a4519-2a09-4b32-9aba-6caa03ed8d37-cni-binary-copy\") pod \"multus-additional-cni-plugins-pfhlb\" (UID: \"2d7a4519-2a09-4b32-9aba-6caa03ed8d37\") " pod="openshift-multus/multus-additional-cni-plugins-pfhlb"
Jul 09 18:59:44.466013 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.465788    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-var-lib-openvswitch\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.466013 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.465802    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-run-openvswitch\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.466013 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.465836    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-etc-kubernetes\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.466013 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.465865    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-host\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.466013 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.465898    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g9bx\" (UniqueName: \"kubernetes.io/projected/2d7a4519-2a09-4b32-9aba-6caa03ed8d37-kube-api-access-9g9bx\") pod \"multus-additional-cni-plugins-pfhlb\" (UID: \"2d7a4519-2a09-4b32-9aba-6caa03ed8d37\") " pod="openshift-multus/multus-additional-cni-plugins-pfhlb"
Jul 09 18:59:44.466013 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.465924    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-etc-openvswitch\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.466013 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.465948    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-log-socket\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.466013 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.465963    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-host-run-ovn-kubernetes\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.466013 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.465977    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/89f43e21-1536-46e8-b2d6-f0dd1584613c-env-overrides\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.466013 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.465996    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/89f43e21-1536-46e8-b2d6-f0dd1584613c-ovn-node-metrics-cert\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.466013 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.466019    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d7a4519-2a09-4b32-9aba-6caa03ed8d37-system-cni-dir\") pod \"multus-additional-cni-plugins-pfhlb\" (UID: \"2d7a4519-2a09-4b32-9aba-6caa03ed8d37\") " pod="openshift-multus/multus-additional-cni-plugins-pfhlb"
Jul 09 18:59:44.466787 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.466043    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpbzc\" (UniqueName: \"kubernetes.io/projected/89f43e21-1536-46e8-b2d6-f0dd1584613c-kube-api-access-vpbzc\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.466787 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.466066    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-etc-sysconfig\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.466787 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.466086    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-tmp\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.466787 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.466132    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 18:59:44.466787 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.466128    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2d7a4519-2a09-4b32-9aba-6caa03ed8d37-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pfhlb\" (UID: \"2d7a4519-2a09-4b32-9aba-6caa03ed8d37\") " pod="openshift-multus/multus-additional-cni-plugins-pfhlb"
Jul 09 18:59:44.466787 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.466226    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-host-cni-bin\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.466787 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.466251    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/67dae793-bded-46b5-8237-b38edbebdc47-kubelet-config\") pod \"global-pull-secret-syncer-b5s6c\" (UID: \"67dae793-bded-46b5-8237-b38edbebdc47\") " pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 18:59:44.466787 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:44.466189    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svvql" podUID="979b4064-b4f4-40b8-86f7-cf21c0a62580"
Jul 09 18:59:44.466787 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.466273    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-host-kubelet\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.466787 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.466297    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-host-slash\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.466787 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.466323    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d7a4519-2a09-4b32-9aba-6caa03ed8d37-cnibin\") pod \"multus-additional-cni-plugins-pfhlb\" (UID: \"2d7a4519-2a09-4b32-9aba-6caa03ed8d37\") " pod="openshift-multus/multus-additional-cni-plugins-pfhlb"
Jul 09 18:59:44.466787 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.466355    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d7a4519-2a09-4b32-9aba-6caa03ed8d37-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pfhlb\" (UID: \"2d7a4519-2a09-4b32-9aba-6caa03ed8d37\") " pod="openshift-multus/multus-additional-cni-plugins-pfhlb"
Jul 09 18:59:44.466787 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.466378    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-host-cni-netd\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.466787 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.466424    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.466787 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.466474    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67dae793-bded-46b5-8237-b38edbebdc47-original-pull-secret\") pod \"global-pull-secret-syncer-b5s6c\" (UID: \"67dae793-bded-46b5-8237-b38edbebdc47\") " pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 18:59:44.466787 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.466500    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-etc-sysctl-d\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.467437 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.466521    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-lib-modules\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.467437 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.466542    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-var-lib-kubelet\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.467607 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.467569    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 18:59:44.467655 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.467644    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cdn7k"
Jul 09 18:59:44.469263 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.469240    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.471003 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.470962    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-d4hjs"
Jul 09 18:59:44.473046 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.473024    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vbqbv"
Jul 09 18:59:44.473397 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.473378    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wstz2\""
Jul 09 18:59:44.473485 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.473445    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 18:59:44.473638 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.473623    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qcjkn\""
Jul 09 18:59:44.473686 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.473664    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 18:59:44.473720 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.473683    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 18:59:44.473866 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.473849    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 18:59:44.474023 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.474001    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 18:59:44.474122 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.474070    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 18:59:44.474206 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.474139    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hsvnj\""
Jul 09 18:59:44.475608 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.475592    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 18:59:44.475748 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.475735    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 18:59:44.476180 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.476160    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 18:59:44.476282 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.476265    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-s9mqf\""
Jul 09 18:59:44.491637 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.491616    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dgvgv"
Jul 09 18:59:44.498721 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.498700    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dgvgv"
Jul 09 18:59:44.558891 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.558860    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 18:59:44.567564 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.567532    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2d7a4519-2a09-4b32-9aba-6caa03ed8d37-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pfhlb\" (UID: \"2d7a4519-2a09-4b32-9aba-6caa03ed8d37\") " pod="openshift-multus/multus-additional-cni-plugins-pfhlb"
Jul 09 18:59:44.567782 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.567762    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-host-cni-bin\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.567897 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.567876    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-host-cni-bin\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.567967 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.567888    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cctmf\" (UniqueName: \"kubernetes.io/projected/4ac17e39-5744-438a-a7ba-eb7c43c8723c-kube-api-access-cctmf\") pod \"iptables-alerter-cdn7k\" (UID: \"4ac17e39-5744-438a-a7ba-eb7c43c8723c\") " pod="openshift-network-operator/iptables-alerter-cdn7k"
Jul 09 18:59:44.567967 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.567941    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-host-kubelet\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.568071 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.567969    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d7a4519-2a09-4b32-9aba-6caa03ed8d37-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pfhlb\" (UID: \"2d7a4519-2a09-4b32-9aba-6caa03ed8d37\") " pod="openshift-multus/multus-additional-cni-plugins-pfhlb"
Jul 09 18:59:44.568071 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.567995    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-host-kubelet\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.568071 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.568011    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-host-cni-netd\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.568071 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.568058    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67dae793-bded-46b5-8237-b38edbebdc47-original-pull-secret\") pod \"global-pull-secret-syncer-b5s6c\" (UID: \"67dae793-bded-46b5-8237-b38edbebdc47\") " pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 18:59:44.568254 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.568075    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-host-cni-netd\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.568254 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.568089    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/10160341-56bd-40f5-8d51-ec008394bca6-registration-dir\") pod \"aws-ebs-csi-driver-node-xmdc7\" (UID: \"10160341-56bd-40f5-8d51-ec008394bca6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmdc7"
Jul 09 18:59:44.568254 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.568119    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-host-run-netns\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.568254 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.568144    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-host-run-multus-certs\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.568254 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.568151    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d7a4519-2a09-4b32-9aba-6caa03ed8d37-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pfhlb\" (UID: \"2d7a4519-2a09-4b32-9aba-6caa03ed8d37\") " pod="openshift-multus/multus-additional-cni-plugins-pfhlb"
Jul 09 18:59:44.568254 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.568169    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-lib-modules\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.568254 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:44.568191    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:59:44.568645 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.568193    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mrwq\" (UniqueName: \"kubernetes.io/projected/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-kube-api-access-7mrwq\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.568645 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.568327    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-lib-modules\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.568645 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.568331    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2d7a4519-2a09-4b32-9aba-6caa03ed8d37-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pfhlb\" (UID: \"2d7a4519-2a09-4b32-9aba-6caa03ed8d37\") " pod="openshift-multus/multus-additional-cni-plugins-pfhlb"
Jul 09 18:59:44.568645 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:44.568541    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67dae793-bded-46b5-8237-b38edbebdc47-original-pull-secret podName:67dae793-bded-46b5-8237-b38edbebdc47 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:45.068250846 +0000 UTC m=+3.453321118 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67dae793-bded-46b5-8237-b38edbebdc47-original-pull-secret") pod "global-pull-secret-syncer-b5s6c" (UID: "67dae793-bded-46b5-8237-b38edbebdc47") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:59:44.568645 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.568603    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-host-run-netns\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.568645 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.568643    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/67dae793-bded-46b5-8237-b38edbebdc47-dbus\") pod \"global-pull-secret-syncer-b5s6c\" (UID: \"67dae793-bded-46b5-8237-b38edbebdc47\") " pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 18:59:44.568961 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.568736    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-host-run-netns\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.569022 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.569003    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/67dae793-bded-46b5-8237-b38edbebdc47-dbus\") pod \"global-pull-secret-syncer-b5s6c\" (UID: \"67dae793-bded-46b5-8237-b38edbebdc47\") " pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 18:59:44.569071 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.569045    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/10160341-56bd-40f5-8d51-ec008394bca6-sys-fs\") pod \"aws-ebs-csi-driver-node-xmdc7\" (UID: \"10160341-56bd-40f5-8d51-ec008394bca6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmdc7"
Jul 09 18:59:44.569120 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.569072    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-cnibin\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.569175 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.569150    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-etc-kubernetes\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.569270 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.569254    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-etc-tuned\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.569603 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.569582    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 18:59:44.569698 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.569662    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-node-log\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.569951 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.569282    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-node-log\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.570025 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.569987    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/89f43e21-1536-46e8-b2d6-f0dd1584613c-ovnkube-config\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.570563 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.570016    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/456dc88f-d993-4b79-9193-62ee943ea3e6-konnectivity-ca\") pod \"konnectivity-agent-d9whc\" (UID: \"456dc88f-d993-4b79-9193-62ee943ea3e6\") " pod="kube-system/konnectivity-agent-d9whc"
Jul 09 18:59:44.570563 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.570553    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/89f43e21-1536-46e8-b2d6-f0dd1584613c-ovnkube-config\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.570683 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.570585    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ac17e39-5744-438a-a7ba-eb7c43c8723c-host-slash\") pod \"iptables-alerter-cdn7k\" (UID: \"4ac17e39-5744-438a-a7ba-eb7c43c8723c\") " pod="openshift-network-operator/iptables-alerter-cdn7k"
Jul 09 18:59:44.570683 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.570611    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/10160341-56bd-40f5-8d51-ec008394bca6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xmdc7\" (UID: \"10160341-56bd-40f5-8d51-ec008394bca6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmdc7"
Jul 09 18:59:44.570683 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.570634    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/979b4064-b4f4-40b8-86f7-cf21c0a62580-metrics-certs\") pod \"network-metrics-daemon-svvql\" (UID: \"979b4064-b4f4-40b8-86f7-cf21c0a62580\") " pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 18:59:44.570683 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.570660    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-host-var-lib-cni-bin\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.570861 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.570687    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-systemd-units\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.570861 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.570717    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-run-ovn\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.570861 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.570740    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/10160341-56bd-40f5-8d51-ec008394bca6-device-dir\") pod \"aws-ebs-csi-driver-node-xmdc7\" (UID: \"10160341-56bd-40f5-8d51-ec008394bca6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmdc7"
Jul 09 18:59:44.570861 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.570776    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-systemd-units\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.570861 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.570794    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6ad86949-d001-4b0c-9a59-cebf82ee6604-cni-binary-copy\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.570861 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.570835    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-run-ovn\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.571126 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.570891    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-host-var-lib-cni-multus\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.571126 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.570916    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6ad86949-d001-4b0c-9a59-cebf82ee6604-multus-daemon-config\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.571126 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.570948    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-sys\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.571126 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.570977    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2d7a4519-2a09-4b32-9aba-6caa03ed8d37-os-release\") pod \"multus-additional-cni-plugins-pfhlb\" (UID: \"2d7a4519-2a09-4b32-9aba-6caa03ed8d37\") " pod="openshift-multus/multus-additional-cni-plugins-pfhlb"
Jul 09 18:59:44.571126 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571052    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2d7a4519-2a09-4b32-9aba-6caa03ed8d37-os-release\") pod \"multus-additional-cni-plugins-pfhlb\" (UID: \"2d7a4519-2a09-4b32-9aba-6caa03ed8d37\") " pod="openshift-multus/multus-additional-cni-plugins-pfhlb"
Jul 09 18:59:44.571126 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571063    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-sys\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.571126 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571082    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-log-socket\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.571126 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571106    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-host-run-ovn-kubernetes\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.571510 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571133    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4ac17e39-5744-438a-a7ba-eb7c43c8723c-iptables-alerter-script\") pod \"iptables-alerter-cdn7k\" (UID: \"4ac17e39-5744-438a-a7ba-eb7c43c8723c\") " pod="openshift-network-operator/iptables-alerter-cdn7k"
Jul 09 18:59:44.571510 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571178    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-log-socket\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.571510 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571190    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-etc-kubernetes\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.571510 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571215    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g9bx\" (UniqueName: \"kubernetes.io/projected/2d7a4519-2a09-4b32-9aba-6caa03ed8d37-kube-api-access-9g9bx\") pod \"multus-additional-cni-plugins-pfhlb\" (UID: \"2d7a4519-2a09-4b32-9aba-6caa03ed8d37\") " pod="openshift-multus/multus-additional-cni-plugins-pfhlb"
Jul 09 18:59:44.571510 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571219    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-host-run-ovn-kubernetes\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.571510 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571238    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-etc-openvswitch\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.571510 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571264    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-etc-kubernetes\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.571510 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571265    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkw98\" (UniqueName: \"kubernetes.io/projected/e98f3c45-8551-4810-a45c-deebf91e11dc-kube-api-access-hkw98\") pod \"node-resolver-d4hjs\" (UID: \"e98f3c45-8551-4810-a45c-deebf91e11dc\") " pod="openshift-dns/node-resolver-d4hjs"
Jul 09 18:59:44.571510 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571372    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-etc-sysconfig\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.571510 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571399    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-tmp\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.571510 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571423    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/67dae793-bded-46b5-8237-b38edbebdc47-kubelet-config\") pod \"global-pull-secret-syncer-b5s6c\" (UID: \"67dae793-bded-46b5-8237-b38edbebdc47\") " pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 18:59:44.571510 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571447    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-multus-socket-dir-parent\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.571510 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571470    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wzc4\" (UniqueName: \"kubernetes.io/projected/17f98f01-8fb0-47b4-887f-b0de9d0ccade-kube-api-access-2wzc4\") pod \"network-check-target-fl7kb\" (UID: \"17f98f01-8fb0-47b4-887f-b0de9d0ccade\") " pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 18:59:44.571510 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571496    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-host-slash\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.571510 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571510    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-etc-sysconfig\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.571510 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571520    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d7a4519-2a09-4b32-9aba-6caa03ed8d37-cnibin\") pod \"multus-additional-cni-plugins-pfhlb\" (UID: \"2d7a4519-2a09-4b32-9aba-6caa03ed8d37\") " pod="openshift-multus/multus-additional-cni-plugins-pfhlb"
Jul 09 18:59:44.572262 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571546    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.572262 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571547    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-etc-openvswitch\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.572262 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571610    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/67dae793-bded-46b5-8237-b38edbebdc47-kubelet-config\") pod \"global-pull-secret-syncer-b5s6c\" (UID: \"67dae793-bded-46b5-8237-b38edbebdc47\") " pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 18:59:44.572262 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571611    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.572262 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571647    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-host-slash\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.572262 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571682    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/10160341-56bd-40f5-8d51-ec008394bca6-etc-selinux\") pod \"aws-ebs-csi-driver-node-xmdc7\" (UID: \"10160341-56bd-40f5-8d51-ec008394bca6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmdc7"
Jul 09 18:59:44.572262 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571707    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kxxg\" (UniqueName: \"kubernetes.io/projected/979b4064-b4f4-40b8-86f7-cf21c0a62580-kube-api-access-4kxxg\") pod \"network-metrics-daemon-svvql\" (UID: \"979b4064-b4f4-40b8-86f7-cf21c0a62580\") " pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 18:59:44.572262 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571743    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-etc-sysctl-d\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.572262 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571767    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-var-lib-kubelet\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.572262 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571793    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fxqv\" (UniqueName: \"kubernetes.io/projected/10160341-56bd-40f5-8d51-ec008394bca6-kube-api-access-9fxqv\") pod \"aws-ebs-csi-driver-node-xmdc7\" (UID: \"10160341-56bd-40f5-8d51-ec008394bca6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmdc7"
Jul 09 18:59:44.572262 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571841    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e98f3c45-8551-4810-a45c-deebf91e11dc-hosts-file\") pod \"node-resolver-d4hjs\" (UID: \"e98f3c45-8551-4810-a45c-deebf91e11dc\") " pod="openshift-dns/node-resolver-d4hjs"
Jul 09 18:59:44.572262 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571894    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e98f3c45-8551-4810-a45c-deebf91e11dc-tmp-dir\") pod \"node-resolver-d4hjs\" (UID: \"e98f3c45-8551-4810-a45c-deebf91e11dc\") " pod="openshift-dns/node-resolver-d4hjs"
Jul 09 18:59:44.572262 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571920    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-etc-systemd\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.572262 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571944    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-run\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.572262 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571968    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/89f43e21-1536-46e8-b2d6-f0dd1584613c-ovnkube-script-lib\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.572262 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.571992    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-multus-conf-dir\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.572262 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.572014    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/605a56fa-674a-44cd-a987-bc27d0fbd80d-serviceca\") pod \"node-ca-vbqbv\" (UID: \"605a56fa-674a-44cd-a987-bc27d0fbd80d\") " pod="openshift-image-registry/node-ca-vbqbv"
Jul 09 18:59:44.573022 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.572038    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-etc-sysctl-conf\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.573022 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.572061    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-run-systemd\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.573022 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.572143    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-host-var-lib-kubelet\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.573022 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.572167    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgt4x\" (UniqueName: \"kubernetes.io/projected/6ad86949-d001-4b0c-9a59-cebf82ee6604-kube-api-access-zgt4x\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.573022 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.572195    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2d7a4519-2a09-4b32-9aba-6caa03ed8d37-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pfhlb\" (UID: \"2d7a4519-2a09-4b32-9aba-6caa03ed8d37\") " pod="openshift-multus/multus-additional-cni-plugins-pfhlb"
Jul 09 18:59:44.573022 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.572222    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-etc-modprobe-d\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.573022 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.572246    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d7a4519-2a09-4b32-9aba-6caa03ed8d37-cni-binary-copy\") pod \"multus-additional-cni-plugins-pfhlb\" (UID: \"2d7a4519-2a09-4b32-9aba-6caa03ed8d37\") " pod="openshift-multus/multus-additional-cni-plugins-pfhlb"
Jul 09 18:59:44.573022 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.572269    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-var-lib-openvswitch\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.573022 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.572293    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-run-openvswitch\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.573022 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.572316    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/89f43e21-1536-46e8-b2d6-f0dd1584613c-ovn-node-metrics-cert\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.573022 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.572340    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-host-run-k8s-cni-cncf-io\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.573022 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.572364    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjvlt\" (UniqueName: \"kubernetes.io/projected/605a56fa-674a-44cd-a987-bc27d0fbd80d-kube-api-access-xjvlt\") pod \"node-ca-vbqbv\" (UID: \"605a56fa-674a-44cd-a987-bc27d0fbd80d\") " pod="openshift-image-registry/node-ca-vbqbv"
Jul 09 18:59:44.573022 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.572390    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-host\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.573022 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.572416    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/89f43e21-1536-46e8-b2d6-f0dd1584613c-env-overrides\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.573022 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.572440    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/456dc88f-d993-4b79-9193-62ee943ea3e6-agent-certs\") pod \"konnectivity-agent-d9whc\" (UID: \"456dc88f-d993-4b79-9193-62ee943ea3e6\") " pod="kube-system/konnectivity-agent-d9whc"
Jul 09 18:59:44.573022 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.572470    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/10160341-56bd-40f5-8d51-ec008394bca6-socket-dir\") pod \"aws-ebs-csi-driver-node-xmdc7\" (UID: \"10160341-56bd-40f5-8d51-ec008394bca6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmdc7"
Jul 09 18:59:44.573022 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.572493    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-system-cni-dir\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.573745 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.572516    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-os-release\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.573745 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.572601    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d7a4519-2a09-4b32-9aba-6caa03ed8d37-system-cni-dir\") pod \"multus-additional-cni-plugins-pfhlb\" (UID: \"2d7a4519-2a09-4b32-9aba-6caa03ed8d37\") " pod="openshift-multus/multus-additional-cni-plugins-pfhlb"
Jul 09 18:59:44.573745 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.572606    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-var-lib-openvswitch\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.573745 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.572631    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpbzc\" (UniqueName: \"kubernetes.io/projected/89f43e21-1536-46e8-b2d6-f0dd1584613c-kube-api-access-vpbzc\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.573745 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.572649    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-run-openvswitch\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.573745 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.572660    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-multus-cni-dir\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.573745 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.572703    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-hostroot\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.573745 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.572725    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/605a56fa-674a-44cd-a987-bc27d0fbd80d-host\") pod \"node-ca-vbqbv\" (UID: \"605a56fa-674a-44cd-a987-bc27d0fbd80d\") " pod="openshift-image-registry/node-ca-vbqbv"
Jul 09 18:59:44.573745 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.572824    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/89f43e21-1536-46e8-b2d6-f0dd1584613c-run-systemd\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.573745 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.572939    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-etc-sysctl-d\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.573745 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.572979    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-var-lib-kubelet\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.573745 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.573023    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-etc-systemd\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.573745 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.573033    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-host\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.573745 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.573128    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-etc-sysctl-conf\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.573745 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.573185    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-run\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.573745 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.573392    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/89f43e21-1536-46e8-b2d6-f0dd1584613c-env-overrides\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.573745 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.573476    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-etc-modprobe-d\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.573745 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.573449    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d7a4519-2a09-4b32-9aba-6caa03ed8d37-cni-binary-copy\") pod \"multus-additional-cni-plugins-pfhlb\" (UID: \"2d7a4519-2a09-4b32-9aba-6caa03ed8d37\") " pod="openshift-multus/multus-additional-cni-plugins-pfhlb"
Jul 09 18:59:44.574694 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.573516    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d7a4519-2a09-4b32-9aba-6caa03ed8d37-cnibin\") pod \"multus-additional-cni-plugins-pfhlb\" (UID: \"2d7a4519-2a09-4b32-9aba-6caa03ed8d37\") " pod="openshift-multus/multus-additional-cni-plugins-pfhlb"
Jul 09 18:59:44.574694 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.573534    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d7a4519-2a09-4b32-9aba-6caa03ed8d37-system-cni-dir\") pod \"multus-additional-cni-plugins-pfhlb\" (UID: \"2d7a4519-2a09-4b32-9aba-6caa03ed8d37\") " pod="openshift-multus/multus-additional-cni-plugins-pfhlb"
Jul 09 18:59:44.574694 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.573688    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/89f43e21-1536-46e8-b2d6-f0dd1584613c-ovnkube-script-lib\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.574694 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.573960    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2d7a4519-2a09-4b32-9aba-6caa03ed8d37-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pfhlb\" (UID: \"2d7a4519-2a09-4b32-9aba-6caa03ed8d37\") " pod="openshift-multus/multus-additional-cni-plugins-pfhlb"
Jul 09 18:59:44.575217 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.575138    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-tmp\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.576241 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.576220    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-etc-tuned\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.579499 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.579476    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/89f43e21-1536-46e8-b2d6-f0dd1584613c-ovn-node-metrics-cert\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.583181 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.583160    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mrwq\" (UniqueName: \"kubernetes.io/projected/0f4d2f14-bdbf-4b67-820b-cbb863aaad2f-kube-api-access-7mrwq\") pod \"tuned-5dbgc\" (UID: \"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f\") " pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.583540 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.583513    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g9bx\" (UniqueName: \"kubernetes.io/projected/2d7a4519-2a09-4b32-9aba-6caa03ed8d37-kube-api-access-9g9bx\") pod \"multus-additional-cni-plugins-pfhlb\" (UID: \"2d7a4519-2a09-4b32-9aba-6caa03ed8d37\") " pod="openshift-multus/multus-additional-cni-plugins-pfhlb"
Jul 09 18:59:44.584819 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.584781    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpbzc\" (UniqueName: \"kubernetes.io/projected/89f43e21-1536-46e8-b2d6-f0dd1584613c-kube-api-access-vpbzc\") pod \"ovnkube-node-bw97f\" (UID: \"89f43e21-1536-46e8-b2d6-f0dd1584613c\") " pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.673752 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.673718    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/10160341-56bd-40f5-8d51-ec008394bca6-registration-dir\") pod \"aws-ebs-csi-driver-node-xmdc7\" (UID: \"10160341-56bd-40f5-8d51-ec008394bca6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmdc7"
Jul 09 18:59:44.673752 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.673760    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-host-run-netns\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.674009 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.673795    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-host-run-multus-certs\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.674009 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.673834    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/10160341-56bd-40f5-8d51-ec008394bca6-sys-fs\") pod \"aws-ebs-csi-driver-node-xmdc7\" (UID: \"10160341-56bd-40f5-8d51-ec008394bca6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmdc7"
Jul 09 18:59:44.674009 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.673857    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-cnibin\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.674009 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.673891    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-etc-kubernetes\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.674009 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.673893    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/10160341-56bd-40f5-8d51-ec008394bca6-registration-dir\") pod \"aws-ebs-csi-driver-node-xmdc7\" (UID: \"10160341-56bd-40f5-8d51-ec008394bca6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmdc7"
Jul 09 18:59:44.674009 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.673918    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/456dc88f-d993-4b79-9193-62ee943ea3e6-konnectivity-ca\") pod \"konnectivity-agent-d9whc\" (UID: \"456dc88f-d993-4b79-9193-62ee943ea3e6\") " pod="kube-system/konnectivity-agent-d9whc"
Jul 09 18:59:44.674009 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.673919    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-host-run-multus-certs\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.674009 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.673941    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ac17e39-5744-438a-a7ba-eb7c43c8723c-host-slash\") pod \"iptables-alerter-cdn7k\" (UID: \"4ac17e39-5744-438a-a7ba-eb7c43c8723c\") " pod="openshift-network-operator/iptables-alerter-cdn7k"
Jul 09 18:59:44.674009 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.673956    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-host-run-netns\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.674009 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.673982    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4ac17e39-5744-438a-a7ba-eb7c43c8723c-host-slash\") pod \"iptables-alerter-cdn7k\" (UID: \"4ac17e39-5744-438a-a7ba-eb7c43c8723c\") " pod="openshift-network-operator/iptables-alerter-cdn7k"
Jul 09 18:59:44.674009 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674008    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-cnibin\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.674009 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674011    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/10160341-56bd-40f5-8d51-ec008394bca6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xmdc7\" (UID: \"10160341-56bd-40f5-8d51-ec008394bca6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmdc7"
Jul 09 18:59:44.674563 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674030    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-etc-kubernetes\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.674563 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674038    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/979b4064-b4f4-40b8-86f7-cf21c0a62580-metrics-certs\") pod \"network-metrics-daemon-svvql\" (UID: \"979b4064-b4f4-40b8-86f7-cf21c0a62580\") " pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 18:59:44.674563 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674058    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/10160341-56bd-40f5-8d51-ec008394bca6-sys-fs\") pod \"aws-ebs-csi-driver-node-xmdc7\" (UID: \"10160341-56bd-40f5-8d51-ec008394bca6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmdc7"
Jul 09 18:59:44.674563 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674067    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-host-var-lib-cni-bin\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.674563 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674093    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/10160341-56bd-40f5-8d51-ec008394bca6-device-dir\") pod \"aws-ebs-csi-driver-node-xmdc7\" (UID: \"10160341-56bd-40f5-8d51-ec008394bca6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmdc7"
Jul 09 18:59:44.674563 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674100    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/10160341-56bd-40f5-8d51-ec008394bca6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xmdc7\" (UID: \"10160341-56bd-40f5-8d51-ec008394bca6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmdc7"
Jul 09 18:59:44.674563 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674116    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6ad86949-d001-4b0c-9a59-cebf82ee6604-cni-binary-copy\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.674563 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674137    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-host-var-lib-cni-bin\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.674563 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674143    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-host-var-lib-cni-multus\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.674563 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674166    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6ad86949-d001-4b0c-9a59-cebf82ee6604-multus-daemon-config\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.674563 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674192    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4ac17e39-5744-438a-a7ba-eb7c43c8723c-iptables-alerter-script\") pod \"iptables-alerter-cdn7k\" (UID: \"4ac17e39-5744-438a-a7ba-eb7c43c8723c\") " pod="openshift-network-operator/iptables-alerter-cdn7k"
Jul 09 18:59:44.674563 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674216    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkw98\" (UniqueName: \"kubernetes.io/projected/e98f3c45-8551-4810-a45c-deebf91e11dc-kube-api-access-hkw98\") pod \"node-resolver-d4hjs\" (UID: \"e98f3c45-8551-4810-a45c-deebf91e11dc\") " pod="openshift-dns/node-resolver-d4hjs"
Jul 09 18:59:44.674563 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:44.674226    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:59:44.674563 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674245    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-multus-socket-dir-parent\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.674563 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674270    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wzc4\" (UniqueName: \"kubernetes.io/projected/17f98f01-8fb0-47b4-887f-b0de9d0ccade-kube-api-access-2wzc4\") pod \"network-check-target-fl7kb\" (UID: \"17f98f01-8fb0-47b4-887f-b0de9d0ccade\") " pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 18:59:44.674563 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674294    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/10160341-56bd-40f5-8d51-ec008394bca6-etc-selinux\") pod \"aws-ebs-csi-driver-node-xmdc7\" (UID: \"10160341-56bd-40f5-8d51-ec008394bca6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmdc7"
Jul 09 18:59:44.674563 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674315    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kxxg\" (UniqueName: \"kubernetes.io/projected/979b4064-b4f4-40b8-86f7-cf21c0a62580-kube-api-access-4kxxg\") pod \"network-metrics-daemon-svvql\" (UID: \"979b4064-b4f4-40b8-86f7-cf21c0a62580\") " pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 18:59:44.675357 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674340    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fxqv\" (UniqueName: \"kubernetes.io/projected/10160341-56bd-40f5-8d51-ec008394bca6-kube-api-access-9fxqv\") pod \"aws-ebs-csi-driver-node-xmdc7\" (UID: \"10160341-56bd-40f5-8d51-ec008394bca6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmdc7"
Jul 09 18:59:44.675357 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674362    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e98f3c45-8551-4810-a45c-deebf91e11dc-hosts-file\") pod \"node-resolver-d4hjs\" (UID: \"e98f3c45-8551-4810-a45c-deebf91e11dc\") " pod="openshift-dns/node-resolver-d4hjs"
Jul 09 18:59:44.675357 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674431    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e98f3c45-8551-4810-a45c-deebf91e11dc-tmp-dir\") pod \"node-resolver-d4hjs\" (UID: \"e98f3c45-8551-4810-a45c-deebf91e11dc\") " pod="openshift-dns/node-resolver-d4hjs"
Jul 09 18:59:44.675357 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674462    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-multus-conf-dir\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.675357 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674486    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/605a56fa-674a-44cd-a987-bc27d0fbd80d-serviceca\") pod \"node-ca-vbqbv\" (UID: \"605a56fa-674a-44cd-a987-bc27d0fbd80d\") " pod="openshift-image-registry/node-ca-vbqbv"
Jul 09 18:59:44.675357 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674484    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-multus-socket-dir-parent\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.675357 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674513    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-host-var-lib-kubelet\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.675357 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674536    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgt4x\" (UniqueName: \"kubernetes.io/projected/6ad86949-d001-4b0c-9a59-cebf82ee6604-kube-api-access-zgt4x\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.675357 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674565    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-host-run-k8s-cni-cncf-io\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.675357 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674589    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjvlt\" (UniqueName: \"kubernetes.io/projected/605a56fa-674a-44cd-a987-bc27d0fbd80d-kube-api-access-xjvlt\") pod \"node-ca-vbqbv\" (UID: \"605a56fa-674a-44cd-a987-bc27d0fbd80d\") " pod="openshift-image-registry/node-ca-vbqbv"
Jul 09 18:59:44.675357 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674614    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/456dc88f-d993-4b79-9193-62ee943ea3e6-agent-certs\") pod \"konnectivity-agent-d9whc\" (UID: \"456dc88f-d993-4b79-9193-62ee943ea3e6\") " pod="kube-system/konnectivity-agent-d9whc"
Jul 09 18:59:44.675357 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674635    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/10160341-56bd-40f5-8d51-ec008394bca6-socket-dir\") pod \"aws-ebs-csi-driver-node-xmdc7\" (UID: \"10160341-56bd-40f5-8d51-ec008394bca6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmdc7"
Jul 09 18:59:44.675357 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674655    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/456dc88f-d993-4b79-9193-62ee943ea3e6-konnectivity-ca\") pod \"konnectivity-agent-d9whc\" (UID: \"456dc88f-d993-4b79-9193-62ee943ea3e6\") " pod="kube-system/konnectivity-agent-d9whc"
Jul 09 18:59:44.675357 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674657    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-system-cni-dir\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.675357 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674702    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-system-cni-dir\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.675357 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674713    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-os-release\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.675357 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674742    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-multus-cni-dir\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.675357 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674765    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-hostroot\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.676202 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674791    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/605a56fa-674a-44cd-a987-bc27d0fbd80d-host\") pod \"node-ca-vbqbv\" (UID: \"605a56fa-674a-44cd-a987-bc27d0fbd80d\") " pod="openshift-image-registry/node-ca-vbqbv"
Jul 09 18:59:44.676202 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.674840    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cctmf\" (UniqueName: \"kubernetes.io/projected/4ac17e39-5744-438a-a7ba-eb7c43c8723c-kube-api-access-cctmf\") pod \"iptables-alerter-cdn7k\" (UID: \"4ac17e39-5744-438a-a7ba-eb7c43c8723c\") " pod="openshift-network-operator/iptables-alerter-cdn7k"
Jul 09 18:59:44.676202 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:44.674950    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/979b4064-b4f4-40b8-86f7-cf21c0a62580-metrics-certs podName:979b4064-b4f4-40b8-86f7-cf21c0a62580 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:45.174928518 +0000 UTC m=+3.559998781 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/979b4064-b4f4-40b8-86f7-cf21c0a62580-metrics-certs") pod "network-metrics-daemon-svvql" (UID: "979b4064-b4f4-40b8-86f7-cf21c0a62580") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:59:44.676202 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.675003    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/10160341-56bd-40f5-8d51-ec008394bca6-etc-selinux\") pod \"aws-ebs-csi-driver-node-xmdc7\" (UID: \"10160341-56bd-40f5-8d51-ec008394bca6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmdc7"
Jul 09 18:59:44.676202 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.675061    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6ad86949-d001-4b0c-9a59-cebf82ee6604-cni-binary-copy\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.676202 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.675110    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-host-var-lib-cni-multus\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.676202 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.675167    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-os-release\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.676202 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.675230    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e98f3c45-8551-4810-a45c-deebf91e11dc-hosts-file\") pod \"node-resolver-d4hjs\" (UID: \"e98f3c45-8551-4810-a45c-deebf91e11dc\") " pod="openshift-dns/node-resolver-d4hjs"
Jul 09 18:59:44.676202 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.675237    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-multus-cni-dir\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.676202 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.675457    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-hostroot\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.676202 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.675479    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e98f3c45-8551-4810-a45c-deebf91e11dc-tmp-dir\") pod \"node-resolver-d4hjs\" (UID: \"e98f3c45-8551-4810-a45c-deebf91e11dc\") " pod="openshift-dns/node-resolver-d4hjs"
Jul 09 18:59:44.676202 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.675505    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/605a56fa-674a-44cd-a987-bc27d0fbd80d-host\") pod \"node-ca-vbqbv\" (UID: \"605a56fa-674a-44cd-a987-bc27d0fbd80d\") " pod="openshift-image-registry/node-ca-vbqbv"
Jul 09 18:59:44.676202 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.675532    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-multus-conf-dir\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.676202 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.675545    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6ad86949-d001-4b0c-9a59-cebf82ee6604-multus-daemon-config\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.676202 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.675579    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-host-var-lib-kubelet\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.676202 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.675623    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/10160341-56bd-40f5-8d51-ec008394bca6-device-dir\") pod \"aws-ebs-csi-driver-node-xmdc7\" (UID: \"10160341-56bd-40f5-8d51-ec008394bca6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmdc7"
Jul 09 18:59:44.676202 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.675748    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6ad86949-d001-4b0c-9a59-cebf82ee6604-host-run-k8s-cni-cncf-io\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.676998 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.675891    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/10160341-56bd-40f5-8d51-ec008394bca6-socket-dir\") pod \"aws-ebs-csi-driver-node-xmdc7\" (UID: \"10160341-56bd-40f5-8d51-ec008394bca6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmdc7"
Jul 09 18:59:44.676998 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.676054    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4ac17e39-5744-438a-a7ba-eb7c43c8723c-iptables-alerter-script\") pod \"iptables-alerter-cdn7k\" (UID: \"4ac17e39-5744-438a-a7ba-eb7c43c8723c\") " pod="openshift-network-operator/iptables-alerter-cdn7k"
Jul 09 18:59:44.676998 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.676422    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/605a56fa-674a-44cd-a987-bc27d0fbd80d-serviceca\") pod \"node-ca-vbqbv\" (UID: \"605a56fa-674a-44cd-a987-bc27d0fbd80d\") " pod="openshift-image-registry/node-ca-vbqbv"
Jul 09 18:59:44.678884 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.678864    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/456dc88f-d993-4b79-9193-62ee943ea3e6-agent-certs\") pod \"konnectivity-agent-d9whc\" (UID: \"456dc88f-d993-4b79-9193-62ee943ea3e6\") " pod="kube-system/konnectivity-agent-d9whc"
Jul 09 18:59:44.682235 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:44.682213    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:59:44.682235 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:44.682238    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:59:44.682390 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:44.682250    2577 projected.go:196] Error preparing data for projected volume kube-api-access-2wzc4 for pod openshift-network-diagnostics/network-check-target-fl7kb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:59:44.682390 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:44.682319    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17f98f01-8fb0-47b4-887f-b0de9d0ccade-kube-api-access-2wzc4 podName:17f98f01-8fb0-47b4-887f-b0de9d0ccade nodeName:}" failed. No retries permitted until 2026-07-09 18:59:45.182302748 +0000 UTC m=+3.567373000 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2wzc4" (UniqueName: "kubernetes.io/projected/17f98f01-8fb0-47b4-887f-b0de9d0ccade-kube-api-access-2wzc4") pod "network-check-target-fl7kb" (UID: "17f98f01-8fb0-47b4-887f-b0de9d0ccade") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:59:44.684470 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.684441    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cctmf\" (UniqueName: \"kubernetes.io/projected/4ac17e39-5744-438a-a7ba-eb7c43c8723c-kube-api-access-cctmf\") pod \"iptables-alerter-cdn7k\" (UID: \"4ac17e39-5744-438a-a7ba-eb7c43c8723c\") " pod="openshift-network-operator/iptables-alerter-cdn7k"
Jul 09 18:59:44.685646 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.685601    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjvlt\" (UniqueName: \"kubernetes.io/projected/605a56fa-674a-44cd-a987-bc27d0fbd80d-kube-api-access-xjvlt\") pod \"node-ca-vbqbv\" (UID: \"605a56fa-674a-44cd-a987-bc27d0fbd80d\") " pod="openshift-image-registry/node-ca-vbqbv"
Jul 09 18:59:44.686493 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.686469    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkw98\" (UniqueName: \"kubernetes.io/projected/e98f3c45-8551-4810-a45c-deebf91e11dc-kube-api-access-hkw98\") pod \"node-resolver-d4hjs\" (UID: \"e98f3c45-8551-4810-a45c-deebf91e11dc\") " pod="openshift-dns/node-resolver-d4hjs"
Jul 09 18:59:44.687631 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.687549    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgt4x\" (UniqueName: \"kubernetes.io/projected/6ad86949-d001-4b0c-9a59-cebf82ee6604-kube-api-access-zgt4x\") pod \"multus-gtbdq\" (UID: \"6ad86949-d001-4b0c-9a59-cebf82ee6604\") " pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.687945 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.687912    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kxxg\" (UniqueName: \"kubernetes.io/projected/979b4064-b4f4-40b8-86f7-cf21c0a62580-kube-api-access-4kxxg\") pod \"network-metrics-daemon-svvql\" (UID: \"979b4064-b4f4-40b8-86f7-cf21c0a62580\") " pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 18:59:44.688962 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.688934    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fxqv\" (UniqueName: \"kubernetes.io/projected/10160341-56bd-40f5-8d51-ec008394bca6-kube-api-access-9fxqv\") pod \"aws-ebs-csi-driver-node-xmdc7\" (UID: \"10160341-56bd-40f5-8d51-ec008394bca6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmdc7"
Jul 09 18:59:44.765734 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.765699    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5dbgc"
Jul 09 18:59:44.775029 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.774994    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pfhlb"
Jul 09 18:59:44.784371 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.784346    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 18:59:44.788075 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.788046    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d9whc"
Jul 09 18:59:44.801947 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:44.801913    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod456dc88f_d993_4b79_9193_62ee943ea3e6.slice/crio-b7cab49c30289c45bf041983fe657c7f9985b68bfaceb8a91d775192bdbc6809 WatchSource:0}: Error finding container b7cab49c30289c45bf041983fe657c7f9985b68bfaceb8a91d775192bdbc6809: Status 404 returned error can't find the container with id b7cab49c30289c45bf041983fe657c7f9985b68bfaceb8a91d775192bdbc6809
Jul 09 18:59:44.802054 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.801960    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmdc7"
Jul 09 18:59:44.810193 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.809985    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cdn7k"
Jul 09 18:59:44.814915 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:44.814887    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10160341_56bd_40f5_8d51_ec008394bca6.slice/crio-b5f3d07d585e9f5bc0d5afe896bce508fd770d4ffef54fdd4b95a55a5e3b4d6d WatchSource:0}: Error finding container b5f3d07d585e9f5bc0d5afe896bce508fd770d4ffef54fdd4b95a55a5e3b4d6d: Status 404 returned error can't find the container with id b5f3d07d585e9f5bc0d5afe896bce508fd770d4ffef54fdd4b95a55a5e3b4d6d
Jul 09 18:59:44.819460 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.819381    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gtbdq"
Jul 09 18:59:44.821124 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:44.821094    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ac17e39_5744_438a_a7ba_eb7c43c8723c.slice/crio-f3dedd4ac856ef4c41f79fba307ed1f3a4bbc8be5763736ec99409dffc6bd438 WatchSource:0}: Error finding container f3dedd4ac856ef4c41f79fba307ed1f3a4bbc8be5763736ec99409dffc6bd438: Status 404 returned error can't find the container with id f3dedd4ac856ef4c41f79fba307ed1f3a4bbc8be5763736ec99409dffc6bd438
Jul 09 18:59:44.826515 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.826489    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-d4hjs"
Jul 09 18:59:44.833890 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.833520    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vbqbv"
Jul 09 18:59:44.836956 ip-10-0-137-233 kubenswrapper[2577]: W0709 18:59:44.836929    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode98f3c45_8551_4810_a45c_deebf91e11dc.slice/crio-829ad8c5453c940cee0806f121f1352ebfc620110b332ca27ff25877afad5f44 WatchSource:0}: Error finding container 829ad8c5453c940cee0806f121f1352ebfc620110b332ca27ff25877afad5f44: Status 404 returned error can't find the container with id 829ad8c5453c940cee0806f121f1352ebfc620110b332ca27ff25877afad5f44
Jul 09 18:59:44.912651 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:44.912621    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:59:45.077992 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:45.077901    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67dae793-bded-46b5-8237-b38edbebdc47-original-pull-secret\") pod \"global-pull-secret-syncer-b5s6c\" (UID: \"67dae793-bded-46b5-8237-b38edbebdc47\") " pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 18:59:45.078158 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:45.078074    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:59:45.078158 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:45.078146    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67dae793-bded-46b5-8237-b38edbebdc47-original-pull-secret podName:67dae793-bded-46b5-8237-b38edbebdc47 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:46.07812858 +0000 UTC m=+4.463198838 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67dae793-bded-46b5-8237-b38edbebdc47-original-pull-secret") pod "global-pull-secret-syncer-b5s6c" (UID: "67dae793-bded-46b5-8237-b38edbebdc47") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:59:45.179110 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:45.179065    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/979b4064-b4f4-40b8-86f7-cf21c0a62580-metrics-certs\") pod \"network-metrics-daemon-svvql\" (UID: \"979b4064-b4f4-40b8-86f7-cf21c0a62580\") " pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 18:59:45.179307 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:45.179237    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:59:45.179359 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:45.179326    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/979b4064-b4f4-40b8-86f7-cf21c0a62580-metrics-certs podName:979b4064-b4f4-40b8-86f7-cf21c0a62580 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:46.179303449 +0000 UTC m=+4.564373728 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/979b4064-b4f4-40b8-86f7-cf21c0a62580-metrics-certs") pod "network-metrics-daemon-svvql" (UID: "979b4064-b4f4-40b8-86f7-cf21c0a62580") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:59:45.280456 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:45.280422    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wzc4\" (UniqueName: \"kubernetes.io/projected/17f98f01-8fb0-47b4-887f-b0de9d0ccade-kube-api-access-2wzc4\") pod \"network-check-target-fl7kb\" (UID: \"17f98f01-8fb0-47b4-887f-b0de9d0ccade\") " pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 18:59:45.280632 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:45.280581    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:59:45.280632 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:45.280606    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:59:45.280632 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:45.280618    2577 projected.go:196] Error preparing data for projected volume kube-api-access-2wzc4 for pod openshift-network-diagnostics/network-check-target-fl7kb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:59:45.280763 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:45.280675    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17f98f01-8fb0-47b4-887f-b0de9d0ccade-kube-api-access-2wzc4 podName:17f98f01-8fb0-47b4-887f-b0de9d0ccade nodeName:}" failed. No retries permitted until 2026-07-09 18:59:46.280662232 +0000 UTC m=+4.665732486 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2wzc4" (UniqueName: "kubernetes.io/projected/17f98f01-8fb0-47b4-887f-b0de9d0ccade-kube-api-access-2wzc4") pod "network-check-target-fl7kb" (UID: "17f98f01-8fb0-47b4-887f-b0de9d0ccade") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:59:45.500981 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:45.500916    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 18:54:44 +0000 UTC" deadline="2027-12-30 18:24:29.99572421 +0000 UTC"
Jul 09 18:59:45.500981 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:45.500975    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12935h24m44.494752222s"
Jul 09 18:59:45.535068 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:45.535026    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:59:45.632593 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:45.632547    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 18:59:45.632757 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:45.632700    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5s6c" podUID="67dae793-bded-46b5-8237-b38edbebdc47"
Jul 09 18:59:45.640199 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:45.640156    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bw97f" event={"ID":"89f43e21-1536-46e8-b2d6-f0dd1584613c","Type":"ContainerStarted","Data":"476a54a37215e6e0e2e4fc5fd13980cc0abbc99a6c388a90b49e9a948c4a26bc"}
Jul 09 18:59:45.641356 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:45.641323    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5dbgc" event={"ID":"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f","Type":"ContainerStarted","Data":"dc721603f800ffe8b1ebf9659f4b9f3580942b33ab4317db854ad0133867d837"}
Jul 09 18:59:45.642660 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:45.642613    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vbqbv" event={"ID":"605a56fa-674a-44cd-a987-bc27d0fbd80d","Type":"ContainerStarted","Data":"a0a00a51f1c482f0de7a6e3cea18d9040b5daf1d09975cd8e93fc7e0b3d7a4e4"}
Jul 09 18:59:45.643910 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:45.643886    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-d4hjs" event={"ID":"e98f3c45-8551-4810-a45c-deebf91e11dc","Type":"ContainerStarted","Data":"829ad8c5453c940cee0806f121f1352ebfc620110b332ca27ff25877afad5f44"}
Jul 09 18:59:45.645130 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:45.645089    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gtbdq" event={"ID":"6ad86949-d001-4b0c-9a59-cebf82ee6604","Type":"ContainerStarted","Data":"240081401da4ee87345ce3df74001f6de6872e826712eface7bd2398e277cb96"}
Jul 09 18:59:45.646309 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:45.646285    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cdn7k" event={"ID":"4ac17e39-5744-438a-a7ba-eb7c43c8723c","Type":"ContainerStarted","Data":"f3dedd4ac856ef4c41f79fba307ed1f3a4bbc8be5763736ec99409dffc6bd438"}
Jul 09 18:59:45.647526 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:45.647501    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d9whc" event={"ID":"456dc88f-d993-4b79-9193-62ee943ea3e6","Type":"ContainerStarted","Data":"b7cab49c30289c45bf041983fe657c7f9985b68bfaceb8a91d775192bdbc6809"}
Jul 09 18:59:45.648702 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:45.648674    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pfhlb" event={"ID":"2d7a4519-2a09-4b32-9aba-6caa03ed8d37","Type":"ContainerStarted","Data":"9581725b8ddcfa6c373aaa9ccbf469d4c1d2db784c8eb4e55ded232a7fcdc68d"}
Jul 09 18:59:45.650060 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:45.650039    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmdc7" event={"ID":"10160341-56bd-40f5-8d51-ec008394bca6","Type":"ContainerStarted","Data":"b5f3d07d585e9f5bc0d5afe896bce508fd770d4ffef54fdd4b95a55a5e3b4d6d"}
Jul 09 18:59:46.087878 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:46.087620    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67dae793-bded-46b5-8237-b38edbebdc47-original-pull-secret\") pod \"global-pull-secret-syncer-b5s6c\" (UID: \"67dae793-bded-46b5-8237-b38edbebdc47\") " pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 18:59:46.088034 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:46.087777    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:59:46.088034 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:46.087987    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67dae793-bded-46b5-8237-b38edbebdc47-original-pull-secret podName:67dae793-bded-46b5-8237-b38edbebdc47 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:48.087967428 +0000 UTC m=+6.473037703 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67dae793-bded-46b5-8237-b38edbebdc47-original-pull-secret") pod "global-pull-secret-syncer-b5s6c" (UID: "67dae793-bded-46b5-8237-b38edbebdc47") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:59:46.188604 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:46.188570    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/979b4064-b4f4-40b8-86f7-cf21c0a62580-metrics-certs\") pod \"network-metrics-daemon-svvql\" (UID: \"979b4064-b4f4-40b8-86f7-cf21c0a62580\") " pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 18:59:46.188774 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:46.188748    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:59:46.188856 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:46.188836    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/979b4064-b4f4-40b8-86f7-cf21c0a62580-metrics-certs podName:979b4064-b4f4-40b8-86f7-cf21c0a62580 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:48.188800942 +0000 UTC m=+6.573871195 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/979b4064-b4f4-40b8-86f7-cf21c0a62580-metrics-certs") pod "network-metrics-daemon-svvql" (UID: "979b4064-b4f4-40b8-86f7-cf21c0a62580") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:59:46.290408 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:46.289653    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wzc4\" (UniqueName: \"kubernetes.io/projected/17f98f01-8fb0-47b4-887f-b0de9d0ccade-kube-api-access-2wzc4\") pod \"network-check-target-fl7kb\" (UID: \"17f98f01-8fb0-47b4-887f-b0de9d0ccade\") " pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 18:59:46.290408 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:46.289976    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:59:46.290408 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:46.290005    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:59:46.290408 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:46.290017    2577 projected.go:196] Error preparing data for projected volume kube-api-access-2wzc4 for pod openshift-network-diagnostics/network-check-target-fl7kb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:59:46.290408 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:46.290076    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17f98f01-8fb0-47b4-887f-b0de9d0ccade-kube-api-access-2wzc4 podName:17f98f01-8fb0-47b4-887f-b0de9d0ccade nodeName:}" failed. No retries permitted until 2026-07-09 18:59:48.290058178 +0000 UTC m=+6.675128431 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2wzc4" (UniqueName: "kubernetes.io/projected/17f98f01-8fb0-47b4-887f-b0de9d0ccade-kube-api-access-2wzc4") pod "network-check-target-fl7kb" (UID: "17f98f01-8fb0-47b4-887f-b0de9d0ccade") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:59:46.501350 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:46.501271    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 18:54:44 +0000 UTC" deadline="2028-04-21 01:25:37.4475403 +0000 UTC"
Jul 09 18:59:46.501350 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:46.501312    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15630h25m50.946233021s"
Jul 09 18:59:46.640048 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:46.640012    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 18:59:46.640236 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:46.640194    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fl7kb" podUID="17f98f01-8fb0-47b4-887f-b0de9d0ccade"
Jul 09 18:59:46.640932 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:46.640910    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 18:59:46.641101 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:46.641074    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svvql" podUID="979b4064-b4f4-40b8-86f7-cf21c0a62580"
Jul 09 18:59:46.668517 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:46.668470    2577 generic.go:356] "Generic (PLEG): container finished" podID="3e5d0c8fd52f7be4f7ee3a0e3f7fbf93" containerID="70715f92af2968439c71402142366b57dc77737c700571794ec57d86369a9deb" exitCode=0
Jul 09 18:59:46.668666 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:46.668580    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal" event={"ID":"3e5d0c8fd52f7be4f7ee3a0e3f7fbf93","Type":"ContainerDied","Data":"70715f92af2968439c71402142366b57dc77737c700571794ec57d86369a9deb"}
Jul 09 18:59:46.681894 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:46.681792    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-233.ec2.internal" event={"ID":"dfaa49bed4f018674f19ee2e2bb3d341","Type":"ContainerStarted","Data":"77d4b935bf9bb604b7036585fa233d8590d705b930bdd62d91fb42188d42044c"}
Jul 09 18:59:47.632577 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:47.632542    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 18:59:47.633087 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:47.632680    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5s6c" podUID="67dae793-bded-46b5-8237-b38edbebdc47"
Jul 09 18:59:48.105856 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:48.105227    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67dae793-bded-46b5-8237-b38edbebdc47-original-pull-secret\") pod \"global-pull-secret-syncer-b5s6c\" (UID: \"67dae793-bded-46b5-8237-b38edbebdc47\") " pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 18:59:48.105856 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:48.105426    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:59:48.105856 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:48.105488    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67dae793-bded-46b5-8237-b38edbebdc47-original-pull-secret podName:67dae793-bded-46b5-8237-b38edbebdc47 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:52.1054701 +0000 UTC m=+10.490540357 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67dae793-bded-46b5-8237-b38edbebdc47-original-pull-secret") pod "global-pull-secret-syncer-b5s6c" (UID: "67dae793-bded-46b5-8237-b38edbebdc47") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:59:48.206523 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:48.205941    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/979b4064-b4f4-40b8-86f7-cf21c0a62580-metrics-certs\") pod \"network-metrics-daemon-svvql\" (UID: \"979b4064-b4f4-40b8-86f7-cf21c0a62580\") " pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 18:59:48.206523 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:48.206121    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:59:48.206523 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:48.206183    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/979b4064-b4f4-40b8-86f7-cf21c0a62580-metrics-certs podName:979b4064-b4f4-40b8-86f7-cf21c0a62580 nodeName:}" failed. No retries permitted until 2026-07-09 18:59:52.206164602 +0000 UTC m=+10.591234861 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/979b4064-b4f4-40b8-86f7-cf21c0a62580-metrics-certs") pod "network-metrics-daemon-svvql" (UID: "979b4064-b4f4-40b8-86f7-cf21c0a62580") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:59:48.307126 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:48.307090    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wzc4\" (UniqueName: \"kubernetes.io/projected/17f98f01-8fb0-47b4-887f-b0de9d0ccade-kube-api-access-2wzc4\") pod \"network-check-target-fl7kb\" (UID: \"17f98f01-8fb0-47b4-887f-b0de9d0ccade\") " pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 18:59:48.307311 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:48.307290    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:59:48.307311 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:48.307313    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:59:48.307463 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:48.307326    2577 projected.go:196] Error preparing data for projected volume kube-api-access-2wzc4 for pod openshift-network-diagnostics/network-check-target-fl7kb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:59:48.307463 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:48.307385    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17f98f01-8fb0-47b4-887f-b0de9d0ccade-kube-api-access-2wzc4 podName:17f98f01-8fb0-47b4-887f-b0de9d0ccade nodeName:}" failed. No retries permitted until 2026-07-09 18:59:52.307366608 +0000 UTC m=+10.692436902 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2wzc4" (UniqueName: "kubernetes.io/projected/17f98f01-8fb0-47b4-887f-b0de9d0ccade-kube-api-access-2wzc4") pod "network-check-target-fl7kb" (UID: "17f98f01-8fb0-47b4-887f-b0de9d0ccade") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:59:48.633088 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:48.632648    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 18:59:48.633088 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:48.632655    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 18:59:48.633088 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:48.632797    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svvql" podUID="979b4064-b4f4-40b8-86f7-cf21c0a62580"
Jul 09 18:59:48.633088 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:48.632893    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fl7kb" podUID="17f98f01-8fb0-47b4-887f-b0de9d0ccade"
Jul 09 18:59:49.632748 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:49.632712    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 18:59:49.632945 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:49.632878    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5s6c" podUID="67dae793-bded-46b5-8237-b38edbebdc47"
Jul 09 18:59:50.633022 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:50.632982    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 18:59:50.633473 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:50.633122    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svvql" podUID="979b4064-b4f4-40b8-86f7-cf21c0a62580"
Jul 09 18:59:50.633473 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:50.633186    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 18:59:50.633473 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:50.633272    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fl7kb" podUID="17f98f01-8fb0-47b4-887f-b0de9d0ccade"
Jul 09 18:59:51.632429 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:51.632393    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 18:59:51.632609 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:51.632582    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5s6c" podUID="67dae793-bded-46b5-8237-b38edbebdc47"
Jul 09 18:59:52.137150 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:52.137115    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67dae793-bded-46b5-8237-b38edbebdc47-original-pull-secret\") pod \"global-pull-secret-syncer-b5s6c\" (UID: \"67dae793-bded-46b5-8237-b38edbebdc47\") " pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 18:59:52.137571 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:52.137284    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:59:52.137571 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:52.137360    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67dae793-bded-46b5-8237-b38edbebdc47-original-pull-secret podName:67dae793-bded-46b5-8237-b38edbebdc47 nodeName:}" failed. No retries permitted until 2026-07-09 19:00:00.137339173 +0000 UTC m=+18.522409432 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67dae793-bded-46b5-8237-b38edbebdc47-original-pull-secret") pod "global-pull-secret-syncer-b5s6c" (UID: "67dae793-bded-46b5-8237-b38edbebdc47") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:59:52.238383 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:52.238346    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/979b4064-b4f4-40b8-86f7-cf21c0a62580-metrics-certs\") pod \"network-metrics-daemon-svvql\" (UID: \"979b4064-b4f4-40b8-86f7-cf21c0a62580\") " pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 18:59:52.238575 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:52.238532    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:59:52.238632 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:52.238599    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/979b4064-b4f4-40b8-86f7-cf21c0a62580-metrics-certs podName:979b4064-b4f4-40b8-86f7-cf21c0a62580 nodeName:}" failed. No retries permitted until 2026-07-09 19:00:00.238579094 +0000 UTC m=+18.623649350 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/979b4064-b4f4-40b8-86f7-cf21c0a62580-metrics-certs") pod "network-metrics-daemon-svvql" (UID: "979b4064-b4f4-40b8-86f7-cf21c0a62580") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:59:52.339371 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:52.339334    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wzc4\" (UniqueName: \"kubernetes.io/projected/17f98f01-8fb0-47b4-887f-b0de9d0ccade-kube-api-access-2wzc4\") pod \"network-check-target-fl7kb\" (UID: \"17f98f01-8fb0-47b4-887f-b0de9d0ccade\") " pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 18:59:52.339531 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:52.339476    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:59:52.339531 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:52.339502    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:59:52.339531 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:52.339513    2577 projected.go:196] Error preparing data for projected volume kube-api-access-2wzc4 for pod openshift-network-diagnostics/network-check-target-fl7kb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:59:52.339648 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:52.339578    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17f98f01-8fb0-47b4-887f-b0de9d0ccade-kube-api-access-2wzc4 podName:17f98f01-8fb0-47b4-887f-b0de9d0ccade nodeName:}" failed. No retries permitted until 2026-07-09 19:00:00.339558006 +0000 UTC m=+18.724628259 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2wzc4" (UniqueName: "kubernetes.io/projected/17f98f01-8fb0-47b4-887f-b0de9d0ccade-kube-api-access-2wzc4") pod "network-check-target-fl7kb" (UID: "17f98f01-8fb0-47b4-887f-b0de9d0ccade") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:59:52.633494 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:52.633452    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 18:59:52.633668 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:52.633569    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fl7kb" podUID="17f98f01-8fb0-47b4-887f-b0de9d0ccade"
Jul 09 18:59:52.633668 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:52.633628    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 18:59:52.633780 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:52.633761    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svvql" podUID="979b4064-b4f4-40b8-86f7-cf21c0a62580"
Jul 09 18:59:53.632766 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:53.632716    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 18:59:53.633246 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:53.632874    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5s6c" podUID="67dae793-bded-46b5-8237-b38edbebdc47"
Jul 09 18:59:54.633497 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:54.633462    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 18:59:54.633497 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:54.633480    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 18:59:54.634056 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:54.633592    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fl7kb" podUID="17f98f01-8fb0-47b4-887f-b0de9d0ccade"
Jul 09 18:59:54.634056 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:54.633673    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svvql" podUID="979b4064-b4f4-40b8-86f7-cf21c0a62580"
Jul 09 18:59:55.633160 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:55.633133    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 18:59:55.633285 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:55.633259    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5s6c" podUID="67dae793-bded-46b5-8237-b38edbebdc47"
Jul 09 18:59:55.713729 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:55.713454    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal" event={"ID":"3e5d0c8fd52f7be4f7ee3a0e3f7fbf93","Type":"ContainerStarted","Data":"f04a27a3a22f27a841e5b1c273c85cf8ab184cc7d3edbbd5a336af7a77623c1b"}
Jul 09 18:59:55.715588 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:55.715471    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmdc7" event={"ID":"10160341-56bd-40f5-8d51-ec008394bca6","Type":"ContainerStarted","Data":"26c07180e48284518d4967d2bb27537929a0af8898c7443a0a02fe87d3433db9"}
Jul 09 18:59:55.717273 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:55.717246    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5dbgc" event={"ID":"0f4d2f14-bdbf-4b67-820b-cbb863aaad2f","Type":"ContainerStarted","Data":"3045a2c814f66254b01ede730139632beca5b4ddc27176d879c5cdd867d12a4d"}
Jul 09 18:59:55.719293 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:55.719162    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vbqbv" event={"ID":"605a56fa-674a-44cd-a987-bc27d0fbd80d","Type":"ContainerStarted","Data":"7453b35bd512878af9eaa26f308ce270820bf4f550042beebb45c0b57b3aaa1f"}
Jul 09 18:59:55.720945 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:55.720922    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-d4hjs" event={"ID":"e98f3c45-8551-4810-a45c-deebf91e11dc","Type":"ContainerStarted","Data":"0c8d6f13fbc764153d22e0022ba309c0fb053d493dc571cf88a025c6d259232c"}
Jul 09 18:59:55.722644 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:55.722623    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d9whc" event={"ID":"456dc88f-d993-4b79-9193-62ee943ea3e6","Type":"ContainerStarted","Data":"aca2475143beed03f91c608f2efac40ea18ca5ff613c0d2bc7b2ea91ba26f7a2"}
Jul 09 18:59:55.724640 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:55.724615    2577 generic.go:356] "Generic (PLEG): container finished" podID="2d7a4519-2a09-4b32-9aba-6caa03ed8d37" containerID="1199b54b7f4e5c6b569cd708dad00bd6571ff2b93de6e4e35511dc14b5c6002d" exitCode=0
Jul 09 18:59:55.724790 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:55.724651    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pfhlb" event={"ID":"2d7a4519-2a09-4b32-9aba-6caa03ed8d37","Type":"ContainerDied","Data":"1199b54b7f4e5c6b569cd708dad00bd6571ff2b93de6e4e35511dc14b5c6002d"}
Jul 09 18:59:55.729778 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:55.729732    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-233.ec2.internal" podStartSLOduration=12.729715241 podStartE2EDuration="12.729715241s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:59:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:59:46.700647886 +0000 UTC m=+5.085718162" watchObservedRunningTime="2026-07-09 18:59:55.729715241 +0000 UTC m=+14.114785516"
Jul 09 18:59:55.729907 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:55.729874    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-233.ec2.internal" podStartSLOduration=12.729867867 podStartE2EDuration="12.729867867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:59:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:59:55.72947867 +0000 UTC m=+14.114548946" watchObservedRunningTime="2026-07-09 18:59:55.729867867 +0000 UTC m=+14.114938142"
Jul 09 18:59:55.746484 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:55.746426    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-d4hjs" podStartSLOduration=3.5188451560000003 podStartE2EDuration="13.74640009s" totalImagesPullingTime="10.227554934s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:59:55.746399565 +0000 UTC m=+14.131469841" watchObservedRunningTime="2026-07-09 18:59:55.74640009 +0000 UTC m=+14.131470366"
Jul 09 18:59:55.762115 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:55.762024    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vbqbv" podStartSLOduration=3.519155117 podStartE2EDuration="13.762002761s" totalImagesPullingTime="10.242847644s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:59:55.761178654 +0000 UTC m=+14.146248930" watchObservedRunningTime="2026-07-09 18:59:55.762002761 +0000 UTC m=+14.147073038"
Jul 09 18:59:55.781971 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:55.779564    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5dbgc" podStartSLOduration=3.155983552 podStartE2EDuration="13.779544565s" totalImagesPullingTime="10.623561013s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:59:55.779007132 +0000 UTC m=+14.164077402" watchObservedRunningTime="2026-07-09 18:59:55.779544565 +0000 UTC m=+14.164614843"
Jul 09 18:59:55.850267 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:55.850189    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 18:59:55.942244 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:55.942187    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 18:59:56.633003 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:56.632432    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 18:59:56.633003 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:56.632459    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 18:59:56.633003 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:56.632598    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svvql" podUID="979b4064-b4f4-40b8-86f7-cf21c0a62580"
Jul 09 18:59:56.633003 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:56.632669    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fl7kb" podUID="17f98f01-8fb0-47b4-887f-b0de9d0ccade"
Jul 09 18:59:56.639096 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:56.639066    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 18:59:56.728468 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:56.728440    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cdn7k" event={"ID":"4ac17e39-5744-438a-a7ba-eb7c43c8723c","Type":"ContainerStarted","Data":"0d5e8761ef9d1eaf7e546b300fbcf3cd7f7859a2413d3bae418f6e5680924055"}
Jul 09 18:59:56.732733 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:56.732704    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 18:59:56.749767 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:56.749736    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-d9whc"
Jul 09 18:59:56.750373 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:56.750353    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-d9whc"
Jul 09 18:59:56.771988 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:56.771933    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-d9whc" podStartSLOduration=4.484199961 podStartE2EDuration="14.771911372s" totalImagesPullingTime="10.287711411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:59:55.822096855 +0000 UTC m=+14.207167128" watchObservedRunningTime="2026-07-09 18:59:56.771911372 +0000 UTC m=+15.156981648"
Jul 09 18:59:57.222866 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:57.222833    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 18:59:57.321244 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:57.321202    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 18:59:57.421211 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:57.421178    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 18:59:57.521845 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:57.521555    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 18:59:57.632332 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:57.632301    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 18:59:57.632520 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:57.632426    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5s6c" podUID="67dae793-bded-46b5-8237-b38edbebdc47"
Jul 09 18:59:57.749159 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:57.749108    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cdn7k" podStartSLOduration=5.506341341 podStartE2EDuration="15.749091548s" totalImagesPullingTime="10.242750207s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:59:57.748544466 +0000 UTC m=+16.133614742" watchObservedRunningTime="2026-07-09 18:59:57.749091548 +0000 UTC m=+16.134161850"
Jul 09 18:59:58.031795 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:58.031746    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 18:59:58.185284 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:58.185226    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 18:59:58.288031 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:58.287868    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 18:59:58.460123 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:58.460085    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 18:59:58.525009 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:58.524970    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 18:59:58.583772 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:58.583673    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 18:59:58.632705 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:58.632672    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 18:59:58.632880 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:58.632713    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 18:59:58.632880 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:58.632794    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svvql" podUID="979b4064-b4f4-40b8-86f7-cf21c0a62580"
Jul 09 18:59:58.633010 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:58.632911    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fl7kb" podUID="17f98f01-8fb0-47b4-887f-b0de9d0ccade"
Jul 09 18:59:58.684531 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:58.684491    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 18:59:58.732526 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:58.732495    2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 09 18:59:59.183864 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:59.183800    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 18:59:59.241117 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:59.241079    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 18:59:59.633015 ip-10-0-137-233 kubenswrapper[2577]: I0709 18:59:59.632934    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 18:59:59.633230 ip-10-0-137-233 kubenswrapper[2577]: E0709 18:59:59.633069    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5s6c" podUID="67dae793-bded-46b5-8237-b38edbebdc47"
Jul 09 19:00:00.208082 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:00.208045    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67dae793-bded-46b5-8237-b38edbebdc47-original-pull-secret\") pod \"global-pull-secret-syncer-b5s6c\" (UID: \"67dae793-bded-46b5-8237-b38edbebdc47\") " pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 19:00:00.208712 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:00.208165    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 19:00:00.208712 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:00.208235    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67dae793-bded-46b5-8237-b38edbebdc47-original-pull-secret podName:67dae793-bded-46b5-8237-b38edbebdc47 nodeName:}" failed. No retries permitted until 2026-07-09 19:00:16.208218303 +0000 UTC m=+34.593288569 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67dae793-bded-46b5-8237-b38edbebdc47-original-pull-secret") pod "global-pull-secret-syncer-b5s6c" (UID: "67dae793-bded-46b5-8237-b38edbebdc47") : object "kube-system"/"original-pull-secret" not registered
Jul 09 19:00:00.308906 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:00.308865    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/979b4064-b4f4-40b8-86f7-cf21c0a62580-metrics-certs\") pod \"network-metrics-daemon-svvql\" (UID: \"979b4064-b4f4-40b8-86f7-cf21c0a62580\") " pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 19:00:00.309093 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:00.309013    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 19:00:00.309093 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:00.309076    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/979b4064-b4f4-40b8-86f7-cf21c0a62580-metrics-certs podName:979b4064-b4f4-40b8-86f7-cf21c0a62580 nodeName:}" failed. No retries permitted until 2026-07-09 19:00:16.3090593 +0000 UTC m=+34.694129553 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/979b4064-b4f4-40b8-86f7-cf21c0a62580-metrics-certs") pod "network-metrics-daemon-svvql" (UID: "979b4064-b4f4-40b8-86f7-cf21c0a62580") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 19:00:00.409756 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:00.409720    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wzc4\" (UniqueName: \"kubernetes.io/projected/17f98f01-8fb0-47b4-887f-b0de9d0ccade-kube-api-access-2wzc4\") pod \"network-check-target-fl7kb\" (UID: \"17f98f01-8fb0-47b4-887f-b0de9d0ccade\") " pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 19:00:00.409969 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:00.409942    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 19:00:00.410042 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:00.409973    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 19:00:00.410042 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:00.409985    2577 projected.go:196] Error preparing data for projected volume kube-api-access-2wzc4 for pod openshift-network-diagnostics/network-check-target-fl7kb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 19:00:00.410122 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:00.410046    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17f98f01-8fb0-47b4-887f-b0de9d0ccade-kube-api-access-2wzc4 podName:17f98f01-8fb0-47b4-887f-b0de9d0ccade nodeName:}" failed. No retries permitted until 2026-07-09 19:00:16.410030816 +0000 UTC m=+34.795101070 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2wzc4" (UniqueName: "kubernetes.io/projected/17f98f01-8fb0-47b4-887f-b0de9d0ccade-kube-api-access-2wzc4") pod "network-check-target-fl7kb" (UID: "17f98f01-8fb0-47b4-887f-b0de9d0ccade") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 19:00:00.633454 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:00.633361    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 19:00:00.633454 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:00.633378    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 19:00:00.633669 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:00.633511    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fl7kb" podUID="17f98f01-8fb0-47b4-887f-b0de9d0ccade"
Jul 09 19:00:00.633669 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:00.633564    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svvql" podUID="979b4064-b4f4-40b8-86f7-cf21c0a62580"
Jul 09 19:00:01.632951 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:01.632916    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 19:00:01.633357 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:01.633046    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5s6c" podUID="67dae793-bded-46b5-8237-b38edbebdc47"
Jul 09 19:00:02.220046 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:02.220005    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:02.427628 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:02.427591    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:02.634006 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:02.633680    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 19:00:02.634424 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:02.633765    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 19:00:02.634424 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:02.634061    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fl7kb" podUID="17f98f01-8fb0-47b4-887f-b0de9d0ccade"
Jul 09 19:00:02.634424 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:02.634166    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svvql" podUID="979b4064-b4f4-40b8-86f7-cf21c0a62580"
Jul 09 19:00:02.824033 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:02.823992    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:02.918796 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:02.918761    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:03.221328 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:03.221239    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:03.319263 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:03.319224    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:03.530018 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:03.529941    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-d4hjs_e98f3c45-8551-4810-a45c-deebf91e11dc/dns-node-resolver/0.log"
Jul 09 19:00:03.633325 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:03.633290    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 19:00:03.633539 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:03.633410    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5s6c" podUID="67dae793-bded-46b5-8237-b38edbebdc47"
Jul 09 19:00:04.633031 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:04.632992    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 19:00:04.633450 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:04.632993    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 19:00:04.633450 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:04.633121    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svvql" podUID="979b4064-b4f4-40b8-86f7-cf21c0a62580"
Jul 09 19:00:04.633450 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:04.633201    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fl7kb" podUID="17f98f01-8fb0-47b4-887f-b0de9d0ccade"
Jul 09 19:00:04.754246 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:04.754212    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:04.811642 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:04.811605    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:04.930689 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:04.930661    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vbqbv_605a56fa-674a-44cd-a987-bc27d0fbd80d/node-ca/0.log"
Jul 09 19:00:05.624683 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:05.624647    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:05.632448 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:05.632420    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 19:00:05.632612 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:05.632539    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5s6c" podUID="67dae793-bded-46b5-8237-b38edbebdc47"
Jul 09 19:00:05.713699 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:05.713661    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:05.814022 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:05.813984    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:05.919186 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:05.919155    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:06.057738 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:06.057708    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-d9whc"
Jul 09 19:00:06.057940 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:06.057865    2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 09 19:00:06.058738 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:06.058690    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-d9whc"
Jul 09 19:00:06.560849 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:06.560789    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:06.632928 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:06.632896    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 19:00:06.633108 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:06.633032    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fl7kb" podUID="17f98f01-8fb0-47b4-887f-b0de9d0ccade"
Jul 09 19:00:06.633108 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:06.633091    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 19:00:06.633219 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:06.633204    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svvql" podUID="979b4064-b4f4-40b8-86f7-cf21c0a62580"
Jul 09 19:00:06.660938 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:06.660888    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:06.859608 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:06.859523    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:06.961584 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:06.961553    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:07.207952 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:07.207914    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:07.269908 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:07.269831    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:07.372376 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:07.372333    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:07.431096 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:07.431059    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 19:00:07.535592 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:07.535496    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T19:00:07.431072126Z","UUID":"b0135c61-3254-443e-a7fc-47d8506dce3f","Handler":null,"Name":"","Endpoint":""}
Jul 09 19:00:07.537987 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:07.537225    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 19:00:07.537987 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:07.537282    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 19:00:07.632524 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:07.632500    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 19:00:07.632642 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:07.632596    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5s6c" podUID="67dae793-bded-46b5-8237-b38edbebdc47"
Jul 09 19:00:07.752707 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:07.752677    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmdc7" event={"ID":"10160341-56bd-40f5-8d51-ec008394bca6","Type":"ContainerStarted","Data":"f9df60eec8cc22ceefec461dcfd8bb23158aa40cac5519423aaf990686e714c2"}
Jul 09 19:00:07.754964 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:07.754936    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bw97f" event={"ID":"89f43e21-1536-46e8-b2d6-f0dd1584613c","Type":"ContainerStarted","Data":"e0a583e96b044301b79009c7f21e420d36a64d273999faa05a0cc943f721a1ca"}
Jul 09 19:00:07.755075 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:07.754999    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bw97f" event={"ID":"89f43e21-1536-46e8-b2d6-f0dd1584613c","Type":"ContainerStarted","Data":"ad80145404c32f9ed027c64482c42ccc50600e968e8b6db3d29dcbc604a7e26a"}
Jul 09 19:00:07.755075 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:07.755028    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bw97f" event={"ID":"89f43e21-1536-46e8-b2d6-f0dd1584613c","Type":"ContainerStarted","Data":"14745404da06bb89fb8f7cc77b2506127b8709b3259ca6ca31f633e1ec0dfd78"}
Jul 09 19:00:07.755075 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:07.755057    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bw97f" event={"ID":"89f43e21-1536-46e8-b2d6-f0dd1584613c","Type":"ContainerStarted","Data":"5a4b5cb09704371cb2aaf996b2fe36119ded252ccec60d22f34290c4fd4c2f67"}
Jul 09 19:00:07.756217 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:07.756196    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gtbdq" event={"ID":"6ad86949-d001-4b0c-9a59-cebf82ee6604","Type":"ContainerStarted","Data":"02b68f9ec77b497e9f92a3d4705c4a4a652652fdd471f9a6ebc8b6d9c24806b0"}
Jul 09 19:00:07.757912 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:07.757893    2577 generic.go:356] "Generic (PLEG): container finished" podID="2d7a4519-2a09-4b32-9aba-6caa03ed8d37" containerID="1abda1fb6c134a8e8f4eb3f4048026da8758ae2e41612d31e55aba61581499e9" exitCode=0
Jul 09 19:00:07.757976 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:07.757926    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pfhlb" event={"ID":"2d7a4519-2a09-4b32-9aba-6caa03ed8d37","Type":"ContainerDied","Data":"1abda1fb6c134a8e8f4eb3f4048026da8758ae2e41612d31e55aba61581499e9"}
Jul 09 19:00:07.799176 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:07.799134    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gtbdq" podStartSLOduration=3.365308544 podStartE2EDuration="25.799118629s" totalImagesPullingTime="22.433810085s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:07.798979181 +0000 UTC m=+26.184049457" watchObservedRunningTime="2026-07-09 19:00:07.799118629 +0000 UTC m=+26.184188904"
Jul 09 19:00:07.944410 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:07.944379    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:08.492824 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:08.492770    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:08.593845 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:08.593746    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:08.633035 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:08.632998    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 19:00:08.633214 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:08.633003    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 19:00:08.633214 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:08.633123    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fl7kb" podUID="17f98f01-8fb0-47b4-887f-b0de9d0ccade"
Jul 09 19:00:08.633214 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:08.633204    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svvql" podUID="979b4064-b4f4-40b8-86f7-cf21c0a62580"
Jul 09 19:00:08.763126 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:08.763091    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bw97f" event={"ID":"89f43e21-1536-46e8-b2d6-f0dd1584613c","Type":"ContainerStarted","Data":"df66cb84db89bccfb7e0e58cf1cfe64979757079100f6e23a5b5c953177ee265"}
Jul 09 19:00:08.763333 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:08.763183    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bw97f" event={"ID":"89f43e21-1536-46e8-b2d6-f0dd1584613c","Type":"ContainerStarted","Data":"f1da2104afebd5274e7f1c0d85b1b0f90fd2a2d7caeb1a6e1a7a651e6ac2037a"}
Jul 09 19:00:09.102223 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:09.102188    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:09.299875 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:09.299838    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:09.497442 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:09.497411    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:09.632755 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:09.632724    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 19:00:09.632950 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:09.632846    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5s6c" podUID="67dae793-bded-46b5-8237-b38edbebdc47"
Jul 09 19:00:09.767447 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:09.767365    2577 generic.go:356] "Generic (PLEG): container finished" podID="2d7a4519-2a09-4b32-9aba-6caa03ed8d37" containerID="511f8ed8554e444411f953574e7e51227759420f36e83091d9ea27a9025acfea" exitCode=0
Jul 09 19:00:09.767447 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:09.767429    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pfhlb" event={"ID":"2d7a4519-2a09-4b32-9aba-6caa03ed8d37","Type":"ContainerDied","Data":"511f8ed8554e444411f953574e7e51227759420f36e83091d9ea27a9025acfea"}
Jul 09 19:00:09.900490 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:09.900454    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:10.290952 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:10.290924    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:10.632754 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:10.632714    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 19:00:10.633033 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:10.632857    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fl7kb" podUID="17f98f01-8fb0-47b4-887f-b0de9d0ccade"
Jul 09 19:00:10.633033 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:10.632889    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 19:00:10.633033 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:10.632991    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svvql" podUID="979b4064-b4f4-40b8-86f7-cf21c0a62580"
Jul 09 19:00:10.772112 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:10.772076    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmdc7" event={"ID":"10160341-56bd-40f5-8d51-ec008394bca6","Type":"ContainerStarted","Data":"e89bbec18c265ed688ac198af0651ab8f99efe3d09e4fcf4875b025f783529ca"}
Jul 09 19:00:10.775334 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:10.775309    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bw97f" event={"ID":"89f43e21-1536-46e8-b2d6-f0dd1584613c","Type":"ContainerStarted","Data":"6786438be720a9dc32c987c22c43c4e628d668a9841d6a13f80d81fe3c065011"}
Jul 09 19:00:10.838658 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:10.838627    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:10.909533 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:10.909493    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:11.293996 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:11.293912    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:11.490480 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:11.490442    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:11.580742 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:11.580655    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:11.632983 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:11.632954    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 19:00:11.633109 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:11.633057    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5s6c" podUID="67dae793-bded-46b5-8237-b38edbebdc47"
Jul 09 19:00:11.779456 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:11.779421    2577 generic.go:356] "Generic (PLEG): container finished" podID="2d7a4519-2a09-4b32-9aba-6caa03ed8d37" containerID="e51b3f404c73905911927f1e4a2ce302ed8253b54a35ab8573703078762be2d6" exitCode=0
Jul 09 19:00:11.779605 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:11.779511    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pfhlb" event={"ID":"2d7a4519-2a09-4b32-9aba-6caa03ed8d37","Type":"ContainerDied","Data":"e51b3f404c73905911927f1e4a2ce302ed8253b54a35ab8573703078762be2d6"}
Jul 09 19:00:11.803588 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:11.803532    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xmdc7" podStartSLOduration=5.092934131 podStartE2EDuration="29.803517809s" totalImagesPullingTime="24.710583678s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:59:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:10.797429637 +0000 UTC m=+29.182499912" watchObservedRunningTime="2026-07-09 19:00:11.803517809 +0000 UTC m=+30.188588135"
Jul 09 19:00:11.900889 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:11.900848    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:12.634158 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:12.633830    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 19:00:12.634158 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:12.633859    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 19:00:12.634777 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:12.634153    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fl7kb" podUID="17f98f01-8fb0-47b4-887f-b0de9d0ccade"
Jul 09 19:00:12.634777 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:12.634226    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svvql" podUID="979b4064-b4f4-40b8-86f7-cf21c0a62580"
Jul 09 19:00:12.697245 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:12.697197    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:12.785454 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:12.785417    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bw97f" event={"ID":"89f43e21-1536-46e8-b2d6-f0dd1584613c","Type":"ContainerStarted","Data":"240d562736d6268e7d29d4ccb8bda7b461814697bed5ca49a925210d2c7d6c79"}
Jul 09 19:00:12.785733 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:12.785718    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 19:00:12.785876 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:12.785783    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 19:00:12.801781 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:12.801753    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 19:00:12.819143 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:12.818165    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bw97f" podStartSLOduration=8.323138115 podStartE2EDuration="30.818143964s" totalImagesPullingTime="22.495005849s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:12.817436781 +0000 UTC m=+31.202507058" watchObservedRunningTime="2026-07-09 19:00:12.818143964 +0000 UTC m=+31.203214239"
Jul 09 19:00:12.891280 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:12.891238    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:13.462420 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:13.462379    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:13.562833 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:13.562786    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:13.633097 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:13.633062    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 19:00:13.633257 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:13.633201    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5s6c" podUID="67dae793-bded-46b5-8237-b38edbebdc47"
Jul 09 19:00:13.689905 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:13.689873    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:13.788309 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:13.788228    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 19:00:13.805435 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:13.805405    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 19:00:14.632678 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:14.632634    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 19:00:14.633003 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:14.632646    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 19:00:14.633003 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:14.632745    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svvql" podUID="979b4064-b4f4-40b8-86f7-cf21c0a62580"
Jul 09 19:00:14.633003 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:14.632838    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fl7kb" podUID="17f98f01-8fb0-47b4-887f-b0de9d0ccade"
Jul 09 19:00:14.692890 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:14.692854    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:15.059594 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:15.059560    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:15.346716 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:15.346611    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:15.499335 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:15.499303    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:15.632889 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:15.632796    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 19:00:15.633055 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:15.632917    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5s6c" podUID="67dae793-bded-46b5-8237-b38edbebdc47"
Jul 09 19:00:16.095196 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:16.095151    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:16.233982 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:16.233949    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67dae793-bded-46b5-8237-b38edbebdc47-original-pull-secret\") pod \"global-pull-secret-syncer-b5s6c\" (UID: \"67dae793-bded-46b5-8237-b38edbebdc47\") " pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 19:00:16.234136 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:16.234094    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 19:00:16.234185 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:16.234162    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67dae793-bded-46b5-8237-b38edbebdc47-original-pull-secret podName:67dae793-bded-46b5-8237-b38edbebdc47 nodeName:}" failed. No retries permitted until 2026-07-09 19:00:48.234141631 +0000 UTC m=+66.619211902 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/67dae793-bded-46b5-8237-b38edbebdc47-original-pull-secret") pod "global-pull-secret-syncer-b5s6c" (UID: "67dae793-bded-46b5-8237-b38edbebdc47") : object "kube-system"/"original-pull-secret" not registered
Jul 09 19:00:16.335024 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:16.334993    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/979b4064-b4f4-40b8-86f7-cf21c0a62580-metrics-certs\") pod \"network-metrics-daemon-svvql\" (UID: \"979b4064-b4f4-40b8-86f7-cf21c0a62580\") " pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 19:00:16.335189 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:16.335168    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 19:00:16.335255 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:16.335244    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/979b4064-b4f4-40b8-86f7-cf21c0a62580-metrics-certs podName:979b4064-b4f4-40b8-86f7-cf21c0a62580 nodeName:}" failed. No retries permitted until 2026-07-09 19:00:48.335222179 +0000 UTC m=+66.720292438 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/979b4064-b4f4-40b8-86f7-cf21c0a62580-metrics-certs") pod "network-metrics-daemon-svvql" (UID: "979b4064-b4f4-40b8-86f7-cf21c0a62580") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 19:00:16.435547 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:16.435512    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wzc4\" (UniqueName: \"kubernetes.io/projected/17f98f01-8fb0-47b4-887f-b0de9d0ccade-kube-api-access-2wzc4\") pod \"network-check-target-fl7kb\" (UID: \"17f98f01-8fb0-47b4-887f-b0de9d0ccade\") " pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 19:00:16.435719 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:16.435657    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 19:00:16.435719 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:16.435686    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 19:00:16.435719 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:16.435697    2577 projected.go:196] Error preparing data for projected volume kube-api-access-2wzc4 for pod openshift-network-diagnostics/network-check-target-fl7kb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 19:00:16.435870 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:16.435747    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/17f98f01-8fb0-47b4-887f-b0de9d0ccade-kube-api-access-2wzc4 podName:17f98f01-8fb0-47b4-887f-b0de9d0ccade nodeName:}" failed. No retries permitted until 2026-07-09 19:00:48.435732754 +0000 UTC m=+66.820803007 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2wzc4" (UniqueName: "kubernetes.io/projected/17f98f01-8fb0-47b4-887f-b0de9d0ccade-kube-api-access-2wzc4") pod "network-check-target-fl7kb" (UID: "17f98f01-8fb0-47b4-887f-b0de9d0ccade") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 19:00:16.633318 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:16.633284    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 19:00:16.633508 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:16.633286    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 19:00:16.633508 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:16.633416    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fl7kb" podUID="17f98f01-8fb0-47b4-887f-b0de9d0ccade"
Jul 09 19:00:16.633508 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:16.633498    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svvql" podUID="979b4064-b4f4-40b8-86f7-cf21c0a62580"
Jul 09 19:00:16.963700 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:16.963660    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:17.020898 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:17.020858    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:17.101894 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:17.101851    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:17.329425 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:17.329302    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:17.633215 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:17.633138    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 19:00:17.633351 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:17.633244    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5s6c" podUID="67dae793-bded-46b5-8237-b38edbebdc47"
Jul 09 19:00:18.633220 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:18.633176    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 19:00:18.633220 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:18.633226    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 19:00:18.633690 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:18.633314    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svvql" podUID="979b4064-b4f4-40b8-86f7-cf21c0a62580"
Jul 09 19:00:18.633690 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:18.633431    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fl7kb" podUID="17f98f01-8fb0-47b4-887f-b0de9d0ccade"
Jul 09 19:00:18.802466 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:18.802430    2577 generic.go:356] "Generic (PLEG): container finished" podID="2d7a4519-2a09-4b32-9aba-6caa03ed8d37" containerID="2049252c29a6a9d6fdf66d8edab5896fda2b6411993947d820df0773bd67444d" exitCode=0
Jul 09 19:00:18.802622 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:18.802479    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pfhlb" event={"ID":"2d7a4519-2a09-4b32-9aba-6caa03ed8d37","Type":"ContainerDied","Data":"2049252c29a6a9d6fdf66d8edab5896fda2b6411993947d820df0773bd67444d"}
Jul 09 19:00:18.871721 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:18.871693    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:19.633163 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:19.633128    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 19:00:19.633335 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:19.633237    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5s6c" podUID="67dae793-bded-46b5-8237-b38edbebdc47"
Jul 09 19:00:19.807229 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:19.807200    2577 generic.go:356] "Generic (PLEG): container finished" podID="2d7a4519-2a09-4b32-9aba-6caa03ed8d37" containerID="176ae8840b94279ed6c037de517308a025fad53a5462fc3a079204c67b014e76" exitCode=0
Jul 09 19:00:19.807381 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:19.807253    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pfhlb" event={"ID":"2d7a4519-2a09-4b32-9aba-6caa03ed8d37","Type":"ContainerDied","Data":"176ae8840b94279ed6c037de517308a025fad53a5462fc3a079204c67b014e76"}
Jul 09 19:00:19.984041 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:19.984000    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:20.443871 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:20.443835    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:20.496743 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:20.496710    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:20.633182 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:20.633140    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 19:00:20.633364 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:20.633277    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fl7kb" podUID="17f98f01-8fb0-47b4-887f-b0de9d0ccade"
Jul 09 19:00:20.633364 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:20.633329    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 19:00:20.633740 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:20.633459    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svvql" podUID="979b4064-b4f4-40b8-86f7-cf21c0a62580"
Jul 09 19:00:20.659909 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:20.659866    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:20.760119 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:20.760029    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:20.812517 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:20.812489    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pfhlb" event={"ID":"2d7a4519-2a09-4b32-9aba-6caa03ed8d37","Type":"ContainerStarted","Data":"4bc7cef29eeab64a72373553489847534061f839127894f132edc624051280cc"}
Jul 09 19:00:20.838207 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:20.838161    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pfhlb" podStartSLOduration=8.464786443 podStartE2EDuration="38.83814524s" totalImagesPullingTime="30.373358797s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:59:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:20.837399415 +0000 UTC m=+39.222469700" watchObservedRunningTime="2026-07-09 19:00:20.83814524 +0000 UTC m=+39.223215518"
Jul 09 19:00:21.061960 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:21.061876    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:21.128856 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:21.128803    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:21.632777 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:21.632748    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 19:00:21.632953 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:21.632857    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5s6c" podUID="67dae793-bded-46b5-8237-b38edbebdc47"
Jul 09 19:00:21.687398 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:21.687368    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:21.748104 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:21.748068    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:21.834022 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:21.833981    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:21.935168 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:21.935139    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:22.633119 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:22.633087    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 19:00:22.633314 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:22.633155    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 19:00:22.633314 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:22.633174    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svvql" podUID="979b4064-b4f4-40b8-86f7-cf21c0a62580"
Jul 09 19:00:22.633314 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:22.633229    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fl7kb" podUID="17f98f01-8fb0-47b4-887f-b0de9d0ccade"
Jul 09 19:00:22.890499 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:22.890467    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:22.991733 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:22.991692    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:23.633147 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:23.633112    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 19:00:23.633296 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:23.633213    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5s6c" podUID="67dae793-bded-46b5-8237-b38edbebdc47"
Jul 09 19:00:23.752061 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:23.752018    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:23.884351 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:23.884270    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:23.981684 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:23.981650    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:24.082931 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:24.082897    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:24.182556 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:24.182527    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:24.632879 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:24.632771    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 19:00:24.633021 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:24.632783    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 19:00:24.633021 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:24.632927    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fl7kb" podUID="17f98f01-8fb0-47b4-887f-b0de9d0ccade"
Jul 09 19:00:24.633021 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:24.632977    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svvql" podUID="979b4064-b4f4-40b8-86f7-cf21c0a62580"
Jul 09 19:00:24.733189 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:24.733098    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:25.126423 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:25.126382    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:25.350462 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:25.350427    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:25.632612 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:25.632444    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 19:00:25.632742 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:25.632684    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5s6c" podUID="67dae793-bded-46b5-8237-b38edbebdc47"
Jul 09 19:00:25.776533 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:25.776502    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b5s6c"]
Jul 09 19:00:25.779936 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:25.779909    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fl7kb"]
Jul 09 19:00:25.780090 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:25.780003    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 19:00:25.780152 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:25.780106    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fl7kb" podUID="17f98f01-8fb0-47b4-887f-b0de9d0ccade"
Jul 09 19:00:25.780580 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:25.780561    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-svvql"]
Jul 09 19:00:25.780710 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:25.780641    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 19:00:25.780775 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:25.780729    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svvql" podUID="979b4064-b4f4-40b8-86f7-cf21c0a62580"
Jul 09 19:00:25.822882 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:25.822796    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 19:00:25.823013 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:25.822919    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5s6c" podUID="67dae793-bded-46b5-8237-b38edbebdc47"
Jul 09 19:00:25.937423 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:25.937391    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:26.332569 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:26.332536    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:26.432885 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:26.432858    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:27.133830 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:27.133788    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:27.531163 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:27.531126    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:27.628759 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:27.628698    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:27.633012 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:27.632990    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 19:00:27.633096 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:27.633017    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 19:00:27.633129 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:27.633104    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svvql" podUID="979b4064-b4f4-40b8-86f7-cf21c0a62580"
Jul 09 19:00:27.633163 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:27.633131    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 19:00:27.633202 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:27.633188    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fl7kb" podUID="17f98f01-8fb0-47b4-887f-b0de9d0ccade"
Jul 09 19:00:27.633257 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:27.633243    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5s6c" podUID="67dae793-bded-46b5-8237-b38edbebdc47"
Jul 09 19:00:28.462375 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:28.462343    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:28.869470 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:28.869384    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:29.632996 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:29.632962    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 19:00:29.633155 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:29.632962    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 19:00:29.633155 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:29.633065    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fl7kb" podUID="17f98f01-8fb0-47b4-887f-b0de9d0ccade"
Jul 09 19:00:29.633155 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:29.633076    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 19:00:29.633249 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:29.633156    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b5s6c" podUID="67dae793-bded-46b5-8237-b38edbebdc47"
Jul 09 19:00:29.633249 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:29.633233    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-svvql" podUID="979b4064-b4f4-40b8-86f7-cf21c0a62580"
Jul 09 19:00:29.954607 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:29.954577    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-233.ec2.internal" event="NodeReady"
Jul 09 19:00:29.955073 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:29.954697    2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 19:00:30.009205 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.009169    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6r97q"]
Jul 09 19:00:30.025234 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.025198    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wlvmd"]
Jul 09 19:00:30.025395 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.025334    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6r97q"
Jul 09 19:00:30.028893 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.028870    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ssx5x\""
Jul 09 19:00:30.028893 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.028888    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 19:00:30.029141 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.029128    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 19:00:30.045804 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.045781    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wlvmd"]
Jul 09 19:00:30.045952 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.045855    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6r97q"]
Jul 09 19:00:30.045952 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.045941    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wlvmd"
Jul 09 19:00:30.049180 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.049158    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 19:00:30.049284 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.049168    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 19:00:30.049381 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.049367    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 19:00:30.049431 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.049395    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ntcpk\""
Jul 09 19:00:30.049431 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.049405    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 19:00:30.085538 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.085504    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:30.112565 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.112534    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-h46tv"]
Jul 09 19:00:30.130007 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.129980    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc39b910-2f78-4b07-ba5c-9d50cf43eeb5-tmp-dir\") pod \"dns-default-6r97q\" (UID: \"cc39b910-2f78-4b07-ba5c-9d50cf43eeb5\") " pod="openshift-dns/dns-default-6r97q"
Jul 09 19:00:30.130173 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.130014    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5469e145-df2f-4d92-bf40-e232c79e9858-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wlvmd\" (UID: \"5469e145-df2f-4d92-bf40-e232c79e9858\") " pod="openshift-insights/insights-runtime-extractor-wlvmd"
Jul 09 19:00:30.130173 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.130044    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m9l7\" (UniqueName: \"kubernetes.io/projected/cc39b910-2f78-4b07-ba5c-9d50cf43eeb5-kube-api-access-5m9l7\") pod \"dns-default-6r97q\" (UID: \"cc39b910-2f78-4b07-ba5c-9d50cf43eeb5\") " pod="openshift-dns/dns-default-6r97q"
Jul 09 19:00:30.130173 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.130060    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlldp\" (UniqueName: \"kubernetes.io/projected/5469e145-df2f-4d92-bf40-e232c79e9858-kube-api-access-hlldp\") pod \"insights-runtime-extractor-wlvmd\" (UID: \"5469e145-df2f-4d92-bf40-e232c79e9858\") " pod="openshift-insights/insights-runtime-extractor-wlvmd"
Jul 09 19:00:30.130173 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.130120    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5469e145-df2f-4d92-bf40-e232c79e9858-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wlvmd\" (UID: \"5469e145-df2f-4d92-bf40-e232c79e9858\") " pod="openshift-insights/insights-runtime-extractor-wlvmd"
Jul 09 19:00:30.130374 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.130179    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5469e145-df2f-4d92-bf40-e232c79e9858-data-volume\") pod \"insights-runtime-extractor-wlvmd\" (UID: \"5469e145-df2f-4d92-bf40-e232c79e9858\") " pod="openshift-insights/insights-runtime-extractor-wlvmd"
Jul 09 19:00:30.130374 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.130212    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5469e145-df2f-4d92-bf40-e232c79e9858-crio-socket\") pod \"insights-runtime-extractor-wlvmd\" (UID: \"5469e145-df2f-4d92-bf40-e232c79e9858\") " pod="openshift-insights/insights-runtime-extractor-wlvmd"
Jul 09 19:00:30.130374 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.130241    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cc39b910-2f78-4b07-ba5c-9d50cf43eeb5-config-volume\") pod \"dns-default-6r97q\" (UID: \"cc39b910-2f78-4b07-ba5c-9d50cf43eeb5\") " pod="openshift-dns/dns-default-6r97q"
Jul 09 19:00:30.130374 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.130264    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc39b910-2f78-4b07-ba5c-9d50cf43eeb5-metrics-tls\") pod \"dns-default-6r97q\" (UID: \"cc39b910-2f78-4b07-ba5c-9d50cf43eeb5\") " pod="openshift-dns/dns-default-6r97q"
Jul 09 19:00:30.130591 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.130574    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h46tv"]
Jul 09 19:00:30.130672 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.130662    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h46tv"
Jul 09 19:00:30.134578 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.134558    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 19:00:30.134688 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.134608    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 19:00:30.134859 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.134845    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 19:00:30.134951 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.134923    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cqw8d\""
Jul 09 19:00:30.159032 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.158999    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:30.230626 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.230542    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5469e145-df2f-4d92-bf40-e232c79e9858-crio-socket\") pod \"insights-runtime-extractor-wlvmd\" (UID: \"5469e145-df2f-4d92-bf40-e232c79e9858\") " pod="openshift-insights/insights-runtime-extractor-wlvmd"
Jul 09 19:00:30.230626 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.230583    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cc39b910-2f78-4b07-ba5c-9d50cf43eeb5-config-volume\") pod \"dns-default-6r97q\" (UID: \"cc39b910-2f78-4b07-ba5c-9d50cf43eeb5\") " pod="openshift-dns/dns-default-6r97q"
Jul 09 19:00:30.230626 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.230607    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc39b910-2f78-4b07-ba5c-9d50cf43eeb5-metrics-tls\") pod \"dns-default-6r97q\" (UID: \"cc39b910-2f78-4b07-ba5c-9d50cf43eeb5\") " pod="openshift-dns/dns-default-6r97q"
Jul 09 19:00:30.230874 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.230701    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1644ac58-9a6f-4faf-9f0e-183cdd63caaa-cert\") pod \"ingress-canary-h46tv\" (UID: \"1644ac58-9a6f-4faf-9f0e-183cdd63caaa\") " pod="openshift-ingress-canary/ingress-canary-h46tv"
Jul 09 19:00:30.230910 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.230729    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc39b910-2f78-4b07-ba5c-9d50cf43eeb5-tmp-dir\") pod \"dns-default-6r97q\" (UID: \"cc39b910-2f78-4b07-ba5c-9d50cf43eeb5\") " pod="openshift-dns/dns-default-6r97q"
Jul 09 19:00:30.231952 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.231070    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5469e145-df2f-4d92-bf40-e232c79e9858-crio-socket\") pod \"insights-runtime-extractor-wlvmd\" (UID: \"5469e145-df2f-4d92-bf40-e232c79e9858\") " pod="openshift-insights/insights-runtime-extractor-wlvmd"
Jul 09 19:00:30.231952 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.231074    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q88c\" (UniqueName: \"kubernetes.io/projected/1644ac58-9a6f-4faf-9f0e-183cdd63caaa-kube-api-access-5q88c\") pod \"ingress-canary-h46tv\" (UID: \"1644ac58-9a6f-4faf-9f0e-183cdd63caaa\") " pod="openshift-ingress-canary/ingress-canary-h46tv"
Jul 09 19:00:30.231952 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.231156    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5469e145-df2f-4d92-bf40-e232c79e9858-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wlvmd\" (UID: \"5469e145-df2f-4d92-bf40-e232c79e9858\") " pod="openshift-insights/insights-runtime-extractor-wlvmd"
Jul 09 19:00:30.231952 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.231224    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m9l7\" (UniqueName: \"kubernetes.io/projected/cc39b910-2f78-4b07-ba5c-9d50cf43eeb5-kube-api-access-5m9l7\") pod \"dns-default-6r97q\" (UID: \"cc39b910-2f78-4b07-ba5c-9d50cf43eeb5\") " pod="openshift-dns/dns-default-6r97q"
Jul 09 19:00:30.231952 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.231251    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlldp\" (UniqueName: \"kubernetes.io/projected/5469e145-df2f-4d92-bf40-e232c79e9858-kube-api-access-hlldp\") pod \"insights-runtime-extractor-wlvmd\" (UID: \"5469e145-df2f-4d92-bf40-e232c79e9858\") " pod="openshift-insights/insights-runtime-extractor-wlvmd"
Jul 09 19:00:30.231952 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.231294    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5469e145-df2f-4d92-bf40-e232c79e9858-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wlvmd\" (UID: \"5469e145-df2f-4d92-bf40-e232c79e9858\") " pod="openshift-insights/insights-runtime-extractor-wlvmd"
Jul 09 19:00:30.231952 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.231522    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc39b910-2f78-4b07-ba5c-9d50cf43eeb5-tmp-dir\") pod \"dns-default-6r97q\" (UID: \"cc39b910-2f78-4b07-ba5c-9d50cf43eeb5\") " pod="openshift-dns/dns-default-6r97q"
Jul 09 19:00:30.231952 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.231646    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5469e145-df2f-4d92-bf40-e232c79e9858-data-volume\") pod \"insights-runtime-extractor-wlvmd\" (UID: \"5469e145-df2f-4d92-bf40-e232c79e9858\") " pod="openshift-insights/insights-runtime-extractor-wlvmd"
Jul 09 19:00:30.231952 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.231705    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cc39b910-2f78-4b07-ba5c-9d50cf43eeb5-config-volume\") pod \"dns-default-6r97q\" (UID: \"cc39b910-2f78-4b07-ba5c-9d50cf43eeb5\") " pod="openshift-dns/dns-default-6r97q"
Jul 09 19:00:30.231952 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.231334    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5469e145-df2f-4d92-bf40-e232c79e9858-data-volume\") pod \"insights-runtime-extractor-wlvmd\" (UID: \"5469e145-df2f-4d92-bf40-e232c79e9858\") " pod="openshift-insights/insights-runtime-extractor-wlvmd"
Jul 09 19:00:30.234846 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.232760    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5469e145-df2f-4d92-bf40-e232c79e9858-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wlvmd\" (UID: \"5469e145-df2f-4d92-bf40-e232c79e9858\") " pod="openshift-insights/insights-runtime-extractor-wlvmd"
Jul 09 19:00:30.236104 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.236080    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc39b910-2f78-4b07-ba5c-9d50cf43eeb5-metrics-tls\") pod \"dns-default-6r97q\" (UID: \"cc39b910-2f78-4b07-ba5c-9d50cf43eeb5\") " pod="openshift-dns/dns-default-6r97q"
Jul 09 19:00:30.236192 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.236116    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5469e145-df2f-4d92-bf40-e232c79e9858-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wlvmd\" (UID: \"5469e145-df2f-4d92-bf40-e232c79e9858\") " pod="openshift-insights/insights-runtime-extractor-wlvmd"
Jul 09 19:00:30.240034 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.240009    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m9l7\" (UniqueName: \"kubernetes.io/projected/cc39b910-2f78-4b07-ba5c-9d50cf43eeb5-kube-api-access-5m9l7\") pod \"dns-default-6r97q\" (UID: \"cc39b910-2f78-4b07-ba5c-9d50cf43eeb5\") " pod="openshift-dns/dns-default-6r97q"
Jul 09 19:00:30.240276 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.240253    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlldp\" (UniqueName: \"kubernetes.io/projected/5469e145-df2f-4d92-bf40-e232c79e9858-kube-api-access-hlldp\") pod \"insights-runtime-extractor-wlvmd\" (UID: \"5469e145-df2f-4d92-bf40-e232c79e9858\") " pod="openshift-insights/insights-runtime-extractor-wlvmd"
Jul 09 19:00:30.332312 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.332281    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1644ac58-9a6f-4faf-9f0e-183cdd63caaa-cert\") pod \"ingress-canary-h46tv\" (UID: \"1644ac58-9a6f-4faf-9f0e-183cdd63caaa\") " pod="openshift-ingress-canary/ingress-canary-h46tv"
Jul 09 19:00:30.332312 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.332313    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q88c\" (UniqueName: \"kubernetes.io/projected/1644ac58-9a6f-4faf-9f0e-183cdd63caaa-kube-api-access-5q88c\") pod \"ingress-canary-h46tv\" (UID: \"1644ac58-9a6f-4faf-9f0e-183cdd63caaa\") " pod="openshift-ingress-canary/ingress-canary-h46tv"
Jul 09 19:00:30.334427 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.334389    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6r97q"
Jul 09 19:00:30.334724 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.334706    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1644ac58-9a6f-4faf-9f0e-183cdd63caaa-cert\") pod \"ingress-canary-h46tv\" (UID: \"1644ac58-9a6f-4faf-9f0e-183cdd63caaa\") " pod="openshift-ingress-canary/ingress-canary-h46tv"
Jul 09 19:00:30.341747 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.341719    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q88c\" (UniqueName: \"kubernetes.io/projected/1644ac58-9a6f-4faf-9f0e-183cdd63caaa-kube-api-access-5q88c\") pod \"ingress-canary-h46tv\" (UID: \"1644ac58-9a6f-4faf-9f0e-183cdd63caaa\") " pod="openshift-ingress-canary/ingress-canary-h46tv"
Jul 09 19:00:30.354426 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.354402    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wlvmd"
Jul 09 19:00:30.439169 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.438928    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h46tv"
Jul 09 19:00:30.542500 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.542471    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wlvmd"]
Jul 09 19:00:30.547382 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:00:30.547336    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5469e145_df2f_4d92_bf40_e232c79e9858.slice/crio-f9d4fa9fef553029c3daad9370c915a42a733a851dabb44b074d9af71f9e49c2 WatchSource:0}: Error finding container f9d4fa9fef553029c3daad9370c915a42a733a851dabb44b074d9af71f9e49c2: Status 404 returned error can't find the container with id f9d4fa9fef553029c3daad9370c915a42a733a851dabb44b074d9af71f9e49c2
Jul 09 19:00:30.550674 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.550653    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6r97q"]
Jul 09 19:00:30.553839 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:00:30.553791    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc39b910_2f78_4b07_ba5c_9d50cf43eeb5.slice/crio-73f089cb460b7eaaa8c2e5b26fb2fa55631e851478764c81626cbe86c99b197b WatchSource:0}: Error finding container 73f089cb460b7eaaa8c2e5b26fb2fa55631e851478764c81626cbe86c99b197b: Status 404 returned error can't find the container with id 73f089cb460b7eaaa8c2e5b26fb2fa55631e851478764c81626cbe86c99b197b
Jul 09 19:00:30.594357 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.594320    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h46tv"]
Jul 09 19:00:30.597959 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:00:30.597936    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1644ac58_9a6f_4faf_9f0e_183cdd63caaa.slice/crio-847385c15a2ebdd5acd0295c5d2ef901824ed6ae098ccf514c04ba8c37a42a5f WatchSource:0}: Error finding container 847385c15a2ebdd5acd0295c5d2ef901824ed6ae098ccf514c04ba8c37a42a5f: Status 404 returned error can't find the container with id 847385c15a2ebdd5acd0295c5d2ef901824ed6ae098ccf514c04ba8c37a42a5f
Jul 09 19:00:30.834201 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.834117    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6r97q" event={"ID":"cc39b910-2f78-4b07-ba5c-9d50cf43eeb5","Type":"ContainerStarted","Data":"73f089cb460b7eaaa8c2e5b26fb2fa55631e851478764c81626cbe86c99b197b"}
Jul 09 19:00:30.835241 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.835213    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h46tv" event={"ID":"1644ac58-9a6f-4faf-9f0e-183cdd63caaa","Type":"ContainerStarted","Data":"847385c15a2ebdd5acd0295c5d2ef901824ed6ae098ccf514c04ba8c37a42a5f"}
Jul 09 19:00:30.836204 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:30.836178    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wlvmd" event={"ID":"5469e145-df2f-4d92-bf40-e232c79e9858","Type":"ContainerStarted","Data":"f9d4fa9fef553029c3daad9370c915a42a733a851dabb44b074d9af71f9e49c2"}
Jul 09 19:00:31.632693 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:31.632568    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 19:00:31.632693 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:31.632598    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 19:00:31.632693 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:31.632620    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 19:00:31.638714 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:31.638686    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 19:00:31.638883 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:31.638855    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dlpdq\""
Jul 09 19:00:31.638960 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:31.638949    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 19:00:31.639052 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:31.639006    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 19:00:31.639172 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:31.639006    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8ctlj\""
Jul 09 19:00:31.639172 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:31.639080    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 19:00:34.300570 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:34.300537    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:34.361858 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:34.361804    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:36.227965 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:36.227886    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:36.329867 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:36.329838    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:36.854288 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:36.854190    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wlvmd" event={"ID":"5469e145-df2f-4d92-bf40-e232c79e9858","Type":"ContainerStarted","Data":"9a69b1e7839bbf73b114a66d8786d991f33ec60c99be33ce116bbe90e82b61b7"}
Jul 09 19:00:36.854288 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:36.854284    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wlvmd" event={"ID":"5469e145-df2f-4d92-bf40-e232c79e9858","Type":"ContainerStarted","Data":"08ec1214b426c3eae710a303c63b5ef3c6125eedb100da1157989c5a75796c6c"}
Jul 09 19:00:36.855840 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:36.855800    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6r97q" event={"ID":"cc39b910-2f78-4b07-ba5c-9d50cf43eeb5","Type":"ContainerStarted","Data":"c2bfededaa4b82b7c1709b7812ca5b7d9e45b644ad0e60a9b62a8bcdcd4475ab"}
Jul 09 19:00:36.855949 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:36.855866    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6r97q" event={"ID":"cc39b910-2f78-4b07-ba5c-9d50cf43eeb5","Type":"ContainerStarted","Data":"dc2b1bdc6544600d2ad63279a64dc7fe2157c18590b15a69c060499f900f6323"}
Jul 09 19:00:36.855949 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:36.855895    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6r97q"
Jul 09 19:00:36.857134 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:36.857108    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h46tv" event={"ID":"1644ac58-9a6f-4faf-9f0e-183cdd63caaa","Type":"ContainerStarted","Data":"25fc591af468522d12fec450deea9f0925ee3831c724ed9a1afc9be318907341"}
Jul 09 19:00:36.875578 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:36.875526    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6r97q" podStartSLOduration=2.5002883540000003 podStartE2EDuration="7.875513233s" totalImagesPullingTime="5.375224879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:00:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:36.873748482 +0000 UTC m=+55.258818757" watchObservedRunningTime="2026-07-09 19:00:36.875513233 +0000 UTC m=+55.260583508"
Jul 09 19:00:36.890447 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:36.890402    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-h46tv" podStartSLOduration=1.539427275 podStartE2EDuration="6.890380109s" totalImagesPullingTime="5.350952834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:00:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:36.889366843 +0000 UTC m=+55.274437117" watchObservedRunningTime="2026-07-09 19:00:36.890380109 +0000 UTC m=+55.275450384"
Jul 09 19:00:39.312974 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.312944    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-774644655c-xd5qw"]
Jul 09 19:00:39.323155 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.323127    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-774644655c-xd5qw"
Jul 09 19:00:39.326486 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.326432    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 09 19:00:39.326486 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.326444    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 09 19:00:39.326486 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.326446    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 09 19:00:39.326726 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.326515    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 09 19:00:39.326767 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.326753    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 09 19:00:39.326838 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.326799    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 09 19:00:39.328260 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.328242    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qq4pn\""
Jul 09 19:00:39.328375 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.328357    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 09 19:00:39.331877 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.331835    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-774644655c-xd5qw"]
Jul 09 19:00:39.400244 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.400214    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c61d86b4-9317-4aec-9231-734775028507-oauth-serving-cert\") pod \"console-774644655c-xd5qw\" (UID: \"c61d86b4-9317-4aec-9231-734775028507\") " pod="openshift-console/console-774644655c-xd5qw"
Jul 09 19:00:39.400402 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.400248    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b6m4\" (UniqueName: \"kubernetes.io/projected/c61d86b4-9317-4aec-9231-734775028507-kube-api-access-4b6m4\") pod \"console-774644655c-xd5qw\" (UID: \"c61d86b4-9317-4aec-9231-734775028507\") " pod="openshift-console/console-774644655c-xd5qw"
Jul 09 19:00:39.400402 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.400297    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c61d86b4-9317-4aec-9231-734775028507-console-config\") pod \"console-774644655c-xd5qw\" (UID: \"c61d86b4-9317-4aec-9231-734775028507\") " pod="openshift-console/console-774644655c-xd5qw"
Jul 09 19:00:39.400402 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.400333    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c61d86b4-9317-4aec-9231-734775028507-console-serving-cert\") pod \"console-774644655c-xd5qw\" (UID: \"c61d86b4-9317-4aec-9231-734775028507\") " pod="openshift-console/console-774644655c-xd5qw"
Jul 09 19:00:39.400559 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.400448    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c61d86b4-9317-4aec-9231-734775028507-console-oauth-config\") pod \"console-774644655c-xd5qw\" (UID: \"c61d86b4-9317-4aec-9231-734775028507\") " pod="openshift-console/console-774644655c-xd5qw"
Jul 09 19:00:39.400559 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.400471    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c61d86b4-9317-4aec-9231-734775028507-service-ca\") pod \"console-774644655c-xd5qw\" (UID: \"c61d86b4-9317-4aec-9231-734775028507\") " pod="openshift-console/console-774644655c-xd5qw"
Jul 09 19:00:39.501283 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.501255    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c61d86b4-9317-4aec-9231-734775028507-console-oauth-config\") pod \"console-774644655c-xd5qw\" (UID: \"c61d86b4-9317-4aec-9231-734775028507\") " pod="openshift-console/console-774644655c-xd5qw"
Jul 09 19:00:39.501416 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.501284    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c61d86b4-9317-4aec-9231-734775028507-service-ca\") pod \"console-774644655c-xd5qw\" (UID: \"c61d86b4-9317-4aec-9231-734775028507\") " pod="openshift-console/console-774644655c-xd5qw"
Jul 09 19:00:39.501416 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.501305    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c61d86b4-9317-4aec-9231-734775028507-oauth-serving-cert\") pod \"console-774644655c-xd5qw\" (UID: \"c61d86b4-9317-4aec-9231-734775028507\") " pod="openshift-console/console-774644655c-xd5qw"
Jul 09 19:00:39.501416 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.501321    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b6m4\" (UniqueName: \"kubernetes.io/projected/c61d86b4-9317-4aec-9231-734775028507-kube-api-access-4b6m4\") pod \"console-774644655c-xd5qw\" (UID: \"c61d86b4-9317-4aec-9231-734775028507\") " pod="openshift-console/console-774644655c-xd5qw"
Jul 09 19:00:39.501416 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.501349    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c61d86b4-9317-4aec-9231-734775028507-console-config\") pod \"console-774644655c-xd5qw\" (UID: \"c61d86b4-9317-4aec-9231-734775028507\") " pod="openshift-console/console-774644655c-xd5qw"
Jul 09 19:00:39.501608 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.501456    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c61d86b4-9317-4aec-9231-734775028507-console-serving-cert\") pod \"console-774644655c-xd5qw\" (UID: \"c61d86b4-9317-4aec-9231-734775028507\") " pod="openshift-console/console-774644655c-xd5qw"
Jul 09 19:00:39.502115 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.502030    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c61d86b4-9317-4aec-9231-734775028507-console-config\") pod \"console-774644655c-xd5qw\" (UID: \"c61d86b4-9317-4aec-9231-734775028507\") " pod="openshift-console/console-774644655c-xd5qw"
Jul 09 19:00:39.502115 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.502078    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c61d86b4-9317-4aec-9231-734775028507-service-ca\") pod \"console-774644655c-xd5qw\" (UID: \"c61d86b4-9317-4aec-9231-734775028507\") " pod="openshift-console/console-774644655c-xd5qw"
Jul 09 19:00:39.502365 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.502122    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c61d86b4-9317-4aec-9231-734775028507-oauth-serving-cert\") pod \"console-774644655c-xd5qw\" (UID: \"c61d86b4-9317-4aec-9231-734775028507\") " pod="openshift-console/console-774644655c-xd5qw"
Jul 09 19:00:39.504124 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.504098    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c61d86b4-9317-4aec-9231-734775028507-console-serving-cert\") pod \"console-774644655c-xd5qw\" (UID: \"c61d86b4-9317-4aec-9231-734775028507\") " pod="openshift-console/console-774644655c-xd5qw"
Jul 09 19:00:39.504200 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.504184    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c61d86b4-9317-4aec-9231-734775028507-console-oauth-config\") pod \"console-774644655c-xd5qw\" (UID: \"c61d86b4-9317-4aec-9231-734775028507\") " pod="openshift-console/console-774644655c-xd5qw"
Jul 09 19:00:39.513434 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.513411    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b6m4\" (UniqueName: \"kubernetes.io/projected/c61d86b4-9317-4aec-9231-734775028507-kube-api-access-4b6m4\") pod \"console-774644655c-xd5qw\" (UID: \"c61d86b4-9317-4aec-9231-734775028507\") " pod="openshift-console/console-774644655c-xd5qw"
Jul 09 19:00:39.634030 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.633929    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-774644655c-xd5qw"
Jul 09 19:00:39.652789 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.652759    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:39.706579 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.706548    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:39.763269 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.763240    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-774644655c-xd5qw"]
Jul 09 19:00:39.766378 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:00:39.766351    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc61d86b4_9317_4aec_9231_734775028507.slice/crio-a9a69dbe32963cdb8ed680136a0dba9279dd276a9cb36d55794a2e54914cb6f6 WatchSource:0}: Error finding container a9a69dbe32963cdb8ed680136a0dba9279dd276a9cb36d55794a2e54914cb6f6: Status 404 returned error can't find the container with id a9a69dbe32963cdb8ed680136a0dba9279dd276a9cb36d55794a2e54914cb6f6
Jul 09 19:00:39.867108 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.867076    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-774644655c-xd5qw" event={"ID":"c61d86b4-9317-4aec-9231-734775028507","Type":"ContainerStarted","Data":"a9a69dbe32963cdb8ed680136a0dba9279dd276a9cb36d55794a2e54914cb6f6"}
Jul 09 19:00:39.869096 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.869073    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wlvmd" event={"ID":"5469e145-df2f-4d92-bf40-e232c79e9858","Type":"ContainerStarted","Data":"ca48cfd7130acb640507493a1583b45d3bb7faa349786ef584279543fc532aa9"}
Jul 09 19:00:39.887681 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:39.887627    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wlvmd" podStartSLOduration=2.11243114 podStartE2EDuration="10.8876103s" totalImagesPullingTime="8.77517916s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 19:00:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:39.886664572 +0000 UTC m=+58.271734902" watchObservedRunningTime="2026-07-09 19:00:39.8876103 +0000 UTC m=+58.272680553"
Jul 09 19:00:40.498904 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:40.498867    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77459bb9cb-4g682"]
Jul 09 19:00:40.507822 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:40.507768    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:40.535154 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:40.535119    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77459bb9cb-4g682"]
Jul 09 19:00:40.535315 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:40.535214    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77459bb9cb-4g682"
Jul 09 19:00:40.545432 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:40.545409    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 09 19:00:40.595834 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:40.595778    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:40.609360 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:40.609324    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fdd94748-e036-4b1f-9fd6-06c8bb265b36-service-ca\") pod \"console-77459bb9cb-4g682\" (UID: \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\") " pod="openshift-console/console-77459bb9cb-4g682"
Jul 09 19:00:40.609565 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:40.609371    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fdd94748-e036-4b1f-9fd6-06c8bb265b36-console-serving-cert\") pod \"console-77459bb9cb-4g682\" (UID: \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\") " pod="openshift-console/console-77459bb9cb-4g682"
Jul 09 19:00:40.609565 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:40.609406    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fdd94748-e036-4b1f-9fd6-06c8bb265b36-console-config\") pod \"console-77459bb9cb-4g682\" (UID: \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\") " pod="openshift-console/console-77459bb9cb-4g682"
Jul 09 19:00:40.609565 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:40.609430    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fdd94748-e036-4b1f-9fd6-06c8bb265b36-oauth-serving-cert\") pod \"console-77459bb9cb-4g682\" (UID: \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\") " pod="openshift-console/console-77459bb9cb-4g682"
Jul 09 19:00:40.609565 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:40.609536    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fdd94748-e036-4b1f-9fd6-06c8bb265b36-console-oauth-config\") pod \"console-77459bb9cb-4g682\" (UID: \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\") " pod="openshift-console/console-77459bb9cb-4g682"
Jul 09 19:00:40.609718 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:40.609592    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdd94748-e036-4b1f-9fd6-06c8bb265b36-trusted-ca-bundle\") pod \"console-77459bb9cb-4g682\" (UID: \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\") " pod="openshift-console/console-77459bb9cb-4g682"
Jul 09 19:00:40.609718 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:40.609632    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pgh9\" (UniqueName: \"kubernetes.io/projected/fdd94748-e036-4b1f-9fd6-06c8bb265b36-kube-api-access-5pgh9\") pod \"console-77459bb9cb-4g682\" (UID: \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\") " pod="openshift-console/console-77459bb9cb-4g682"
Jul 09 19:00:40.710654 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:40.710611    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fdd94748-e036-4b1f-9fd6-06c8bb265b36-service-ca\") pod \"console-77459bb9cb-4g682\" (UID: \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\") " pod="openshift-console/console-77459bb9cb-4g682"
Jul 09 19:00:40.710882 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:40.710664    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fdd94748-e036-4b1f-9fd6-06c8bb265b36-console-serving-cert\") pod \"console-77459bb9cb-4g682\" (UID: \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\") " pod="openshift-console/console-77459bb9cb-4g682"
Jul 09 19:00:40.710882 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:40.710691    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fdd94748-e036-4b1f-9fd6-06c8bb265b36-console-config\") pod \"console-77459bb9cb-4g682\" (UID: \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\") " pod="openshift-console/console-77459bb9cb-4g682"
Jul 09 19:00:40.710882 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:40.710710    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fdd94748-e036-4b1f-9fd6-06c8bb265b36-oauth-serving-cert\") pod \"console-77459bb9cb-4g682\" (UID: \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\") " pod="openshift-console/console-77459bb9cb-4g682"
Jul 09 19:00:40.711044 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:40.710955    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fdd94748-e036-4b1f-9fd6-06c8bb265b36-console-oauth-config\") pod \"console-77459bb9cb-4g682\" (UID: \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\") " pod="openshift-console/console-77459bb9cb-4g682"
Jul 09 19:00:40.711044 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:40.711033    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdd94748-e036-4b1f-9fd6-06c8bb265b36-trusted-ca-bundle\") pod \"console-77459bb9cb-4g682\" (UID: \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\") " pod="openshift-console/console-77459bb9cb-4g682"
Jul 09 19:00:40.711143 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:40.711062    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pgh9\" (UniqueName: \"kubernetes.io/projected/fdd94748-e036-4b1f-9fd6-06c8bb265b36-kube-api-access-5pgh9\") pod \"console-77459bb9cb-4g682\" (UID: \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\") " pod="openshift-console/console-77459bb9cb-4g682"
Jul 09 19:00:40.711536 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:40.711502    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fdd94748-e036-4b1f-9fd6-06c8bb265b36-oauth-serving-cert\") pod \"console-77459bb9cb-4g682\" (UID: \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\") " pod="openshift-console/console-77459bb9cb-4g682"
Jul 09 19:00:40.711536 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:40.711530    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fdd94748-e036-4b1f-9fd6-06c8bb265b36-console-config\") pod \"console-77459bb9cb-4g682\" (UID: \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\") " pod="openshift-console/console-77459bb9cb-4g682"
Jul 09 19:00:40.711688 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:40.711502    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fdd94748-e036-4b1f-9fd6-06c8bb265b36-service-ca\") pod \"console-77459bb9cb-4g682\" (UID: \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\") " pod="openshift-console/console-77459bb9cb-4g682"
Jul 09 19:00:40.711910 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:40.711891    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdd94748-e036-4b1f-9fd6-06c8bb265b36-trusted-ca-bundle\") pod \"console-77459bb9cb-4g682\" (UID: \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\") " pod="openshift-console/console-77459bb9cb-4g682"
Jul 09 19:00:40.713261 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:40.713217    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:40.713359 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:40.713318    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fdd94748-e036-4b1f-9fd6-06c8bb265b36-console-serving-cert\") pod \"console-77459bb9cb-4g682\" (UID: \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\") " pod="openshift-console/console-77459bb9cb-4g682"
Jul 09 19:00:40.713531 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:40.713517    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fdd94748-e036-4b1f-9fd6-06c8bb265b36-console-oauth-config\") pod \"console-77459bb9cb-4g682\" (UID: \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\") " pod="openshift-console/console-77459bb9cb-4g682"
Jul 09 19:00:40.720435 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:40.720411    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pgh9\" (UniqueName: \"kubernetes.io/projected/fdd94748-e036-4b1f-9fd6-06c8bb265b36-kube-api-access-5pgh9\") pod \"console-77459bb9cb-4g682\" (UID: \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\") " pod="openshift-console/console-77459bb9cb-4g682"
Jul 09 19:00:40.781872 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:40.781792    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:40.845513 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:40.845469    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77459bb9cb-4g682"
Jul 09 19:00:41.004789 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:41.004756    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77459bb9cb-4g682"]
Jul 09 19:00:41.007973 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:00:41.007951    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdd94748_e036_4b1f_9fd6_06c8bb265b36.slice/crio-c1480436502f4c6cb017e9bd522baf455e1746ebb0b1b19ab5de7c04c29ccb06 WatchSource:0}: Error finding container c1480436502f4c6cb017e9bd522baf455e1746ebb0b1b19ab5de7c04c29ccb06: Status 404 returned error can't find the container with id c1480436502f4c6cb017e9bd522baf455e1746ebb0b1b19ab5de7c04c29ccb06
Jul 09 19:00:41.877387 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:41.877351    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77459bb9cb-4g682" event={"ID":"fdd94748-e036-4b1f-9fd6-06c8bb265b36","Type":"ContainerStarted","Data":"c1480436502f4c6cb017e9bd522baf455e1746ebb0b1b19ab5de7c04c29ccb06"}
Jul 09 19:00:43.100484 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:43.100444    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:43.155617 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:43.155579    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:43.458869 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:43.458834    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:43.564892 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:43.564849    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:44.386084 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:44.386049    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:44.486097 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:44.486057    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:44.561349 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:44.561314    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:44.564180 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:44.564156    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-z8lcw"]
Jul 09 19:00:44.565858 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:44.565843    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-z8lcw"
Jul 09 19:00:44.569197 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:44.569172    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 09 19:00:44.569294 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:44.569207    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-bld7k\""
Jul 09 19:00:44.574604 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:44.574584    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-z8lcw"]
Jul 09 19:00:44.641422 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:44.641348    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5fea6453-32c0-46c4-b1d8-2728f9485896-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-z8lcw\" (UID: \"5fea6453-32c0-46c4-b1d8-2728f9485896\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-z8lcw"
Jul 09 19:00:44.693981 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:44.693942    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:44.742111 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:44.742069    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5fea6453-32c0-46c4-b1d8-2728f9485896-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-z8lcw\" (UID: \"5fea6453-32c0-46c4-b1d8-2728f9485896\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-z8lcw"
Jul 09 19:00:44.744589 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:44.744562    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5fea6453-32c0-46c4-b1d8-2728f9485896-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-z8lcw\" (UID: \"5fea6453-32c0-46c4-b1d8-2728f9485896\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-z8lcw"
Jul 09 19:00:44.874924 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:44.874889    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-z8lcw"
Jul 09 19:00:44.892730 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:44.892638    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-774644655c-xd5qw" event={"ID":"c61d86b4-9317-4aec-9231-734775028507","Type":"ContainerStarted","Data":"d5a385d5f606b87e6f4de5324ec1207e6783ccb9f3b58bc46e12edfbd7906d5f"}
Jul 09 19:00:44.894149 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:44.894123    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77459bb9cb-4g682" event={"ID":"fdd94748-e036-4b1f-9fd6-06c8bb265b36","Type":"ContainerStarted","Data":"7d5b13f4883524d913ae4f7795b0ce007aacb4256cae4e9195d4801637679a71"}
Jul 09 19:00:44.911421 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:44.911372    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-774644655c-xd5qw" podStartSLOduration=1.717183111 podStartE2EDuration="5.91135761s" totalImagesPullingTime="4.194174499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:00:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:44.910771665 +0000 UTC m=+63.295841943" watchObservedRunningTime="2026-07-09 19:00:44.91135761 +0000 UTC m=+63.296427885"
Jul 09 19:00:44.929471 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:44.929420    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77459bb9cb-4g682" podStartSLOduration=1.9730979400000002 podStartE2EDuration="4.92939999s" totalImagesPullingTime="2.95630205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:00:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:44.927971788 +0000 UTC m=+63.313042074" watchObservedRunningTime="2026-07-09 19:00:44.92939999 +0000 UTC m=+63.314470265"
Jul 09 19:00:45.002096 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:45.002063    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-z8lcw"]
Jul 09 19:00:45.005347 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:00:45.005322    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fea6453_32c0_46c4_b1d8_2728f9485896.slice/crio-681cd7951229c378fc4e6f6d31aad5f721883e13a30a7b62371baa9e47e34bf0 WatchSource:0}: Error finding container 681cd7951229c378fc4e6f6d31aad5f721883e13a30a7b62371baa9e47e34bf0: Status 404 returned error can't find the container with id 681cd7951229c378fc4e6f6d31aad5f721883e13a30a7b62371baa9e47e34bf0
Jul 09 19:00:45.803793 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:45.803757    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bw97f"
Jul 09 19:00:45.902373 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:45.902334    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-z8lcw" event={"ID":"5fea6453-32c0-46c4-b1d8-2728f9485896","Type":"ContainerStarted","Data":"681cd7951229c378fc4e6f6d31aad5f721883e13a30a7b62371baa9e47e34bf0"}
Jul 09 19:00:45.926092 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:45.926028    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:46.025910 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:46.025875    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:46.125981 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:46.125895    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:46.213258 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:46.213223    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:46.342192 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:46.342160    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:46.442776 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:46.442710    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:46.863093 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:46.863019    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6r97q"
Jul 09 19:00:47.698027 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:47.697990    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:47.815052 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:47.815012    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:47.910058 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:47.910026    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-z8lcw" event={"ID":"5fea6453-32c0-46c4-b1d8-2728f9485896","Type":"ContainerStarted","Data":"9dd0c8e2ec408755b1da37ef3f9f6ce7d8a3de48b6b90c2f2f368169000a37b8"}
Jul 09 19:00:47.910467 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:47.910220    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-z8lcw"
Jul 09 19:00:47.914792 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:47.914772    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-z8lcw"
Jul 09 19:00:47.928825 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:47.928743    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-z8lcw" podStartSLOduration=1.927147518 podStartE2EDuration="3.92872879s" totalImagesPullingTime="2.001581272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:00:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:47.927997112 +0000 UTC m=+66.313067389" watchObservedRunningTime="2026-07-09 19:00:47.92872879 +0000 UTC m=+66.313799064"
Jul 09 19:00:48.267113 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.267072    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67dae793-bded-46b5-8237-b38edbebdc47-original-pull-secret\") pod \"global-pull-secret-syncer-b5s6c\" (UID: \"67dae793-bded-46b5-8237-b38edbebdc47\") " pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 19:00:48.270533 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.270514    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 19:00:48.279604 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.279579    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/67dae793-bded-46b5-8237-b38edbebdc47-original-pull-secret\") pod \"global-pull-secret-syncer-b5s6c\" (UID: \"67dae793-bded-46b5-8237-b38edbebdc47\") " pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 19:00:48.367562 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.367519    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/979b4064-b4f4-40b8-86f7-cf21c0a62580-metrics-certs\") pod \"network-metrics-daemon-svvql\" (UID: \"979b4064-b4f4-40b8-86f7-cf21c0a62580\") " pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 19:00:48.370969 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.370951    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 19:00:48.380819 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.380777    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/979b4064-b4f4-40b8-86f7-cf21c0a62580-metrics-certs\") pod \"network-metrics-daemon-svvql\" (UID: \"979b4064-b4f4-40b8-86f7-cf21c0a62580\") " pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 19:00:48.456395 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.456353    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b5s6c"
Jul 09 19:00:48.464540 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.464518    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8ctlj\""
Jul 09 19:00:48.468346 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.468327    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wzc4\" (UniqueName: \"kubernetes.io/projected/17f98f01-8fb0-47b4-887f-b0de9d0ccade-kube-api-access-2wzc4\") pod \"network-check-target-fl7kb\" (UID: \"17f98f01-8fb0-47b4-887f-b0de9d0ccade\") " pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 19:00:48.471318 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.471300    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 19:00:48.471618 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.471599    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-svvql"
Jul 09 19:00:48.481634 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.481612    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 19:00:48.491444 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.491413    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wzc4\" (UniqueName: \"kubernetes.io/projected/17f98f01-8fb0-47b4-887f-b0de9d0ccade-kube-api-access-2wzc4\") pod \"network-check-target-fl7kb\" (UID: \"17f98f01-8fb0-47b4-887f-b0de9d0ccade\") " pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 19:00:48.598490 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.598456    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:48.606935 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.606758    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b5s6c"]
Jul 09 19:00:48.609650 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:00:48.609624    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67dae793_bded_46b5_8237_b38edbebdc47.slice/crio-601dd39b6f4caadf2b632548f5e3157ed1988be67b6b6dcc729c872e264e16d9 WatchSource:0}: Error finding container 601dd39b6f4caadf2b632548f5e3157ed1988be67b6b6dcc729c872e264e16d9: Status 404 returned error can't find the container with id 601dd39b6f4caadf2b632548f5e3157ed1988be67b6b6dcc729c872e264e16d9
Jul 09 19:00:48.629676 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.629643    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-4q5hf"]
Jul 09 19:00:48.639796 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:00:48.639765    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod979b4064_b4f4_40b8_86f7_cf21c0a62580.slice/crio-9976589a3a5596b999e4e9669700943b319569ed68209565779c87b61c8d909d WatchSource:0}: Error finding container 9976589a3a5596b999e4e9669700943b319569ed68209565779c87b61c8d909d: Status 404 returned error can't find the container with id 9976589a3a5596b999e4e9669700943b319569ed68209565779c87b61c8d909d
Jul 09 19:00:48.657778 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.657750    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-4q5hf"
Jul 09 19:00:48.661264 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.661228    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 09 19:00:48.661264 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.661257    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 09 19:00:48.661468 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.661275    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-zjz6p\""
Jul 09 19:00:48.662261 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.662241    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-svvql"]
Jul 09 19:00:48.662408 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.662294    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-4q5hf"]
Jul 09 19:00:48.662787 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.662768    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 19:00:48.662900 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.662790    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 19:00:48.662900 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.662882    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 19:00:48.680192 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.680159    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:48.750911 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.750882    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dlpdq\""
Jul 09 19:00:48.757255 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.757233    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 19:00:48.770324 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.770293    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0c5f69b-404c-40af-a042-fca5220650d4-metrics-client-ca\") pod \"prometheus-operator-64785b6675-4q5hf\" (UID: \"a0c5f69b-404c-40af-a042-fca5220650d4\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4q5hf"
Jul 09 19:00:48.770415 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.770349    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r5hn\" (UniqueName: \"kubernetes.io/projected/a0c5f69b-404c-40af-a042-fca5220650d4-kube-api-access-2r5hn\") pod \"prometheus-operator-64785b6675-4q5hf\" (UID: \"a0c5f69b-404c-40af-a042-fca5220650d4\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4q5hf"
Jul 09 19:00:48.770483 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.770461    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0c5f69b-404c-40af-a042-fca5220650d4-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-4q5hf\" (UID: \"a0c5f69b-404c-40af-a042-fca5220650d4\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4q5hf"
Jul 09 19:00:48.770564 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.770506    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0c5f69b-404c-40af-a042-fca5220650d4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-4q5hf\" (UID: \"a0c5f69b-404c-40af-a042-fca5220650d4\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4q5hf"
Jul 09 19:00:48.871275 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.871242    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0c5f69b-404c-40af-a042-fca5220650d4-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-4q5hf\" (UID: \"a0c5f69b-404c-40af-a042-fca5220650d4\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4q5hf"
Jul 09 19:00:48.871448 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.871286    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0c5f69b-404c-40af-a042-fca5220650d4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-4q5hf\" (UID: \"a0c5f69b-404c-40af-a042-fca5220650d4\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4q5hf"
Jul 09 19:00:48.871448 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.871329    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0c5f69b-404c-40af-a042-fca5220650d4-metrics-client-ca\") pod \"prometheus-operator-64785b6675-4q5hf\" (UID: \"a0c5f69b-404c-40af-a042-fca5220650d4\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4q5hf"
Jul 09 19:00:48.871448 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.871359    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r5hn\" (UniqueName: \"kubernetes.io/projected/a0c5f69b-404c-40af-a042-fca5220650d4-kube-api-access-2r5hn\") pod \"prometheus-operator-64785b6675-4q5hf\" (UID: \"a0c5f69b-404c-40af-a042-fca5220650d4\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4q5hf"
Jul 09 19:00:48.871448 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:48.871395    2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 09 19:00:48.871673 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:48.871479    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0c5f69b-404c-40af-a042-fca5220650d4-prometheus-operator-tls podName:a0c5f69b-404c-40af-a042-fca5220650d4 nodeName:}" failed. No retries permitted until 2026-07-09 19:00:49.371458091 +0000 UTC m=+67.756528345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/a0c5f69b-404c-40af-a042-fca5220650d4-prometheus-operator-tls") pod "prometheus-operator-64785b6675-4q5hf" (UID: "a0c5f69b-404c-40af-a042-fca5220650d4") : secret "prometheus-operator-tls" not found
Jul 09 19:00:48.872065 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.872043    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0c5f69b-404c-40af-a042-fca5220650d4-metrics-client-ca\") pod \"prometheus-operator-64785b6675-4q5hf\" (UID: \"a0c5f69b-404c-40af-a042-fca5220650d4\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4q5hf"
Jul 09 19:00:48.873822 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.873783    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0c5f69b-404c-40af-a042-fca5220650d4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-4q5hf\" (UID: \"a0c5f69b-404c-40af-a042-fca5220650d4\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4q5hf"
Jul 09 19:00:48.891849 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.891790    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r5hn\" (UniqueName: \"kubernetes.io/projected/a0c5f69b-404c-40af-a042-fca5220650d4-kube-api-access-2r5hn\") pod \"prometheus-operator-64785b6675-4q5hf\" (UID: \"a0c5f69b-404c-40af-a042-fca5220650d4\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4q5hf"
Jul 09 19:00:48.903038 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.902985    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fl7kb"]
Jul 09 19:00:48.905533 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:00:48.905508    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17f98f01_8fb0_47b4_887f_b0de9d0ccade.slice/crio-956ea5a270c1f7efad4fe0b14c301469a34bdc93cedfbfa5fe3ba647929848df WatchSource:0}: Error finding container 956ea5a270c1f7efad4fe0b14c301469a34bdc93cedfbfa5fe3ba647929848df: Status 404 returned error can't find the container with id 956ea5a270c1f7efad4fe0b14c301469a34bdc93cedfbfa5fe3ba647929848df
Jul 09 19:00:48.914542 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.914514    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fl7kb" event={"ID":"17f98f01-8fb0-47b4-887f-b0de9d0ccade","Type":"ContainerStarted","Data":"956ea5a270c1f7efad4fe0b14c301469a34bdc93cedfbfa5fe3ba647929848df"}
Jul 09 19:00:48.915611 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.915589    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b5s6c" event={"ID":"67dae793-bded-46b5-8237-b38edbebdc47","Type":"ContainerStarted","Data":"601dd39b6f4caadf2b632548f5e3157ed1988be67b6b6dcc729c872e264e16d9"}
Jul 09 19:00:48.916644 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:48.916620    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-svvql" event={"ID":"979b4064-b4f4-40b8-86f7-cf21c0a62580","Type":"ContainerStarted","Data":"9976589a3a5596b999e4e9669700943b319569ed68209565779c87b61c8d909d"}
Jul 09 19:00:49.151355 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:49.151306    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:49.375850 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:49.375797    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0c5f69b-404c-40af-a042-fca5220650d4-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-4q5hf\" (UID: \"a0c5f69b-404c-40af-a042-fca5220650d4\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4q5hf"
Jul 09 19:00:49.378511 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:49.378482    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a0c5f69b-404c-40af-a042-fca5220650d4-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-4q5hf\" (UID: \"a0c5f69b-404c-40af-a042-fca5220650d4\") " pod="openshift-monitoring/prometheus-operator-64785b6675-4q5hf"
Jul 09 19:00:49.571426 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:49.571323    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-4q5hf"
Jul 09 19:00:49.635641 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:49.635604    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-774644655c-xd5qw"
Jul 09 19:00:49.636031 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:49.635939    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-774644655c-xd5qw"
Jul 09 19:00:49.642145 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:49.642121    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-774644655c-xd5qw"
Jul 09 19:00:49.709268 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:49.709226    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-4q5hf"]
Jul 09 19:00:49.711719 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:00:49.711689    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0c5f69b_404c_40af_a042_fca5220650d4.slice/crio-7f442124d1db8d6e3e478dd1bdbbe420d3e1c93bbc2ae823e7ba84b8fe576210 WatchSource:0}: Error finding container 7f442124d1db8d6e3e478dd1bdbbe420d3e1c93bbc2ae823e7ba84b8fe576210: Status 404 returned error can't find the container with id 7f442124d1db8d6e3e478dd1bdbbe420d3e1c93bbc2ae823e7ba84b8fe576210
Jul 09 19:00:49.926175 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:49.926072    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-4q5hf" event={"ID":"a0c5f69b-404c-40af-a042-fca5220650d4","Type":"ContainerStarted","Data":"7f442124d1db8d6e3e478dd1bdbbe420d3e1c93bbc2ae823e7ba84b8fe576210"}
Jul 09 19:00:49.931353 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:49.931321    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-774644655c-xd5qw"
Jul 09 19:00:50.831967 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:50.831926    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:50.845970 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:50.845939    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77459bb9cb-4g682"
Jul 09 19:00:50.846544 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:50.846375    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77459bb9cb-4g682"
Jul 09 19:00:50.852949 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:50.852922    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77459bb9cb-4g682"
Jul 09 19:00:50.930099 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:50.930065    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:50.934279 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:50.934177    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-svvql" event={"ID":"979b4064-b4f4-40b8-86f7-cf21c0a62580","Type":"ContainerStarted","Data":"6558936718a1d95e0b1cae48515e594bbdc6f318f402af36b9908dd81c785f14"}
Jul 09 19:00:50.934279 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:50.934244    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-svvql" event={"ID":"979b4064-b4f4-40b8-86f7-cf21c0a62580","Type":"ContainerStarted","Data":"4356a8e6baf7a06c034bac199a59669d5eef75e74d3a61f2d0b4cea70b825c88"}
Jul 09 19:00:50.945080 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:50.945015    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77459bb9cb-4g682"
Jul 09 19:00:50.956967 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:50.956840    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-svvql" podStartSLOduration=67.529057493 podStartE2EDuration="1m8.956795584s" totalImagesPullingTime="1.427738091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:50.956439387 +0000 UTC m=+69.341509654" watchObservedRunningTime="2026-07-09 19:00:50.956795584 +0000 UTC m=+69.341865860"
Jul 09 19:00:51.014580 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:51.014502    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-774644655c-xd5qw"]
Jul 09 19:00:51.027291 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:51.027253    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:51.095207 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:51.095114    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:51.153545 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:51.153498    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:51.324133 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:51.324056    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:51.425414 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:51.425390    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:51.605446 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:51.605353    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:51.940529 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:51.940475    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-4q5hf" event={"ID":"a0c5f69b-404c-40af-a042-fca5220650d4","Type":"ContainerStarted","Data":"80cf05be109c03bb1c7b02803278eb7d6575f2e186c0c564375ec9a762b64b5e"}
Jul 09 19:00:51.940997 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:51.940543    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-4q5hf" event={"ID":"a0c5f69b-404c-40af-a042-fca5220650d4","Type":"ContainerStarted","Data":"a0e9c56fe1fb25ba4d2b06fd67a5ea14a4dd9e25ce36d65528b882b959a6fc3a"}
Jul 09 19:00:51.958423 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:51.958352    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-4q5hf" podStartSLOduration=2.324502262 podStartE2EDuration="3.958327005s" totalImagesPullingTime="1.633824743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:51.957999325 +0000 UTC m=+70.343069595" watchObservedRunningTime="2026-07-09 19:00:51.958327005 +0000 UTC m=+70.343397285"
Jul 09 19:00:53.796922 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:53.796873    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:53.940055 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:53.940012    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:53.961204 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:53.961175    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-7wwbk"]
Jul 09 19:00:53.965439 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:53.965416    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7wwbk"
Jul 09 19:00:53.968230 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:53.968201    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-pdx9m"]
Jul 09 19:00:53.968490 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:53.968464    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 09 19:00:53.968619 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:53.968551    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 09 19:00:53.969161 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:53.969141    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-j8799\""
Jul 09 19:00:53.971018 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:53.971001    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-pdx9m"
Jul 09 19:00:53.974148 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:53.974094    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 09 19:00:53.974148 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:53.974122    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 09 19:00:53.974148 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:53.974130    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-d5pjt\""
Jul 09 19:00:53.974569 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:53.974552    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 09 19:00:53.978030 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:53.977961    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-7wwbk"]
Jul 09 19:00:53.983867 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:53.983844    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-pdx9m"]
Jul 09 19:00:54.001133 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.001097    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qrrl7"]
Jul 09 19:00:54.004218 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.004196    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qrrl7"
Jul 09 19:00:54.007554 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.007402    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 19:00:54.007554 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.007432    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 19:00:54.007554 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.007448    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 19:00:54.007554 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.007473    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5v9q2\""
Jul 09 19:00:54.016521 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.016493    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/82b57efd-d3d6-4e60-9102-88fea9ebadb4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-7wwbk\" (UID: \"82b57efd-d3d6-4e60-9102-88fea9ebadb4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7wwbk"
Jul 09 19:00:54.016626 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.016541    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/393d0b99-20db-49d4-bb50-bef80c86563d-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-pdx9m\" (UID: \"393d0b99-20db-49d4-bb50-bef80c86563d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pdx9m"
Jul 09 19:00:54.016626 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.016571    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/393d0b99-20db-49d4-bb50-bef80c86563d-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-pdx9m\" (UID: \"393d0b99-20db-49d4-bb50-bef80c86563d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pdx9m"
Jul 09 19:00:54.016626 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.016587    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/393d0b99-20db-49d4-bb50-bef80c86563d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-pdx9m\" (UID: \"393d0b99-20db-49d4-bb50-bef80c86563d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pdx9m"
Jul 09 19:00:54.016840 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.016634    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsgm5\" (UniqueName: \"kubernetes.io/projected/393d0b99-20db-49d4-bb50-bef80c86563d-kube-api-access-tsgm5\") pod \"kube-state-metrics-785778ff74-pdx9m\" (UID: \"393d0b99-20db-49d4-bb50-bef80c86563d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pdx9m"
Jul 09 19:00:54.016840 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.016660    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82b57efd-d3d6-4e60-9102-88fea9ebadb4-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-7wwbk\" (UID: \"82b57efd-d3d6-4e60-9102-88fea9ebadb4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7wwbk"
Jul 09 19:00:54.016840 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.016682    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/393d0b99-20db-49d4-bb50-bef80c86563d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-pdx9m\" (UID: \"393d0b99-20db-49d4-bb50-bef80c86563d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pdx9m"
Jul 09 19:00:54.016840 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.016721    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/393d0b99-20db-49d4-bb50-bef80c86563d-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-pdx9m\" (UID: \"393d0b99-20db-49d4-bb50-bef80c86563d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pdx9m"
Jul 09 19:00:54.016840 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.016751    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82b57efd-d3d6-4e60-9102-88fea9ebadb4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-7wwbk\" (UID: \"82b57efd-d3d6-4e60-9102-88fea9ebadb4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7wwbk"
Jul 09 19:00:54.016840 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.016772    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpkln\" (UniqueName: \"kubernetes.io/projected/82b57efd-d3d6-4e60-9102-88fea9ebadb4-kube-api-access-wpkln\") pod \"openshift-state-metrics-84bd68b896-7wwbk\" (UID: \"82b57efd-d3d6-4e60-9102-88fea9ebadb4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7wwbk"
Jul 09 19:00:54.019098 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.019070    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:54.088162 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.088050    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:54.118074 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.118036    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/393d0b99-20db-49d4-bb50-bef80c86563d-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-pdx9m\" (UID: \"393d0b99-20db-49d4-bb50-bef80c86563d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pdx9m"
Jul 09 19:00:54.118074 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.118088    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2d925277-c169-430e-9535-1a3da7490d86-node-exporter-accelerators-collector-config\") pod \"node-exporter-qrrl7\" (UID: \"2d925277-c169-430e-9535-1a3da7490d86\") " pod="openshift-monitoring/node-exporter-qrrl7"
Jul 09 19:00:54.118323 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.118127    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/393d0b99-20db-49d4-bb50-bef80c86563d-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-pdx9m\" (UID: \"393d0b99-20db-49d4-bb50-bef80c86563d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pdx9m"
Jul 09 19:00:54.118323 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.118155    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/393d0b99-20db-49d4-bb50-bef80c86563d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-pdx9m\" (UID: \"393d0b99-20db-49d4-bb50-bef80c86563d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pdx9m"
Jul 09 19:00:54.118323 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.118180    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2d925277-c169-430e-9535-1a3da7490d86-node-exporter-wtmp\") pod \"node-exporter-qrrl7\" (UID: \"2d925277-c169-430e-9535-1a3da7490d86\") " pod="openshift-monitoring/node-exporter-qrrl7"
Jul 09 19:00:54.118323 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.118207    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d925277-c169-430e-9535-1a3da7490d86-sys\") pod \"node-exporter-qrrl7\" (UID: \"2d925277-c169-430e-9535-1a3da7490d86\") " pod="openshift-monitoring/node-exporter-qrrl7"
Jul 09 19:00:54.118323 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.118252    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsgm5\" (UniqueName: \"kubernetes.io/projected/393d0b99-20db-49d4-bb50-bef80c86563d-kube-api-access-tsgm5\") pod \"kube-state-metrics-785778ff74-pdx9m\" (UID: \"393d0b99-20db-49d4-bb50-bef80c86563d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pdx9m"
Jul 09 19:00:54.118323 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.118280    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82b57efd-d3d6-4e60-9102-88fea9ebadb4-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-7wwbk\" (UID: \"82b57efd-d3d6-4e60-9102-88fea9ebadb4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7wwbk"
Jul 09 19:00:54.118323 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.118310    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/393d0b99-20db-49d4-bb50-bef80c86563d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-pdx9m\" (UID: \"393d0b99-20db-49d4-bb50-bef80c86563d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pdx9m"
Jul 09 19:00:54.118667 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.118331    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d925277-c169-430e-9535-1a3da7490d86-metrics-client-ca\") pod \"node-exporter-qrrl7\" (UID: \"2d925277-c169-430e-9535-1a3da7490d86\") " pod="openshift-monitoring/node-exporter-qrrl7"
Jul 09 19:00:54.118667 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.118350    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d925277-c169-430e-9535-1a3da7490d86-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qrrl7\" (UID: \"2d925277-c169-430e-9535-1a3da7490d86\") " pod="openshift-monitoring/node-exporter-qrrl7"
Jul 09 19:00:54.118667 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.118372    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7jsf\" (UniqueName: \"kubernetes.io/projected/2d925277-c169-430e-9535-1a3da7490d86-kube-api-access-z7jsf\") pod \"node-exporter-qrrl7\" (UID: \"2d925277-c169-430e-9535-1a3da7490d86\") " pod="openshift-monitoring/node-exporter-qrrl7"
Jul 09 19:00:54.118667 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.118406    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/393d0b99-20db-49d4-bb50-bef80c86563d-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-pdx9m\" (UID: \"393d0b99-20db-49d4-bb50-bef80c86563d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pdx9m"
Jul 09 19:00:54.118667 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.118434    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82b57efd-d3d6-4e60-9102-88fea9ebadb4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-7wwbk\" (UID: \"82b57efd-d3d6-4e60-9102-88fea9ebadb4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7wwbk"
Jul 09 19:00:54.118667 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.118456    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2d925277-c169-430e-9535-1a3da7490d86-node-exporter-textfile\") pod \"node-exporter-qrrl7\" (UID: \"2d925277-c169-430e-9535-1a3da7490d86\") " pod="openshift-monitoring/node-exporter-qrrl7"
Jul 09 19:00:54.118667 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.118479    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpkln\" (UniqueName: \"kubernetes.io/projected/82b57efd-d3d6-4e60-9102-88fea9ebadb4-kube-api-access-wpkln\") pod \"openshift-state-metrics-84bd68b896-7wwbk\" (UID: \"82b57efd-d3d6-4e60-9102-88fea9ebadb4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7wwbk"
Jul 09 19:00:54.118667 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.118495    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2d925277-c169-430e-9535-1a3da7490d86-node-exporter-tls\") pod \"node-exporter-qrrl7\" (UID: \"2d925277-c169-430e-9535-1a3da7490d86\") " pod="openshift-monitoring/node-exporter-qrrl7"
Jul 09 19:00:54.118667 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.118513    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/82b57efd-d3d6-4e60-9102-88fea9ebadb4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-7wwbk\" (UID: \"82b57efd-d3d6-4e60-9102-88fea9ebadb4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7wwbk"
Jul 09 19:00:54.118667 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.118513    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/393d0b99-20db-49d4-bb50-bef80c86563d-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-pdx9m\" (UID: \"393d0b99-20db-49d4-bb50-bef80c86563d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pdx9m"
Jul 09 19:00:54.118667 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.118533    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2d925277-c169-430e-9535-1a3da7490d86-root\") pod \"node-exporter-qrrl7\" (UID: \"2d925277-c169-430e-9535-1a3da7490d86\") " pod="openshift-monitoring/node-exporter-qrrl7"
Jul 09 19:00:54.118667 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:54.118647    2577 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 09 19:00:54.119257 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:54.118710    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82b57efd-d3d6-4e60-9102-88fea9ebadb4-openshift-state-metrics-tls podName:82b57efd-d3d6-4e60-9102-88fea9ebadb4 nodeName:}" failed. No retries permitted until 2026-07-09 19:00:54.618690185 +0000 UTC m=+73.003760438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/82b57efd-d3d6-4e60-9102-88fea9ebadb4-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-7wwbk" (UID: "82b57efd-d3d6-4e60-9102-88fea9ebadb4") : secret "openshift-state-metrics-tls" not found
Jul 09 19:00:54.119257 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:54.118876    2577 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 09 19:00:54.119257 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:00:54.118918    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/393d0b99-20db-49d4-bb50-bef80c86563d-kube-state-metrics-tls podName:393d0b99-20db-49d4-bb50-bef80c86563d nodeName:}" failed. No retries permitted until 2026-07-09 19:00:54.61890363 +0000 UTC m=+73.003973887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/393d0b99-20db-49d4-bb50-bef80c86563d-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-pdx9m" (UID: "393d0b99-20db-49d4-bb50-bef80c86563d") : secret "kube-state-metrics-tls" not found
Jul 09 19:00:54.119257 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.118993    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/393d0b99-20db-49d4-bb50-bef80c86563d-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-pdx9m\" (UID: \"393d0b99-20db-49d4-bb50-bef80c86563d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pdx9m"
Jul 09 19:00:54.119592 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.119562    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82b57efd-d3d6-4e60-9102-88fea9ebadb4-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-7wwbk\" (UID: \"82b57efd-d3d6-4e60-9102-88fea9ebadb4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7wwbk"
Jul 09 19:00:54.119592 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.119569    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/393d0b99-20db-49d4-bb50-bef80c86563d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-pdx9m\" (UID: \"393d0b99-20db-49d4-bb50-bef80c86563d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pdx9m"
Jul 09 19:00:54.121296 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.121268    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/393d0b99-20db-49d4-bb50-bef80c86563d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-pdx9m\" (UID: \"393d0b99-20db-49d4-bb50-bef80c86563d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pdx9m"
Jul 09 19:00:54.121440 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.121411    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82b57efd-d3d6-4e60-9102-88fea9ebadb4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-7wwbk\" (UID: \"82b57efd-d3d6-4e60-9102-88fea9ebadb4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7wwbk"
Jul 09 19:00:54.132505 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.132478    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsgm5\" (UniqueName: \"kubernetes.io/projected/393d0b99-20db-49d4-bb50-bef80c86563d-kube-api-access-tsgm5\") pod \"kube-state-metrics-785778ff74-pdx9m\" (UID: \"393d0b99-20db-49d4-bb50-bef80c86563d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pdx9m"
Jul 09 19:00:54.133206 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.133182    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpkln\" (UniqueName: \"kubernetes.io/projected/82b57efd-d3d6-4e60-9102-88fea9ebadb4-kube-api-access-wpkln\") pod \"openshift-state-metrics-84bd68b896-7wwbk\" (UID: \"82b57efd-d3d6-4e60-9102-88fea9ebadb4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7wwbk"
Jul 09 19:00:54.187291 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.187249    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:54.219695 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.219664    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2d925277-c169-430e-9535-1a3da7490d86-node-exporter-wtmp\") pod \"node-exporter-qrrl7\" (UID: \"2d925277-c169-430e-9535-1a3da7490d86\") " pod="openshift-monitoring/node-exporter-qrrl7"
Jul 09 19:00:54.219888 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.219704    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d925277-c169-430e-9535-1a3da7490d86-sys\") pod \"node-exporter-qrrl7\" (UID: \"2d925277-c169-430e-9535-1a3da7490d86\") " pod="openshift-monitoring/node-exporter-qrrl7"
Jul 09 19:00:54.219888 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.219744    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d925277-c169-430e-9535-1a3da7490d86-metrics-client-ca\") pod \"node-exporter-qrrl7\" (UID: \"2d925277-c169-430e-9535-1a3da7490d86\") " pod="openshift-monitoring/node-exporter-qrrl7"
Jul 09 19:00:54.219888 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.219769    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d925277-c169-430e-9535-1a3da7490d86-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qrrl7\" (UID: \"2d925277-c169-430e-9535-1a3da7490d86\") " pod="openshift-monitoring/node-exporter-qrrl7"
Jul 09 19:00:54.219888 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.219799    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7jsf\" (UniqueName: \"kubernetes.io/projected/2d925277-c169-430e-9535-1a3da7490d86-kube-api-access-z7jsf\") pod \"node-exporter-qrrl7\" (UID: \"2d925277-c169-430e-9535-1a3da7490d86\") " pod="openshift-monitoring/node-exporter-qrrl7"
Jul 09 19:00:54.219888 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.219862    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2d925277-c169-430e-9535-1a3da7490d86-node-exporter-textfile\") pod \"node-exporter-qrrl7\" (UID: \"2d925277-c169-430e-9535-1a3da7490d86\") " pod="openshift-monitoring/node-exporter-qrrl7"
Jul 09 19:00:54.219888 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.219871    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2d925277-c169-430e-9535-1a3da7490d86-node-exporter-wtmp\") pod \"node-exporter-qrrl7\" (UID: \"2d925277-c169-430e-9535-1a3da7490d86\") " pod="openshift-monitoring/node-exporter-qrrl7"
Jul 09 19:00:54.220223 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.219890    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2d925277-c169-430e-9535-1a3da7490d86-node-exporter-tls\") pod \"node-exporter-qrrl7\" (UID: \"2d925277-c169-430e-9535-1a3da7490d86\") " pod="openshift-monitoring/node-exporter-qrrl7"
Jul 09 19:00:54.220223 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.219930    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2d925277-c169-430e-9535-1a3da7490d86-root\") pod \"node-exporter-qrrl7\" (UID: \"2d925277-c169-430e-9535-1a3da7490d86\") " pod="openshift-monitoring/node-exporter-qrrl7"
Jul 09 19:00:54.220223 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.219967    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2d925277-c169-430e-9535-1a3da7490d86-node-exporter-accelerators-collector-config\") pod \"node-exporter-qrrl7\" (UID: \"2d925277-c169-430e-9535-1a3da7490d86\") " pod="openshift-monitoring/node-exporter-qrrl7"
Jul 09 19:00:54.220223 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.220118    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d925277-c169-430e-9535-1a3da7490d86-sys\") pod \"node-exporter-qrrl7\" (UID: \"2d925277-c169-430e-9535-1a3da7490d86\") " pod="openshift-monitoring/node-exporter-qrrl7"
Jul 09 19:00:54.220422 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.220238    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2d925277-c169-430e-9535-1a3da7490d86-root\") pod \"node-exporter-qrrl7\" (UID: \"2d925277-c169-430e-9535-1a3da7490d86\") " pod="openshift-monitoring/node-exporter-qrrl7"
Jul 09 19:00:54.221035 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.220982    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2d925277-c169-430e-9535-1a3da7490d86-node-exporter-textfile\") pod \"node-exporter-qrrl7\" (UID: \"2d925277-c169-430e-9535-1a3da7490d86\") " pod="openshift-monitoring/node-exporter-qrrl7"
Jul 09 19:00:54.221221 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.221191    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2d925277-c169-430e-9535-1a3da7490d86-node-exporter-accelerators-collector-config\") pod \"node-exporter-qrrl7\" (UID: \"2d925277-c169-430e-9535-1a3da7490d86\") " pod="openshift-monitoring/node-exporter-qrrl7"
Jul 09 19:00:54.221648 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.221624    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2d925277-c169-430e-9535-1a3da7490d86-metrics-client-ca\") pod \"node-exporter-qrrl7\" (UID: \"2d925277-c169-430e-9535-1a3da7490d86\") " pod="openshift-monitoring/node-exporter-qrrl7"
Jul 09 19:00:54.222583 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.222560    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2d925277-c169-430e-9535-1a3da7490d86-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qrrl7\" (UID: \"2d925277-c169-430e-9535-1a3da7490d86\") " pod="openshift-monitoring/node-exporter-qrrl7"
Jul 09 19:00:54.222866 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.222846    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2d925277-c169-430e-9535-1a3da7490d86-node-exporter-tls\") pod \"node-exporter-qrrl7\" (UID: \"2d925277-c169-430e-9535-1a3da7490d86\") " pod="openshift-monitoring/node-exporter-qrrl7"
Jul 09 19:00:54.230136 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.230104    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7jsf\" (UniqueName: \"kubernetes.io/projected/2d925277-c169-430e-9535-1a3da7490d86-kube-api-access-z7jsf\") pod \"node-exporter-qrrl7\" (UID: \"2d925277-c169-430e-9535-1a3da7490d86\") " pod="openshift-monitoring/node-exporter-qrrl7"
Jul 09 19:00:54.287337 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.287294    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:54.315178 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.315149    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qrrl7"
Jul 09 19:00:54.386730 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.386689    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:54.489133 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.489098    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:54.622618 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.622576    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/82b57efd-d3d6-4e60-9102-88fea9ebadb4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-7wwbk\" (UID: \"82b57efd-d3d6-4e60-9102-88fea9ebadb4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7wwbk"
Jul 09 19:00:54.622790 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.622680    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/393d0b99-20db-49d4-bb50-bef80c86563d-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-pdx9m\" (UID: \"393d0b99-20db-49d4-bb50-bef80c86563d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pdx9m"
Jul 09 19:00:54.625372 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.625343    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/393d0b99-20db-49d4-bb50-bef80c86563d-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-pdx9m\" (UID: \"393d0b99-20db-49d4-bb50-bef80c86563d\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-pdx9m"
Jul 09 19:00:54.625372 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.625359    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/82b57efd-d3d6-4e60-9102-88fea9ebadb4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-7wwbk\" (UID: \"82b57efd-d3d6-4e60-9102-88fea9ebadb4\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7wwbk"
Jul 09 19:00:54.796343 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:00:54.796306    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d925277_c169_430e_9535_1a3da7490d86.slice/crio-36a3357745679bb2a5a0690187b662df4a7c7bf7115859919b7576356282a2f0 WatchSource:0}: Error finding container 36a3357745679bb2a5a0690187b662df4a7c7bf7115859919b7576356282a2f0: Status 404 returned error can't find the container with id 36a3357745679bb2a5a0690187b662df4a7c7bf7115859919b7576356282a2f0
Jul 09 19:00:54.878763 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.878731    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7wwbk"
Jul 09 19:00:54.886531 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.886505    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-pdx9m"
Jul 09 19:00:54.962855 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.962697    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qrrl7" event={"ID":"2d925277-c169-430e-9535-1a3da7490d86","Type":"ContainerStarted","Data":"36a3357745679bb2a5a0690187b662df4a7c7bf7115859919b7576356282a2f0"}
Jul 09 19:00:54.965715 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.964896    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fl7kb" event={"ID":"17f98f01-8fb0-47b4-887f-b0de9d0ccade","Type":"ContainerStarted","Data":"f11b9e70c0eb06a32e8c3e4d73f2f7c6132541a1a4e8398dd8de491a72039b56"}
Jul 09 19:00:54.965715 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.965657    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 19:00:54.968328 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.967852    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b5s6c" event={"ID":"67dae793-bded-46b5-8237-b38edbebdc47","Type":"ContainerStarted","Data":"0fcc8dd478c852d77817747292e11d567084bfb9c1adef2af98c1f663afdf082"}
Jul 09 19:00:54.983014 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.982919    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fl7kb" podStartSLOduration=67.086261057 podStartE2EDuration="1m12.982896621s" totalImagesPullingTime="5.896635564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:54.981970839 +0000 UTC m=+73.367041115" watchObservedRunningTime="2026-07-09 19:00:54.982896621 +0000 UTC m=+73.367966896"
Jul 09 19:00:54.999302 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:54.998829    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-b5s6c" podStartSLOduration=66.810332857 podStartE2EDuration="1m12.998791469s" totalImagesPullingTime="6.188458612s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:54.9978034 +0000 UTC m=+73.382873675" watchObservedRunningTime="2026-07-09 19:00:54.998791469 +0000 UTC m=+73.383861746"
Jul 09 19:00:55.048767 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.048740    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-7wwbk"]
Jul 09 19:00:55.051599 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:00:55.051572    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82b57efd_d3d6_4e60_9102_88fea9ebadb4.slice/crio-55cf4ed6d901dff9b77a24a4926e9085bae1c60403a3222738ad57d302ca5aed WatchSource:0}: Error finding container 55cf4ed6d901dff9b77a24a4926e9085bae1c60403a3222738ad57d302ca5aed: Status 404 returned error can't find the container with id 55cf4ed6d901dff9b77a24a4926e9085bae1c60403a3222738ad57d302ca5aed
Jul 09 19:00:55.063055 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.063032    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-pdx9m"]
Jul 09 19:00:55.065705 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:00:55.065673    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod393d0b99_20db_49d4_bb50_bef80c86563d.slice/crio-416d66838af33977befa61bf5fb1c638df45b66ace810f52453c299ab85eedd4 WatchSource:0}: Error finding container 416d66838af33977befa61bf5fb1c638df45b66ace810f52453c299ab85eedd4: Status 404 returned error can't find the container with id 416d66838af33977befa61bf5fb1c638df45b66ace810f52453c299ab85eedd4
Jul 09 19:00:55.092790 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.092759    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 19:00:55.097892 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.097870    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.102584 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.102565    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 09 19:00:55.103355 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.103332    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 09 19:00:55.103447 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.103409    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 09 19:00:55.104000 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.103687    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 09 19:00:55.104000 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.103748    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tszp6\""
Jul 09 19:00:55.104224 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.104156    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 09 19:00:55.104224 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.104170    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 09 19:00:55.104224 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.104172    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 09 19:00:55.104394 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.104377    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 09 19:00:55.104841 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.104827    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 09 19:00:55.135951 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.135842    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 19:00:55.227380 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.227347    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-config-out\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.227380 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.227386    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.227553 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.227406    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.227553 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.227422    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwjsb\" (UniqueName: \"kubernetes.io/projected/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-kube-api-access-qwjsb\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.227553 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.227449    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.227553 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.227485    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.227553 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.227518    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.227553 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.227543    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-config-volume\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.227754 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.227569    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.227754 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.227598    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-web-config\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.227754 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.227623    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.227754 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.227641    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.227754 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.227665    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.254673 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.254634    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:55.318156 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.318068    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:55.328985 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.328948    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.328985 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.328983    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.329238 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.329021    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.329238 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.329064    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-config-volume\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.329238 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.329102    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.329238 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.329139    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-web-config\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.329238 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.329166    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.329238 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.329194    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.329238 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.329239    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.329570 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.329284    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-config-out\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.329570 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.329326    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.329570 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.329351    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.329570 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.329378    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwjsb\" (UniqueName: \"kubernetes.io/projected/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-kube-api-access-qwjsb\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.329570 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.329436    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.330405 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.330114    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.330405 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.330195    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.333275 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.333202    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.333275 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.333227    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.333471 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.333422    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.333616 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.333527    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.334220 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.333883    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-config-out\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.334220 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.334188    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-web-config\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.334389 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.334293    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.335161 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.335132    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-config-volume\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.335492 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.335470    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.338009 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.337990    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwjsb\" (UniqueName: \"kubernetes.io/projected/ba94276e-4b28-40d0-bd8d-c7e6b628adf9-kube-api-access-qwjsb\") pod \"alertmanager-main-0\" (UID: \"ba94276e-4b28-40d0-bd8d-c7e6b628adf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.402071 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.402027    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:55.406579 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.406552    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 19:00:55.571323 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.571182    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 19:00:55.575901 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:00:55.575873    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba94276e_4b28_40d0_bd8d_c7e6b628adf9.slice/crio-2eff4878493bd50e71c2f48b2c32b40439da40a41c1573329f8d13b1938ddaa8 WatchSource:0}: Error finding container 2eff4878493bd50e71c2f48b2c32b40439da40a41c1573329f8d13b1938ddaa8: Status 404 returned error can't find the container with id 2eff4878493bd50e71c2f48b2c32b40439da40a41c1573329f8d13b1938ddaa8
Jul 09 19:00:55.951083 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.951056    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-69544d7d48-zd6h4"]
Jul 09 19:00:55.955756 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.955737    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4"
Jul 09 19:00:55.959372 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.959159    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-p9bw4\""
Jul 09 19:00:55.959372 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.959181    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 09 19:00:55.959372 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.959201    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 09 19:00:55.959372 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.959218    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 09 19:00:55.959372 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.959240    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 09 19:00:55.959372 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.959265    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 09 19:00:55.959372 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.959221    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1j74td92g9u9f\""
Jul 09 19:00:55.969308 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.969282    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-69544d7d48-zd6h4"]
Jul 09 19:00:55.973245 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.973219    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba94276e-4b28-40d0-bd8d-c7e6b628adf9","Type":"ContainerStarted","Data":"2eff4878493bd50e71c2f48b2c32b40439da40a41c1573329f8d13b1938ddaa8"}
Jul 09 19:00:55.975208 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.975182    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7wwbk" event={"ID":"82b57efd-d3d6-4e60-9102-88fea9ebadb4","Type":"ContainerStarted","Data":"605e88fc2825f67d688fe17722b7501a6f10661dd5c1c0aaed4e94aa06812095"}
Jul 09 19:00:55.975322 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.975229    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7wwbk" event={"ID":"82b57efd-d3d6-4e60-9102-88fea9ebadb4","Type":"ContainerStarted","Data":"4c07d51b9cc24b3d3084609ef90c42426c83295ef2e4f1ada38296c91546bfc3"}
Jul 09 19:00:55.975322 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.975255    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7wwbk" event={"ID":"82b57efd-d3d6-4e60-9102-88fea9ebadb4","Type":"ContainerStarted","Data":"55cf4ed6d901dff9b77a24a4926e9085bae1c60403a3222738ad57d302ca5aed"}
Jul 09 19:00:55.976743 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.976720    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qrrl7" event={"ID":"2d925277-c169-430e-9535-1a3da7490d86","Type":"ContainerStarted","Data":"589066274d14c192d34025c0021969445d6007c9ee9848dc36a613933c3a857f"}
Jul 09 19:00:55.978073 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:55.978050    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-pdx9m" event={"ID":"393d0b99-20db-49d4-bb50-bef80c86563d","Type":"ContainerStarted","Data":"416d66838af33977befa61bf5fb1c638df45b66ace810f52453c299ab85eedd4"}
Jul 09 19:00:56.034930 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:56.034896    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7aeef437-26b0-411d-b8c0-4878ea3036d1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69544d7d48-zd6h4\" (UID: \"7aeef437-26b0-411d-b8c0-4878ea3036d1\") " pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4"
Jul 09 19:00:56.035107 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:56.034951    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7fcn\" (UniqueName: \"kubernetes.io/projected/7aeef437-26b0-411d-b8c0-4878ea3036d1-kube-api-access-b7fcn\") pod \"thanos-querier-69544d7d48-zd6h4\" (UID: \"7aeef437-26b0-411d-b8c0-4878ea3036d1\") " pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4"
Jul 09 19:00:56.035107 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:56.034975    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7aeef437-26b0-411d-b8c0-4878ea3036d1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69544d7d48-zd6h4\" (UID: \"7aeef437-26b0-411d-b8c0-4878ea3036d1\") " pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4"
Jul 09 19:00:56.035107 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:56.035035    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7aeef437-26b0-411d-b8c0-4878ea3036d1-secret-thanos-querier-tls\") pod \"thanos-querier-69544d7d48-zd6h4\" (UID: \"7aeef437-26b0-411d-b8c0-4878ea3036d1\") " pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4"
Jul 09 19:00:56.035107 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:56.035080    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7aeef437-26b0-411d-b8c0-4878ea3036d1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69544d7d48-zd6h4\" (UID: \"7aeef437-26b0-411d-b8c0-4878ea3036d1\") " pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4"
Jul 09 19:00:56.035107 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:56.035106    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7aeef437-26b0-411d-b8c0-4878ea3036d1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69544d7d48-zd6h4\" (UID: \"7aeef437-26b0-411d-b8c0-4878ea3036d1\") " pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4"
Jul 09 19:00:56.035359 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:56.035123    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7aeef437-26b0-411d-b8c0-4878ea3036d1-secret-grpc-tls\") pod \"thanos-querier-69544d7d48-zd6h4\" (UID: \"7aeef437-26b0-411d-b8c0-4878ea3036d1\") " pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4"
Jul 09 19:00:56.035359 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:56.035244    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7aeef437-26b0-411d-b8c0-4878ea3036d1-metrics-client-ca\") pod \"thanos-querier-69544d7d48-zd6h4\" (UID: \"7aeef437-26b0-411d-b8c0-4878ea3036d1\") " pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4"
Jul 09 19:00:56.135871 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:56.135839    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7aeef437-26b0-411d-b8c0-4878ea3036d1-metrics-client-ca\") pod \"thanos-querier-69544d7d48-zd6h4\" (UID: \"7aeef437-26b0-411d-b8c0-4878ea3036d1\") " pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4"
Jul 09 19:00:56.136027 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:56.135912    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7aeef437-26b0-411d-b8c0-4878ea3036d1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69544d7d48-zd6h4\" (UID: \"7aeef437-26b0-411d-b8c0-4878ea3036d1\") " pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4"
Jul 09 19:00:56.136027 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:56.135950    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7fcn\" (UniqueName: \"kubernetes.io/projected/7aeef437-26b0-411d-b8c0-4878ea3036d1-kube-api-access-b7fcn\") pod \"thanos-querier-69544d7d48-zd6h4\" (UID: \"7aeef437-26b0-411d-b8c0-4878ea3036d1\") " pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4"
Jul 09 19:00:56.136027 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:56.135983    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7aeef437-26b0-411d-b8c0-4878ea3036d1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69544d7d48-zd6h4\" (UID: \"7aeef437-26b0-411d-b8c0-4878ea3036d1\") " pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4"
Jul 09 19:00:56.136027 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:56.136018    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7aeef437-26b0-411d-b8c0-4878ea3036d1-secret-thanos-querier-tls\") pod \"thanos-querier-69544d7d48-zd6h4\" (UID: \"7aeef437-26b0-411d-b8c0-4878ea3036d1\") " pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4"
Jul 09 19:00:56.136242 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:56.136050    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7aeef437-26b0-411d-b8c0-4878ea3036d1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69544d7d48-zd6h4\" (UID: \"7aeef437-26b0-411d-b8c0-4878ea3036d1\") " pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4"
Jul 09 19:00:56.136242 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:56.136076    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7aeef437-26b0-411d-b8c0-4878ea3036d1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69544d7d48-zd6h4\" (UID: \"7aeef437-26b0-411d-b8c0-4878ea3036d1\") " pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4"
Jul 09 19:00:56.136242 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:56.136103    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7aeef437-26b0-411d-b8c0-4878ea3036d1-secret-grpc-tls\") pod \"thanos-querier-69544d7d48-zd6h4\" (UID: \"7aeef437-26b0-411d-b8c0-4878ea3036d1\") " pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4"
Jul 09 19:00:56.136718 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:56.136665    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7aeef437-26b0-411d-b8c0-4878ea3036d1-metrics-client-ca\") pod \"thanos-querier-69544d7d48-zd6h4\" (UID: \"7aeef437-26b0-411d-b8c0-4878ea3036d1\") " pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4"
Jul 09 19:00:56.138748 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:56.138695    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7aeef437-26b0-411d-b8c0-4878ea3036d1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69544d7d48-zd6h4\" (UID: \"7aeef437-26b0-411d-b8c0-4878ea3036d1\") " pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4"
Jul 09 19:00:56.138748 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:56.138733    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7aeef437-26b0-411d-b8c0-4878ea3036d1-secret-grpc-tls\") pod \"thanos-querier-69544d7d48-zd6h4\" (UID: \"7aeef437-26b0-411d-b8c0-4878ea3036d1\") " pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4"
Jul 09 19:00:56.138961 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:56.138874    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7aeef437-26b0-411d-b8c0-4878ea3036d1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69544d7d48-zd6h4\" (UID: \"7aeef437-26b0-411d-b8c0-4878ea3036d1\") " pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4"
Jul 09 19:00:56.138961 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:56.138897    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7aeef437-26b0-411d-b8c0-4878ea3036d1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69544d7d48-zd6h4\" (UID: \"7aeef437-26b0-411d-b8c0-4878ea3036d1\") " pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4"
Jul 09 19:00:56.139135 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:56.139057    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7aeef437-26b0-411d-b8c0-4878ea3036d1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69544d7d48-zd6h4\" (UID: \"7aeef437-26b0-411d-b8c0-4878ea3036d1\") " pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4"
Jul 09 19:00:56.139187 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:56.139160    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7aeef437-26b0-411d-b8c0-4878ea3036d1-secret-thanos-querier-tls\") pod \"thanos-querier-69544d7d48-zd6h4\" (UID: \"7aeef437-26b0-411d-b8c0-4878ea3036d1\") " pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4"
Jul 09 19:00:56.144676 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:56.144654    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7fcn\" (UniqueName: \"kubernetes.io/projected/7aeef437-26b0-411d-b8c0-4878ea3036d1-kube-api-access-b7fcn\") pod \"thanos-querier-69544d7d48-zd6h4\" (UID: \"7aeef437-26b0-411d-b8c0-4878ea3036d1\") " pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4"
Jul 09 19:00:56.265595 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:56.265505    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4"
Jul 09 19:00:56.400866 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:56.400844    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-69544d7d48-zd6h4"]
Jul 09 19:00:56.403080 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:00:56.403052    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aeef437_26b0_411d_b8c0_4878ea3036d1.slice/crio-2809617c2491d748a8388fa96ad55f81fce1758c329a5ec737a0b55e148f7711 WatchSource:0}: Error finding container 2809617c2491d748a8388fa96ad55f81fce1758c329a5ec737a0b55e148f7711: Status 404 returned error can't find the container with id 2809617c2491d748a8388fa96ad55f81fce1758c329a5ec737a0b55e148f7711
Jul 09 19:00:56.883866 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:56.883798    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:56.943824 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:56.943779    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:56.985916 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:56.985878    2577 generic.go:356] "Generic (PLEG): container finished" podID="2d925277-c169-430e-9535-1a3da7490d86" containerID="589066274d14c192d34025c0021969445d6007c9ee9848dc36a613933c3a857f" exitCode=0
Jul 09 19:00:56.986383 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:56.985978    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qrrl7" event={"ID":"2d925277-c169-430e-9535-1a3da7490d86","Type":"ContainerDied","Data":"589066274d14c192d34025c0021969445d6007c9ee9848dc36a613933c3a857f"}
Jul 09 19:00:56.988145 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:56.988115    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4" event={"ID":"7aeef437-26b0-411d-b8c0-4878ea3036d1","Type":"ContainerStarted","Data":"2809617c2491d748a8388fa96ad55f81fce1758c329a5ec737a0b55e148f7711"}
Jul 09 19:00:57.807181 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:57.807075    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:57.999349 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:57.999223    2577 generic.go:356] "Generic (PLEG): container finished" podID="ba94276e-4b28-40d0-bd8d-c7e6b628adf9" containerID="ed451ec4564f4ed83a555dd2fa5ab3a7c1244c1790b27dd1fc77ffb9a8ddd267" exitCode=0
Jul 09 19:00:57.999349 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:57.999309    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba94276e-4b28-40d0-bd8d-c7e6b628adf9","Type":"ContainerDied","Data":"ed451ec4564f4ed83a555dd2fa5ab3a7c1244c1790b27dd1fc77ffb9a8ddd267"}
Jul 09 19:00:58.004899 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.004865    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7wwbk" event={"ID":"82b57efd-d3d6-4e60-9102-88fea9ebadb4","Type":"ContainerStarted","Data":"42158b942f1b470f101b13d810cf93e77b93ae1ef8c56a4dad8c042f4cf09e7f"}
Jul 09 19:00:58.008043 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.008017    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qrrl7" event={"ID":"2d925277-c169-430e-9535-1a3da7490d86","Type":"ContainerStarted","Data":"75f53aded811d47110c6a9e7a1d0ff11c581b0aa2661fa3a1f316fdfe4d48373"}
Jul 09 19:00:58.008156 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.008075    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qrrl7" event={"ID":"2d925277-c169-430e-9535-1a3da7490d86","Type":"ContainerStarted","Data":"5046fb11fc95d79c00cfb6ef36ad29d4d6d281454898e2247fbb392dbb1c8baa"}
Jul 09 19:00:58.010749 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.010693    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-pdx9m" event={"ID":"393d0b99-20db-49d4-bb50-bef80c86563d","Type":"ContainerStarted","Data":"930520e833379bcc90731d8355ca09eb825f5e9a60516fbc6c95a30672fbc6a6"}
Jul 09 19:00:58.010868 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.010756    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-pdx9m" event={"ID":"393d0b99-20db-49d4-bb50-bef80c86563d","Type":"ContainerStarted","Data":"0d491f3f23c91239265569156637e62ab5a69e5b8fb1d1b3a3a522c486e7aa28"}
Jul 09 19:00:58.048858 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.048742    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qrrl7" podStartSLOduration=3.869355704 podStartE2EDuration="5.048723791s" totalImagesPullingTime="1.111146883s" totalInitContainerRuntime="68.221204ms" isStatefulPod=true podCreationTimestamp="2026-07-09 19:00:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:58.048021725 +0000 UTC m=+76.433092034" watchObservedRunningTime="2026-07-09 19:00:58.048723791 +0000 UTC m=+76.433794064"
Jul 09 19:00:58.067290 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.067237    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7wwbk" podStartSLOduration=2.5357590869999997 podStartE2EDuration="5.067221886s" totalImagesPullingTime="2.531462799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:00:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:58.065589831 +0000 UTC m=+76.450660106" watchObservedRunningTime="2026-07-09 19:00:58.067221886 +0000 UTC m=+76.452292162"
Jul 09 19:00:58.183042 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.183004    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:58.279138 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.279059    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-578847dcdd-vqskg"]
Jul 09 19:00:58.282762 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.282738    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-578847dcdd-vqskg"
Jul 09 19:00:58.286002 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.285974    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 09 19:00:58.286126 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.286010    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 09 19:00:58.287526 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.287486    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 09 19:00:58.287526 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.287515    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-r4dl0memouu9\""
Jul 09 19:00:58.287695 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.287493    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-bctxg\""
Jul 09 19:00:58.287695 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.287487    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 09 19:00:58.295755 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.295107    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-578847dcdd-vqskg"]
Jul 09 19:00:58.355498 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.355453    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7687faf4-d297-4618-9243-35897a1bc2ec-secret-metrics-server-tls\") pod \"metrics-server-578847dcdd-vqskg\" (UID: \"7687faf4-d297-4618-9243-35897a1bc2ec\") " pod="openshift-monitoring/metrics-server-578847dcdd-vqskg"
Jul 09 19:00:58.355657 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.355544    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb8kt\" (UniqueName: \"kubernetes.io/projected/7687faf4-d297-4618-9243-35897a1bc2ec-kube-api-access-qb8kt\") pod \"metrics-server-578847dcdd-vqskg\" (UID: \"7687faf4-d297-4618-9243-35897a1bc2ec\") " pod="openshift-monitoring/metrics-server-578847dcdd-vqskg"
Jul 09 19:00:58.355657 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.355579    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7687faf4-d297-4618-9243-35897a1bc2ec-audit-log\") pod \"metrics-server-578847dcdd-vqskg\" (UID: \"7687faf4-d297-4618-9243-35897a1bc2ec\") " pod="openshift-monitoring/metrics-server-578847dcdd-vqskg"
Jul 09 19:00:58.355783 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.355674    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7687faf4-d297-4618-9243-35897a1bc2ec-secret-metrics-server-client-certs\") pod \"metrics-server-578847dcdd-vqskg\" (UID: \"7687faf4-d297-4618-9243-35897a1bc2ec\") " pod="openshift-monitoring/metrics-server-578847dcdd-vqskg"
Jul 09 19:00:58.355783 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.355712    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7687faf4-d297-4618-9243-35897a1bc2ec-client-ca-bundle\") pod \"metrics-server-578847dcdd-vqskg\" (UID: \"7687faf4-d297-4618-9243-35897a1bc2ec\") " pod="openshift-monitoring/metrics-server-578847dcdd-vqskg"
Jul 09 19:00:58.355883 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.355860    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7687faf4-d297-4618-9243-35897a1bc2ec-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-578847dcdd-vqskg\" (UID: \"7687faf4-d297-4618-9243-35897a1bc2ec\") " pod="openshift-monitoring/metrics-server-578847dcdd-vqskg"
Jul 09 19:00:58.355924 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.355894    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7687faf4-d297-4618-9243-35897a1bc2ec-metrics-server-audit-profiles\") pod \"metrics-server-578847dcdd-vqskg\" (UID: \"7687faf4-d297-4618-9243-35897a1bc2ec\") " pod="openshift-monitoring/metrics-server-578847dcdd-vqskg"
Jul 09 19:00:58.456909 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.456872    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7687faf4-d297-4618-9243-35897a1bc2ec-secret-metrics-server-tls\") pod \"metrics-server-578847dcdd-vqskg\" (UID: \"7687faf4-d297-4618-9243-35897a1bc2ec\") " pod="openshift-monitoring/metrics-server-578847dcdd-vqskg"
Jul 09 19:00:58.457102 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.456957    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb8kt\" (UniqueName: \"kubernetes.io/projected/7687faf4-d297-4618-9243-35897a1bc2ec-kube-api-access-qb8kt\") pod \"metrics-server-578847dcdd-vqskg\" (UID: \"7687faf4-d297-4618-9243-35897a1bc2ec\") " pod="openshift-monitoring/metrics-server-578847dcdd-vqskg"
Jul 09 19:00:58.457102 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.456988    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7687faf4-d297-4618-9243-35897a1bc2ec-audit-log\") pod \"metrics-server-578847dcdd-vqskg\" (UID: \"7687faf4-d297-4618-9243-35897a1bc2ec\") " pod="openshift-monitoring/metrics-server-578847dcdd-vqskg"
Jul 09 19:00:58.457102 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.457026    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7687faf4-d297-4618-9243-35897a1bc2ec-secret-metrics-server-client-certs\") pod \"metrics-server-578847dcdd-vqskg\" (UID: \"7687faf4-d297-4618-9243-35897a1bc2ec\") " pod="openshift-monitoring/metrics-server-578847dcdd-vqskg"
Jul 09 19:00:58.457102 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.457049    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7687faf4-d297-4618-9243-35897a1bc2ec-client-ca-bundle\") pod \"metrics-server-578847dcdd-vqskg\" (UID: \"7687faf4-d297-4618-9243-35897a1bc2ec\") " pod="openshift-monitoring/metrics-server-578847dcdd-vqskg"
Jul 09 19:00:58.457297 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.457135    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7687faf4-d297-4618-9243-35897a1bc2ec-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-578847dcdd-vqskg\" (UID: \"7687faf4-d297-4618-9243-35897a1bc2ec\") " pod="openshift-monitoring/metrics-server-578847dcdd-vqskg"
Jul 09 19:00:58.457297 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.457170    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7687faf4-d297-4618-9243-35897a1bc2ec-metrics-server-audit-profiles\") pod \"metrics-server-578847dcdd-vqskg\" (UID: \"7687faf4-d297-4618-9243-35897a1bc2ec\") " pod="openshift-monitoring/metrics-server-578847dcdd-vqskg"
Jul 09 19:00:58.457856 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.457755    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7687faf4-d297-4618-9243-35897a1bc2ec-audit-log\") pod \"metrics-server-578847dcdd-vqskg\" (UID: \"7687faf4-d297-4618-9243-35897a1bc2ec\") " pod="openshift-monitoring/metrics-server-578847dcdd-vqskg"
Jul 09 19:00:58.458044 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.457985    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7687faf4-d297-4618-9243-35897a1bc2ec-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-578847dcdd-vqskg\" (UID: \"7687faf4-d297-4618-9243-35897a1bc2ec\") " pod="openshift-monitoring/metrics-server-578847dcdd-vqskg"
Jul 09 19:00:58.458335 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.458286    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7687faf4-d297-4618-9243-35897a1bc2ec-metrics-server-audit-profiles\") pod \"metrics-server-578847dcdd-vqskg\" (UID: \"7687faf4-d297-4618-9243-35897a1bc2ec\") " pod="openshift-monitoring/metrics-server-578847dcdd-vqskg"
Jul 09 19:00:58.459854 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.459830    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7687faf4-d297-4618-9243-35897a1bc2ec-secret-metrics-server-tls\") pod \"metrics-server-578847dcdd-vqskg\" (UID: \"7687faf4-d297-4618-9243-35897a1bc2ec\") " pod="openshift-monitoring/metrics-server-578847dcdd-vqskg"
Jul 09 19:00:58.459982 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.459957    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7687faf4-d297-4618-9243-35897a1bc2ec-client-ca-bundle\") pod \"metrics-server-578847dcdd-vqskg\" (UID: \"7687faf4-d297-4618-9243-35897a1bc2ec\") " pod="openshift-monitoring/metrics-server-578847dcdd-vqskg"
Jul 09 19:00:58.460169 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.460138    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7687faf4-d297-4618-9243-35897a1bc2ec-secret-metrics-server-client-certs\") pod \"metrics-server-578847dcdd-vqskg\" (UID: \"7687faf4-d297-4618-9243-35897a1bc2ec\") " pod="openshift-monitoring/metrics-server-578847dcdd-vqskg"
Jul 09 19:00:58.461753 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.461725    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:58.465598 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.465575    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb8kt\" (UniqueName: \"kubernetes.io/projected/7687faf4-d297-4618-9243-35897a1bc2ec-kube-api-access-qb8kt\") pod \"metrics-server-578847dcdd-vqskg\" (UID: \"7687faf4-d297-4618-9243-35897a1bc2ec\") " pod="openshift-monitoring/metrics-server-578847dcdd-vqskg"
Jul 09 19:00:58.562637 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.562537    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:58.597544 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.597497    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-578847dcdd-vqskg"
Jul 09 19:00:58.752319 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.752284    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-q2pgk"]
Jul 09 19:00:58.755753 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.755727    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-q2pgk"
Jul 09 19:00:58.758625 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.758604    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 09 19:00:58.758982 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.758962    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-h26qq\""
Jul 09 19:00:58.766201 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.765600    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-q2pgk"]
Jul 09 19:00:58.770381 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.770357    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-759fb69bc9-2jdmf"]
Jul 09 19:00:58.773486 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.773466    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759fb69bc9-2jdmf"
Jul 09 19:00:58.786449 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.786422    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-759fb69bc9-2jdmf"]
Jul 09 19:00:58.860447 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.860420    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f562fd94-5906-419c-800b-686ce9abb62e-trusted-ca-bundle\") pod \"console-759fb69bc9-2jdmf\" (UID: \"f562fd94-5906-419c-800b-686ce9abb62e\") " pod="openshift-console/console-759fb69bc9-2jdmf"
Jul 09 19:00:58.860548 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.860461    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f562fd94-5906-419c-800b-686ce9abb62e-console-oauth-config\") pod \"console-759fb69bc9-2jdmf\" (UID: \"f562fd94-5906-419c-800b-686ce9abb62e\") " pod="openshift-console/console-759fb69bc9-2jdmf"
Jul 09 19:00:58.860548 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.860484    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f562fd94-5906-419c-800b-686ce9abb62e-service-ca\") pod \"console-759fb69bc9-2jdmf\" (UID: \"f562fd94-5906-419c-800b-686ce9abb62e\") " pod="openshift-console/console-759fb69bc9-2jdmf"
Jul 09 19:00:58.860548 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.860509    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpknl\" (UniqueName: \"kubernetes.io/projected/f562fd94-5906-419c-800b-686ce9abb62e-kube-api-access-cpknl\") pod \"console-759fb69bc9-2jdmf\" (UID: \"f562fd94-5906-419c-800b-686ce9abb62e\") " pod="openshift-console/console-759fb69bc9-2jdmf"
Jul 09 19:00:58.860548 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.860536    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/750b5f41-0adb-44a3-a504-88fe8cd67cf9-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-q2pgk\" (UID: \"750b5f41-0adb-44a3-a504-88fe8cd67cf9\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-q2pgk"
Jul 09 19:00:58.860717 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.860553    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f562fd94-5906-419c-800b-686ce9abb62e-oauth-serving-cert\") pod \"console-759fb69bc9-2jdmf\" (UID: \"f562fd94-5906-419c-800b-686ce9abb62e\") " pod="openshift-console/console-759fb69bc9-2jdmf"
Jul 09 19:00:58.860717 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.860574    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f562fd94-5906-419c-800b-686ce9abb62e-console-config\") pod \"console-759fb69bc9-2jdmf\" (UID: \"f562fd94-5906-419c-800b-686ce9abb62e\") " pod="openshift-console/console-759fb69bc9-2jdmf"
Jul 09 19:00:58.860717 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.860613    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f562fd94-5906-419c-800b-686ce9abb62e-console-serving-cert\") pod \"console-759fb69bc9-2jdmf\" (UID: \"f562fd94-5906-419c-800b-686ce9abb62e\") " pod="openshift-console/console-759fb69bc9-2jdmf"
Jul 09 19:00:58.860717 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.860653    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z222l\" (UniqueName: \"kubernetes.io/projected/750b5f41-0adb-44a3-a504-88fe8cd67cf9-kube-api-access-z222l\") pod \"monitoring-plugin-5f68df7f58-q2pgk\" (UID: \"750b5f41-0adb-44a3-a504-88fe8cd67cf9\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-q2pgk"
Jul 09 19:00:58.914389 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.914323    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-578847dcdd-vqskg"]
Jul 09 19:00:58.921887 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:00:58.921857    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7687faf4_d297_4618_9243_35897a1bc2ec.slice/crio-282d1e85db196fb93dda49ba67e90f31da9e0978362ce1ac0c92f34a1222db94 WatchSource:0}: Error finding container 282d1e85db196fb93dda49ba67e90f31da9e0978362ce1ac0c92f34a1222db94: Status 404 returned error can't find the container with id 282d1e85db196fb93dda49ba67e90f31da9e0978362ce1ac0c92f34a1222db94
Jul 09 19:00:58.961382 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.961351    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/750b5f41-0adb-44a3-a504-88fe8cd67cf9-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-q2pgk\" (UID: \"750b5f41-0adb-44a3-a504-88fe8cd67cf9\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-q2pgk"
Jul 09 19:00:58.961483 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.961393    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f562fd94-5906-419c-800b-686ce9abb62e-oauth-serving-cert\") pod \"console-759fb69bc9-2jdmf\" (UID: \"f562fd94-5906-419c-800b-686ce9abb62e\") " pod="openshift-console/console-759fb69bc9-2jdmf"
Jul 09 19:00:58.961483 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.961419    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f562fd94-5906-419c-800b-686ce9abb62e-console-config\") pod \"console-759fb69bc9-2jdmf\" (UID: \"f562fd94-5906-419c-800b-686ce9abb62e\") " pod="openshift-console/console-759fb69bc9-2jdmf"
Jul 09 19:00:58.961483 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.961447    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f562fd94-5906-419c-800b-686ce9abb62e-console-serving-cert\") pod \"console-759fb69bc9-2jdmf\" (UID: \"f562fd94-5906-419c-800b-686ce9abb62e\") " pod="openshift-console/console-759fb69bc9-2jdmf"
Jul 09 19:00:58.961642 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.961510    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z222l\" (UniqueName: \"kubernetes.io/projected/750b5f41-0adb-44a3-a504-88fe8cd67cf9-kube-api-access-z222l\") pod \"monitoring-plugin-5f68df7f58-q2pgk\" (UID: \"750b5f41-0adb-44a3-a504-88fe8cd67cf9\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-q2pgk"
Jul 09 19:00:58.961642 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.961562    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f562fd94-5906-419c-800b-686ce9abb62e-trusted-ca-bundle\") pod \"console-759fb69bc9-2jdmf\" (UID: \"f562fd94-5906-419c-800b-686ce9abb62e\") " pod="openshift-console/console-759fb69bc9-2jdmf"
Jul 09 19:00:58.961642 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.961612    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f562fd94-5906-419c-800b-686ce9abb62e-console-oauth-config\") pod \"console-759fb69bc9-2jdmf\" (UID: \"f562fd94-5906-419c-800b-686ce9abb62e\") " pod="openshift-console/console-759fb69bc9-2jdmf"
Jul 09 19:00:58.961782 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.961647    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f562fd94-5906-419c-800b-686ce9abb62e-service-ca\") pod \"console-759fb69bc9-2jdmf\" (UID: \"f562fd94-5906-419c-800b-686ce9abb62e\") " pod="openshift-console/console-759fb69bc9-2jdmf"
Jul 09 19:00:58.961782 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.961673    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpknl\" (UniqueName: \"kubernetes.io/projected/f562fd94-5906-419c-800b-686ce9abb62e-kube-api-access-cpknl\") pod \"console-759fb69bc9-2jdmf\" (UID: \"f562fd94-5906-419c-800b-686ce9abb62e\") " pod="openshift-console/console-759fb69bc9-2jdmf"
Jul 09 19:00:58.962464 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.962439    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f562fd94-5906-419c-800b-686ce9abb62e-service-ca\") pod \"console-759fb69bc9-2jdmf\" (UID: \"f562fd94-5906-419c-800b-686ce9abb62e\") " pod="openshift-console/console-759fb69bc9-2jdmf"
Jul 09 19:00:58.962603 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.962505    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f562fd94-5906-419c-800b-686ce9abb62e-console-config\") pod \"console-759fb69bc9-2jdmf\" (UID: \"f562fd94-5906-419c-800b-686ce9abb62e\") " pod="openshift-console/console-759fb69bc9-2jdmf"
Jul 09 19:00:58.962840 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.962791    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f562fd94-5906-419c-800b-686ce9abb62e-oauth-serving-cert\") pod \"console-759fb69bc9-2jdmf\" (UID: \"f562fd94-5906-419c-800b-686ce9abb62e\") " pod="openshift-console/console-759fb69bc9-2jdmf"
Jul 09 19:00:58.963202 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.963173    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f562fd94-5906-419c-800b-686ce9abb62e-trusted-ca-bundle\") pod \"console-759fb69bc9-2jdmf\" (UID: \"f562fd94-5906-419c-800b-686ce9abb62e\") " pod="openshift-console/console-759fb69bc9-2jdmf"
Jul 09 19:00:58.964177 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.964134    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f562fd94-5906-419c-800b-686ce9abb62e-console-serving-cert\") pod \"console-759fb69bc9-2jdmf\" (UID: \"f562fd94-5906-419c-800b-686ce9abb62e\") " pod="openshift-console/console-759fb69bc9-2jdmf"
Jul 09 19:00:58.964736 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.964408    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f562fd94-5906-419c-800b-686ce9abb62e-console-oauth-config\") pod \"console-759fb69bc9-2jdmf\" (UID: \"f562fd94-5906-419c-800b-686ce9abb62e\") " pod="openshift-console/console-759fb69bc9-2jdmf"
Jul 09 19:00:58.964736 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.964447    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/750b5f41-0adb-44a3-a504-88fe8cd67cf9-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-q2pgk\" (UID: \"750b5f41-0adb-44a3-a504-88fe8cd67cf9\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-q2pgk"
Jul 09 19:00:58.970804 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.970778    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpknl\" (UniqueName: \"kubernetes.io/projected/f562fd94-5906-419c-800b-686ce9abb62e-kube-api-access-cpknl\") pod \"console-759fb69bc9-2jdmf\" (UID: \"f562fd94-5906-419c-800b-686ce9abb62e\") " pod="openshift-console/console-759fb69bc9-2jdmf"
Jul 09 19:00:58.970934 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:58.970913    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z222l\" (UniqueName: \"kubernetes.io/projected/750b5f41-0adb-44a3-a504-88fe8cd67cf9-kube-api-access-z222l\") pod \"monitoring-plugin-5f68df7f58-q2pgk\" (UID: \"750b5f41-0adb-44a3-a504-88fe8cd67cf9\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-q2pgk"
Jul 09 19:00:59.018348 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:59.018316    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-pdx9m" event={"ID":"393d0b99-20db-49d4-bb50-bef80c86563d","Type":"ContainerStarted","Data":"a62c4ffa4870b8bd945d6f1571551ee8f80f836c166de1863bc999b91b1a68fc"}
Jul 09 19:00:59.020888 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:59.020860    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4" event={"ID":"7aeef437-26b0-411d-b8c0-4878ea3036d1","Type":"ContainerStarted","Data":"826c985da25f8c25610a579bc8da0ae77badb1a186fa4676239e7bee76e52ef0"}
Jul 09 19:00:59.021001 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:59.020943    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4" event={"ID":"7aeef437-26b0-411d-b8c0-4878ea3036d1","Type":"ContainerStarted","Data":"b3cde859a37212ba7ffabb4d661e6fd9ea9f00938255b684cd6ac2d710cc068f"}
Jul 09 19:00:59.022702 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:59.022675    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-578847dcdd-vqskg" event={"ID":"7687faf4-d297-4618-9243-35897a1bc2ec","Type":"ContainerStarted","Data":"282d1e85db196fb93dda49ba67e90f31da9e0978362ce1ac0c92f34a1222db94"}
Jul 09 19:00:59.038960 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:59.038845    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-pdx9m" podStartSLOduration=3.381917455 podStartE2EDuration="6.03882272s" totalImagesPullingTime="2.656905265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:00:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:59.037461963 +0000 UTC m=+77.422532239" watchObservedRunningTime="2026-07-09 19:00:59.03882272 +0000 UTC m=+77.423892992"
Jul 09 19:00:59.068233 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:59.068197    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-q2pgk"
Jul 09 19:00:59.086615 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:59.086360    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759fb69bc9-2jdmf"
Jul 09 19:00:59.147656 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:59.147545    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:59.212992 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:59.212953    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:00:59.225518 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:59.225492    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-q2pgk"]
Jul 09 19:00:59.228617 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:00:59.228589    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod750b5f41_0adb_44a3_a504_88fe8cd67cf9.slice/crio-7a719e8a22766e541a450c4558f6bcfa2bae63723556068b22b3282343b6a69b WatchSource:0}: Error finding container 7a719e8a22766e541a450c4558f6bcfa2bae63723556068b22b3282343b6a69b: Status 404 returned error can't find the container with id 7a719e8a22766e541a450c4558f6bcfa2bae63723556068b22b3282343b6a69b
Jul 09 19:00:59.247927 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:00:59.247904    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-759fb69bc9-2jdmf"]
Jul 09 19:00:59.250172 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:00:59.250146    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf562fd94_5906_419c_800b_686ce9abb62e.slice/crio-dfad4e1fcb0620dcd6f73acefa616f28e83f64c60a0bdd242ca740d039a972f3 WatchSource:0}: Error finding container dfad4e1fcb0620dcd6f73acefa616f28e83f64c60a0bdd242ca740d039a972f3: Status 404 returned error can't find the container with id dfad4e1fcb0620dcd6f73acefa616f28e83f64c60a0bdd242ca740d039a972f3
Jul 09 19:01:00.029784 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.029738    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-q2pgk" event={"ID":"750b5f41-0adb-44a3-a504-88fe8cd67cf9","Type":"ContainerStarted","Data":"7a719e8a22766e541a450c4558f6bcfa2bae63723556068b22b3282343b6a69b"}
Jul 09 19:01:00.031498 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.031471    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759fb69bc9-2jdmf" event={"ID":"f562fd94-5906-419c-800b-686ce9abb62e","Type":"ContainerStarted","Data":"34f0cf9bd56d0c2c2be4bd28324327959ce060e4de393359de5bf5d8ef640a4c"}
Jul 09 19:01:00.031621 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.031519    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759fb69bc9-2jdmf" event={"ID":"f562fd94-5906-419c-800b-686ce9abb62e","Type":"ContainerStarted","Data":"dfad4e1fcb0620dcd6f73acefa616f28e83f64c60a0bdd242ca740d039a972f3"}
Jul 09 19:01:00.033953 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.033920    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4" event={"ID":"7aeef437-26b0-411d-b8c0-4878ea3036d1","Type":"ContainerStarted","Data":"3bdcfe4907a28fe5fcbde119abc0af8944ebbefa41173f4864d98a2f6f68919d"}
Jul 09 19:01:00.056954 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.056841    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-759fb69bc9-2jdmf" podStartSLOduration=2.056798066 podStartE2EDuration="2.056798066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:00:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:01:00.0536617 +0000 UTC m=+78.438732013" watchObservedRunningTime="2026-07-09 19:01:00.056798066 +0000 UTC m=+78.441868342"
Jul 09 19:01:00.155740 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.155673    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:01:00.161123 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.158699    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 19:01:00.165303 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.165274    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.168950 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.168712    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 09 19:01:00.168950 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.168778    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 09 19:01:00.168950 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.168721    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 09 19:01:00.169263 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.169173    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ae2p0d1fir75v\""
Jul 09 19:01:00.169263 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.169238    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 09 19:01:00.169376 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.169320    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 09 19:01:00.170509 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.170486    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 09 19:01:00.170759 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.170742    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 09 19:01:00.171182 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.171155    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-77pj4\""
Jul 09 19:01:00.171310 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.171288    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 09 19:01:00.171396 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.171378    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 09 19:01:00.171468 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.171380    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 09 19:01:00.171468 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.171417    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 09 19:01:00.171612 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.171501    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 09 19:01:00.174067 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.174050    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 09 19:01:00.178855 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.178833    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 09 19:01:00.180531 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.180513    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 19:01:00.277504 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.277411    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/45eb820c-c11f-460e-8a80-19ef30f80904-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.277504 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.277467    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/45eb820c-c11f-460e-8a80-19ef30f80904-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.277504 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.277501    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45eb820c-c11f-460e-8a80-19ef30f80904-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.277799 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.277553    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjr8c\" (UniqueName: \"kubernetes.io/projected/45eb820c-c11f-460e-8a80-19ef30f80904-kube-api-access-bjr8c\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.277799 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.277635    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45eb820c-c11f-460e-8a80-19ef30f80904-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.277799 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.277693    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/45eb820c-c11f-460e-8a80-19ef30f80904-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.277799 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.277747    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/45eb820c-c11f-460e-8a80-19ef30f80904-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.277799 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.277773    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/45eb820c-c11f-460e-8a80-19ef30f80904-config\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.277799 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.277800    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45eb820c-c11f-460e-8a80-19ef30f80904-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.278130 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.277860    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/45eb820c-c11f-460e-8a80-19ef30f80904-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.278130 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.277918    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45eb820c-c11f-460e-8a80-19ef30f80904-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.278130 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.277958    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45eb820c-c11f-460e-8a80-19ef30f80904-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.278130 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.278000    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/45eb820c-c11f-460e-8a80-19ef30f80904-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.278130 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.278033    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45eb820c-c11f-460e-8a80-19ef30f80904-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.278130 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.278093    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/45eb820c-c11f-460e-8a80-19ef30f80904-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.278130 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.278128    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45eb820c-c11f-460e-8a80-19ef30f80904-config-out\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.278470 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.278173    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45eb820c-c11f-460e-8a80-19ef30f80904-web-config\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.278470 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.278203    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/45eb820c-c11f-460e-8a80-19ef30f80904-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.278470 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.278226    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45eb820c-c11f-460e-8a80-19ef30f80904-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.278470 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.278258    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/45eb820c-c11f-460e-8a80-19ef30f80904-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.379669 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.379588    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45eb820c-c11f-460e-8a80-19ef30f80904-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.379669 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.379633    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/45eb820c-c11f-460e-8a80-19ef30f80904-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.379912 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.379689    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/45eb820c-c11f-460e-8a80-19ef30f80904-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.379912 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.379715    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/45eb820c-c11f-460e-8a80-19ef30f80904-config\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.379912 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.379748    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45eb820c-c11f-460e-8a80-19ef30f80904-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.379912 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.379771    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/45eb820c-c11f-460e-8a80-19ef30f80904-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.379912 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.379837    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45eb820c-c11f-460e-8a80-19ef30f80904-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.379912 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.379864    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45eb820c-c11f-460e-8a80-19ef30f80904-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.379912 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.379889    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/45eb820c-c11f-460e-8a80-19ef30f80904-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.380237 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.379949    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45eb820c-c11f-460e-8a80-19ef30f80904-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.380237 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.379992    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/45eb820c-c11f-460e-8a80-19ef30f80904-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.380237 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.380029    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45eb820c-c11f-460e-8a80-19ef30f80904-config-out\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.380237 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.380061    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45eb820c-c11f-460e-8a80-19ef30f80904-web-config\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.380237 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.380096    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/45eb820c-c11f-460e-8a80-19ef30f80904-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.380237 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.380123    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45eb820c-c11f-460e-8a80-19ef30f80904-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.380237 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.380155    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/45eb820c-c11f-460e-8a80-19ef30f80904-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.380237 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.380203    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/45eb820c-c11f-460e-8a80-19ef30f80904-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.380237 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.380233    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/45eb820c-c11f-460e-8a80-19ef30f80904-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.380643 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.380261    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45eb820c-c11f-460e-8a80-19ef30f80904-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.380643 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.380291    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjr8c\" (UniqueName: \"kubernetes.io/projected/45eb820c-c11f-460e-8a80-19ef30f80904-kube-api-access-bjr8c\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.382113 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.381690    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/45eb820c-c11f-460e-8a80-19ef30f80904-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.382113 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.381941    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45eb820c-c11f-460e-8a80-19ef30f80904-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.384607 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.384580    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45eb820c-c11f-460e-8a80-19ef30f80904-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.384952 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.384929    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/45eb820c-c11f-460e-8a80-19ef30f80904-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.385361 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.385335    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/45eb820c-c11f-460e-8a80-19ef30f80904-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.390542 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.390420    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/45eb820c-c11f-460e-8a80-19ef30f80904-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.391836 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.390961    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45eb820c-c11f-460e-8a80-19ef30f80904-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.391836 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.391766    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45eb820c-c11f-460e-8a80-19ef30f80904-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.393025 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.392998    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/45eb820c-c11f-460e-8a80-19ef30f80904-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.393227 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.393190    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45eb820c-c11f-460e-8a80-19ef30f80904-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.400649 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.400588    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjr8c\" (UniqueName: \"kubernetes.io/projected/45eb820c-c11f-460e-8a80-19ef30f80904-kube-api-access-bjr8c\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.403170 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.403140    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45eb820c-c11f-460e-8a80-19ef30f80904-config-out\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.403726 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.403698    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/45eb820c-c11f-460e-8a80-19ef30f80904-config\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.403726 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.403718    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/45eb820c-c11f-460e-8a80-19ef30f80904-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.404629 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.404311    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/45eb820c-c11f-460e-8a80-19ef30f80904-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.404629 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.404316    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45eb820c-c11f-460e-8a80-19ef30f80904-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.404629 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.404588    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/45eb820c-c11f-460e-8a80-19ef30f80904-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.404841 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.404737    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45eb820c-c11f-460e-8a80-19ef30f80904-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.405410 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.405368    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/45eb820c-c11f-460e-8a80-19ef30f80904-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.407388 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.407342    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45eb820c-c11f-460e-8a80-19ef30f80904-web-config\") pod \"prometheus-k8s-0\" (UID: \"45eb820c-c11f-460e-8a80-19ef30f80904\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.482597 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.482555    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:00.839445 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:00.839417    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 19:01:01.041678 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:01.041593    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba94276e-4b28-40d0-bd8d-c7e6b628adf9","Type":"ContainerStarted","Data":"66b4b344841252df42d3d69e05c5a99b50e26429730796fccde0c6f24c8e8a8a"}
Jul 09 19:01:01.044440 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:01.044411    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4" event={"ID":"7aeef437-26b0-411d-b8c0-4878ea3036d1","Type":"ContainerStarted","Data":"f0811b34f30b04c4e85d9ff5a4c18a396743c57c963d837af5d72d9348712463"}
Jul 09 19:01:01.162538 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:01:01.162507    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45eb820c_c11f_460e_8a80_19ef30f80904.slice/crio-ebb8659b6fbcdce31a582a6c1ae31cf36fbdf56a3a2f75cc91f4db503b72d96c WatchSource:0}: Error finding container ebb8659b6fbcdce31a582a6c1ae31cf36fbdf56a3a2f75cc91f4db503b72d96c: Status 404 returned error can't find the container with id ebb8659b6fbcdce31a582a6c1ae31cf36fbdf56a3a2f75cc91f4db503b72d96c
Jul 09 19:01:02.053798 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:02.053761    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba94276e-4b28-40d0-bd8d-c7e6b628adf9","Type":"ContainerStarted","Data":"e3a9f78628451337af548e4d138a83f97a0185e63a6d3ed282105780fda337f6"}
Jul 09 19:01:02.054254 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:02.053869    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba94276e-4b28-40d0-bd8d-c7e6b628adf9","Type":"ContainerStarted","Data":"fe84d6ee8eb16dc8b0f6f4864b393efbc5219abf19b73976ee7a0a7f389ddeec"}
Jul 09 19:01:02.054254 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:02.053915    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba94276e-4b28-40d0-bd8d-c7e6b628adf9","Type":"ContainerStarted","Data":"7b0d405d0cbf8056840ea2d2c9fa0d856d6bce7917f17f13a06b084c07838771"}
Jul 09 19:01:02.054254 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:02.053955    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba94276e-4b28-40d0-bd8d-c7e6b628adf9","Type":"ContainerStarted","Data":"7cf482f765eea600be74d24262e29f2ab80b83385fea05f68f889ed29f839400"}
Jul 09 19:01:02.054254 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:02.053986    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ba94276e-4b28-40d0-bd8d-c7e6b628adf9","Type":"ContainerStarted","Data":"36da5cef326f47011f5369fd178c2459c88b0f8a2861d592dab6f7fdbdb0a162"}
Jul 09 19:01:02.055433 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:02.055408    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-578847dcdd-vqskg" event={"ID":"7687faf4-d297-4618-9243-35897a1bc2ec","Type":"ContainerStarted","Data":"e5ea3e1b08310d9d97731524a385e28a3cd4ecd57e34fb2a0fcaee18eed64320"}
Jul 09 19:01:02.064406 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:02.064369    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4" event={"ID":"7aeef437-26b0-411d-b8c0-4878ea3036d1","Type":"ContainerStarted","Data":"9d179daf5633786dfd0d685d459592816b85a008359de4d8007e7998821d3098"}
Jul 09 19:01:02.064659 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:02.064636    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4"
Jul 09 19:01:02.064794 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:02.064687    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4" event={"ID":"7aeef437-26b0-411d-b8c0-4878ea3036d1","Type":"ContainerStarted","Data":"2b1cba153257a00450b2ad4165423aa167c282a9f379041e0b2acd7572dddac0"}
Jul 09 19:01:02.066230 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:02.066202    2577 generic.go:356] "Generic (PLEG): container finished" podID="45eb820c-c11f-460e-8a80-19ef30f80904" containerID="97d539030350f93d1771522a2a50787366ecf4252449017a7e3dede94c39a105" exitCode=0
Jul 09 19:01:02.066327 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:02.066231    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45eb820c-c11f-460e-8a80-19ef30f80904","Type":"ContainerDied","Data":"97d539030350f93d1771522a2a50787366ecf4252449017a7e3dede94c39a105"}
Jul 09 19:01:02.066327 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:02.066308    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45eb820c-c11f-460e-8a80-19ef30f80904","Type":"ContainerStarted","Data":"ebb8659b6fbcdce31a582a6c1ae31cf36fbdf56a3a2f75cc91f4db503b72d96c"}
Jul 09 19:01:02.087775 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:02.087717    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.251546641 podStartE2EDuration="7.087699571s" totalImagesPullingTime="4.810154383s" totalInitContainerRuntime="25.998547ms" isStatefulPod=false podCreationTimestamp="2026-07-09 19:00:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:01:02.086254929 +0000 UTC m=+80.471325206" watchObservedRunningTime="2026-07-09 19:01:02.087699571 +0000 UTC m=+80.472769848"
Jul 09 19:01:02.108059 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:02.107994    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-578847dcdd-vqskg" podStartSLOduration=1.810645458 podStartE2EDuration="4.107972323s" totalImagesPullingTime="2.297326865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:01:02.107431913 +0000 UTC m=+80.492502189" watchObservedRunningTime="2026-07-09 19:01:02.107972323 +0000 UTC m=+80.493042577"
Jul 09 19:01:02.131406 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:02.131349    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4" podStartSLOduration=3.078047086 podStartE2EDuration="7.131330853s" totalImagesPullingTime="4.053283767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:00:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:01:02.130343502 +0000 UTC m=+80.515413814" watchObservedRunningTime="2026-07-09 19:01:02.131330853 +0000 UTC m=+80.516401105"
Jul 09 19:01:03.071857 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:03.071793    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-q2pgk" event={"ID":"750b5f41-0adb-44a3-a504-88fe8cd67cf9","Type":"ContainerStarted","Data":"8f52caf69e7f339362dd732f47d72c6cdf13feabee3bd0b7ae412a299f447188"}
Jul 09 19:01:03.072350 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:03.072331    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-q2pgk"
Jul 09 19:01:03.077114 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:03.077090    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-q2pgk"
Jul 09 19:01:03.077483 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:03.077465    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-69544d7d48-zd6h4"
Jul 09 19:01:03.088675 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:03.088618    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-q2pgk" podStartSLOduration=1.898096206 podStartE2EDuration="5.088604983s" totalImagesPullingTime="3.190508777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:00:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:01:03.088498755 +0000 UTC m=+81.473569029" watchObservedRunningTime="2026-07-09 19:01:03.088604983 +0000 UTC m=+81.473675257"
Jul 09 19:01:05.133191 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:05.133038    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:01:05.234497 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:05.234460    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:01:07.097178 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:07.097146    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45eb820c-c11f-460e-8a80-19ef30f80904","Type":"ContainerStarted","Data":"01637b7aee1b06e659fb2e546a934db14eec5a6c6b4875dcd60115fd4fafea94"}
Jul 09 19:01:07.097534 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:07.097224    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45eb820c-c11f-460e-8a80-19ef30f80904","Type":"ContainerStarted","Data":"197da4e3d925cb5064c8eaeacd0ef286acb6d949b3678bdb7bab8453090b8ffd"}
Jul 09 19:01:07.602241 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:07.602155    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:01:07.667069 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:07.667021    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:01:08.104513 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:08.104475    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45eb820c-c11f-460e-8a80-19ef30f80904","Type":"ContainerStarted","Data":"d8164b8bfa734ae04605aff55baa2dbd6a77fb3c520384f459b1ea0823de221d"}
Jul 09 19:01:08.104923 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:08.104591    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45eb820c-c11f-460e-8a80-19ef30f80904","Type":"ContainerStarted","Data":"eeeda3b2c61de1208fbd04e4ea44830e125efbee87f1e13e2bd732974929aa10"}
Jul 09 19:01:08.104923 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:08.104632    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45eb820c-c11f-460e-8a80-19ef30f80904","Type":"ContainerStarted","Data":"bb1ebf2b0fd99189ea23c4961f708d37497b6f00d3a98cdcab8b9f52039d68ba"}
Jul 09 19:01:08.104923 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:08.104667    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"45eb820c-c11f-460e-8a80-19ef30f80904","Type":"ContainerStarted","Data":"a7e089f88396f1602266b3c6d22fdcda59c68f21cd7350e4b487e76c380d778d"}
Jul 09 19:01:08.139707 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:08.139652    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.468421964 podStartE2EDuration="8.139634998s" totalImagesPullingTime="4.646948418s" totalInitContainerRuntime="24.264616ms" isStatefulPod=false podCreationTimestamp="2026-07-09 19:01:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:01:08.137237699 +0000 UTC m=+86.522307978" watchObservedRunningTime="2026-07-09 19:01:08.139634998 +0000 UTC m=+86.524705309"
Jul 09 19:01:09.087007 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:09.086970    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-759fb69bc9-2jdmf"
Jul 09 19:01:09.087286 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:09.087023    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-759fb69bc9-2jdmf"
Jul 09 19:01:09.092023 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:09.091997    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-759fb69bc9-2jdmf"
Jul 09 19:01:09.113224 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:09.113197    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-759fb69bc9-2jdmf"
Jul 09 19:01:09.163513 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:09.163479    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77459bb9cb-4g682"]
Jul 09 19:01:09.277978 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:09.277942    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:01:09.379052 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:09.378957    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:01:09.480859 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:09.480822    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:01:10.483011 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:10.482978    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:01:13.464154 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:13.464115    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:01:13.966030 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:13.965996    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:01:17.967737 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:17.967690    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-774644655c-xd5qw" podUID="c61d86b4-9317-4aec-9231-734775028507" containerName="console" containerID="cri-o://d5a385d5f606b87e6f4de5324ec1207e6783ccb9f3b58bc46e12edfbd7906d5f" gracePeriod=15
Jul 09 19:01:18.149236 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:18.149200    2577 generic.go:356] "Generic (PLEG): container finished" podID="c61d86b4-9317-4aec-9231-734775028507" containerID="d5a385d5f606b87e6f4de5324ec1207e6783ccb9f3b58bc46e12edfbd7906d5f" exitCode=0
Jul 09 19:01:18.149416 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:18.149244    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-774644655c-xd5qw" event={"ID":"c61d86b4-9317-4aec-9231-734775028507","Type":"ContainerDied","Data":"d5a385d5f606b87e6f4de5324ec1207e6783ccb9f3b58bc46e12edfbd7906d5f"}
Jul 09 19:01:18.222510 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:18.222452    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-774644655c-xd5qw"
Jul 09 19:01:18.264885 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:18.264855    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c61d86b4-9317-4aec-9231-734775028507-service-ca\") pod \"c61d86b4-9317-4aec-9231-734775028507\" (UID: \"c61d86b4-9317-4aec-9231-734775028507\") "
Jul 09 19:01:18.265056 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:18.264903    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c61d86b4-9317-4aec-9231-734775028507-console-config\") pod \"c61d86b4-9317-4aec-9231-734775028507\" (UID: \"c61d86b4-9317-4aec-9231-734775028507\") "
Jul 09 19:01:18.265056 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:18.264936    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c61d86b4-9317-4aec-9231-734775028507-oauth-serving-cert\") pod \"c61d86b4-9317-4aec-9231-734775028507\" (UID: \"c61d86b4-9317-4aec-9231-734775028507\") "
Jul 09 19:01:18.265056 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:18.264988    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4b6m4\" (UniqueName: \"kubernetes.io/projected/c61d86b4-9317-4aec-9231-734775028507-kube-api-access-4b6m4\") pod \"c61d86b4-9317-4aec-9231-734775028507\" (UID: \"c61d86b4-9317-4aec-9231-734775028507\") "
Jul 09 19:01:18.265056 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:18.265022    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c61d86b4-9317-4aec-9231-734775028507-console-oauth-config\") pod \"c61d86b4-9317-4aec-9231-734775028507\" (UID: \"c61d86b4-9317-4aec-9231-734775028507\") "
Jul 09 19:01:18.265224 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:18.265059    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c61d86b4-9317-4aec-9231-734775028507-console-serving-cert\") pod \"c61d86b4-9317-4aec-9231-734775028507\" (UID: \"c61d86b4-9317-4aec-9231-734775028507\") "
Jul 09 19:01:18.265335 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:18.265307    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c61d86b4-9317-4aec-9231-734775028507-service-ca" (OuterVolumeSpecName: "service-ca") pod "c61d86b4-9317-4aec-9231-734775028507" (UID: "c61d86b4-9317-4aec-9231-734775028507"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:01:18.265371 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:18.265346    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c61d86b4-9317-4aec-9231-734775028507-console-config" (OuterVolumeSpecName: "console-config") pod "c61d86b4-9317-4aec-9231-734775028507" (UID: "c61d86b4-9317-4aec-9231-734775028507"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:01:18.265371 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:18.265352    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c61d86b4-9317-4aec-9231-734775028507-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c61d86b4-9317-4aec-9231-734775028507" (UID: "c61d86b4-9317-4aec-9231-734775028507"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:01:18.267464 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:18.267425    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c61d86b4-9317-4aec-9231-734775028507-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c61d86b4-9317-4aec-9231-734775028507" (UID: "c61d86b4-9317-4aec-9231-734775028507"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:01:18.267567 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:18.267456    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c61d86b4-9317-4aec-9231-734775028507-kube-api-access-4b6m4" (OuterVolumeSpecName: "kube-api-access-4b6m4") pod "c61d86b4-9317-4aec-9231-734775028507" (UID: "c61d86b4-9317-4aec-9231-734775028507"). InnerVolumeSpecName "kube-api-access-4b6m4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:01:18.267567 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:18.267479    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c61d86b4-9317-4aec-9231-734775028507-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c61d86b4-9317-4aec-9231-734775028507" (UID: "c61d86b4-9317-4aec-9231-734775028507"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:01:18.366697 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:18.366657    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c61d86b4-9317-4aec-9231-734775028507-console-oauth-config\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:01:18.366697 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:18.366690    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c61d86b4-9317-4aec-9231-734775028507-console-serving-cert\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:01:18.366697 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:18.366700    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c61d86b4-9317-4aec-9231-734775028507-service-ca\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:01:18.366697 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:18.366709    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c61d86b4-9317-4aec-9231-734775028507-console-config\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:01:18.366993 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:18.366717    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c61d86b4-9317-4aec-9231-734775028507-oauth-serving-cert\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:01:18.366993 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:18.366725    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4b6m4\" (UniqueName: \"kubernetes.io/projected/c61d86b4-9317-4aec-9231-734775028507-kube-api-access-4b6m4\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:01:18.598652 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:18.598564    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-578847dcdd-vqskg"
Jul 09 19:01:18.598652 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:18.598625    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-578847dcdd-vqskg"
Jul 09 19:01:19.154260 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:19.154230    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-774644655c-xd5qw"
Jul 09 19:01:19.154695 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:19.154263    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-774644655c-xd5qw" event={"ID":"c61d86b4-9317-4aec-9231-734775028507","Type":"ContainerDied","Data":"a9a69dbe32963cdb8ed680136a0dba9279dd276a9cb36d55794a2e54914cb6f6"}
Jul 09 19:01:19.154695 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:19.154321    2577 scope.go:117] "RemoveContainer" containerID="d5a385d5f606b87e6f4de5324ec1207e6783ccb9f3b58bc46e12edfbd7906d5f"
Jul 09 19:01:19.192099 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:19.192068    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-774644655c-xd5qw"]
Jul 09 19:01:19.195360 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:19.195334    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-774644655c-xd5qw"]
Jul 09 19:01:20.638709 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:20.638675    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c61d86b4-9317-4aec-9231-734775028507" path="/var/lib/kubelet/pods/c61d86b4-9317-4aec-9231-734775028507/volumes"
Jul 09 19:01:25.160703 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:25.160666    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:01:25.394786 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:25.394750    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:01:26.991362 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:26.991329    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fl7kb"
Jul 09 19:01:28.458037 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:28.457976    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:01:28.516797 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:28.516749    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:01:32.944825 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:32.944777    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:01:33.002794 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:33.002757    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:01:34.184763 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:34.184714    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-77459bb9cb-4g682" podUID="fdd94748-e036-4b1f-9fd6-06c8bb265b36" containerName="console" containerID="cri-o://7d5b13f4883524d913ae4f7795b0ce007aacb4256cae4e9195d4801637679a71" gracePeriod=15
Jul 09 19:01:34.461688 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:34.461617    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77459bb9cb-4g682"
Jul 09 19:01:34.607088 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:34.607040    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fdd94748-e036-4b1f-9fd6-06c8bb265b36-service-ca\") pod \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\" (UID: \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\") "
Jul 09 19:01:34.607088 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:34.607079    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fdd94748-e036-4b1f-9fd6-06c8bb265b36-console-config\") pod \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\" (UID: \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\") "
Jul 09 19:01:34.607088 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:34.607102    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pgh9\" (UniqueName: \"kubernetes.io/projected/fdd94748-e036-4b1f-9fd6-06c8bb265b36-kube-api-access-5pgh9\") pod \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\" (UID: \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\") "
Jul 09 19:01:34.607387 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:34.607163    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fdd94748-e036-4b1f-9fd6-06c8bb265b36-oauth-serving-cert\") pod \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\" (UID: \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\") "
Jul 09 19:01:34.607387 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:34.607195    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdd94748-e036-4b1f-9fd6-06c8bb265b36-trusted-ca-bundle\") pod \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\" (UID: \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\") "
Jul 09 19:01:34.607387 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:34.607227    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fdd94748-e036-4b1f-9fd6-06c8bb265b36-console-serving-cert\") pod \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\" (UID: \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\") "
Jul 09 19:01:34.607387 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:34.607261    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fdd94748-e036-4b1f-9fd6-06c8bb265b36-console-oauth-config\") pod \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\" (UID: \"fdd94748-e036-4b1f-9fd6-06c8bb265b36\") "
Jul 09 19:01:34.607601 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:34.607543    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdd94748-e036-4b1f-9fd6-06c8bb265b36-console-config" (OuterVolumeSpecName: "console-config") pod "fdd94748-e036-4b1f-9fd6-06c8bb265b36" (UID: "fdd94748-e036-4b1f-9fd6-06c8bb265b36"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:01:34.607661 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:34.607603    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdd94748-e036-4b1f-9fd6-06c8bb265b36-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fdd94748-e036-4b1f-9fd6-06c8bb265b36" (UID: "fdd94748-e036-4b1f-9fd6-06c8bb265b36"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:01:34.607661 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:34.607618    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdd94748-e036-4b1f-9fd6-06c8bb265b36-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fdd94748-e036-4b1f-9fd6-06c8bb265b36" (UID: "fdd94748-e036-4b1f-9fd6-06c8bb265b36"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:01:34.607766 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:34.607721    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdd94748-e036-4b1f-9fd6-06c8bb265b36-service-ca" (OuterVolumeSpecName: "service-ca") pod "fdd94748-e036-4b1f-9fd6-06c8bb265b36" (UID: "fdd94748-e036-4b1f-9fd6-06c8bb265b36"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:01:34.609555 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:34.609518    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdd94748-e036-4b1f-9fd6-06c8bb265b36-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fdd94748-e036-4b1f-9fd6-06c8bb265b36" (UID: "fdd94748-e036-4b1f-9fd6-06c8bb265b36"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:01:34.609555 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:34.609527    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdd94748-e036-4b1f-9fd6-06c8bb265b36-kube-api-access-5pgh9" (OuterVolumeSpecName: "kube-api-access-5pgh9") pod "fdd94748-e036-4b1f-9fd6-06c8bb265b36" (UID: "fdd94748-e036-4b1f-9fd6-06c8bb265b36"). InnerVolumeSpecName "kube-api-access-5pgh9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:01:34.609736 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:34.609583    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdd94748-e036-4b1f-9fd6-06c8bb265b36-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fdd94748-e036-4b1f-9fd6-06c8bb265b36" (UID: "fdd94748-e036-4b1f-9fd6-06c8bb265b36"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:01:34.708494 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:34.708456    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fdd94748-e036-4b1f-9fd6-06c8bb265b36-service-ca\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:01:34.708494 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:34.708488    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fdd94748-e036-4b1f-9fd6-06c8bb265b36-console-config\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:01:34.708494 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:34.708499    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pgh9\" (UniqueName: \"kubernetes.io/projected/fdd94748-e036-4b1f-9fd6-06c8bb265b36-kube-api-access-5pgh9\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:01:34.708494 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:34.708507    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fdd94748-e036-4b1f-9fd6-06c8bb265b36-oauth-serving-cert\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:01:34.708756 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:34.708516    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdd94748-e036-4b1f-9fd6-06c8bb265b36-trusted-ca-bundle\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:01:34.708756 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:34.708524    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fdd94748-e036-4b1f-9fd6-06c8bb265b36-console-serving-cert\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:01:34.708756 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:34.708532    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fdd94748-e036-4b1f-9fd6-06c8bb265b36-console-oauth-config\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:01:35.219763 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:35.219729    2577 generic.go:356] "Generic (PLEG): container finished" podID="fdd94748-e036-4b1f-9fd6-06c8bb265b36" containerID="7d5b13f4883524d913ae4f7795b0ce007aacb4256cae4e9195d4801637679a71" exitCode=0
Jul 09 19:01:35.220239 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:35.219773    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77459bb9cb-4g682"
Jul 09 19:01:35.220239 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:35.219773    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77459bb9cb-4g682" event={"ID":"fdd94748-e036-4b1f-9fd6-06c8bb265b36","Type":"ContainerDied","Data":"7d5b13f4883524d913ae4f7795b0ce007aacb4256cae4e9195d4801637679a71"}
Jul 09 19:01:35.220239 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:35.219923    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77459bb9cb-4g682" event={"ID":"fdd94748-e036-4b1f-9fd6-06c8bb265b36","Type":"ContainerDied","Data":"c1480436502f4c6cb017e9bd522baf455e1746ebb0b1b19ab5de7c04c29ccb06"}
Jul 09 19:01:35.220239 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:35.219962    2577 scope.go:117] "RemoveContainer" containerID="7d5b13f4883524d913ae4f7795b0ce007aacb4256cae4e9195d4801637679a71"
Jul 09 19:01:35.230648 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:35.230561    2577 scope.go:117] "RemoveContainer" containerID="7d5b13f4883524d913ae4f7795b0ce007aacb4256cae4e9195d4801637679a71"
Jul 09 19:01:35.231200 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:01:35.231171    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d5b13f4883524d913ae4f7795b0ce007aacb4256cae4e9195d4801637679a71\": container with ID starting with 7d5b13f4883524d913ae4f7795b0ce007aacb4256cae4e9195d4801637679a71 not found: ID does not exist" containerID="7d5b13f4883524d913ae4f7795b0ce007aacb4256cae4e9195d4801637679a71"
Jul 09 19:01:35.231318 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:35.231204    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d5b13f4883524d913ae4f7795b0ce007aacb4256cae4e9195d4801637679a71"} err="failed to get container status \"7d5b13f4883524d913ae4f7795b0ce007aacb4256cae4e9195d4801637679a71\": rpc error: code = NotFound desc = could not find container \"7d5b13f4883524d913ae4f7795b0ce007aacb4256cae4e9195d4801637679a71\": container with ID starting with 7d5b13f4883524d913ae4f7795b0ce007aacb4256cae4e9195d4801637679a71 not found: ID does not exist"
Jul 09 19:01:35.240601 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:35.240576    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77459bb9cb-4g682"]
Jul 09 19:01:35.244473 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:35.244451    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77459bb9cb-4g682"]
Jul 09 19:01:36.637985 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:36.637952    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdd94748-e036-4b1f-9fd6-06c8bb265b36" path="/var/lib/kubelet/pods/fdd94748-e036-4b1f-9fd6-06c8bb265b36/volumes"
Jul 09 19:01:38.515201 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:38.515169    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:01:38.604026 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:38.603999    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-578847dcdd-vqskg"
Jul 09 19:01:38.607726 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:38.607704    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-578847dcdd-vqskg"
Jul 09 19:01:38.614583 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:38.614560    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:01:47.307717 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:01:47.307680    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:02:00.483385 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:00.483348    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:02:00.504365 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:00.504338    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:02:01.349593 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:01.349568    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 19:02:08.717093 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:08.717060    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:02:13.137110 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:13.137071    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:02:13.259822 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:13.259763    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:02:18.224221 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.224187    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7f658749c7-tlc54"]
Jul 09 19:02:18.224693 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.224540    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdd94748-e036-4b1f-9fd6-06c8bb265b36" containerName="console"
Jul 09 19:02:18.224693 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.224552    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdd94748-e036-4b1f-9fd6-06c8bb265b36" containerName="console"
Jul 09 19:02:18.224693 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.224561    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c61d86b4-9317-4aec-9231-734775028507" containerName="console"
Jul 09 19:02:18.224693 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.224567    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c61d86b4-9317-4aec-9231-734775028507" containerName="console"
Jul 09 19:02:18.224693 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.224622    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c61d86b4-9317-4aec-9231-734775028507" containerName="console"
Jul 09 19:02:18.224693 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.224631    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdd94748-e036-4b1f-9fd6-06c8bb265b36" containerName="console"
Jul 09 19:02:18.226965 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.226946    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f658749c7-tlc54"
Jul 09 19:02:18.230041 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.230019    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 09 19:02:18.230367 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.230337    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 09 19:02:18.230491 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.230347    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 09 19:02:18.230491 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.230466    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 09 19:02:18.230491 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.230470    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 09 19:02:18.230701 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.230469    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-lpnmd\""
Jul 09 19:02:18.236031 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.236007    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 09 19:02:18.242125 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.242097    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f658749c7-tlc54"]
Jul 09 19:02:18.287588 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.287553    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srskq\" (UniqueName: \"kubernetes.io/projected/e1ef83f0-4839-495e-8519-ac044a394c8a-kube-api-access-srskq\") pod \"telemeter-client-7f658749c7-tlc54\" (UID: \"e1ef83f0-4839-495e-8519-ac044a394c8a\") " pod="openshift-monitoring/telemeter-client-7f658749c7-tlc54"
Jul 09 19:02:18.287754 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.287599    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1ef83f0-4839-495e-8519-ac044a394c8a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f658749c7-tlc54\" (UID: \"e1ef83f0-4839-495e-8519-ac044a394c8a\") " pod="openshift-monitoring/telemeter-client-7f658749c7-tlc54"
Jul 09 19:02:18.287754 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.287626    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1ef83f0-4839-495e-8519-ac044a394c8a-metrics-client-ca\") pod \"telemeter-client-7f658749c7-tlc54\" (UID: \"e1ef83f0-4839-495e-8519-ac044a394c8a\") " pod="openshift-monitoring/telemeter-client-7f658749c7-tlc54"
Jul 09 19:02:18.287754 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.287705    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e1ef83f0-4839-495e-8519-ac044a394c8a-telemeter-client-tls\") pod \"telemeter-client-7f658749c7-tlc54\" (UID: \"e1ef83f0-4839-495e-8519-ac044a394c8a\") " pod="openshift-monitoring/telemeter-client-7f658749c7-tlc54"
Jul 09 19:02:18.287754 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.287744    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1ef83f0-4839-495e-8519-ac044a394c8a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f658749c7-tlc54\" (UID: \"e1ef83f0-4839-495e-8519-ac044a394c8a\") " pod="openshift-monitoring/telemeter-client-7f658749c7-tlc54"
Jul 09 19:02:18.287936 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.287826    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1ef83f0-4839-495e-8519-ac044a394c8a-serving-certs-ca-bundle\") pod \"telemeter-client-7f658749c7-tlc54\" (UID: \"e1ef83f0-4839-495e-8519-ac044a394c8a\") " pod="openshift-monitoring/telemeter-client-7f658749c7-tlc54"
Jul 09 19:02:18.287936 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.287862    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e1ef83f0-4839-495e-8519-ac044a394c8a-federate-client-tls\") pod \"telemeter-client-7f658749c7-tlc54\" (UID: \"e1ef83f0-4839-495e-8519-ac044a394c8a\") " pod="openshift-monitoring/telemeter-client-7f658749c7-tlc54"
Jul 09 19:02:18.287936 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.287888    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e1ef83f0-4839-495e-8519-ac044a394c8a-secret-telemeter-client\") pod \"telemeter-client-7f658749c7-tlc54\" (UID: \"e1ef83f0-4839-495e-8519-ac044a394c8a\") " pod="openshift-monitoring/telemeter-client-7f658749c7-tlc54"
Jul 09 19:02:18.389238 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.389191    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e1ef83f0-4839-495e-8519-ac044a394c8a-telemeter-client-tls\") pod \"telemeter-client-7f658749c7-tlc54\" (UID: \"e1ef83f0-4839-495e-8519-ac044a394c8a\") " pod="openshift-monitoring/telemeter-client-7f658749c7-tlc54"
Jul 09 19:02:18.389238 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.389239    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1ef83f0-4839-495e-8519-ac044a394c8a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f658749c7-tlc54\" (UID: \"e1ef83f0-4839-495e-8519-ac044a394c8a\") " pod="openshift-monitoring/telemeter-client-7f658749c7-tlc54"
Jul 09 19:02:18.389484 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.389276    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1ef83f0-4839-495e-8519-ac044a394c8a-serving-certs-ca-bundle\") pod \"telemeter-client-7f658749c7-tlc54\" (UID: \"e1ef83f0-4839-495e-8519-ac044a394c8a\") " pod="openshift-monitoring/telemeter-client-7f658749c7-tlc54"
Jul 09 19:02:18.389484 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.389302    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e1ef83f0-4839-495e-8519-ac044a394c8a-federate-client-tls\") pod \"telemeter-client-7f658749c7-tlc54\" (UID: \"e1ef83f0-4839-495e-8519-ac044a394c8a\") " pod="openshift-monitoring/telemeter-client-7f658749c7-tlc54"
Jul 09 19:02:18.389484 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.389324    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e1ef83f0-4839-495e-8519-ac044a394c8a-secret-telemeter-client\") pod \"telemeter-client-7f658749c7-tlc54\" (UID: \"e1ef83f0-4839-495e-8519-ac044a394c8a\") " pod="openshift-monitoring/telemeter-client-7f658749c7-tlc54"
Jul 09 19:02:18.389484 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.389349    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srskq\" (UniqueName: \"kubernetes.io/projected/e1ef83f0-4839-495e-8519-ac044a394c8a-kube-api-access-srskq\") pod \"telemeter-client-7f658749c7-tlc54\" (UID: \"e1ef83f0-4839-495e-8519-ac044a394c8a\") " pod="openshift-monitoring/telemeter-client-7f658749c7-tlc54"
Jul 09 19:02:18.389484 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.389391    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1ef83f0-4839-495e-8519-ac044a394c8a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f658749c7-tlc54\" (UID: \"e1ef83f0-4839-495e-8519-ac044a394c8a\") " pod="openshift-monitoring/telemeter-client-7f658749c7-tlc54"
Jul 09 19:02:18.389484 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.389419    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1ef83f0-4839-495e-8519-ac044a394c8a-metrics-client-ca\") pod \"telemeter-client-7f658749c7-tlc54\" (UID: \"e1ef83f0-4839-495e-8519-ac044a394c8a\") " pod="openshift-monitoring/telemeter-client-7f658749c7-tlc54"
Jul 09 19:02:18.390192 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.390162    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1ef83f0-4839-495e-8519-ac044a394c8a-serving-certs-ca-bundle\") pod \"telemeter-client-7f658749c7-tlc54\" (UID: \"e1ef83f0-4839-495e-8519-ac044a394c8a\") " pod="openshift-monitoring/telemeter-client-7f658749c7-tlc54"
Jul 09 19:02:18.390313 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.390204    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1ef83f0-4839-495e-8519-ac044a394c8a-metrics-client-ca\") pod \"telemeter-client-7f658749c7-tlc54\" (UID: \"e1ef83f0-4839-495e-8519-ac044a394c8a\") " pod="openshift-monitoring/telemeter-client-7f658749c7-tlc54"
Jul 09 19:02:18.390313 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.390237    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1ef83f0-4839-495e-8519-ac044a394c8a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f658749c7-tlc54\" (UID: \"e1ef83f0-4839-495e-8519-ac044a394c8a\") " pod="openshift-monitoring/telemeter-client-7f658749c7-tlc54"
Jul 09 19:02:18.391950 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.391927    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1ef83f0-4839-495e-8519-ac044a394c8a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f658749c7-tlc54\" (UID: \"e1ef83f0-4839-495e-8519-ac044a394c8a\") " pod="openshift-monitoring/telemeter-client-7f658749c7-tlc54"
Jul 09 19:02:18.392040 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.391958    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e1ef83f0-4839-495e-8519-ac044a394c8a-secret-telemeter-client\") pod \"telemeter-client-7f658749c7-tlc54\" (UID: \"e1ef83f0-4839-495e-8519-ac044a394c8a\") " pod="openshift-monitoring/telemeter-client-7f658749c7-tlc54"
Jul 09 19:02:18.392180 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.392164    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e1ef83f0-4839-495e-8519-ac044a394c8a-federate-client-tls\") pod \"telemeter-client-7f658749c7-tlc54\" (UID: \"e1ef83f0-4839-495e-8519-ac044a394c8a\") " pod="openshift-monitoring/telemeter-client-7f658749c7-tlc54"
Jul 09 19:02:18.392216 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.392201    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e1ef83f0-4839-495e-8519-ac044a394c8a-telemeter-client-tls\") pod \"telemeter-client-7f658749c7-tlc54\" (UID: \"e1ef83f0-4839-495e-8519-ac044a394c8a\") " pod="openshift-monitoring/telemeter-client-7f658749c7-tlc54"
Jul 09 19:02:18.398111 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.398082    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srskq\" (UniqueName: \"kubernetes.io/projected/e1ef83f0-4839-495e-8519-ac044a394c8a-kube-api-access-srskq\") pod \"telemeter-client-7f658749c7-tlc54\" (UID: \"e1ef83f0-4839-495e-8519-ac044a394c8a\") " pod="openshift-monitoring/telemeter-client-7f658749c7-tlc54"
Jul 09 19:02:18.538699 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.538595    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f658749c7-tlc54"
Jul 09 19:02:18.676837 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:18.676799    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f658749c7-tlc54"]
Jul 09 19:02:18.678978 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:02:18.678953    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1ef83f0_4839_495e_8519_ac044a394c8a.slice/crio-7ff3be21b3a9a8d8926f12c0ef158034d2eda0fcb4a9e27607793a9906f0ad90 WatchSource:0}: Error finding container 7ff3be21b3a9a8d8926f12c0ef158034d2eda0fcb4a9e27607793a9906f0ad90: Status 404 returned error can't find the container with id 7ff3be21b3a9a8d8926f12c0ef158034d2eda0fcb4a9e27607793a9906f0ad90
Jul 09 19:02:19.402477 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:19.402442    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f658749c7-tlc54" event={"ID":"e1ef83f0-4839-495e-8519-ac044a394c8a","Type":"ContainerStarted","Data":"7ff3be21b3a9a8d8926f12c0ef158034d2eda0fcb4a9e27607793a9906f0ad90"}
Jul 09 19:02:21.413499 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:21.413455    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f658749c7-tlc54" event={"ID":"e1ef83f0-4839-495e-8519-ac044a394c8a","Type":"ContainerStarted","Data":"a0d56749731f1b4983692ffb21a8462fa90534ef6847d9a6a928e98afc663b06"}
Jul 09 19:02:21.413903 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:21.413521    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f658749c7-tlc54" event={"ID":"e1ef83f0-4839-495e-8519-ac044a394c8a","Type":"ContainerStarted","Data":"eb925816ecf9bf45891c398610c9895eaffab389651ff71b8e616345338df850"}
Jul 09 19:02:21.413903 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:21.413542    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f658749c7-tlc54" event={"ID":"e1ef83f0-4839-495e-8519-ac044a394c8a","Type":"ContainerStarted","Data":"4572ffda9ab89f9ffeda4b709f701be82290b1e6c03e2f17a30a097b5f3d1947"}
Jul 09 19:02:21.441569 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:21.441514    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7f658749c7-tlc54" podStartSLOduration=1.154392935 podStartE2EDuration="3.441498332s" totalImagesPullingTime="2.287105397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:02:21.43959027 +0000 UTC m=+159.824660557" watchObservedRunningTime="2026-07-09 19:02:21.441498332 +0000 UTC m=+159.826568606"
Jul 09 19:02:22.362298 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:22.362251    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b45c66894-ld4mt"]
Jul 09 19:02:22.364978 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:22.364951    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b45c66894-ld4mt"
Jul 09 19:02:22.379403 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:22.379376    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b45c66894-ld4mt"]
Jul 09 19:02:22.426524 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:22.426482    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:02:22.428501 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:22.428478    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-oauth-serving-cert\") pod \"console-7b45c66894-ld4mt\" (UID: \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\") " pod="openshift-console/console-7b45c66894-ld4mt"
Jul 09 19:02:22.428639 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:22.428531    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-trusted-ca-bundle\") pod \"console-7b45c66894-ld4mt\" (UID: \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\") " pod="openshift-console/console-7b45c66894-ld4mt"
Jul 09 19:02:22.428639 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:22.428597    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpn2m\" (UniqueName: \"kubernetes.io/projected/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-kube-api-access-tpn2m\") pod \"console-7b45c66894-ld4mt\" (UID: \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\") " pod="openshift-console/console-7b45c66894-ld4mt"
Jul 09 19:02:22.428722 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:22.428654    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-console-serving-cert\") pod \"console-7b45c66894-ld4mt\" (UID: \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\") " pod="openshift-console/console-7b45c66894-ld4mt"
Jul 09 19:02:22.428722 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:22.428692    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-console-oauth-config\") pod \"console-7b45c66894-ld4mt\" (UID: \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\") " pod="openshift-console/console-7b45c66894-ld4mt"
Jul 09 19:02:22.428835 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:22.428784    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-service-ca\") pod \"console-7b45c66894-ld4mt\" (UID: \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\") " pod="openshift-console/console-7b45c66894-ld4mt"
Jul 09 19:02:22.428892 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:22.428854    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-console-config\") pod \"console-7b45c66894-ld4mt\" (UID: \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\") " pod="openshift-console/console-7b45c66894-ld4mt"
Jul 09 19:02:22.529455 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:22.529417    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-console-oauth-config\") pod \"console-7b45c66894-ld4mt\" (UID: \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\") " pod="openshift-console/console-7b45c66894-ld4mt"
Jul 09 19:02:22.530261 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:22.530237    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-service-ca\") pod \"console-7b45c66894-ld4mt\" (UID: \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\") " pod="openshift-console/console-7b45c66894-ld4mt"
Jul 09 19:02:22.530432 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:22.530417    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-console-config\") pod \"console-7b45c66894-ld4mt\" (UID: \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\") " pod="openshift-console/console-7b45c66894-ld4mt"
Jul 09 19:02:22.530562 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:22.530548    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-oauth-serving-cert\") pod \"console-7b45c66894-ld4mt\" (UID: \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\") " pod="openshift-console/console-7b45c66894-ld4mt"
Jul 09 19:02:22.530707 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:22.530695    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-trusted-ca-bundle\") pod \"console-7b45c66894-ld4mt\" (UID: \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\") " pod="openshift-console/console-7b45c66894-ld4mt"
Jul 09 19:02:22.530844 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:22.530830    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpn2m\" (UniqueName: \"kubernetes.io/projected/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-kube-api-access-tpn2m\") pod \"console-7b45c66894-ld4mt\" (UID: \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\") " pod="openshift-console/console-7b45c66894-ld4mt"
Jul 09 19:02:22.530976 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:22.530963    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-console-serving-cert\") pod \"console-7b45c66894-ld4mt\" (UID: \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\") " pod="openshift-console/console-7b45c66894-ld4mt"
Jul 09 19:02:22.532075 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:22.531752    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-oauth-serving-cert\") pod \"console-7b45c66894-ld4mt\" (UID: \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\") " pod="openshift-console/console-7b45c66894-ld4mt"
Jul 09 19:02:22.532075 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:22.532001    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-console-config\") pod \"console-7b45c66894-ld4mt\" (UID: \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\") " pod="openshift-console/console-7b45c66894-ld4mt"
Jul 09 19:02:22.532075 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:22.532025    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-service-ca\") pod \"console-7b45c66894-ld4mt\" (UID: \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\") " pod="openshift-console/console-7b45c66894-ld4mt"
Jul 09 19:02:22.532273 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:22.532183    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-trusted-ca-bundle\") pod \"console-7b45c66894-ld4mt\" (UID: \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\") " pod="openshift-console/console-7b45c66894-ld4mt"
Jul 09 19:02:22.533305 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:22.533284    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-console-oauth-config\") pod \"console-7b45c66894-ld4mt\" (UID: \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\") " pod="openshift-console/console-7b45c66894-ld4mt"
Jul 09 19:02:22.534079 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:22.534061    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-console-serving-cert\") pod \"console-7b45c66894-ld4mt\" (UID: \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\") " pod="openshift-console/console-7b45c66894-ld4mt"
Jul 09 19:02:22.540204 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:22.540184    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpn2m\" (UniqueName: \"kubernetes.io/projected/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-kube-api-access-tpn2m\") pod \"console-7b45c66894-ld4mt\" (UID: \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\") " pod="openshift-console/console-7b45c66894-ld4mt"
Jul 09 19:02:22.562920 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:22.562881    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:02:22.675857 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:22.675790    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b45c66894-ld4mt"
Jul 09 19:02:22.817995 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:22.817968    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b45c66894-ld4mt"]
Jul 09 19:02:22.820086 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:02:22.820060    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb51ec5df_b550_4b1f_8ef5_0332f94c8bc0.slice/crio-89e582fbfa2440279bb5ebcf7bfbc46d76ebc540a2dee1667709800b8a4d20f1 WatchSource:0}: Error finding container 89e582fbfa2440279bb5ebcf7bfbc46d76ebc540a2dee1667709800b8a4d20f1: Status 404 returned error can't find the container with id 89e582fbfa2440279bb5ebcf7bfbc46d76ebc540a2dee1667709800b8a4d20f1
Jul 09 19:02:23.423952 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:23.423913    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b45c66894-ld4mt" event={"ID":"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0","Type":"ContainerStarted","Data":"5ce5642ed8bcb7e541fd9c505b329dc1ee7d46fd4ad8a85c5f8624f3779416a4"}
Jul 09 19:02:23.424113 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:23.424004    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b45c66894-ld4mt" event={"ID":"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0","Type":"ContainerStarted","Data":"89e582fbfa2440279bb5ebcf7bfbc46d76ebc540a2dee1667709800b8a4d20f1"}
Jul 09 19:02:23.444121 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:23.444071    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b45c66894-ld4mt" podStartSLOduration=1.444056161 podStartE2EDuration="1.444056161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:02:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:02:23.442439004 +0000 UTC m=+161.827509281" watchObservedRunningTime="2026-07-09 19:02:23.444056161 +0000 UTC m=+161.829126478"
Jul 09 19:02:28.367026 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:28.366991    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:02:28.426447 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:28.426405    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:02:30.078074 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:30.078036    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b45c66894-ld4mt"]
Jul 09 19:02:30.110610 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:30.110570    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f44d7c7b6-89cz6"]
Jul 09 19:02:30.113020 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:30.113004    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f44d7c7b6-89cz6"
Jul 09 19:02:30.125136 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:30.125112    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f44d7c7b6-89cz6"]
Jul 09 19:02:30.212132 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:30.212095    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f988a736-e65a-4045-8eda-e4220b04819a-console-serving-cert\") pod \"console-7f44d7c7b6-89cz6\" (UID: \"f988a736-e65a-4045-8eda-e4220b04819a\") " pod="openshift-console/console-7f44d7c7b6-89cz6"
Jul 09 19:02:30.212305 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:30.212142    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f988a736-e65a-4045-8eda-e4220b04819a-service-ca\") pod \"console-7f44d7c7b6-89cz6\" (UID: \"f988a736-e65a-4045-8eda-e4220b04819a\") " pod="openshift-console/console-7f44d7c7b6-89cz6"
Jul 09 19:02:30.212305 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:30.212165    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsxsr\" (UniqueName: \"kubernetes.io/projected/f988a736-e65a-4045-8eda-e4220b04819a-kube-api-access-qsxsr\") pod \"console-7f44d7c7b6-89cz6\" (UID: \"f988a736-e65a-4045-8eda-e4220b04819a\") " pod="openshift-console/console-7f44d7c7b6-89cz6"
Jul 09 19:02:30.212305 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:30.212225    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f988a736-e65a-4045-8eda-e4220b04819a-trusted-ca-bundle\") pod \"console-7f44d7c7b6-89cz6\" (UID: \"f988a736-e65a-4045-8eda-e4220b04819a\") " pod="openshift-console/console-7f44d7c7b6-89cz6"
Jul 09 19:02:30.212305 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:30.212282    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f988a736-e65a-4045-8eda-e4220b04819a-console-oauth-config\") pod \"console-7f44d7c7b6-89cz6\" (UID: \"f988a736-e65a-4045-8eda-e4220b04819a\") " pod="openshift-console/console-7f44d7c7b6-89cz6"
Jul 09 19:02:30.212305 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:30.212305    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f988a736-e65a-4045-8eda-e4220b04819a-console-config\") pod \"console-7f44d7c7b6-89cz6\" (UID: \"f988a736-e65a-4045-8eda-e4220b04819a\") " pod="openshift-console/console-7f44d7c7b6-89cz6"
Jul 09 19:02:30.212511 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:30.212407    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f988a736-e65a-4045-8eda-e4220b04819a-oauth-serving-cert\") pod \"console-7f44d7c7b6-89cz6\" (UID: \"f988a736-e65a-4045-8eda-e4220b04819a\") " pod="openshift-console/console-7f44d7c7b6-89cz6"
Jul 09 19:02:30.272529 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:30.272494    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:02:30.313557 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:30.313519    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f988a736-e65a-4045-8eda-e4220b04819a-console-serving-cert\") pod \"console-7f44d7c7b6-89cz6\" (UID: \"f988a736-e65a-4045-8eda-e4220b04819a\") " pod="openshift-console/console-7f44d7c7b6-89cz6"
Jul 09 19:02:30.313685 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:30.313566    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f988a736-e65a-4045-8eda-e4220b04819a-service-ca\") pod \"console-7f44d7c7b6-89cz6\" (UID: \"f988a736-e65a-4045-8eda-e4220b04819a\") " pod="openshift-console/console-7f44d7c7b6-89cz6"
Jul 09 19:02:30.313685 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:30.313651    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsxsr\" (UniqueName: \"kubernetes.io/projected/f988a736-e65a-4045-8eda-e4220b04819a-kube-api-access-qsxsr\") pod \"console-7f44d7c7b6-89cz6\" (UID: \"f988a736-e65a-4045-8eda-e4220b04819a\") " pod="openshift-console/console-7f44d7c7b6-89cz6"
Jul 09 19:02:30.313685 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:30.313669    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f988a736-e65a-4045-8eda-e4220b04819a-trusted-ca-bundle\") pod \"console-7f44d7c7b6-89cz6\" (UID: \"f988a736-e65a-4045-8eda-e4220b04819a\") " pod="openshift-console/console-7f44d7c7b6-89cz6"
Jul 09 19:02:30.313867 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:30.313694    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f988a736-e65a-4045-8eda-e4220b04819a-console-oauth-config\") pod \"console-7f44d7c7b6-89cz6\" (UID: \"f988a736-e65a-4045-8eda-e4220b04819a\") " pod="openshift-console/console-7f44d7c7b6-89cz6"
Jul 09 19:02:30.313867 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:30.313709    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f988a736-e65a-4045-8eda-e4220b04819a-console-config\") pod \"console-7f44d7c7b6-89cz6\" (UID: \"f988a736-e65a-4045-8eda-e4220b04819a\") " pod="openshift-console/console-7f44d7c7b6-89cz6"
Jul 09 19:02:30.313974 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:30.313953    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f988a736-e65a-4045-8eda-e4220b04819a-oauth-serving-cert\") pod \"console-7f44d7c7b6-89cz6\" (UID: \"f988a736-e65a-4045-8eda-e4220b04819a\") " pod="openshift-console/console-7f44d7c7b6-89cz6"
Jul 09 19:02:30.314472 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:30.314444    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f988a736-e65a-4045-8eda-e4220b04819a-service-ca\") pod \"console-7f44d7c7b6-89cz6\" (UID: \"f988a736-e65a-4045-8eda-e4220b04819a\") " pod="openshift-console/console-7f44d7c7b6-89cz6"
Jul 09 19:02:30.314622 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:30.314493    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f988a736-e65a-4045-8eda-e4220b04819a-console-config\") pod \"console-7f44d7c7b6-89cz6\" (UID: \"f988a736-e65a-4045-8eda-e4220b04819a\") " pod="openshift-console/console-7f44d7c7b6-89cz6"
Jul 09 19:02:30.314686 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:30.314649    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f988a736-e65a-4045-8eda-e4220b04819a-oauth-serving-cert\") pod \"console-7f44d7c7b6-89cz6\" (UID: \"f988a736-e65a-4045-8eda-e4220b04819a\") " pod="openshift-console/console-7f44d7c7b6-89cz6"
Jul 09 19:02:30.314739 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:30.314696    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f988a736-e65a-4045-8eda-e4220b04819a-trusted-ca-bundle\") pod \"console-7f44d7c7b6-89cz6\" (UID: \"f988a736-e65a-4045-8eda-e4220b04819a\") " pod="openshift-console/console-7f44d7c7b6-89cz6"
Jul 09 19:02:30.316176 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:30.316149    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f988a736-e65a-4045-8eda-e4220b04819a-console-serving-cert\") pod \"console-7f44d7c7b6-89cz6\" (UID: \"f988a736-e65a-4045-8eda-e4220b04819a\") " pod="openshift-console/console-7f44d7c7b6-89cz6"
Jul 09 19:02:30.316176 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:30.316175    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f988a736-e65a-4045-8eda-e4220b04819a-console-oauth-config\") pod \"console-7f44d7c7b6-89cz6\" (UID: \"f988a736-e65a-4045-8eda-e4220b04819a\") " pod="openshift-console/console-7f44d7c7b6-89cz6"
Jul 09 19:02:30.322713 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:30.322676    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsxsr\" (UniqueName: \"kubernetes.io/projected/f988a736-e65a-4045-8eda-e4220b04819a-kube-api-access-qsxsr\") pod \"console-7f44d7c7b6-89cz6\" (UID: \"f988a736-e65a-4045-8eda-e4220b04819a\") " pod="openshift-console/console-7f44d7c7b6-89cz6"
Jul 09 19:02:30.373028 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:30.372925    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:02:30.422602 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:30.422568    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f44d7c7b6-89cz6"
Jul 09 19:02:30.556372 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:30.556347    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f44d7c7b6-89cz6"]
Jul 09 19:02:30.558924 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:02:30.558894    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf988a736_e65a_4045_8eda_e4220b04819a.slice/crio-3a9a153e5bd6877abcff78099bf59c6765b92180f90dc62e8a72b4f6b0aaf1df WatchSource:0}: Error finding container 3a9a153e5bd6877abcff78099bf59c6765b92180f90dc62e8a72b4f6b0aaf1df: Status 404 returned error can't find the container with id 3a9a153e5bd6877abcff78099bf59c6765b92180f90dc62e8a72b4f6b0aaf1df
Jul 09 19:02:30.867688 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:30.867658    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:02:30.925010 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:30.924977    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:02:31.460306 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:31.460264    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f44d7c7b6-89cz6" event={"ID":"f988a736-e65a-4045-8eda-e4220b04819a","Type":"ContainerStarted","Data":"1b979ad1e5e7b1c95255a3978cef06045af8a04dc7cb64aeeb536391695f01ce"}
Jul 09 19:02:31.460686 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:31.460321    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f44d7c7b6-89cz6" event={"ID":"f988a736-e65a-4045-8eda-e4220b04819a","Type":"ContainerStarted","Data":"3a9a153e5bd6877abcff78099bf59c6765b92180f90dc62e8a72b4f6b0aaf1df"}
Jul 09 19:02:31.481735 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:31.481688    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f44d7c7b6-89cz6" podStartSLOduration=1.481673358 podStartE2EDuration="1.481673358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:02:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:02:31.47929868 +0000 UTC m=+169.864368980" watchObservedRunningTime="2026-07-09 19:02:31.481673358 +0000 UTC m=+169.866743633"
Jul 09 19:02:32.676074 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:32.676040    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b45c66894-ld4mt"
Jul 09 19:02:40.270919 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:40.270862    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:02:40.371060 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:40.371020    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:02:40.423562 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:40.423530    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f44d7c7b6-89cz6"
Jul 09 19:02:40.423761 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:40.423596    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f44d7c7b6-89cz6"
Jul 09 19:02:40.428305 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:40.428282    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f44d7c7b6-89cz6"
Jul 09 19:02:40.503679 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:40.503651    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f44d7c7b6-89cz6"
Jul 09 19:02:40.553519 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:40.553436    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-759fb69bc9-2jdmf"]
Jul 09 19:02:40.651145 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:40.651111    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:02:40.751441 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:40.751405    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:02:40.813256 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:40.813167    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:02:43.462730 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:43.462693    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:02:43.565167 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:43.565114    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:02:43.617361 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:43.617313    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:02:55.098328 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:55.098271    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7b45c66894-ld4mt" podUID="b51ec5df-b550-4b1f-8ef5-0332f94c8bc0" containerName="console" containerID="cri-o://5ce5642ed8bcb7e541fd9c505b329dc1ee7d46fd4ad8a85c5f8624f3779416a4" gracePeriod=15
Jul 09 19:02:55.343015 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:55.342985    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b45c66894-ld4mt"
Jul 09 19:02:55.439382 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:55.439340    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-service-ca\") pod \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\" (UID: \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\") "
Jul 09 19:02:55.439549 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:55.439413    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpn2m\" (UniqueName: \"kubernetes.io/projected/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-kube-api-access-tpn2m\") pod \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\" (UID: \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\") "
Jul 09 19:02:55.439549 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:55.439437    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-trusted-ca-bundle\") pod \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\" (UID: \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\") "
Jul 09 19:02:55.439549 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:55.439457    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-console-config\") pod \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\" (UID: \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\") "
Jul 09 19:02:55.439549 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:55.439475    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-oauth-serving-cert\") pod \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\" (UID: \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\") "
Jul 09 19:02:55.439702 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:55.439640    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-console-serving-cert\") pod \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\" (UID: \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\") "
Jul 09 19:02:55.439755 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:55.439707    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-console-oauth-config\") pod \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\" (UID: \"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0\") "
Jul 09 19:02:55.439755 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:55.439732    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-service-ca" (OuterVolumeSpecName: "service-ca") pod "b51ec5df-b550-4b1f-8ef5-0332f94c8bc0" (UID: "b51ec5df-b550-4b1f-8ef5-0332f94c8bc0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:02:55.439933 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:55.439916    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b51ec5df-b550-4b1f-8ef5-0332f94c8bc0" (UID: "b51ec5df-b550-4b1f-8ef5-0332f94c8bc0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:02:55.440018 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:55.439914    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-console-config" (OuterVolumeSpecName: "console-config") pod "b51ec5df-b550-4b1f-8ef5-0332f94c8bc0" (UID: "b51ec5df-b550-4b1f-8ef5-0332f94c8bc0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:02:55.440018 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:55.439962    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b51ec5df-b550-4b1f-8ef5-0332f94c8bc0" (UID: "b51ec5df-b550-4b1f-8ef5-0332f94c8bc0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:02:55.440127 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:55.440081    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-trusted-ca-bundle\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:02:55.440127 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:55.440096    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-console-config\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:02:55.440127 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:55.440107    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-oauth-serving-cert\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:02:55.440127 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:55.440115    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-service-ca\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:02:55.441761 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:55.441744    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b51ec5df-b550-4b1f-8ef5-0332f94c8bc0" (UID: "b51ec5df-b550-4b1f-8ef5-0332f94c8bc0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:02:55.442147 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:55.442125    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b51ec5df-b550-4b1f-8ef5-0332f94c8bc0" (UID: "b51ec5df-b550-4b1f-8ef5-0332f94c8bc0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:02:55.442267 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:55.442244    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-kube-api-access-tpn2m" (OuterVolumeSpecName: "kube-api-access-tpn2m") pod "b51ec5df-b550-4b1f-8ef5-0332f94c8bc0" (UID: "b51ec5df-b550-4b1f-8ef5-0332f94c8bc0"). InnerVolumeSpecName "kube-api-access-tpn2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:02:55.541413 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:55.541376    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpn2m\" (UniqueName: \"kubernetes.io/projected/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-kube-api-access-tpn2m\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:02:55.541413 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:55.541409    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-console-serving-cert\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:02:55.541413 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:55.541418    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0-console-oauth-config\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:02:55.562068 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:55.562033    2577 generic.go:356] "Generic (PLEG): container finished" podID="b51ec5df-b550-4b1f-8ef5-0332f94c8bc0" containerID="5ce5642ed8bcb7e541fd9c505b329dc1ee7d46fd4ad8a85c5f8624f3779416a4" exitCode=0
Jul 09 19:02:55.562223 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:55.562087    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b45c66894-ld4mt"
Jul 09 19:02:55.562223 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:55.562119    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b45c66894-ld4mt" event={"ID":"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0","Type":"ContainerDied","Data":"5ce5642ed8bcb7e541fd9c505b329dc1ee7d46fd4ad8a85c5f8624f3779416a4"}
Jul 09 19:02:55.562223 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:55.562171    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b45c66894-ld4mt" event={"ID":"b51ec5df-b550-4b1f-8ef5-0332f94c8bc0","Type":"ContainerDied","Data":"89e582fbfa2440279bb5ebcf7bfbc46d76ebc540a2dee1667709800b8a4d20f1"}
Jul 09 19:02:55.562223 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:55.562197    2577 scope.go:117] "RemoveContainer" containerID="5ce5642ed8bcb7e541fd9c505b329dc1ee7d46fd4ad8a85c5f8624f3779416a4"
Jul 09 19:02:55.571402 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:55.571382    2577 scope.go:117] "RemoveContainer" containerID="5ce5642ed8bcb7e541fd9c505b329dc1ee7d46fd4ad8a85c5f8624f3779416a4"
Jul 09 19:02:55.571653 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:02:55.571634    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ce5642ed8bcb7e541fd9c505b329dc1ee7d46fd4ad8a85c5f8624f3779416a4\": container with ID starting with 5ce5642ed8bcb7e541fd9c505b329dc1ee7d46fd4ad8a85c5f8624f3779416a4 not found: ID does not exist" containerID="5ce5642ed8bcb7e541fd9c505b329dc1ee7d46fd4ad8a85c5f8624f3779416a4"
Jul 09 19:02:55.571737 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:55.571662    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ce5642ed8bcb7e541fd9c505b329dc1ee7d46fd4ad8a85c5f8624f3779416a4"} err="failed to get container status \"5ce5642ed8bcb7e541fd9c505b329dc1ee7d46fd4ad8a85c5f8624f3779416a4\": rpc error: code = NotFound desc = could not find container \"5ce5642ed8bcb7e541fd9c505b329dc1ee7d46fd4ad8a85c5f8624f3779416a4\": container with ID starting with 5ce5642ed8bcb7e541fd9c505b329dc1ee7d46fd4ad8a85c5f8624f3779416a4 not found: ID does not exist"
Jul 09 19:02:55.583460 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:55.583429    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b45c66894-ld4mt"]
Jul 09 19:02:55.588930 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:55.588905    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b45c66894-ld4mt"]
Jul 09 19:02:56.637873 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:02:56.637835    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b51ec5df-b550-4b1f-8ef5-0332f94c8bc0" path="/var/lib/kubelet/pods/b51ec5df-b550-4b1f-8ef5-0332f94c8bc0/volumes"
Jul 09 19:03:03.667079 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:03.667039    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:03:03.845932 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:03.845898    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:03:05.574464 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:05.574396    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-759fb69bc9-2jdmf" podUID="f562fd94-5906-419c-800b-686ce9abb62e" containerName="console" containerID="cri-o://34f0cf9bd56d0c2c2be4bd28324327959ce060e4de393359de5bf5d8ef640a4c" gracePeriod=15
Jul 09 19:03:05.819389 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:05.819360    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759fb69bc9-2jdmf"
Jul 09 19:03:05.939309 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:05.939277    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f562fd94-5906-419c-800b-686ce9abb62e-console-config\") pod \"f562fd94-5906-419c-800b-686ce9abb62e\" (UID: \"f562fd94-5906-419c-800b-686ce9abb62e\") "
Jul 09 19:03:05.939475 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:05.939332    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f562fd94-5906-419c-800b-686ce9abb62e-console-serving-cert\") pod \"f562fd94-5906-419c-800b-686ce9abb62e\" (UID: \"f562fd94-5906-419c-800b-686ce9abb62e\") "
Jul 09 19:03:05.939475 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:05.939369    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f562fd94-5906-419c-800b-686ce9abb62e-console-oauth-config\") pod \"f562fd94-5906-419c-800b-686ce9abb62e\" (UID: \"f562fd94-5906-419c-800b-686ce9abb62e\") "
Jul 09 19:03:05.939475 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:05.939407    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f562fd94-5906-419c-800b-686ce9abb62e-trusted-ca-bundle\") pod \"f562fd94-5906-419c-800b-686ce9abb62e\" (UID: \"f562fd94-5906-419c-800b-686ce9abb62e\") "
Jul 09 19:03:05.939608 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:05.939476    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f562fd94-5906-419c-800b-686ce9abb62e-oauth-serving-cert\") pod \"f562fd94-5906-419c-800b-686ce9abb62e\" (UID: \"f562fd94-5906-419c-800b-686ce9abb62e\") "
Jul 09 19:03:05.939608 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:05.939536    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f562fd94-5906-419c-800b-686ce9abb62e-service-ca\") pod \"f562fd94-5906-419c-800b-686ce9abb62e\" (UID: \"f562fd94-5906-419c-800b-686ce9abb62e\") "
Jul 09 19:03:05.939608 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:05.939572    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpknl\" (UniqueName: \"kubernetes.io/projected/f562fd94-5906-419c-800b-686ce9abb62e-kube-api-access-cpknl\") pod \"f562fd94-5906-419c-800b-686ce9abb62e\" (UID: \"f562fd94-5906-419c-800b-686ce9abb62e\") "
Jul 09 19:03:05.939794 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:05.939739    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f562fd94-5906-419c-800b-686ce9abb62e-console-config" (OuterVolumeSpecName: "console-config") pod "f562fd94-5906-419c-800b-686ce9abb62e" (UID: "f562fd94-5906-419c-800b-686ce9abb62e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:03:05.939975 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:05.939942    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f562fd94-5906-419c-800b-686ce9abb62e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f562fd94-5906-419c-800b-686ce9abb62e" (UID: "f562fd94-5906-419c-800b-686ce9abb62e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:03:05.940044 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:05.939974    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f562fd94-5906-419c-800b-686ce9abb62e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f562fd94-5906-419c-800b-686ce9abb62e" (UID: "f562fd94-5906-419c-800b-686ce9abb62e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:03:05.940044 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:05.939983    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f562fd94-5906-419c-800b-686ce9abb62e-service-ca" (OuterVolumeSpecName: "service-ca") pod "f562fd94-5906-419c-800b-686ce9abb62e" (UID: "f562fd94-5906-419c-800b-686ce9abb62e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:03:05.940044 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:05.939960    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f562fd94-5906-419c-800b-686ce9abb62e-console-config\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:03:05.941575 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:05.941555    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f562fd94-5906-419c-800b-686ce9abb62e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f562fd94-5906-419c-800b-686ce9abb62e" (UID: "f562fd94-5906-419c-800b-686ce9abb62e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:03:05.941657 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:05.941589    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f562fd94-5906-419c-800b-686ce9abb62e-kube-api-access-cpknl" (OuterVolumeSpecName: "kube-api-access-cpknl") pod "f562fd94-5906-419c-800b-686ce9abb62e" (UID: "f562fd94-5906-419c-800b-686ce9abb62e"). InnerVolumeSpecName "kube-api-access-cpknl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:03:05.941657 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:05.941608    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f562fd94-5906-419c-800b-686ce9abb62e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f562fd94-5906-419c-800b-686ce9abb62e" (UID: "f562fd94-5906-419c-800b-686ce9abb62e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:03:06.041260 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:06.041222    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpknl\" (UniqueName: \"kubernetes.io/projected/f562fd94-5906-419c-800b-686ce9abb62e-kube-api-access-cpknl\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:03:06.041260 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:06.041254    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f562fd94-5906-419c-800b-686ce9abb62e-console-serving-cert\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:03:06.041260 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:06.041263    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f562fd94-5906-419c-800b-686ce9abb62e-console-oauth-config\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:03:06.041260 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:06.041271    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f562fd94-5906-419c-800b-686ce9abb62e-trusted-ca-bundle\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:03:06.041572 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:06.041281    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f562fd94-5906-419c-800b-686ce9abb62e-oauth-serving-cert\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:03:06.041572 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:06.041289    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f562fd94-5906-419c-800b-686ce9abb62e-service-ca\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:03:06.608522 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:06.608484    2577 generic.go:356] "Generic (PLEG): container finished" podID="f562fd94-5906-419c-800b-686ce9abb62e" containerID="34f0cf9bd56d0c2c2be4bd28324327959ce060e4de393359de5bf5d8ef640a4c" exitCode=0
Jul 09 19:03:06.608967 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:06.608529    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-759fb69bc9-2jdmf"
Jul 09 19:03:06.608967 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:06.608568    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759fb69bc9-2jdmf" event={"ID":"f562fd94-5906-419c-800b-686ce9abb62e","Type":"ContainerDied","Data":"34f0cf9bd56d0c2c2be4bd28324327959ce060e4de393359de5bf5d8ef640a4c"}
Jul 09 19:03:06.608967 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:06.608618    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-759fb69bc9-2jdmf" event={"ID":"f562fd94-5906-419c-800b-686ce9abb62e","Type":"ContainerDied","Data":"dfad4e1fcb0620dcd6f73acefa616f28e83f64c60a0bdd242ca740d039a972f3"}
Jul 09 19:03:06.608967 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:06.608642    2577 scope.go:117] "RemoveContainer" containerID="34f0cf9bd56d0c2c2be4bd28324327959ce060e4de393359de5bf5d8ef640a4c"
Jul 09 19:03:06.623310 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:06.623286    2577 scope.go:117] "RemoveContainer" containerID="34f0cf9bd56d0c2c2be4bd28324327959ce060e4de393359de5bf5d8ef640a4c"
Jul 09 19:03:06.623608 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:03:06.623588    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34f0cf9bd56d0c2c2be4bd28324327959ce060e4de393359de5bf5d8ef640a4c\": container with ID starting with 34f0cf9bd56d0c2c2be4bd28324327959ce060e4de393359de5bf5d8ef640a4c not found: ID does not exist" containerID="34f0cf9bd56d0c2c2be4bd28324327959ce060e4de393359de5bf5d8ef640a4c"
Jul 09 19:03:06.623659 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:06.623617    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34f0cf9bd56d0c2c2be4bd28324327959ce060e4de393359de5bf5d8ef640a4c"} err="failed to get container status \"34f0cf9bd56d0c2c2be4bd28324327959ce060e4de393359de5bf5d8ef640a4c\": rpc error: code = NotFound desc = could not find container \"34f0cf9bd56d0c2c2be4bd28324327959ce060e4de393359de5bf5d8ef640a4c\": container with ID starting with 34f0cf9bd56d0c2c2be4bd28324327959ce060e4de393359de5bf5d8ef640a4c not found: ID does not exist"
Jul 09 19:03:06.637593 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:06.637566    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-759fb69bc9-2jdmf"]
Jul 09 19:03:06.638557 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:06.638529    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-759fb69bc9-2jdmf"]
Jul 09 19:03:08.638156 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:08.638121    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f562fd94-5906-419c-800b-686ce9abb62e" path="/var/lib/kubelet/pods/f562fd94-5906-419c-800b-686ce9abb62e/volumes"
Jul 09 19:03:08.784212 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:08.784169    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:03:08.910468 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:08.910380    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:03:30.359146 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:30.359100    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:03:31.412772 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:31.412732    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:03:33.974942 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:33.974888    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:03:34.073208 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:34.073174    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:03:35.639448 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:35.639412    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:03:35.734328 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:35.734292    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:03:36.322270 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:36.322238    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:03:36.424119 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:36.424086    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:03:37.851085 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:37.851053    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:03:38.004033 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:38.004000    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9jcz6"]
Jul 09 19:03:38.004336 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:38.004325    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f562fd94-5906-419c-800b-686ce9abb62e" containerName="console"
Jul 09 19:03:38.004384 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:38.004339    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f562fd94-5906-419c-800b-686ce9abb62e" containerName="console"
Jul 09 19:03:38.004384 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:38.004352    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b51ec5df-b550-4b1f-8ef5-0332f94c8bc0" containerName="console"
Jul 09 19:03:38.004384 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:38.004358    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b51ec5df-b550-4b1f-8ef5-0332f94c8bc0" containerName="console"
Jul 09 19:03:38.004473 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:38.004420    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b51ec5df-b550-4b1f-8ef5-0332f94c8bc0" containerName="console"
Jul 09 19:03:38.004473 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:38.004432    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f562fd94-5906-419c-800b-686ce9abb62e" containerName="console"
Jul 09 19:03:38.007519 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:38.007498    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-9jcz6"
Jul 09 19:03:38.010598 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:38.010580    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 09 19:03:38.012093 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:38.012078    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 09 19:03:38.012147 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:38.012077    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-wtg9j\""
Jul 09 19:03:38.015648 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:38.015627    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9jcz6"]
Jul 09 19:03:38.121505 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:38.121419    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99c6l\" (UniqueName: \"kubernetes.io/projected/edae8201-d3e6-44e8-a665-3f9a34407473-kube-api-access-99c6l\") pod \"cert-manager-webhook-6486ffd997-9jcz6\" (UID: \"edae8201-d3e6-44e8-a665-3f9a34407473\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9jcz6"
Jul 09 19:03:38.121701 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:38.121514    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/edae8201-d3e6-44e8-a665-3f9a34407473-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9jcz6\" (UID: \"edae8201-d3e6-44e8-a665-3f9a34407473\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9jcz6"
Jul 09 19:03:38.222746 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:38.222707    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99c6l\" (UniqueName: \"kubernetes.io/projected/edae8201-d3e6-44e8-a665-3f9a34407473-kube-api-access-99c6l\") pod \"cert-manager-webhook-6486ffd997-9jcz6\" (UID: \"edae8201-d3e6-44e8-a665-3f9a34407473\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9jcz6"
Jul 09 19:03:38.222941 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:38.222798    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/edae8201-d3e6-44e8-a665-3f9a34407473-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9jcz6\" (UID: \"edae8201-d3e6-44e8-a665-3f9a34407473\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9jcz6"
Jul 09 19:03:38.235887 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:38.235846    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/edae8201-d3e6-44e8-a665-3f9a34407473-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-9jcz6\" (UID: \"edae8201-d3e6-44e8-a665-3f9a34407473\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9jcz6"
Jul 09 19:03:38.236207 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:38.236190    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99c6l\" (UniqueName: \"kubernetes.io/projected/edae8201-d3e6-44e8-a665-3f9a34407473-kube-api-access-99c6l\") pod \"cert-manager-webhook-6486ffd997-9jcz6\" (UID: \"edae8201-d3e6-44e8-a665-3f9a34407473\") " pod="cert-manager/cert-manager-webhook-6486ffd997-9jcz6"
Jul 09 19:03:38.325002 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:38.324963    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-9jcz6"
Jul 09 19:03:38.440798 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:38.440768    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:03:38.455439 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:38.455401    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-9jcz6"]
Jul 09 19:03:38.458261 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:03:38.458236    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podedae8201_d3e6_44e8_a665_3f9a34407473.slice/crio-e7fe2223db8e83f92d3e19b237388327bc95af175ef991a23c983ea9572aed04 WatchSource:0}: Error finding container e7fe2223db8e83f92d3e19b237388327bc95af175ef991a23c983ea9572aed04: Status 404 returned error can't find the container with id e7fe2223db8e83f92d3e19b237388327bc95af175ef991a23c983ea9572aed04
Jul 09 19:03:38.750425 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:38.750390    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-9jcz6" event={"ID":"edae8201-d3e6-44e8-a665-3f9a34407473","Type":"ContainerStarted","Data":"e7fe2223db8e83f92d3e19b237388327bc95af175ef991a23c983ea9572aed04"}
Jul 09 19:03:40.970536 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:40.970478    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:03:41.071494 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:41.071441    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:03:42.772419 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:42.772385    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-9jcz6" event={"ID":"edae8201-d3e6-44e8-a665-3f9a34407473","Type":"ContainerStarted","Data":"6065e83e00be72b84ddb6a49f5d0921d7d47dd3edca92e16a6ac1a2209f9801d"}
Jul 09 19:03:42.772795 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:42.772436    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-9jcz6"
Jul 09 19:03:42.818900 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:42.818845    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-9jcz6" podStartSLOduration=1.96767046 podStartE2EDuration="5.818830569s" totalImagesPullingTime="3.851160109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:03:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:03:42.816615359 +0000 UTC m=+241.201685633" watchObservedRunningTime="2026-07-09 19:03:42.818830569 +0000 UTC m=+241.203900843"
Jul 09 19:03:43.315640 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:43.315602    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:03:43.415845 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:43.415775    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:03:46.236926 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:46.236890    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:03:46.977354 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:46.977323    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hsktf"]
Jul 09 19:03:46.982150 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:46.982132    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-hsktf"
Jul 09 19:03:46.985442 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:46.985422    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-4qn9t\""
Jul 09 19:03:46.991066 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:46.991042    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hsktf"]
Jul 09 19:03:47.103749 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:47.103715    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9tlk\" (UniqueName: \"kubernetes.io/projected/2745f80a-d3b1-43d2-9cc5-24de8ccb6013-kube-api-access-p9tlk\") pod \"cert-manager-55b4d954d5-hsktf\" (UID: \"2745f80a-d3b1-43d2-9cc5-24de8ccb6013\") " pod="cert-manager/cert-manager-55b4d954d5-hsktf"
Jul 09 19:03:47.103956 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:47.103791    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2745f80a-d3b1-43d2-9cc5-24de8ccb6013-bound-sa-token\") pod \"cert-manager-55b4d954d5-hsktf\" (UID: \"2745f80a-d3b1-43d2-9cc5-24de8ccb6013\") " pod="cert-manager/cert-manager-55b4d954d5-hsktf"
Jul 09 19:03:47.204836 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:47.204791    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2745f80a-d3b1-43d2-9cc5-24de8ccb6013-bound-sa-token\") pod \"cert-manager-55b4d954d5-hsktf\" (UID: \"2745f80a-d3b1-43d2-9cc5-24de8ccb6013\") " pod="cert-manager/cert-manager-55b4d954d5-hsktf"
Jul 09 19:03:47.205035 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:47.204894    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9tlk\" (UniqueName: \"kubernetes.io/projected/2745f80a-d3b1-43d2-9cc5-24de8ccb6013-kube-api-access-p9tlk\") pod \"cert-manager-55b4d954d5-hsktf\" (UID: \"2745f80a-d3b1-43d2-9cc5-24de8ccb6013\") " pod="cert-manager/cert-manager-55b4d954d5-hsktf"
Jul 09 19:03:47.214054 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:47.214020    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9tlk\" (UniqueName: \"kubernetes.io/projected/2745f80a-d3b1-43d2-9cc5-24de8ccb6013-kube-api-access-p9tlk\") pod \"cert-manager-55b4d954d5-hsktf\" (UID: \"2745f80a-d3b1-43d2-9cc5-24de8ccb6013\") " pod="cert-manager/cert-manager-55b4d954d5-hsktf"
Jul 09 19:03:47.214054 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:47.214030    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2745f80a-d3b1-43d2-9cc5-24de8ccb6013-bound-sa-token\") pod \"cert-manager-55b4d954d5-hsktf\" (UID: \"2745f80a-d3b1-43d2-9cc5-24de8ccb6013\") " pod="cert-manager/cert-manager-55b4d954d5-hsktf"
Jul 09 19:03:47.291848 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:47.291732    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-hsktf"
Jul 09 19:03:47.422946 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:47.422922    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hsktf"]
Jul 09 19:03:47.425566 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:03:47.425538    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2745f80a_d3b1_43d2_9cc5_24de8ccb6013.slice/crio-41bb8600095e21edab8c68fdedfe384773921f1bb2c8118072264bc5cd458c71 WatchSource:0}: Error finding container 41bb8600095e21edab8c68fdedfe384773921f1bb2c8118072264bc5cd458c71: Status 404 returned error can't find the container with id 41bb8600095e21edab8c68fdedfe384773921f1bb2c8118072264bc5cd458c71
Jul 09 19:03:47.794731 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:47.794698    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-hsktf" event={"ID":"2745f80a-d3b1-43d2-9cc5-24de8ccb6013","Type":"ContainerStarted","Data":"cab5aac84467ce91c4a49b6ad2568de847374697f10ccc13770a9701eb3bb9fc"}
Jul 09 19:03:47.794731 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:47.794737    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-hsktf" event={"ID":"2745f80a-d3b1-43d2-9cc5-24de8ccb6013","Type":"ContainerStarted","Data":"41bb8600095e21edab8c68fdedfe384773921f1bb2c8118072264bc5cd458c71"}
Jul 09 19:03:48.779260 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:48.779224    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-9jcz6"
Jul 09 19:03:48.798090 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:48.798030    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-hsktf" podStartSLOduration=2.798011406 podStartE2EDuration="2.798011406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:03:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:03:47.81337081 +0000 UTC m=+246.198441084" watchObservedRunningTime="2026-07-09 19:03:48.798011406 +0000 UTC m=+247.183081683"
Jul 09 19:03:52.567589 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:52.567543    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:03:52.671073 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:52.671035    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:03:58.700796 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:58.700748    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:03:58.800771 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:03:58.800730    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:00.371044 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:00.371013    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:13.368494 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:13.368385    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:13.475605 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:13.475575    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:13.984605 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:13.984573    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:14.341068 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.340986    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-779db88bb-xhp8b"]
Jul 09 19:04:14.347618 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.347582    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-xhp8b"
Jul 09 19:04:14.351055 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.351030    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 09 19:04:14.351177 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.351085    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-67swh\""
Jul 09 19:04:14.351582 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.351568    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 09 19:04:14.352177 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.352160    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 09 19:04:14.352254 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.352216    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 09 19:04:14.363388 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.363362    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-779db88bb-xhp8b"]
Jul 09 19:04:14.448156 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.448123    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj8hl\" (UniqueName: \"kubernetes.io/projected/92045a2d-ff6b-411b-a596-2ac71e27d975-kube-api-access-vj8hl\") pod \"opendatahub-operator-controller-manager-779db88bb-xhp8b\" (UID: \"92045a2d-ff6b-411b-a596-2ac71e27d975\") " pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-xhp8b"
Jul 09 19:04:14.448527 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.448165    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/92045a2d-ff6b-411b-a596-2ac71e27d975-webhook-cert\") pod \"opendatahub-operator-controller-manager-779db88bb-xhp8b\" (UID: \"92045a2d-ff6b-411b-a596-2ac71e27d975\") " pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-xhp8b"
Jul 09 19:04:14.448527 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.448257    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/92045a2d-ff6b-411b-a596-2ac71e27d975-manifests\") pod \"opendatahub-operator-controller-manager-779db88bb-xhp8b\" (UID: \"92045a2d-ff6b-411b-a596-2ac71e27d975\") " pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-xhp8b"
Jul 09 19:04:14.448527 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.448296    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92045a2d-ff6b-411b-a596-2ac71e27d975-tmp\") pod \"opendatahub-operator-controller-manager-779db88bb-xhp8b\" (UID: \"92045a2d-ff6b-411b-a596-2ac71e27d975\") " pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-xhp8b"
Jul 09 19:04:14.448527 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.448325    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/92045a2d-ff6b-411b-a596-2ac71e27d975-apiservice-cert\") pod \"opendatahub-operator-controller-manager-779db88bb-xhp8b\" (UID: \"92045a2d-ff6b-411b-a596-2ac71e27d975\") " pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-xhp8b"
Jul 09 19:04:14.530511 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.530475    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:14.549164 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.549132    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj8hl\" (UniqueName: \"kubernetes.io/projected/92045a2d-ff6b-411b-a596-2ac71e27d975-kube-api-access-vj8hl\") pod \"opendatahub-operator-controller-manager-779db88bb-xhp8b\" (UID: \"92045a2d-ff6b-411b-a596-2ac71e27d975\") " pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-xhp8b"
Jul 09 19:04:14.549302 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.549178    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/92045a2d-ff6b-411b-a596-2ac71e27d975-webhook-cert\") pod \"opendatahub-operator-controller-manager-779db88bb-xhp8b\" (UID: \"92045a2d-ff6b-411b-a596-2ac71e27d975\") " pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-xhp8b"
Jul 09 19:04:14.549302 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.549233    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/92045a2d-ff6b-411b-a596-2ac71e27d975-manifests\") pod \"opendatahub-operator-controller-manager-779db88bb-xhp8b\" (UID: \"92045a2d-ff6b-411b-a596-2ac71e27d975\") " pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-xhp8b"
Jul 09 19:04:14.549302 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.549260    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92045a2d-ff6b-411b-a596-2ac71e27d975-tmp\") pod \"opendatahub-operator-controller-manager-779db88bb-xhp8b\" (UID: \"92045a2d-ff6b-411b-a596-2ac71e27d975\") " pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-xhp8b"
Jul 09 19:04:14.549302 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.549288    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/92045a2d-ff6b-411b-a596-2ac71e27d975-apiservice-cert\") pod \"opendatahub-operator-controller-manager-779db88bb-xhp8b\" (UID: \"92045a2d-ff6b-411b-a596-2ac71e27d975\") " pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-xhp8b"
Jul 09 19:04:14.549661 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.549641    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/92045a2d-ff6b-411b-a596-2ac71e27d975-manifests\") pod \"opendatahub-operator-controller-manager-779db88bb-xhp8b\" (UID: \"92045a2d-ff6b-411b-a596-2ac71e27d975\") " pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-xhp8b"
Jul 09 19:04:14.551583 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.551559    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92045a2d-ff6b-411b-a596-2ac71e27d975-tmp\") pod \"opendatahub-operator-controller-manager-779db88bb-xhp8b\" (UID: \"92045a2d-ff6b-411b-a596-2ac71e27d975\") " pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-xhp8b"
Jul 09 19:04:14.551702 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.551669    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/92045a2d-ff6b-411b-a596-2ac71e27d975-webhook-cert\") pod \"opendatahub-operator-controller-manager-779db88bb-xhp8b\" (UID: \"92045a2d-ff6b-411b-a596-2ac71e27d975\") " pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-xhp8b"
Jul 09 19:04:14.551772 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.551697    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/92045a2d-ff6b-411b-a596-2ac71e27d975-apiservice-cert\") pod \"opendatahub-operator-controller-manager-779db88bb-xhp8b\" (UID: \"92045a2d-ff6b-411b-a596-2ac71e27d975\") " pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-xhp8b"
Jul 09 19:04:14.561047 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.561016    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj8hl\" (UniqueName: \"kubernetes.io/projected/92045a2d-ff6b-411b-a596-2ac71e27d975-kube-api-access-vj8hl\") pod \"opendatahub-operator-controller-manager-779db88bb-xhp8b\" (UID: \"92045a2d-ff6b-411b-a596-2ac71e27d975\") " pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-xhp8b"
Jul 09 19:04:14.624069 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.623986    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:14.659431 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.659402    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-xhp8b"
Jul 09 19:04:14.724556 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.724449    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:14.777699 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.777665    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8ff7d7b96-rhjhz"]
Jul 09 19:04:14.780336 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.780313    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-rhjhz"
Jul 09 19:04:14.784281 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.784257    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 09 19:04:14.785063 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.785042    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 09 19:04:14.785194 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.785106    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-74stm\""
Jul 09 19:04:14.785194 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.785134    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 09 19:04:14.786198 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.786173    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 09 19:04:14.789255 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.789235    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 09 19:04:14.800022 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.799999    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8ff7d7b96-rhjhz"]
Jul 09 19:04:14.815408 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.815383    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-779db88bb-xhp8b"]
Jul 09 19:04:14.816914 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:04:14.816889    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92045a2d_ff6b_411b_a596_2ac71e27d975.slice/crio-9bcf8028a8710ba53e25e4f5d2cbdd19f1139d5ef8cf428e43e6bb1fb934e805 WatchSource:0}: Error finding container 9bcf8028a8710ba53e25e4f5d2cbdd19f1139d5ef8cf428e43e6bb1fb934e805: Status 404 returned error can't find the container with id 9bcf8028a8710ba53e25e4f5d2cbdd19f1139d5ef8cf428e43e6bb1fb934e805
Jul 09 19:04:14.833261 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.833233    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:14.851431 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.851403    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a0ae800a-a0cd-483a-903a-05e5a2ca09f2-metrics-cert\") pod \"lws-controller-manager-8ff7d7b96-rhjhz\" (UID: \"a0ae800a-a0cd-483a-903a-05e5a2ca09f2\") " pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-rhjhz"
Jul 09 19:04:14.851544 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.851439    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a0ae800a-a0cd-483a-903a-05e5a2ca09f2-manager-config\") pod \"lws-controller-manager-8ff7d7b96-rhjhz\" (UID: \"a0ae800a-a0cd-483a-903a-05e5a2ca09f2\") " pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-rhjhz"
Jul 09 19:04:14.851544 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.851475    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5rjf\" (UniqueName: \"kubernetes.io/projected/a0ae800a-a0cd-483a-903a-05e5a2ca09f2-kube-api-access-p5rjf\") pod \"lws-controller-manager-8ff7d7b96-rhjhz\" (UID: \"a0ae800a-a0cd-483a-903a-05e5a2ca09f2\") " pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-rhjhz"
Jul 09 19:04:14.851636 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.851608    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0ae800a-a0cd-483a-903a-05e5a2ca09f2-cert\") pod \"lws-controller-manager-8ff7d7b96-rhjhz\" (UID: \"a0ae800a-a0cd-483a-903a-05e5a2ca09f2\") " pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-rhjhz"
Jul 09 19:04:14.907329 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.907298    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-xhp8b" event={"ID":"92045a2d-ff6b-411b-a596-2ac71e27d975","Type":"ContainerStarted","Data":"9bcf8028a8710ba53e25e4f5d2cbdd19f1139d5ef8cf428e43e6bb1fb934e805"}
Jul 09 19:04:14.952967 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.952931    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a0ae800a-a0cd-483a-903a-05e5a2ca09f2-metrics-cert\") pod \"lws-controller-manager-8ff7d7b96-rhjhz\" (UID: \"a0ae800a-a0cd-483a-903a-05e5a2ca09f2\") " pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-rhjhz"
Jul 09 19:04:14.953122 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.952973    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a0ae800a-a0cd-483a-903a-05e5a2ca09f2-manager-config\") pod \"lws-controller-manager-8ff7d7b96-rhjhz\" (UID: \"a0ae800a-a0cd-483a-903a-05e5a2ca09f2\") " pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-rhjhz"
Jul 09 19:04:14.953122 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.953095    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5rjf\" (UniqueName: \"kubernetes.io/projected/a0ae800a-a0cd-483a-903a-05e5a2ca09f2-kube-api-access-p5rjf\") pod \"lws-controller-manager-8ff7d7b96-rhjhz\" (UID: \"a0ae800a-a0cd-483a-903a-05e5a2ca09f2\") " pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-rhjhz"
Jul 09 19:04:14.953255 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.953150    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0ae800a-a0cd-483a-903a-05e5a2ca09f2-cert\") pod \"lws-controller-manager-8ff7d7b96-rhjhz\" (UID: \"a0ae800a-a0cd-483a-903a-05e5a2ca09f2\") " pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-rhjhz"
Jul 09 19:04:14.953591 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.953569    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a0ae800a-a0cd-483a-903a-05e5a2ca09f2-manager-config\") pod \"lws-controller-manager-8ff7d7b96-rhjhz\" (UID: \"a0ae800a-a0cd-483a-903a-05e5a2ca09f2\") " pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-rhjhz"
Jul 09 19:04:14.955438 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.955419    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a0ae800a-a0cd-483a-903a-05e5a2ca09f2-cert\") pod \"lws-controller-manager-8ff7d7b96-rhjhz\" (UID: \"a0ae800a-a0cd-483a-903a-05e5a2ca09f2\") " pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-rhjhz"
Jul 09 19:04:14.956014 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.955997    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a0ae800a-a0cd-483a-903a-05e5a2ca09f2-metrics-cert\") pod \"lws-controller-manager-8ff7d7b96-rhjhz\" (UID: \"a0ae800a-a0cd-483a-903a-05e5a2ca09f2\") " pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-rhjhz"
Jul 09 19:04:14.965507 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:14.965486    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5rjf\" (UniqueName: \"kubernetes.io/projected/a0ae800a-a0cd-483a-903a-05e5a2ca09f2-kube-api-access-p5rjf\") pod \"lws-controller-manager-8ff7d7b96-rhjhz\" (UID: \"a0ae800a-a0cd-483a-903a-05e5a2ca09f2\") " pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-rhjhz"
Jul 09 19:04:15.090710 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:15.090667    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-rhjhz"
Jul 09 19:04:15.113192 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:15.113156    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:15.226524 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:15.226498    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8ff7d7b96-rhjhz"]
Jul 09 19:04:15.228930 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:04:15.228904    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0ae800a_a0cd_483a_903a_05e5a2ca09f2.slice/crio-7584857f5ad66318090a40310fdfe64fc42f796c23cf19fd74f899d951eab6f2 WatchSource:0}: Error finding container 7584857f5ad66318090a40310fdfe64fc42f796c23cf19fd74f899d951eab6f2: Status 404 returned error can't find the container with id 7584857f5ad66318090a40310fdfe64fc42f796c23cf19fd74f899d951eab6f2
Jul 09 19:04:15.915850 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:15.915786    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-rhjhz" event={"ID":"a0ae800a-a0cd-483a-903a-05e5a2ca09f2","Type":"ContainerStarted","Data":"7584857f5ad66318090a40310fdfe64fc42f796c23cf19fd74f899d951eab6f2"}
Jul 09 19:04:17.928207 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:17.928122    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-xhp8b" event={"ID":"92045a2d-ff6b-411b-a596-2ac71e27d975","Type":"ContainerStarted","Data":"7c2b1baaf6a1b767395203a616cfcca81903249215aeab8847b0ba33ce6edf8c"}
Jul 09 19:04:19.939838 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:19.939730    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-rhjhz" event={"ID":"a0ae800a-a0cd-483a-903a-05e5a2ca09f2","Type":"ContainerStarted","Data":"d0efa2da2d8d4abc192c959780d07d8c3ed03654b0ee735492eb5c23397acc27"}
Jul 09 19:04:19.940263 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:19.939861    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-rhjhz"
Jul 09 19:04:19.941414 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:19.941392    2577 generic.go:356] "Generic (PLEG): container finished" podID="92045a2d-ff6b-411b-a596-2ac71e27d975" containerID="7c2b1baaf6a1b767395203a616cfcca81903249215aeab8847b0ba33ce6edf8c" exitCode=0
Jul 09 19:04:19.941518 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:19.941427    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-xhp8b" event={"ID":"92045a2d-ff6b-411b-a596-2ac71e27d975","Type":"ContainerDied","Data":"7c2b1baaf6a1b767395203a616cfcca81903249215aeab8847b0ba33ce6edf8c"}
Jul 09 19:04:19.963239 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:19.963190    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-rhjhz" podStartSLOduration=1.486064829 podStartE2EDuration="5.963175294s" totalImagesPullingTime="4.477110465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:04:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:04:19.96202574 +0000 UTC m=+278.347096018" watchObservedRunningTime="2026-07-09 19:04:19.963175294 +0000 UTC m=+278.348245565"
Jul 09 19:04:20.948244 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:20.948212    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-xhp8b" event={"ID":"92045a2d-ff6b-411b-a596-2ac71e27d975","Type":"ContainerStarted","Data":"77f8d4e86f9d9c33cb2c5e945fb6123b90dd636a97020d7e3098f2b67c36ac2e"}
Jul 09 19:04:20.948602 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:20.948519    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-xhp8b"
Jul 09 19:04:20.974444 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:20.974393    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-xhp8b" podStartSLOduration=2.001511007 podStartE2EDuration="6.974375404s" totalImagesPullingTime="3.660676222s" totalInitContainerRuntime="1.312188175s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:04:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:04:20.972105182 +0000 UTC m=+279.357175456" watchObservedRunningTime="2026-07-09 19:04:20.974375404 +0000 UTC m=+279.359445753"
Jul 09 19:04:25.633645 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:25.633604    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:27.627357 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:27.627323    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:30.951309 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:30.951279    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8ff7d7b96-rhjhz"
Jul 09 19:04:31.955895 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:31.955864    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-779db88bb-xhp8b"
Jul 09 19:04:33.870374 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:33.870336    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:33.991006 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:33.990969    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:39.578830 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:39.578771    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:39.685705 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:39.685668    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7b6c4d4-g6hzz"]
Jul 09 19:04:39.701645 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:39.701618    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7b6c4d4-g6hzz"]
Jul 09 19:04:39.701842 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:39.701718    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7b6c4d4-g6hzz"
Jul 09 19:04:39.705041 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:39.705012    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 09 19:04:39.705201 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:39.705012    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-jkwf6\""
Jul 09 19:04:39.706444 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:39.706421    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 09 19:04:39.706444 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:39.706465    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 19:04:39.706632 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:39.706591    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 19:04:39.834489 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:39.834395    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:39.894913 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:39.894880    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba524d40-a1a2-4b64-bb5d-8722dd385d19-tls-certs\") pod \"kube-auth-proxy-7b6c4d4-g6hzz\" (UID: \"ba524d40-a1a2-4b64-bb5d-8722dd385d19\") " pod="openshift-ingress/kube-auth-proxy-7b6c4d4-g6hzz"
Jul 09 19:04:39.895089 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:39.894938    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5z7s\" (UniqueName: \"kubernetes.io/projected/ba524d40-a1a2-4b64-bb5d-8722dd385d19-kube-api-access-d5z7s\") pod \"kube-auth-proxy-7b6c4d4-g6hzz\" (UID: \"ba524d40-a1a2-4b64-bb5d-8722dd385d19\") " pod="openshift-ingress/kube-auth-proxy-7b6c4d4-g6hzz"
Jul 09 19:04:39.895089 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:39.895008    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba524d40-a1a2-4b64-bb5d-8722dd385d19-tmp\") pod \"kube-auth-proxy-7b6c4d4-g6hzz\" (UID: \"ba524d40-a1a2-4b64-bb5d-8722dd385d19\") " pod="openshift-ingress/kube-auth-proxy-7b6c4d4-g6hzz"
Jul 09 19:04:39.936907 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:39.936859    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:39.995540 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:39.995507    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba524d40-a1a2-4b64-bb5d-8722dd385d19-tls-certs\") pod \"kube-auth-proxy-7b6c4d4-g6hzz\" (UID: \"ba524d40-a1a2-4b64-bb5d-8722dd385d19\") " pod="openshift-ingress/kube-auth-proxy-7b6c4d4-g6hzz"
Jul 09 19:04:39.995732 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:39.995554    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5z7s\" (UniqueName: \"kubernetes.io/projected/ba524d40-a1a2-4b64-bb5d-8722dd385d19-kube-api-access-d5z7s\") pod \"kube-auth-proxy-7b6c4d4-g6hzz\" (UID: \"ba524d40-a1a2-4b64-bb5d-8722dd385d19\") " pod="openshift-ingress/kube-auth-proxy-7b6c4d4-g6hzz"
Jul 09 19:04:39.995732 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:39.995698    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba524d40-a1a2-4b64-bb5d-8722dd385d19-tmp\") pod \"kube-auth-proxy-7b6c4d4-g6hzz\" (UID: \"ba524d40-a1a2-4b64-bb5d-8722dd385d19\") " pod="openshift-ingress/kube-auth-proxy-7b6c4d4-g6hzz"
Jul 09 19:04:39.997919 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:39.997890    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba524d40-a1a2-4b64-bb5d-8722dd385d19-tmp\") pod \"kube-auth-proxy-7b6c4d4-g6hzz\" (UID: \"ba524d40-a1a2-4b64-bb5d-8722dd385d19\") " pod="openshift-ingress/kube-auth-proxy-7b6c4d4-g6hzz"
Jul 09 19:04:39.998037 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:39.998019    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba524d40-a1a2-4b64-bb5d-8722dd385d19-tls-certs\") pod \"kube-auth-proxy-7b6c4d4-g6hzz\" (UID: \"ba524d40-a1a2-4b64-bb5d-8722dd385d19\") " pod="openshift-ingress/kube-auth-proxy-7b6c4d4-g6hzz"
Jul 09 19:04:40.004232 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:40.004202    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5z7s\" (UniqueName: \"kubernetes.io/projected/ba524d40-a1a2-4b64-bb5d-8722dd385d19-kube-api-access-d5z7s\") pod \"kube-auth-proxy-7b6c4d4-g6hzz\" (UID: \"ba524d40-a1a2-4b64-bb5d-8722dd385d19\") " pod="openshift-ingress/kube-auth-proxy-7b6c4d4-g6hzz"
Jul 09 19:04:40.012067 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:40.012040    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7b6c4d4-g6hzz"
Jul 09 19:04:40.087181 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:40.087091    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:40.157396 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:40.157291    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7b6c4d4-g6hzz"]
Jul 09 19:04:40.160156 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:04:40.160135    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba524d40_a1a2_4b64_bb5d_8722dd385d19.slice/crio-ca912c7cffa2a36f612e975167ac8ae83a46beba461f122e9b2a51c66249a09f WatchSource:0}: Error finding container ca912c7cffa2a36f612e975167ac8ae83a46beba461f122e9b2a51c66249a09f: Status 404 returned error can't find the container with id ca912c7cffa2a36f612e975167ac8ae83a46beba461f122e9b2a51c66249a09f
Jul 09 19:04:40.264147 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:40.264115    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:40.616580 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:40.616546    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:41.039423 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:41.039384    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7b6c4d4-g6hzz" event={"ID":"ba524d40-a1a2-4b64-bb5d-8722dd385d19","Type":"ContainerStarted","Data":"ca912c7cffa2a36f612e975167ac8ae83a46beba461f122e9b2a51c66249a09f"}
Jul 09 19:04:41.148069 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:41.148036    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:41.275425 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:41.275387    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:42.353799 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:42.353764    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:42.504295 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:42.504259    2577 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 19:04:43.575883 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:43.575863    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 09 19:04:44.055884 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:44.055846    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7b6c4d4-g6hzz" event={"ID":"ba524d40-a1a2-4b64-bb5d-8722dd385d19","Type":"ContainerStarted","Data":"df620009a616b79717216783a722b8ce93de09479d26631f15609e4a92b8f494"}
Jul 09 19:04:44.074378 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:44.074325    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7b6c4d4-g6hzz" podStartSLOduration=1.664028544 podStartE2EDuration="5.074308331s" totalImagesPullingTime="3.410279787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:04:44.072761653 +0000 UTC m=+302.457831928" watchObservedRunningTime="2026-07-09 19:04:44.074308331 +0000 UTC m=+302.459378607"
Jul 09 19:04:47.501255 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:47.501219    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:47.603455 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:47.603404    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:48.369862 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:48.369804    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:48.683152 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:48.683114    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:48.830870 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:48.830796    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:52.144803 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:52.144765    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:52.284354 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:52.284315    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:52.364221 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:52.364182    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:52.480831 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:52.480727    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:52.594364 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:52.594327    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:52.711366 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:52.711320    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:53.255135 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:53.255095    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:04:53.847398 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:04:53.847359    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:05:05.703900 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:05:05.703869    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:05:35.336998 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:05:35.336958    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:05:35.643291 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:05:35.643257    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:05:35.708336 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:05:35.708308    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:05:47.838261 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:05:47.838218    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:05:47.939345 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:05:47.939310    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:05:49.686464 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:05:49.686431    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:05:49.739764 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:05:49.739725    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:04.221911 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:04.221869    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:08.270210 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:08.270179    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:10.881208 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:10.881172    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:12.364991 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:12.364955    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:13.228116 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:13.228075    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:16.249134 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:16.249095    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:16.350211 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:16.350180    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:17.010343 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:17.010301    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:17.122003 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:17.121968    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:18.918360 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:18.918321    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:20.824571 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:20.824528    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:20.924913 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:20.924871    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:22.769273 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:22.769237    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cljhs"]
Jul 09 19:06:22.771506 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:22.771488    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cljhs"
Jul 09 19:06:22.774474 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:22.774447    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 09 19:06:22.774610 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:22.774450    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 09 19:06:22.774610 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:22.774451    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 19:06:22.775888 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:22.775874    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-njbf7\""
Jul 09 19:06:22.775949 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:22.775904    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 19:06:22.781373 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:22.781329    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:22.782135 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:22.782100    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cljhs"]
Jul 09 19:06:22.861249 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:22.861212    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhb8f\" (UniqueName: \"kubernetes.io/projected/e0fba050-da7d-49c0-8088-d77da7b61bdc-kube-api-access-fhb8f\") pod \"kuadrant-console-plugin-66b5774985-cljhs\" (UID: \"e0fba050-da7d-49c0-8088-d77da7b61bdc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cljhs"
Jul 09 19:06:22.861460 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:22.861288    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0fba050-da7d-49c0-8088-d77da7b61bdc-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cljhs\" (UID: \"e0fba050-da7d-49c0-8088-d77da7b61bdc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cljhs"
Jul 09 19:06:22.861460 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:22.861316    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e0fba050-da7d-49c0-8088-d77da7b61bdc-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cljhs\" (UID: \"e0fba050-da7d-49c0-8088-d77da7b61bdc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cljhs"
Jul 09 19:06:22.962683 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:22.962640    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhb8f\" (UniqueName: \"kubernetes.io/projected/e0fba050-da7d-49c0-8088-d77da7b61bdc-kube-api-access-fhb8f\") pod \"kuadrant-console-plugin-66b5774985-cljhs\" (UID: \"e0fba050-da7d-49c0-8088-d77da7b61bdc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cljhs"
Jul 09 19:06:22.962913 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:22.962694    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0fba050-da7d-49c0-8088-d77da7b61bdc-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cljhs\" (UID: \"e0fba050-da7d-49c0-8088-d77da7b61bdc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cljhs"
Jul 09 19:06:22.962913 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:22.962724    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e0fba050-da7d-49c0-8088-d77da7b61bdc-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cljhs\" (UID: \"e0fba050-da7d-49c0-8088-d77da7b61bdc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cljhs"
Jul 09 19:06:22.962913 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:06:22.962869    2577 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 09 19:06:22.963098 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:06:22.962940    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0fba050-da7d-49c0-8088-d77da7b61bdc-plugin-serving-cert podName:e0fba050-da7d-49c0-8088-d77da7b61bdc nodeName:}" failed. No retries permitted until 2026-07-09 19:06:23.462922048 +0000 UTC m=+401.847992303 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/e0fba050-da7d-49c0-8088-d77da7b61bdc-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-cljhs" (UID: "e0fba050-da7d-49c0-8088-d77da7b61bdc") : secret "plugin-serving-cert" not found
Jul 09 19:06:22.963475 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:22.963449    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e0fba050-da7d-49c0-8088-d77da7b61bdc-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-cljhs\" (UID: \"e0fba050-da7d-49c0-8088-d77da7b61bdc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cljhs"
Jul 09 19:06:22.979761 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:22.979726    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhb8f\" (UniqueName: \"kubernetes.io/projected/e0fba050-da7d-49c0-8088-d77da7b61bdc-kube-api-access-fhb8f\") pod \"kuadrant-console-plugin-66b5774985-cljhs\" (UID: \"e0fba050-da7d-49c0-8088-d77da7b61bdc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cljhs"
Jul 09 19:06:23.126192 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:23.126102    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:23.467413 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:23.467385    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0fba050-da7d-49c0-8088-d77da7b61bdc-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cljhs\" (UID: \"e0fba050-da7d-49c0-8088-d77da7b61bdc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cljhs"
Jul 09 19:06:23.469765 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:23.469747    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0fba050-da7d-49c0-8088-d77da7b61bdc-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-cljhs\" (UID: \"e0fba050-da7d-49c0-8088-d77da7b61bdc\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cljhs"
Jul 09 19:06:23.681262 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:23.681219    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cljhs"
Jul 09 19:06:23.812577 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:23.812554    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-cljhs"]
Jul 09 19:06:23.814589 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:06:23.814564    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0fba050_da7d_49c0_8088_d77da7b61bdc.slice/crio-17373109a3bb3918fbd94ad6e99201646b79e1e25c56b7d0becc8a7b88de8a7e WatchSource:0}: Error finding container 17373109a3bb3918fbd94ad6e99201646b79e1e25c56b7d0becc8a7b88de8a7e: Status 404 returned error can't find the container with id 17373109a3bb3918fbd94ad6e99201646b79e1e25c56b7d0becc8a7b88de8a7e
Jul 09 19:06:23.815970 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:23.815953    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 19:06:24.509134 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:24.509093    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cljhs" event={"ID":"e0fba050-da7d-49c0-8088-d77da7b61bdc","Type":"ContainerStarted","Data":"17373109a3bb3918fbd94ad6e99201646b79e1e25c56b7d0becc8a7b88de8a7e"}
Jul 09 19:06:24.621462 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:24.621420    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:24.720460 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:24.720428    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:31.913071 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:31.913033    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:32.097513 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:32.097475    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:32.776777 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:32.776723    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rtf2x"]
Jul 09 19:06:32.779404 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:32.779378    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rtf2x"
Jul 09 19:06:32.782846 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:32.782674    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mh8f8\""
Jul 09 19:06:32.797074 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:32.796998    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rtf2x"]
Jul 09 19:06:32.958555 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:32.958508    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/18a8cae9-5b6e-4369-97ba-f64936fd5892-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-rtf2x\" (UID: \"18a8cae9-5b6e-4369-97ba-f64936fd5892\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rtf2x"
Jul 09 19:06:32.958961 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:32.958640    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs7sg\" (UniqueName: \"kubernetes.io/projected/18a8cae9-5b6e-4369-97ba-f64936fd5892-kube-api-access-cs7sg\") pod \"kuadrant-operator-controller-manager-55467d9f7-rtf2x\" (UID: \"18a8cae9-5b6e-4369-97ba-f64936fd5892\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rtf2x"
Jul 09 19:06:33.060166 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:33.060070    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/18a8cae9-5b6e-4369-97ba-f64936fd5892-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-rtf2x\" (UID: \"18a8cae9-5b6e-4369-97ba-f64936fd5892\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rtf2x"
Jul 09 19:06:33.060338 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:33.060165    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs7sg\" (UniqueName: \"kubernetes.io/projected/18a8cae9-5b6e-4369-97ba-f64936fd5892-kube-api-access-cs7sg\") pod \"kuadrant-operator-controller-manager-55467d9f7-rtf2x\" (UID: \"18a8cae9-5b6e-4369-97ba-f64936fd5892\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rtf2x"
Jul 09 19:06:33.060570 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:33.060532    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/18a8cae9-5b6e-4369-97ba-f64936fd5892-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-rtf2x\" (UID: \"18a8cae9-5b6e-4369-97ba-f64936fd5892\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rtf2x"
Jul 09 19:06:33.071175 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:33.071148    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs7sg\" (UniqueName: \"kubernetes.io/projected/18a8cae9-5b6e-4369-97ba-f64936fd5892-kube-api-access-cs7sg\") pod \"kuadrant-operator-controller-manager-55467d9f7-rtf2x\" (UID: \"18a8cae9-5b6e-4369-97ba-f64936fd5892\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rtf2x"
Jul 09 19:06:33.095044 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:33.095012    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rtf2x"
Jul 09 19:06:33.238776 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:33.238751    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rtf2x"]
Jul 09 19:06:33.241519 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:06:33.241488    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18a8cae9_5b6e_4369_97ba_f64936fd5892.slice/crio-c8c5b1485ef8b804e6da8b08271e6d20adefcaf72e1dc3295a4eca7de283afa0 WatchSource:0}: Error finding container c8c5b1485ef8b804e6da8b08271e6d20adefcaf72e1dc3295a4eca7de283afa0: Status 404 returned error can't find the container with id c8c5b1485ef8b804e6da8b08271e6d20adefcaf72e1dc3295a4eca7de283afa0
Jul 09 19:06:33.558276 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:33.558225    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rtf2x" event={"ID":"18a8cae9-5b6e-4369-97ba-f64936fd5892","Type":"ContainerStarted","Data":"c8c5b1485ef8b804e6da8b08271e6d20adefcaf72e1dc3295a4eca7de283afa0"}
Jul 09 19:06:36.616774 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:36.616735    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:36.716993 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:36.716954    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:39.224126 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:39.224091    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:39.323917 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:39.323870    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:42.823440 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:42.823399    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:42.888257 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:42.888224    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:50.651572 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:50.651536    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rtf2x" event={"ID":"18a8cae9-5b6e-4369-97ba-f64936fd5892","Type":"ContainerStarted","Data":"c470ea92ffc0d2266e0ba2ae1af77c8b2cd1ffdbc0cdd5b97de2380461db86a2"}
Jul 09 19:06:50.652070 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:50.651599    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rtf2x"
Jul 09 19:06:50.653066 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:50.653030    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cljhs" event={"ID":"e0fba050-da7d-49c0-8088-d77da7b61bdc","Type":"ContainerStarted","Data":"c8aa3aad3b3eb2a6c2151d276262dae6acfc86aad28c76972eb31a445bf838ab"}
Jul 09 19:06:50.691606 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:50.691543    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rtf2x" podStartSLOduration=1.644036174 podStartE2EDuration="18.691523856s" totalImagesPullingTime="17.047487682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:06:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:06:50.691476485 +0000 UTC m=+429.076546760" watchObservedRunningTime="2026-07-09 19:06:50.691523856 +0000 UTC m=+429.076594110"
Jul 09 19:06:50.722851 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:50.722767    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-cljhs" podStartSLOduration=2.227278291 podStartE2EDuration="28.722751014s" totalImagesPullingTime="26.495472723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:06:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:06:50.722442522 +0000 UTC m=+429.107512796" watchObservedRunningTime="2026-07-09 19:06:50.722751014 +0000 UTC m=+429.107821289"
Jul 09 19:06:51.237962 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:51.237929    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:51.339173 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:51.339139    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:56.034678 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:56.034632    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:06:56.133488 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:06:56.133452    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:01.660970 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:01.660938    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rtf2x"
Jul 09 19:07:14.161927 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:14.161833    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rtf2x"]
Jul 09 19:07:14.162490 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:14.162081    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rtf2x" podUID="18a8cae9-5b6e-4369-97ba-f64936fd5892" containerName="manager" containerID="cri-o://c470ea92ffc0d2266e0ba2ae1af77c8b2cd1ffdbc0cdd5b97de2380461db86a2" gracePeriod=10
Jul 09 19:07:14.410425 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:14.410399    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rtf2x"
Jul 09 19:07:14.556267 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:14.556175    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/18a8cae9-5b6e-4369-97ba-f64936fd5892-extensions-socket-volume\") pod \"18a8cae9-5b6e-4369-97ba-f64936fd5892\" (UID: \"18a8cae9-5b6e-4369-97ba-f64936fd5892\") "
Jul 09 19:07:14.556267 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:14.556212    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cs7sg\" (UniqueName: \"kubernetes.io/projected/18a8cae9-5b6e-4369-97ba-f64936fd5892-kube-api-access-cs7sg\") pod \"18a8cae9-5b6e-4369-97ba-f64936fd5892\" (UID: \"18a8cae9-5b6e-4369-97ba-f64936fd5892\") "
Jul 09 19:07:14.556825 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:14.556781    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18a8cae9-5b6e-4369-97ba-f64936fd5892-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "18a8cae9-5b6e-4369-97ba-f64936fd5892" (UID: "18a8cae9-5b6e-4369-97ba-f64936fd5892"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:07:14.558504 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:14.558476    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18a8cae9-5b6e-4369-97ba-f64936fd5892-kube-api-access-cs7sg" (OuterVolumeSpecName: "kube-api-access-cs7sg") pod "18a8cae9-5b6e-4369-97ba-f64936fd5892" (UID: "18a8cae9-5b6e-4369-97ba-f64936fd5892"). InnerVolumeSpecName "kube-api-access-cs7sg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:07:14.657082 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:14.657050    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/18a8cae9-5b6e-4369-97ba-f64936fd5892-extensions-socket-volume\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:07:14.657082 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:14.657077    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cs7sg\" (UniqueName: \"kubernetes.io/projected/18a8cae9-5b6e-4369-97ba-f64936fd5892-kube-api-access-cs7sg\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:07:14.765003 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:14.764969    2577 generic.go:356] "Generic (PLEG): container finished" podID="18a8cae9-5b6e-4369-97ba-f64936fd5892" containerID="c470ea92ffc0d2266e0ba2ae1af77c8b2cd1ffdbc0cdd5b97de2380461db86a2" exitCode=0
Jul 09 19:07:14.765003 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:14.765007    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rtf2x"
Jul 09 19:07:14.765209 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:14.765011    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rtf2x" event={"ID":"18a8cae9-5b6e-4369-97ba-f64936fd5892","Type":"ContainerDied","Data":"c470ea92ffc0d2266e0ba2ae1af77c8b2cd1ffdbc0cdd5b97de2380461db86a2"}
Jul 09 19:07:14.765209 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:14.765065    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rtf2x" event={"ID":"18a8cae9-5b6e-4369-97ba-f64936fd5892","Type":"ContainerDied","Data":"c8c5b1485ef8b804e6da8b08271e6d20adefcaf72e1dc3295a4eca7de283afa0"}
Jul 09 19:07:14.765209 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:14.765089    2577 scope.go:117] "RemoveContainer" containerID="c470ea92ffc0d2266e0ba2ae1af77c8b2cd1ffdbc0cdd5b97de2380461db86a2"
Jul 09 19:07:14.773867 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:14.773850    2577 scope.go:117] "RemoveContainer" containerID="c470ea92ffc0d2266e0ba2ae1af77c8b2cd1ffdbc0cdd5b97de2380461db86a2"
Jul 09 19:07:14.774171 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:07:14.774151    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c470ea92ffc0d2266e0ba2ae1af77c8b2cd1ffdbc0cdd5b97de2380461db86a2\": container with ID starting with c470ea92ffc0d2266e0ba2ae1af77c8b2cd1ffdbc0cdd5b97de2380461db86a2 not found: ID does not exist" containerID="c470ea92ffc0d2266e0ba2ae1af77c8b2cd1ffdbc0cdd5b97de2380461db86a2"
Jul 09 19:07:14.774209 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:14.774179    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c470ea92ffc0d2266e0ba2ae1af77c8b2cd1ffdbc0cdd5b97de2380461db86a2"} err="failed to get container status \"c470ea92ffc0d2266e0ba2ae1af77c8b2cd1ffdbc0cdd5b97de2380461db86a2\": rpc error: code = NotFound desc = could not find container \"c470ea92ffc0d2266e0ba2ae1af77c8b2cd1ffdbc0cdd5b97de2380461db86a2\": container with ID starting with c470ea92ffc0d2266e0ba2ae1af77c8b2cd1ffdbc0cdd5b97de2380461db86a2 not found: ID does not exist"
Jul 09 19:07:14.814437 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:14.814356    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rtf2x"]
Jul 09 19:07:14.825680 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:14.825650    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-rtf2x"]
Jul 09 19:07:16.638573 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:16.638527    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18a8cae9-5b6e-4369-97ba-f64936fd5892" path="/var/lib/kubelet/pods/18a8cae9-5b6e-4369-97ba-f64936fd5892/volumes"
Jul 09 19:07:18.129093 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:18.129051    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:18.349507 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:18.349470    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:19.740660 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:19.740623    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:19.843713 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:19.843670    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:19.943654 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:19.943623    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:20.062454 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:20.062381    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:20.211286 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:20.211257    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:07:20.211622 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:20.211601    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18a8cae9-5b6e-4369-97ba-f64936fd5892" containerName="manager"
Jul 09 19:07:20.211622 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:20.211615    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="18a8cae9-5b6e-4369-97ba-f64936fd5892" containerName="manager"
Jul 09 19:07:20.211833 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:20.211704    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="18a8cae9-5b6e-4369-97ba-f64936fd5892" containerName="manager"
Jul 09 19:07:20.273719 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:20.273679    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:07:20.273719 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:20.273716    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:07:20.273965 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:20.273798    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-68679"
Jul 09 19:07:20.277535 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:20.277513    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 09 19:07:20.406722 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:20.406685    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pcfs\" (UniqueName: \"kubernetes.io/projected/397e40eb-bc0c-40a1-8dfb-33ac81d17ea9-kube-api-access-8pcfs\") pod \"limitador-limitador-54d6d988d5-68679\" (UID: \"397e40eb-bc0c-40a1-8dfb-33ac81d17ea9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-68679"
Jul 09 19:07:20.406905 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:20.406775    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/397e40eb-bc0c-40a1-8dfb-33ac81d17ea9-config-file\") pod \"limitador-limitador-54d6d988d5-68679\" (UID: \"397e40eb-bc0c-40a1-8dfb-33ac81d17ea9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-68679"
Jul 09 19:07:20.507492 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:20.507462    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/397e40eb-bc0c-40a1-8dfb-33ac81d17ea9-config-file\") pod \"limitador-limitador-54d6d988d5-68679\" (UID: \"397e40eb-bc0c-40a1-8dfb-33ac81d17ea9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-68679"
Jul 09 19:07:20.507637 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:20.507539    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pcfs\" (UniqueName: \"kubernetes.io/projected/397e40eb-bc0c-40a1-8dfb-33ac81d17ea9-kube-api-access-8pcfs\") pod \"limitador-limitador-54d6d988d5-68679\" (UID: \"397e40eb-bc0c-40a1-8dfb-33ac81d17ea9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-68679"
Jul 09 19:07:20.508079 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:20.508058    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/397e40eb-bc0c-40a1-8dfb-33ac81d17ea9-config-file\") pod \"limitador-limitador-54d6d988d5-68679\" (UID: \"397e40eb-bc0c-40a1-8dfb-33ac81d17ea9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-68679"
Jul 09 19:07:20.517144 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:20.517126    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pcfs\" (UniqueName: \"kubernetes.io/projected/397e40eb-bc0c-40a1-8dfb-33ac81d17ea9-kube-api-access-8pcfs\") pod \"limitador-limitador-54d6d988d5-68679\" (UID: \"397e40eb-bc0c-40a1-8dfb-33ac81d17ea9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-68679"
Jul 09 19:07:20.584156 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:20.584130    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-68679"
Jul 09 19:07:20.671122 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:20.671048    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:20.747754 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:20.747665    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:20.783284 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:20.783223    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:07:20.785378 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:20.785351    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-kpm5d"]
Jul 09 19:07:20.785718 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:07:20.785691    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod397e40eb_bc0c_40a1_8dfb_33ac81d17ea9.slice/crio-98e6e97bce0f67a28739fa342988d750cf604831478704d5c55895635227ea33 WatchSource:0}: Error finding container 98e6e97bce0f67a28739fa342988d750cf604831478704d5c55895635227ea33: Status 404 returned error can't find the container with id 98e6e97bce0f67a28739fa342988d750cf604831478704d5c55895635227ea33
Jul 09 19:07:20.806239 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:20.806209    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kpm5d"]
Jul 09 19:07:20.806239 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:20.806242    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-68679" event={"ID":"397e40eb-bc0c-40a1-8dfb-33ac81d17ea9","Type":"ContainerStarted","Data":"98e6e97bce0f67a28739fa342988d750cf604831478704d5c55895635227ea33"}
Jul 09 19:07:20.806470 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:20.806320    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kpm5d"
Jul 09 19:07:20.810195 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:20.810171    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-fcl7g\""
Jul 09 19:07:20.912021 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:20.911980    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crhf9\" (UniqueName: \"kubernetes.io/projected/f87617c3-f73a-4fc0-8572-168925f1605e-kube-api-access-crhf9\") pod \"authorino-75d556bd77-kpm5d\" (UID: \"f87617c3-f73a-4fc0-8572-168925f1605e\") " pod="kuadrant-system/authorino-75d556bd77-kpm5d"
Jul 09 19:07:21.012658 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:21.012568    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crhf9\" (UniqueName: \"kubernetes.io/projected/f87617c3-f73a-4fc0-8572-168925f1605e-kube-api-access-crhf9\") pod \"authorino-75d556bd77-kpm5d\" (UID: \"f87617c3-f73a-4fc0-8572-168925f1605e\") " pod="kuadrant-system/authorino-75d556bd77-kpm5d"
Jul 09 19:07:21.026039 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:21.025999    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crhf9\" (UniqueName: \"kubernetes.io/projected/f87617c3-f73a-4fc0-8572-168925f1605e-kube-api-access-crhf9\") pod \"authorino-75d556bd77-kpm5d\" (UID: \"f87617c3-f73a-4fc0-8572-168925f1605e\") " pod="kuadrant-system/authorino-75d556bd77-kpm5d"
Jul 09 19:07:21.116229 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:21.116191    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kpm5d"
Jul 09 19:07:21.311639 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:21.311604    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kpm5d"]
Jul 09 19:07:21.314222 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:07:21.314188    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf87617c3_f73a_4fc0_8572_168925f1605e.slice/crio-ce07d5d4bd382032c0def93e092c27c97d5919779793a9e98ab8914c9bcdf20b WatchSource:0}: Error finding container ce07d5d4bd382032c0def93e092c27c97d5919779793a9e98ab8914c9bcdf20b: Status 404 returned error can't find the container with id ce07d5d4bd382032c0def93e092c27c97d5919779793a9e98ab8914c9bcdf20b
Jul 09 19:07:21.806112 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:21.806069    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kpm5d" event={"ID":"f87617c3-f73a-4fc0-8572-168925f1605e","Type":"ContainerStarted","Data":"ce07d5d4bd382032c0def93e092c27c97d5919779793a9e98ab8914c9bcdf20b"}
Jul 09 19:07:23.893671 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:23.893635    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b78b8cc99-4q2gk"]
Jul 09 19:07:23.896405 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:23.896379    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b78b8cc99-4q2gk"
Jul 09 19:07:23.914612 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:23.914579    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b78b8cc99-4q2gk"]
Jul 09 19:07:24.011242 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:24.011204    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:24.042129 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:24.042086    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmhcb\" (UniqueName: \"kubernetes.io/projected/7dd99ffd-f285-4149-ab43-ab4f8ef8e152-kube-api-access-qmhcb\") pod \"console-7b78b8cc99-4q2gk\" (UID: \"7dd99ffd-f285-4149-ab43-ab4f8ef8e152\") " pod="openshift-console/console-7b78b8cc99-4q2gk"
Jul 09 19:07:24.042129 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:24.042130    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7dd99ffd-f285-4149-ab43-ab4f8ef8e152-console-oauth-config\") pod \"console-7b78b8cc99-4q2gk\" (UID: \"7dd99ffd-f285-4149-ab43-ab4f8ef8e152\") " pod="openshift-console/console-7b78b8cc99-4q2gk"
Jul 09 19:07:24.042357 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:24.042158    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7dd99ffd-f285-4149-ab43-ab4f8ef8e152-oauth-serving-cert\") pod \"console-7b78b8cc99-4q2gk\" (UID: \"7dd99ffd-f285-4149-ab43-ab4f8ef8e152\") " pod="openshift-console/console-7b78b8cc99-4q2gk"
Jul 09 19:07:24.042357 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:24.042237    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7dd99ffd-f285-4149-ab43-ab4f8ef8e152-console-serving-cert\") pod \"console-7b78b8cc99-4q2gk\" (UID: \"7dd99ffd-f285-4149-ab43-ab4f8ef8e152\") " pod="openshift-console/console-7b78b8cc99-4q2gk"
Jul 09 19:07:24.042357 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:24.042295    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7dd99ffd-f285-4149-ab43-ab4f8ef8e152-console-config\") pod \"console-7b78b8cc99-4q2gk\" (UID: \"7dd99ffd-f285-4149-ab43-ab4f8ef8e152\") " pod="openshift-console/console-7b78b8cc99-4q2gk"
Jul 09 19:07:24.042357 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:24.042336    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dd99ffd-f285-4149-ab43-ab4f8ef8e152-trusted-ca-bundle\") pod \"console-7b78b8cc99-4q2gk\" (UID: \"7dd99ffd-f285-4149-ab43-ab4f8ef8e152\") " pod="openshift-console/console-7b78b8cc99-4q2gk"
Jul 09 19:07:24.042542 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:24.042386    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7dd99ffd-f285-4149-ab43-ab4f8ef8e152-service-ca\") pod \"console-7b78b8cc99-4q2gk\" (UID: \"7dd99ffd-f285-4149-ab43-ab4f8ef8e152\") " pod="openshift-console/console-7b78b8cc99-4q2gk"
Jul 09 19:07:24.126487 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:24.126453    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:24.143643 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:24.143603    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7dd99ffd-f285-4149-ab43-ab4f8ef8e152-console-serving-cert\") pod \"console-7b78b8cc99-4q2gk\" (UID: \"7dd99ffd-f285-4149-ab43-ab4f8ef8e152\") " pod="openshift-console/console-7b78b8cc99-4q2gk"
Jul 09 19:07:24.143884 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:24.143678    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7dd99ffd-f285-4149-ab43-ab4f8ef8e152-console-config\") pod \"console-7b78b8cc99-4q2gk\" (UID: \"7dd99ffd-f285-4149-ab43-ab4f8ef8e152\") " pod="openshift-console/console-7b78b8cc99-4q2gk"
Jul 09 19:07:24.143884 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:24.143711    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dd99ffd-f285-4149-ab43-ab4f8ef8e152-trusted-ca-bundle\") pod \"console-7b78b8cc99-4q2gk\" (UID: \"7dd99ffd-f285-4149-ab43-ab4f8ef8e152\") " pod="openshift-console/console-7b78b8cc99-4q2gk"
Jul 09 19:07:24.143884 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:24.143742    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7dd99ffd-f285-4149-ab43-ab4f8ef8e152-service-ca\") pod \"console-7b78b8cc99-4q2gk\" (UID: \"7dd99ffd-f285-4149-ab43-ab4f8ef8e152\") " pod="openshift-console/console-7b78b8cc99-4q2gk"
Jul 09 19:07:24.143884 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:24.143850    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmhcb\" (UniqueName: \"kubernetes.io/projected/7dd99ffd-f285-4149-ab43-ab4f8ef8e152-kube-api-access-qmhcb\") pod \"console-7b78b8cc99-4q2gk\" (UID: \"7dd99ffd-f285-4149-ab43-ab4f8ef8e152\") " pod="openshift-console/console-7b78b8cc99-4q2gk"
Jul 09 19:07:24.143884 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:24.143876    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7dd99ffd-f285-4149-ab43-ab4f8ef8e152-console-oauth-config\") pod \"console-7b78b8cc99-4q2gk\" (UID: \"7dd99ffd-f285-4149-ab43-ab4f8ef8e152\") " pod="openshift-console/console-7b78b8cc99-4q2gk"
Jul 09 19:07:24.144147 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:24.143919    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7dd99ffd-f285-4149-ab43-ab4f8ef8e152-oauth-serving-cert\") pod \"console-7b78b8cc99-4q2gk\" (UID: \"7dd99ffd-f285-4149-ab43-ab4f8ef8e152\") " pod="openshift-console/console-7b78b8cc99-4q2gk"
Jul 09 19:07:24.144574 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:24.144546    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7dd99ffd-f285-4149-ab43-ab4f8ef8e152-console-config\") pod \"console-7b78b8cc99-4q2gk\" (UID: \"7dd99ffd-f285-4149-ab43-ab4f8ef8e152\") " pod="openshift-console/console-7b78b8cc99-4q2gk"
Jul 09 19:07:24.144686 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:24.144581    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7dd99ffd-f285-4149-ab43-ab4f8ef8e152-service-ca\") pod \"console-7b78b8cc99-4q2gk\" (UID: \"7dd99ffd-f285-4149-ab43-ab4f8ef8e152\") " pod="openshift-console/console-7b78b8cc99-4q2gk"
Jul 09 19:07:24.144822 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:24.144779    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7dd99ffd-f285-4149-ab43-ab4f8ef8e152-oauth-serving-cert\") pod \"console-7b78b8cc99-4q2gk\" (UID: \"7dd99ffd-f285-4149-ab43-ab4f8ef8e152\") " pod="openshift-console/console-7b78b8cc99-4q2gk"
Jul 09 19:07:24.145187 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:24.145162    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dd99ffd-f285-4149-ab43-ab4f8ef8e152-trusted-ca-bundle\") pod \"console-7b78b8cc99-4q2gk\" (UID: \"7dd99ffd-f285-4149-ab43-ab4f8ef8e152\") " pod="openshift-console/console-7b78b8cc99-4q2gk"
Jul 09 19:07:24.146596 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:24.146575    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7dd99ffd-f285-4149-ab43-ab4f8ef8e152-console-serving-cert\") pod \"console-7b78b8cc99-4q2gk\" (UID: \"7dd99ffd-f285-4149-ab43-ab4f8ef8e152\") " pod="openshift-console/console-7b78b8cc99-4q2gk"
Jul 09 19:07:24.146772 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:24.146750    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7dd99ffd-f285-4149-ab43-ab4f8ef8e152-console-oauth-config\") pod \"console-7b78b8cc99-4q2gk\" (UID: \"7dd99ffd-f285-4149-ab43-ab4f8ef8e152\") " pod="openshift-console/console-7b78b8cc99-4q2gk"
Jul 09 19:07:24.155245 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:24.155195    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmhcb\" (UniqueName: \"kubernetes.io/projected/7dd99ffd-f285-4149-ab43-ab4f8ef8e152-kube-api-access-qmhcb\") pod \"console-7b78b8cc99-4q2gk\" (UID: \"7dd99ffd-f285-4149-ab43-ab4f8ef8e152\") " pod="openshift-console/console-7b78b8cc99-4q2gk"
Jul 09 19:07:24.208007 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:24.207969    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b78b8cc99-4q2gk"
Jul 09 19:07:24.690230 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:24.690191    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:24.755957 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:24.755922    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:25.429703 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:25.429590    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b78b8cc99-4q2gk"]
Jul 09 19:07:25.432612 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:07:25.432581    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dd99ffd_f285_4149_ab43_ab4f8ef8e152.slice/crio-f9f15e042962472a4d9a6c583216be26479bdc02ed69158e4c564b4ef1815ed2 WatchSource:0}: Error finding container f9f15e042962472a4d9a6c583216be26479bdc02ed69158e4c564b4ef1815ed2: Status 404 returned error can't find the container with id f9f15e042962472a4d9a6c583216be26479bdc02ed69158e4c564b4ef1815ed2
Jul 09 19:07:25.835796 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:25.835759    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-68679" event={"ID":"397e40eb-bc0c-40a1-8dfb-33ac81d17ea9","Type":"ContainerStarted","Data":"9c3b656e3a6b71c1df6cc47c3eabb4c285b53a631bdcc6543b54e90382148e82"}
Jul 09 19:07:25.836018 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:25.835867    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-68679"
Jul 09 19:07:25.837438 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:25.837416    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b78b8cc99-4q2gk" event={"ID":"7dd99ffd-f285-4149-ab43-ab4f8ef8e152","Type":"ContainerStarted","Data":"79a3a24654b2b36a71db60ecf0edc0384eeff3bb5d41f8409303d0b1cc90ea46"}
Jul 09 19:07:25.837551 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:25.837447    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b78b8cc99-4q2gk" event={"ID":"7dd99ffd-f285-4149-ab43-ab4f8ef8e152","Type":"ContainerStarted","Data":"f9f15e042962472a4d9a6c583216be26479bdc02ed69158e4c564b4ef1815ed2"}
Jul 09 19:07:25.838824 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:25.838792    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kpm5d" event={"ID":"f87617c3-f73a-4fc0-8572-168925f1605e","Type":"ContainerStarted","Data":"b3740918d018658329da594fb343684c7f9a8eb9b821cacd1eb7bafd9431325f"}
Jul 09 19:07:25.892960 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:25.892908    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-68679" podStartSLOduration=1.373428482 podStartE2EDuration="5.892890723s" totalImagesPullingTime="4.519462241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:07:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:07:25.857403366 +0000 UTC m=+464.242473650" watchObservedRunningTime="2026-07-09 19:07:25.892890723 +0000 UTC m=+464.277960998"
Jul 09 19:07:25.893770 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:25.893735    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b78b8cc99-4q2gk" podStartSLOduration=2.893723712 podStartE2EDuration="2.893723712s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:07:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:07:25.892974482 +0000 UTC m=+464.278044757" watchObservedRunningTime="2026-07-09 19:07:25.893723712 +0000 UTC m=+464.278793986"
Jul 09 19:07:25.929707 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:25.929654    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-kpm5d" podStartSLOduration=1.975414007 podStartE2EDuration="5.929636401s" totalImagesPullingTime="3.954222394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:07:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:07:25.928734779 +0000 UTC m=+464.313805054" watchObservedRunningTime="2026-07-09 19:07:25.929636401 +0000 UTC m=+464.314706677"
Jul 09 19:07:34.208487 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:34.208434    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b78b8cc99-4q2gk"
Jul 09 19:07:34.208980 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:34.208515    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b78b8cc99-4q2gk"
Jul 09 19:07:34.213303 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:34.213283    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b78b8cc99-4q2gk"
Jul 09 19:07:34.886131 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:34.886092    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b78b8cc99-4q2gk"
Jul 09 19:07:34.935945 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:34.935917    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f44d7c7b6-89cz6"]
Jul 09 19:07:35.035377 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:35.035327    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:35.137294 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:35.137197    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:35.213450 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:35.213420    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:36.845224 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:36.845197    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-68679"
Jul 09 19:07:40.980295 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:40.980244    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:41.080963 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:41.080932    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:41.439959 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:41.439922    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:53.688405 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:53.688371    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:53.878926 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:53.878886    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:54.395552 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:54.395518    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7b46c966d9-bqjp4"]
Jul 09 19:07:54.405414 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:54.405386    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b46c966d9-bqjp4"
Jul 09 19:07:54.408651 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:54.408627    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 09 19:07:54.409512 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:54.409485    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b46c966d9-bqjp4"]
Jul 09 19:07:54.526761 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:54.526717    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb67n\" (UniqueName: \"kubernetes.io/projected/cb1f2562-a062-480b-a3a9-85576ad78149-kube-api-access-kb67n\") pod \"authorino-7b46c966d9-bqjp4\" (UID: \"cb1f2562-a062-480b-a3a9-85576ad78149\") " pod="kuadrant-system/authorino-7b46c966d9-bqjp4"
Jul 09 19:07:54.526957 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:54.526768    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cb1f2562-a062-480b-a3a9-85576ad78149-tls-cert\") pod \"authorino-7b46c966d9-bqjp4\" (UID: \"cb1f2562-a062-480b-a3a9-85576ad78149\") " pod="kuadrant-system/authorino-7b46c966d9-bqjp4"
Jul 09 19:07:54.627720 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:54.627681    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cb1f2562-a062-480b-a3a9-85576ad78149-tls-cert\") pod \"authorino-7b46c966d9-bqjp4\" (UID: \"cb1f2562-a062-480b-a3a9-85576ad78149\") " pod="kuadrant-system/authorino-7b46c966d9-bqjp4"
Jul 09 19:07:54.627912 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:54.627792    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb67n\" (UniqueName: \"kubernetes.io/projected/cb1f2562-a062-480b-a3a9-85576ad78149-kube-api-access-kb67n\") pod \"authorino-7b46c966d9-bqjp4\" (UID: \"cb1f2562-a062-480b-a3a9-85576ad78149\") " pod="kuadrant-system/authorino-7b46c966d9-bqjp4"
Jul 09 19:07:54.630063 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:54.630041    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cb1f2562-a062-480b-a3a9-85576ad78149-tls-cert\") pod \"authorino-7b46c966d9-bqjp4\" (UID: \"cb1f2562-a062-480b-a3a9-85576ad78149\") " pod="kuadrant-system/authorino-7b46c966d9-bqjp4"
Jul 09 19:07:54.636478 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:54.636451    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb67n\" (UniqueName: \"kubernetes.io/projected/cb1f2562-a062-480b-a3a9-85576ad78149-kube-api-access-kb67n\") pod \"authorino-7b46c966d9-bqjp4\" (UID: \"cb1f2562-a062-480b-a3a9-85576ad78149\") " pod="kuadrant-system/authorino-7b46c966d9-bqjp4"
Jul 09 19:07:54.715566 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:54.715488    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b46c966d9-bqjp4"
Jul 09 19:07:54.860036 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:54.860012    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b46c966d9-bqjp4"]
Jul 09 19:07:54.862297 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:07:54.862267    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb1f2562_a062_480b_a3a9_85576ad78149.slice/crio-3428a2bd4b7b9f81fbbe1a957b8c5ef2ccb4ee4ad09c988f7e9960c3529e52d2 WatchSource:0}: Error finding container 3428a2bd4b7b9f81fbbe1a957b8c5ef2ccb4ee4ad09c988f7e9960c3529e52d2: Status 404 returned error can't find the container with id 3428a2bd4b7b9f81fbbe1a957b8c5ef2ccb4ee4ad09c988f7e9960c3529e52d2
Jul 09 19:07:54.976602 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:54.976518    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b46c966d9-bqjp4" event={"ID":"cb1f2562-a062-480b-a3a9-85576ad78149","Type":"ContainerStarted","Data":"3428a2bd4b7b9f81fbbe1a957b8c5ef2ccb4ee4ad09c988f7e9960c3529e52d2"}
Jul 09 19:07:55.982203 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:55.982162    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b46c966d9-bqjp4" event={"ID":"cb1f2562-a062-480b-a3a9-85576ad78149","Type":"ContainerStarted","Data":"402b6a390ff35e0f77e32a3a11c3f3d573769b93ea063ea2537d38589b70a7c8"}
Jul 09 19:07:55.999583 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:55.999533    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7b46c966d9-bqjp4" podStartSLOduration=1.434622009 podStartE2EDuration="1.999516708s" totalImagesPullingTime="564.894699ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:07:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:07:55.998004619 +0000 UTC m=+494.383074898" watchObservedRunningTime="2026-07-09 19:07:55.999516708 +0000 UTC m=+494.384586984"
Jul 09 19:07:56.026383 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:56.026342    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kpm5d"]
Jul 09 19:07:56.026588 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:56.026537    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-kpm5d" podUID="f87617c3-f73a-4fc0-8572-168925f1605e" containerName="authorino" containerID="cri-o://b3740918d018658329da594fb343684c7f9a8eb9b821cacd1eb7bafd9431325f" gracePeriod=30
Jul 09 19:07:56.321864 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:56.321832    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kpm5d"
Jul 09 19:07:56.448681 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:56.448650    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crhf9\" (UniqueName: \"kubernetes.io/projected/f87617c3-f73a-4fc0-8572-168925f1605e-kube-api-access-crhf9\") pod \"f87617c3-f73a-4fc0-8572-168925f1605e\" (UID: \"f87617c3-f73a-4fc0-8572-168925f1605e\") "
Jul 09 19:07:56.450776 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:56.450744    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f87617c3-f73a-4fc0-8572-168925f1605e-kube-api-access-crhf9" (OuterVolumeSpecName: "kube-api-access-crhf9") pod "f87617c3-f73a-4fc0-8572-168925f1605e" (UID: "f87617c3-f73a-4fc0-8572-168925f1605e"). InnerVolumeSpecName "kube-api-access-crhf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:07:56.549763 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:56.549689    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crhf9\" (UniqueName: \"kubernetes.io/projected/f87617c3-f73a-4fc0-8572-168925f1605e-kube-api-access-crhf9\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:07:56.988084 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:56.988048    2577 generic.go:356] "Generic (PLEG): container finished" podID="f87617c3-f73a-4fc0-8572-168925f1605e" containerID="b3740918d018658329da594fb343684c7f9a8eb9b821cacd1eb7bafd9431325f" exitCode=0
Jul 09 19:07:56.988542 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:56.988088    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-kpm5d"
Jul 09 19:07:56.988542 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:56.988128    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kpm5d" event={"ID":"f87617c3-f73a-4fc0-8572-168925f1605e","Type":"ContainerDied","Data":"b3740918d018658329da594fb343684c7f9a8eb9b821cacd1eb7bafd9431325f"}
Jul 09 19:07:56.988542 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:56.988164    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-kpm5d" event={"ID":"f87617c3-f73a-4fc0-8572-168925f1605e","Type":"ContainerDied","Data":"ce07d5d4bd382032c0def93e092c27c97d5919779793a9e98ab8914c9bcdf20b"}
Jul 09 19:07:56.988542 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:56.988181    2577 scope.go:117] "RemoveContainer" containerID="b3740918d018658329da594fb343684c7f9a8eb9b821cacd1eb7bafd9431325f"
Jul 09 19:07:56.997004 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:56.996915    2577 scope.go:117] "RemoveContainer" containerID="b3740918d018658329da594fb343684c7f9a8eb9b821cacd1eb7bafd9431325f"
Jul 09 19:07:56.997191 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:07:56.997168    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3740918d018658329da594fb343684c7f9a8eb9b821cacd1eb7bafd9431325f\": container with ID starting with b3740918d018658329da594fb343684c7f9a8eb9b821cacd1eb7bafd9431325f not found: ID does not exist" containerID="b3740918d018658329da594fb343684c7f9a8eb9b821cacd1eb7bafd9431325f"
Jul 09 19:07:56.997235 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:56.997201    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3740918d018658329da594fb343684c7f9a8eb9b821cacd1eb7bafd9431325f"} err="failed to get container status \"b3740918d018658329da594fb343684c7f9a8eb9b821cacd1eb7bafd9431325f\": rpc error: code = NotFound desc = could not find container \"b3740918d018658329da594fb343684c7f9a8eb9b821cacd1eb7bafd9431325f\": container with ID starting with b3740918d018658329da594fb343684c7f9a8eb9b821cacd1eb7bafd9431325f not found: ID does not exist"
Jul 09 19:07:57.005541 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:57.005519    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kpm5d"]
Jul 09 19:07:57.008907 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:57.008889    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-kpm5d"]
Jul 09 19:07:57.225533 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:57.225496    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:07:58.639510 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:58.639462    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f87617c3-f73a-4fc0-8572-168925f1605e" path="/var/lib/kubelet/pods/f87617c3-f73a-4fc0-8572-168925f1605e/volumes"
Jul 09 19:07:59.959384 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:07:59.959315    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7f44d7c7b6-89cz6" podUID="f988a736-e65a-4045-8eda-e4220b04819a" containerName="console" containerID="cri-o://1b979ad1e5e7b1c95255a3978cef06045af8a04dc7cb64aeeb536391695f01ce" gracePeriod=15
Jul 09 19:08:00.215325 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:00.215259    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f44d7c7b6-89cz6"
Jul 09 19:08:00.221514 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:00.221475    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:08:00.333670 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:00.333635    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:08:00.385866 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:00.385835    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f988a736-e65a-4045-8eda-e4220b04819a-console-oauth-config\") pod \"f988a736-e65a-4045-8eda-e4220b04819a\" (UID: \"f988a736-e65a-4045-8eda-e4220b04819a\") "
Jul 09 19:08:00.386049 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:00.385897    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f988a736-e65a-4045-8eda-e4220b04819a-console-serving-cert\") pod \"f988a736-e65a-4045-8eda-e4220b04819a\" (UID: \"f988a736-e65a-4045-8eda-e4220b04819a\") "
Jul 09 19:08:00.386049 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:00.385922    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsxsr\" (UniqueName: \"kubernetes.io/projected/f988a736-e65a-4045-8eda-e4220b04819a-kube-api-access-qsxsr\") pod \"f988a736-e65a-4045-8eda-e4220b04819a\" (UID: \"f988a736-e65a-4045-8eda-e4220b04819a\") "
Jul 09 19:08:00.386049 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:00.385947    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f988a736-e65a-4045-8eda-e4220b04819a-console-config\") pod \"f988a736-e65a-4045-8eda-e4220b04819a\" (UID: \"f988a736-e65a-4045-8eda-e4220b04819a\") "
Jul 09 19:08:00.386049 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:00.385992    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f988a736-e65a-4045-8eda-e4220b04819a-oauth-serving-cert\") pod \"f988a736-e65a-4045-8eda-e4220b04819a\" (UID: \"f988a736-e65a-4045-8eda-e4220b04819a\") "
Jul 09 19:08:00.386049 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:00.386029    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f988a736-e65a-4045-8eda-e4220b04819a-service-ca\") pod \"f988a736-e65a-4045-8eda-e4220b04819a\" (UID: \"f988a736-e65a-4045-8eda-e4220b04819a\") "
Jul 09 19:08:00.386378 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:00.386352    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f988a736-e65a-4045-8eda-e4220b04819a-trusted-ca-bundle\") pod \"f988a736-e65a-4045-8eda-e4220b04819a\" (UID: \"f988a736-e65a-4045-8eda-e4220b04819a\") "
Jul 09 19:08:00.386524 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:00.386403    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f988a736-e65a-4045-8eda-e4220b04819a-console-config" (OuterVolumeSpecName: "console-config") pod "f988a736-e65a-4045-8eda-e4220b04819a" (UID: "f988a736-e65a-4045-8eda-e4220b04819a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:08:00.386524 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:00.386414    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f988a736-e65a-4045-8eda-e4220b04819a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f988a736-e65a-4045-8eda-e4220b04819a" (UID: "f988a736-e65a-4045-8eda-e4220b04819a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:08:00.386524 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:00.386467    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f988a736-e65a-4045-8eda-e4220b04819a-service-ca" (OuterVolumeSpecName: "service-ca") pod "f988a736-e65a-4045-8eda-e4220b04819a" (UID: "f988a736-e65a-4045-8eda-e4220b04819a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:08:00.386743 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:00.386708    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f988a736-e65a-4045-8eda-e4220b04819a-console-config\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:08:00.386743 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:00.386734    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f988a736-e65a-4045-8eda-e4220b04819a-oauth-serving-cert\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:08:00.386904 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:00.386748    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f988a736-e65a-4045-8eda-e4220b04819a-service-ca\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:08:00.386904 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:00.386852    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f988a736-e65a-4045-8eda-e4220b04819a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f988a736-e65a-4045-8eda-e4220b04819a" (UID: "f988a736-e65a-4045-8eda-e4220b04819a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:08:00.388082 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:00.388056    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f988a736-e65a-4045-8eda-e4220b04819a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f988a736-e65a-4045-8eda-e4220b04819a" (UID: "f988a736-e65a-4045-8eda-e4220b04819a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:08:00.388171 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:00.388103    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f988a736-e65a-4045-8eda-e4220b04819a-kube-api-access-qsxsr" (OuterVolumeSpecName: "kube-api-access-qsxsr") pod "f988a736-e65a-4045-8eda-e4220b04819a" (UID: "f988a736-e65a-4045-8eda-e4220b04819a"). InnerVolumeSpecName "kube-api-access-qsxsr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:08:00.388171 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:00.388126    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f988a736-e65a-4045-8eda-e4220b04819a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f988a736-e65a-4045-8eda-e4220b04819a" (UID: "f988a736-e65a-4045-8eda-e4220b04819a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:08:00.412073 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:00.412042    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:08:00.464484 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:00.464450    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:08:00.487766 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:00.487694    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f988a736-e65a-4045-8eda-e4220b04819a-console-serving-cert\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:08:00.487766 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:00.487718    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsxsr\" (UniqueName: \"kubernetes.io/projected/f988a736-e65a-4045-8eda-e4220b04819a-kube-api-access-qsxsr\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:08:00.487766 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:00.487729    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f988a736-e65a-4045-8eda-e4220b04819a-trusted-ca-bundle\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:08:00.487766 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:00.487739    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f988a736-e65a-4045-8eda-e4220b04819a-console-oauth-config\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:08:01.011280 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:01.011243    2577 generic.go:356] "Generic (PLEG): container finished" podID="f988a736-e65a-4045-8eda-e4220b04819a" containerID="1b979ad1e5e7b1c95255a3978cef06045af8a04dc7cb64aeeb536391695f01ce" exitCode=0
Jul 09 19:08:01.011703 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:01.011290    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f44d7c7b6-89cz6"
Jul 09 19:08:01.011703 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:01.011334    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f44d7c7b6-89cz6" event={"ID":"f988a736-e65a-4045-8eda-e4220b04819a","Type":"ContainerDied","Data":"1b979ad1e5e7b1c95255a3978cef06045af8a04dc7cb64aeeb536391695f01ce"}
Jul 09 19:08:01.011703 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:01.011385    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f44d7c7b6-89cz6" event={"ID":"f988a736-e65a-4045-8eda-e4220b04819a","Type":"ContainerDied","Data":"3a9a153e5bd6877abcff78099bf59c6765b92180f90dc62e8a72b4f6b0aaf1df"}
Jul 09 19:08:01.011703 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:01.011407    2577 scope.go:117] "RemoveContainer" containerID="1b979ad1e5e7b1c95255a3978cef06045af8a04dc7cb64aeeb536391695f01ce"
Jul 09 19:08:01.020067 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:01.020046    2577 scope.go:117] "RemoveContainer" containerID="1b979ad1e5e7b1c95255a3978cef06045af8a04dc7cb64aeeb536391695f01ce"
Jul 09 19:08:01.020344 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:08:01.020324    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b979ad1e5e7b1c95255a3978cef06045af8a04dc7cb64aeeb536391695f01ce\": container with ID starting with 1b979ad1e5e7b1c95255a3978cef06045af8a04dc7cb64aeeb536391695f01ce not found: ID does not exist" containerID="1b979ad1e5e7b1c95255a3978cef06045af8a04dc7cb64aeeb536391695f01ce"
Jul 09 19:08:01.020405 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:01.020356    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b979ad1e5e7b1c95255a3978cef06045af8a04dc7cb64aeeb536391695f01ce"} err="failed to get container status \"1b979ad1e5e7b1c95255a3978cef06045af8a04dc7cb64aeeb536391695f01ce\": rpc error: code = NotFound desc = could not find container \"1b979ad1e5e7b1c95255a3978cef06045af8a04dc7cb64aeeb536391695f01ce\": container with ID starting with 1b979ad1e5e7b1c95255a3978cef06045af8a04dc7cb64aeeb536391695f01ce not found: ID does not exist"
Jul 09 19:08:01.030151 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:01.030122    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f44d7c7b6-89cz6"]
Jul 09 19:08:01.034925 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:01.034902    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f44d7c7b6-89cz6"]
Jul 09 19:08:02.639090 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:02.639054    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f988a736-e65a-4045-8eda-e4220b04819a" path="/var/lib/kubelet/pods/f988a736-e65a-4045-8eda-e4220b04819a/volumes"
Jul 09 19:08:03.185477 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:03.185446    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:08:03.284945 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:03.284897    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:08:38.173519 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:38.173477    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:08:38.585698 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:38.585606    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:08:38.715664 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:38.715631    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:08:39.014083 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:39.014035    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:08:39.120038 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:39.119998    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:08:39.240148 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:39.240115    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:08:48.683228 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:48.683179    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:08:49.257015 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:49.256987    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:08:55.205250 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:55.205212    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:08:55.645527 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:55.645491    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:08:57.086532 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:08:57.086488    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:09:01.680771 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:09:01.680727    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:09:02.752536 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:09:02.752505    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:09:04.244692 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:09:04.244659    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:09:08.357046 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:09:08.357003    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:09:08.955670 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:09:08.955636    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:09:09.050585 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:09:09.050544    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:09:12.752134 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:09:12.752102    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:09:13.461034 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:09:13.460994    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:09:13.559111 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:09:13.559078    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:09:16.382483 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:09:16.382449    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:09:16.453115 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:09:16.453080    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:09:20.099424 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:09:20.099383    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:09:21.143559 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:09:21.143525    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:09:37.541943 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:09:37.541880    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:09:39.144645 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:09:39.144602    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:10:07.546396 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:07.546325    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-fj26l"]
Jul 09 19:10:07.548650 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:07.546836    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f87617c3-f73a-4fc0-8572-168925f1605e" containerName="authorino"
Jul 09 19:10:07.548650 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:07.546856    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f87617c3-f73a-4fc0-8572-168925f1605e" containerName="authorino"
Jul 09 19:10:07.548650 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:07.546878    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f988a736-e65a-4045-8eda-e4220b04819a" containerName="console"
Jul 09 19:10:07.548650 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:07.546887    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f988a736-e65a-4045-8eda-e4220b04819a" containerName="console"
Jul 09 19:10:07.548650 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:07.546990    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f87617c3-f73a-4fc0-8572-168925f1605e" containerName="authorino"
Jul 09 19:10:07.548650 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:07.547002    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f988a736-e65a-4045-8eda-e4220b04819a" containerName="console"
Jul 09 19:10:07.550128 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:07.550110    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fj26l"
Jul 09 19:10:07.554943 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:07.554916    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 09 19:10:07.554943 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:07.554937    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tt5pt\""
Jul 09 19:10:07.555138 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:07.554953    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 09 19:10:07.555138 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:07.554988    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 09 19:10:07.560685 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:07.560662    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-fj26l"]
Jul 09 19:10:07.638843 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:07.638798    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42dc2b34-0007-4cb7-990e-733e83c863ac-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fj26l\" (UID: \"42dc2b34-0007-4cb7-990e-733e83c863ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fj26l"
Jul 09 19:10:07.638843 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:07.638852    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42dc2b34-0007-4cb7-990e-733e83c863ac-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fj26l\" (UID: \"42dc2b34-0007-4cb7-990e-733e83c863ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fj26l"
Jul 09 19:10:07.639101 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:07.638904    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42dc2b34-0007-4cb7-990e-733e83c863ac-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fj26l\" (UID: \"42dc2b34-0007-4cb7-990e-733e83c863ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fj26l"
Jul 09 19:10:07.639101 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:07.638928    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42dc2b34-0007-4cb7-990e-733e83c863ac-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fj26l\" (UID: \"42dc2b34-0007-4cb7-990e-733e83c863ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fj26l"
Jul 09 19:10:07.639101 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:07.639034    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42dc2b34-0007-4cb7-990e-733e83c863ac-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fj26l\" (UID: \"42dc2b34-0007-4cb7-990e-733e83c863ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fj26l"
Jul 09 19:10:07.639101 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:07.639084    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv4p9\" (UniqueName: \"kubernetes.io/projected/42dc2b34-0007-4cb7-990e-733e83c863ac-kube-api-access-zv4p9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fj26l\" (UID: \"42dc2b34-0007-4cb7-990e-733e83c863ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fj26l"
Jul 09 19:10:07.640032 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:07.640002    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:10:07.740088 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:07.740048    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42dc2b34-0007-4cb7-990e-733e83c863ac-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fj26l\" (UID: \"42dc2b34-0007-4cb7-990e-733e83c863ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fj26l"
Jul 09 19:10:07.740291 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:07.740126    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42dc2b34-0007-4cb7-990e-733e83c863ac-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fj26l\" (UID: \"42dc2b34-0007-4cb7-990e-733e83c863ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fj26l"
Jul 09 19:10:07.740291 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:07.740165    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42dc2b34-0007-4cb7-990e-733e83c863ac-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fj26l\" (UID: \"42dc2b34-0007-4cb7-990e-733e83c863ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fj26l"
Jul 09 19:10:07.740291 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:07.740248    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42dc2b34-0007-4cb7-990e-733e83c863ac-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fj26l\" (UID: \"42dc2b34-0007-4cb7-990e-733e83c863ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fj26l"
Jul 09 19:10:07.740457 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:07.740292    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv4p9\" (UniqueName: \"kubernetes.io/projected/42dc2b34-0007-4cb7-990e-733e83c863ac-kube-api-access-zv4p9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fj26l\" (UID: \"42dc2b34-0007-4cb7-990e-733e83c863ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fj26l"
Jul 09 19:10:07.740457 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:07.740430    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42dc2b34-0007-4cb7-990e-733e83c863ac-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fj26l\" (UID: \"42dc2b34-0007-4cb7-990e-733e83c863ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fj26l"
Jul 09 19:10:07.740638 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:07.740604    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42dc2b34-0007-4cb7-990e-733e83c863ac-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fj26l\" (UID: \"42dc2b34-0007-4cb7-990e-733e83c863ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fj26l"
Jul 09 19:10:07.740775 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:07.740638    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42dc2b34-0007-4cb7-990e-733e83c863ac-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fj26l\" (UID: \"42dc2b34-0007-4cb7-990e-733e83c863ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fj26l"
Jul 09 19:10:07.740775 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:07.740767    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42dc2b34-0007-4cb7-990e-733e83c863ac-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fj26l\" (UID: \"42dc2b34-0007-4cb7-990e-733e83c863ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fj26l"
Jul 09 19:10:07.742434 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:07.742410    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42dc2b34-0007-4cb7-990e-733e83c863ac-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fj26l\" (UID: \"42dc2b34-0007-4cb7-990e-733e83c863ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fj26l"
Jul 09 19:10:07.742637 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:07.742621    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42dc2b34-0007-4cb7-990e-733e83c863ac-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fj26l\" (UID: \"42dc2b34-0007-4cb7-990e-733e83c863ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fj26l"
Jul 09 19:10:07.749168 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:07.749144    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv4p9\" (UniqueName: \"kubernetes.io/projected/42dc2b34-0007-4cb7-990e-733e83c863ac-kube-api-access-zv4p9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fj26l\" (UID: \"42dc2b34-0007-4cb7-990e-733e83c863ac\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fj26l"
Jul 09 19:10:07.860876 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:07.860777    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fj26l"
Jul 09 19:10:08.005511 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:10:08.005482    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42dc2b34_0007_4cb7_990e_733e83c863ac.slice/crio-2967f4851afe0e52fbe9b58c726ecc218f18ddc4235fcadb22516debd404d23e WatchSource:0}: Error finding container 2967f4851afe0e52fbe9b58c726ecc218f18ddc4235fcadb22516debd404d23e: Status 404 returned error can't find the container with id 2967f4851afe0e52fbe9b58c726ecc218f18ddc4235fcadb22516debd404d23e
Jul 09 19:10:08.005822 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:08.005785    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-fj26l"]
Jul 09 19:10:08.617559 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:08.617513    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fj26l" event={"ID":"42dc2b34-0007-4cb7-990e-733e83c863ac","Type":"ContainerStarted","Data":"2967f4851afe0e52fbe9b58c726ecc218f18ddc4235fcadb22516debd404d23e"}
Jul 09 19:10:09.538529 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:09.538432    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:10:09.623900 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:09.623864    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fj26l" event={"ID":"42dc2b34-0007-4cb7-990e-733e83c863ac","Type":"ContainerStarted","Data":"58da947ae8da19b3d8e0692dd7f650956fac85494235aa65b7b10b92fc53a815"}
Jul 09 19:10:09.651454 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:09.651377    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fj26l" podStartSLOduration=1.464048188 podStartE2EDuration="2.651342936s" totalImagesPullingTime="1.187294748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:10:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:10:09.650320137 +0000 UTC m=+628.035390413" watchObservedRunningTime="2026-07-09 19:10:09.651342936 +0000 UTC m=+628.036413212"
Jul 09 19:10:12.839892 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:12.839854    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps"]
Jul 09 19:10:12.843257 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:12.843236    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps"
Jul 09 19:10:12.846134 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:12.846113    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 09 19:10:12.853331 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:12.853309    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps"]
Jul 09 19:10:12.862318 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:12.862291    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:10:12.992065 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:12.992027    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e40fccb-82dd-47f8-b045-db5416d30d72-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps\" (UID: \"7e40fccb-82dd-47f8-b045-db5416d30d72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps"
Jul 09 19:10:12.992065 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:12.992068    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e40fccb-82dd-47f8-b045-db5416d30d72-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps\" (UID: \"7e40fccb-82dd-47f8-b045-db5416d30d72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps"
Jul 09 19:10:12.992474 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:12.992087    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e40fccb-82dd-47f8-b045-db5416d30d72-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps\" (UID: \"7e40fccb-82dd-47f8-b045-db5416d30d72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps"
Jul 09 19:10:12.992474 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:12.992210    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57dtf\" (UniqueName: \"kubernetes.io/projected/7e40fccb-82dd-47f8-b045-db5416d30d72-kube-api-access-57dtf\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps\" (UID: \"7e40fccb-82dd-47f8-b045-db5416d30d72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps"
Jul 09 19:10:12.992474 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:12.992263    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e40fccb-82dd-47f8-b045-db5416d30d72-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps\" (UID: \"7e40fccb-82dd-47f8-b045-db5416d30d72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps"
Jul 09 19:10:12.992474 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:12.992289    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e40fccb-82dd-47f8-b045-db5416d30d72-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps\" (UID: \"7e40fccb-82dd-47f8-b045-db5416d30d72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps"
Jul 09 19:10:13.093541 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:13.093443    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e40fccb-82dd-47f8-b045-db5416d30d72-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps\" (UID: \"7e40fccb-82dd-47f8-b045-db5416d30d72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps"
Jul 09 19:10:13.093541 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:13.093488    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e40fccb-82dd-47f8-b045-db5416d30d72-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps\" (UID: \"7e40fccb-82dd-47f8-b045-db5416d30d72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps"
Jul 09 19:10:13.093782 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:13.093615    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e40fccb-82dd-47f8-b045-db5416d30d72-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps\" (UID: \"7e40fccb-82dd-47f8-b045-db5416d30d72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps"
Jul 09 19:10:13.093782 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:13.093665    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e40fccb-82dd-47f8-b045-db5416d30d72-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps\" (UID: \"7e40fccb-82dd-47f8-b045-db5416d30d72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps"
Jul 09 19:10:13.093782 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:13.093696    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e40fccb-82dd-47f8-b045-db5416d30d72-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps\" (UID: \"7e40fccb-82dd-47f8-b045-db5416d30d72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps"
Jul 09 19:10:13.093782 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:13.093773    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57dtf\" (UniqueName: \"kubernetes.io/projected/7e40fccb-82dd-47f8-b045-db5416d30d72-kube-api-access-57dtf\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps\" (UID: \"7e40fccb-82dd-47f8-b045-db5416d30d72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps"
Jul 09 19:10:13.094021 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:13.093938    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e40fccb-82dd-47f8-b045-db5416d30d72-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps\" (UID: \"7e40fccb-82dd-47f8-b045-db5416d30d72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps"
Jul 09 19:10:13.094065 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:13.094046    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e40fccb-82dd-47f8-b045-db5416d30d72-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps\" (UID: \"7e40fccb-82dd-47f8-b045-db5416d30d72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps"
Jul 09 19:10:13.094065 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:13.094052    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e40fccb-82dd-47f8-b045-db5416d30d72-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps\" (UID: \"7e40fccb-82dd-47f8-b045-db5416d30d72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps"
Jul 09 19:10:13.095823 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:13.095783    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e40fccb-82dd-47f8-b045-db5416d30d72-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps\" (UID: \"7e40fccb-82dd-47f8-b045-db5416d30d72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps"
Jul 09 19:10:13.096052 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:13.096035    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e40fccb-82dd-47f8-b045-db5416d30d72-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps\" (UID: \"7e40fccb-82dd-47f8-b045-db5416d30d72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps"
Jul 09 19:10:13.101823 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:13.101780    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57dtf\" (UniqueName: \"kubernetes.io/projected/7e40fccb-82dd-47f8-b045-db5416d30d72-kube-api-access-57dtf\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps\" (UID: \"7e40fccb-82dd-47f8-b045-db5416d30d72\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps"
Jul 09 19:10:13.152909 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:13.152867    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps"
Jul 09 19:10:13.287445 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:13.287417    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps"]
Jul 09 19:10:13.289833 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:10:13.289782    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e40fccb_82dd_47f8_b045_db5416d30d72.slice/crio-1dbee68838523d362a50f4034973a05b4b5185ac5d0cbc956f250dac7e4b47f0 WatchSource:0}: Error finding container 1dbee68838523d362a50f4034973a05b4b5185ac5d0cbc956f250dac7e4b47f0: Status 404 returned error can't find the container with id 1dbee68838523d362a50f4034973a05b4b5185ac5d0cbc956f250dac7e4b47f0
Jul 09 19:10:13.646085 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:13.646054    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps" event={"ID":"7e40fccb-82dd-47f8-b045-db5416d30d72","Type":"ContainerStarted","Data":"3765ad778e7e4e830ff9ec51769cbe54b70f99a17aa70f4847928fbe4558b037"}
Jul 09 19:10:13.646268 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:13.646094    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps" event={"ID":"7e40fccb-82dd-47f8-b045-db5416d30d72","Type":"ContainerStarted","Data":"1dbee68838523d362a50f4034973a05b4b5185ac5d0cbc956f250dac7e4b47f0"}
Jul 09 19:10:13.666087 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:13.666032    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps" podStartSLOduration=1.404417849 podStartE2EDuration="1.666014507s" totalImagesPullingTime="261.596658ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:10:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:10:13.663371016 +0000 UTC m=+632.048441291" watchObservedRunningTime="2026-07-09 19:10:13.666014507 +0000 UTC m=+632.051084780"
Jul 09 19:10:17.861514 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:17.861476    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fj26l"
Jul 09 19:10:17.861972 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:17.861539    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fj26l"
Jul 09 19:10:17.874150 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:17.874111    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fj26l"
Jul 09 19:10:18.679689 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:18.679662    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fj26l"
Jul 09 19:10:21.445709 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:21.445672    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:10:23.153094 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:23.153058    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps"
Jul 09 19:10:23.153535 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:23.153137    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps"
Jul 09 19:10:23.165551 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:23.165518    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps"
Jul 09 19:10:23.709752 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:10:23.709720    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps"
Jul 09 19:11:09.276980 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:11:09.276947    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:09.374559 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:11:09.374505    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:10.402520 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:11:10.402482    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:10.502096 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:11:10.502059    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:10.565284 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:11:10.565248    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b46c966d9-bqjp4"]
Jul 09 19:11:10.565452 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:11:10.565421    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7b46c966d9-bqjp4" podUID="cb1f2562-a062-480b-a3a9-85576ad78149" containerName="authorino" containerID="cri-o://402b6a390ff35e0f77e32a3a11c3f3d573769b93ea063ea2537d38589b70a7c8" gracePeriod=30
Jul 09 19:11:10.824729 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:11:10.824698    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b46c966d9-bqjp4"
Jul 09 19:11:10.922348 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:11:10.922315    2577 generic.go:356] "Generic (PLEG): container finished" podID="cb1f2562-a062-480b-a3a9-85576ad78149" containerID="402b6a390ff35e0f77e32a3a11c3f3d573769b93ea063ea2537d38589b70a7c8" exitCode=0
Jul 09 19:11:10.922517 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:11:10.922352    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b46c966d9-bqjp4"
Jul 09 19:11:10.922517 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:11:10.922372    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b46c966d9-bqjp4" event={"ID":"cb1f2562-a062-480b-a3a9-85576ad78149","Type":"ContainerDied","Data":"402b6a390ff35e0f77e32a3a11c3f3d573769b93ea063ea2537d38589b70a7c8"}
Jul 09 19:11:10.922517 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:11:10.922402    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b46c966d9-bqjp4" event={"ID":"cb1f2562-a062-480b-a3a9-85576ad78149","Type":"ContainerDied","Data":"3428a2bd4b7b9f81fbbe1a957b8c5ef2ccb4ee4ad09c988f7e9960c3529e52d2"}
Jul 09 19:11:10.922517 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:11:10.922418    2577 scope.go:117] "RemoveContainer" containerID="402b6a390ff35e0f77e32a3a11c3f3d573769b93ea063ea2537d38589b70a7c8"
Jul 09 19:11:10.925836 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:11:10.925794    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kb67n\" (UniqueName: \"kubernetes.io/projected/cb1f2562-a062-480b-a3a9-85576ad78149-kube-api-access-kb67n\") pod \"cb1f2562-a062-480b-a3a9-85576ad78149\" (UID: \"cb1f2562-a062-480b-a3a9-85576ad78149\") "
Jul 09 19:11:10.925942 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:11:10.925898    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cb1f2562-a062-480b-a3a9-85576ad78149-tls-cert\") pod \"cb1f2562-a062-480b-a3a9-85576ad78149\" (UID: \"cb1f2562-a062-480b-a3a9-85576ad78149\") "
Jul 09 19:11:10.927894 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:11:10.927865    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb1f2562-a062-480b-a3a9-85576ad78149-kube-api-access-kb67n" (OuterVolumeSpecName: "kube-api-access-kb67n") pod "cb1f2562-a062-480b-a3a9-85576ad78149" (UID: "cb1f2562-a062-480b-a3a9-85576ad78149"). InnerVolumeSpecName "kube-api-access-kb67n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:11:10.931222 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:11:10.931206    2577 scope.go:117] "RemoveContainer" containerID="402b6a390ff35e0f77e32a3a11c3f3d573769b93ea063ea2537d38589b70a7c8"
Jul 09 19:11:10.931531 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:11:10.931506    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"402b6a390ff35e0f77e32a3a11c3f3d573769b93ea063ea2537d38589b70a7c8\": container with ID starting with 402b6a390ff35e0f77e32a3a11c3f3d573769b93ea063ea2537d38589b70a7c8 not found: ID does not exist" containerID="402b6a390ff35e0f77e32a3a11c3f3d573769b93ea063ea2537d38589b70a7c8"
Jul 09 19:11:10.931587 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:11:10.931543    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"402b6a390ff35e0f77e32a3a11c3f3d573769b93ea063ea2537d38589b70a7c8"} err="failed to get container status \"402b6a390ff35e0f77e32a3a11c3f3d573769b93ea063ea2537d38589b70a7c8\": rpc error: code = NotFound desc = could not find container \"402b6a390ff35e0f77e32a3a11c3f3d573769b93ea063ea2537d38589b70a7c8\": container with ID starting with 402b6a390ff35e0f77e32a3a11c3f3d573769b93ea063ea2537d38589b70a7c8 not found: ID does not exist"
Jul 09 19:11:10.936986 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:11:10.936963    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb1f2562-a062-480b-a3a9-85576ad78149-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "cb1f2562-a062-480b-a3a9-85576ad78149" (UID: "cb1f2562-a062-480b-a3a9-85576ad78149"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:11:11.027004 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:11:11.026966    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kb67n\" (UniqueName: \"kubernetes.io/projected/cb1f2562-a062-480b-a3a9-85576ad78149-kube-api-access-kb67n\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:11:11.027004 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:11:11.026995    2577 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cb1f2562-a062-480b-a3a9-85576ad78149-tls-cert\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:11:11.250421 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:11:11.250391    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b46c966d9-bqjp4"]
Jul 09 19:11:11.255499 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:11:11.255467    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7b46c966d9-bqjp4"]
Jul 09 19:11:12.639805 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:11:12.639769    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb1f2562-a062-480b-a3a9-85576ad78149" path="/var/lib/kubelet/pods/cb1f2562-a062-480b-a3a9-85576ad78149/volumes"
Jul 09 19:11:36.227284 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:11:36.227248    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:36.328472 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:11:36.328440    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:36.547317 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:11:36.547229    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:11:37.877187 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:11:37.877155    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:11:47.838868 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:11:47.838834    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:11:58.641451 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:11:58.641420    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:12:07.448172 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:12:07.448135    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:12:18.766558 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:12:18.766524    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:12:20.089779 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:12:20.089749    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:12:21.570544 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:12:21.570506    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:12:43.645800 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:12:43.645768    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:12:55.938221 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:12:55.938184    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:13:02.052067 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:13:02.052029    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:13:02.148682 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:13:02.148644    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:13:02.263205 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:13:02.263170    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:13:08.113241 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:13:08.113148    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:13:08.187612 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:13:08.187579    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:13:08.269907 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:13:08.269877    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:13:08.842174 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:13:08.842141    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:13:14.260567 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:13:14.260530    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:13:14.363518 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:13:14.363483    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:13:30.939981 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:13:30.939945    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:13:40.542841 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:13:40.542793    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:13:50.039612 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:13:50.039576    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:14:01.538440 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:14:01.538396    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:14:12.037059 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:14:12.037019    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:14:24.244462 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:14:24.244418    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:14:34.732286 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:14:34.732210    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:14:44.234344 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:14:44.234310    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:15:00.137251 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:15:00.137213    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727075-hn898"]
Jul 09 19:15:00.137776 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:15:00.137756    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb1f2562-a062-480b-a3a9-85576ad78149" containerName="authorino"
Jul 09 19:15:00.137884 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:15:00.137780    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb1f2562-a062-480b-a3a9-85576ad78149" containerName="authorino"
Jul 09 19:15:00.137964 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:15:00.137951    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb1f2562-a062-480b-a3a9-85576ad78149" containerName="authorino"
Jul 09 19:15:00.141149 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:15:00.141129    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-hn898"
Jul 09 19:15:00.144528 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:15:00.144498    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 19:15:00.144644 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:15:00.144553    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dlwh6\""
Jul 09 19:15:00.145890 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:15:00.145875    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 19:15:00.154430 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:15:00.154400    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727075-hn898"]
Jul 09 19:15:00.225565 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:15:00.225529    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qxgt\" (UniqueName: \"kubernetes.io/projected/a418c8a1-1ac0-4f5d-a599-76849ae26dc9-kube-api-access-2qxgt\") pod \"maas-api-key-cleanup-29727075-hn898\" (UID: \"a418c8a1-1ac0-4f5d-a599-76849ae26dc9\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-hn898"
Jul 09 19:15:00.326435 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:15:00.326401    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qxgt\" (UniqueName: \"kubernetes.io/projected/a418c8a1-1ac0-4f5d-a599-76849ae26dc9-kube-api-access-2qxgt\") pod \"maas-api-key-cleanup-29727075-hn898\" (UID: \"a418c8a1-1ac0-4f5d-a599-76849ae26dc9\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-hn898"
Jul 09 19:15:00.335350 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:15:00.335313    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qxgt\" (UniqueName: \"kubernetes.io/projected/a418c8a1-1ac0-4f5d-a599-76849ae26dc9-kube-api-access-2qxgt\") pod \"maas-api-key-cleanup-29727075-hn898\" (UID: \"a418c8a1-1ac0-4f5d-a599-76849ae26dc9\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-hn898"
Jul 09 19:15:00.451521 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:15:00.451417    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-hn898"
Jul 09 19:15:00.590361 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:15:00.590337    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727075-hn898"]
Jul 09 19:15:00.592405 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:15:00.592369    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda418c8a1_1ac0_4f5d_a599_76849ae26dc9.slice/crio-e9049cb1a04077bac43af2b27253a4379e7ecc710e41a69b1a7cfaad066e656c WatchSource:0}: Error finding container e9049cb1a04077bac43af2b27253a4379e7ecc710e41a69b1a7cfaad066e656c: Status 404 returned error can't find the container with id e9049cb1a04077bac43af2b27253a4379e7ecc710e41a69b1a7cfaad066e656c
Jul 09 19:15:00.594317 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:15:00.594299    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 19:15:01.023111 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:15:01.023074    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-hn898" event={"ID":"a418c8a1-1ac0-4f5d-a599-76849ae26dc9","Type":"ContainerStarted","Data":"e9049cb1a04077bac43af2b27253a4379e7ecc710e41a69b1a7cfaad066e656c"}
Jul 09 19:15:04.040610 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:15:04.040573    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-hn898" event={"ID":"a418c8a1-1ac0-4f5d-a599-76849ae26dc9","Type":"ContainerStarted","Data":"b9c941ddbdfd87188bf57c587169ddb5e03b15c2798722b1eb800ff5013095c4"}
Jul 09 19:15:04.057628 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:15:04.057520    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-hn898" podStartSLOduration=1.140422362 podStartE2EDuration="4.057502268s" totalImagesPullingTime="2.917079906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:15:04.055163281 +0000 UTC m=+922.440233555" watchObservedRunningTime="2026-07-09 19:15:04.057502268 +0000 UTC m=+922.442572567"
Jul 09 19:15:07.037469 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:15:07.037433    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:15:18.041447 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:15:18.041415    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:15:26.442346 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:15:26.442309    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:15:40.951271 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:15:40.951238    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:15:53.842210 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:15:53.842166    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:16:00.011988 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:16:00.011934    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727075-hn898"]
Jul 09 19:16:00.012476 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:16:00.012212    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-hn898" podUID="a418c8a1-1ac0-4f5d-a599-76849ae26dc9" containerName="cleanup" containerID="cri-o://b9c941ddbdfd87188bf57c587169ddb5e03b15c2798722b1eb800ff5013095c4" gracePeriod=30
Jul 09 19:16:10.439714 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:16:10.439633    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:16:20.137711 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:16:20.137673    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:16:29.846332 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:16:29.846293    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:16:30.210109 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:16:30.210074    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-hn898"
Jul 09 19:16:30.303206 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:16:30.303168    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qxgt\" (UniqueName: \"kubernetes.io/projected/a418c8a1-1ac0-4f5d-a599-76849ae26dc9-kube-api-access-2qxgt\") pod \"a418c8a1-1ac0-4f5d-a599-76849ae26dc9\" (UID: \"a418c8a1-1ac0-4f5d-a599-76849ae26dc9\") "
Jul 09 19:16:30.305336 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:16:30.305307    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a418c8a1-1ac0-4f5d-a599-76849ae26dc9-kube-api-access-2qxgt" (OuterVolumeSpecName: "kube-api-access-2qxgt") pod "a418c8a1-1ac0-4f5d-a599-76849ae26dc9" (UID: "a418c8a1-1ac0-4f5d-a599-76849ae26dc9"). InnerVolumeSpecName "kube-api-access-2qxgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:16:30.404675 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:16:30.404641    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qxgt\" (UniqueName: \"kubernetes.io/projected/a418c8a1-1ac0-4f5d-a599-76849ae26dc9-kube-api-access-2qxgt\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:16:30.449012 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:16:30.448980    2577 generic.go:356] "Generic (PLEG): container finished" podID="a418c8a1-1ac0-4f5d-a599-76849ae26dc9" containerID="b9c941ddbdfd87188bf57c587169ddb5e03b15c2798722b1eb800ff5013095c4" exitCode=137
Jul 09 19:16:30.449175 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:16:30.449027    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-hn898"
Jul 09 19:16:30.449175 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:16:30.449067    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-hn898" event={"ID":"a418c8a1-1ac0-4f5d-a599-76849ae26dc9","Type":"ContainerDied","Data":"b9c941ddbdfd87188bf57c587169ddb5e03b15c2798722b1eb800ff5013095c4"}
Jul 09 19:16:30.449175 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:16:30.449126    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-hn898" event={"ID":"a418c8a1-1ac0-4f5d-a599-76849ae26dc9","Type":"ContainerDied","Data":"e9049cb1a04077bac43af2b27253a4379e7ecc710e41a69b1a7cfaad066e656c"}
Jul 09 19:16:30.449175 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:16:30.449155    2577 scope.go:117] "RemoveContainer" containerID="b9c941ddbdfd87188bf57c587169ddb5e03b15c2798722b1eb800ff5013095c4"
Jul 09 19:16:30.458244 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:16:30.458219    2577 scope.go:117] "RemoveContainer" containerID="b9c941ddbdfd87188bf57c587169ddb5e03b15c2798722b1eb800ff5013095c4"
Jul 09 19:16:30.458518 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:16:30.458500    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9c941ddbdfd87188bf57c587169ddb5e03b15c2798722b1eb800ff5013095c4\": container with ID starting with b9c941ddbdfd87188bf57c587169ddb5e03b15c2798722b1eb800ff5013095c4 not found: ID does not exist" containerID="b9c941ddbdfd87188bf57c587169ddb5e03b15c2798722b1eb800ff5013095c4"
Jul 09 19:16:30.458597 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:16:30.458533    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9c941ddbdfd87188bf57c587169ddb5e03b15c2798722b1eb800ff5013095c4"} err="failed to get container status \"b9c941ddbdfd87188bf57c587169ddb5e03b15c2798722b1eb800ff5013095c4\": rpc error: code = NotFound desc = could not find container \"b9c941ddbdfd87188bf57c587169ddb5e03b15c2798722b1eb800ff5013095c4\": container with ID starting with b9c941ddbdfd87188bf57c587169ddb5e03b15c2798722b1eb800ff5013095c4 not found: ID does not exist"
Jul 09 19:16:30.470971 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:16:30.470944    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727075-hn898"]
Jul 09 19:16:30.474542 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:16:30.474518    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727075-hn898"]
Jul 09 19:16:30.638254 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:16:30.638224    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a418c8a1-1ac0-4f5d-a599-76849ae26dc9" path="/var/lib/kubelet/pods/a418c8a1-1ac0-4f5d-a599-76849ae26dc9/volumes"
Jul 09 19:16:39.739412 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:16:39.739363    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:16:49.934815 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:16:49.934767    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:17:50.873756 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:17:50.873724    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:18:22.320177 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:18:22.320141    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:18:22.384977 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:18:22.384940    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:18:34.645163 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:18:34.645130    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:18:46.552836 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:18:46.552785    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:18:58.961604 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:18:58.961566    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:19:07.140798 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:19:07.140717    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:19:18.445391 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:19:18.445355    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:19:26.242805 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:19:26.242758    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:19:37.543398 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:19:37.543364    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:19:48.736042 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:19:48.736001    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:19:58.139437 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:19:58.139399    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:20:07.840488 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:20:07.840452    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:20:13.699734 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:20:13.699702    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:20:19.739655 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:20:19.739617    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:20:29.641747 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:20:29.641711    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:20:47.050351 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:20:47.050254    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:20:55.643592 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:20:55.643557    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:21:07.038013 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:21:07.037979    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:21:16.547407 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:21:16.547375    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:21:34.553646 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:21:34.553608    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:21:44.248194 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:21:44.248159    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:21:53.946288 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:21:53.946253    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:22:02.850674 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:22:02.850638    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:22:04.603673 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:22:04.603559    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:22:13.241935 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:22:13.241900    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:22:23.344440 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:22:23.344404    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:22:36.944074 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:22:36.944040    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:22:46.453262 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:22:46.453228    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:23:01.839964 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:23:01.839927    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:23:05.314592 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:23:05.314525    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:23:10.751890 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:23:10.751854    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:23:23.333030 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:23:23.332987    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:23:33.351601 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:23:33.351564    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:23:41.648801 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:23:41.648765    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:23:51.246889 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:23:51.246854    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:24:01.047646 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:01.047609    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:24:10.304789 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:10.304753    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:24:13.699916 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:13.699886    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:20.315201 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:20.315137    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:24.241795 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:24.241760    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:24:28.575438 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:28.575398    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:32.847244 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:32.847206    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:24:33.693137 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:33.693083    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:36.505395 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:36.505344    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:36.607448 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:36.607407    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:36.954275 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:36.954231    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:42.711083 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:42.711045    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:42.777825 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:42.777782    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:42.947296 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:42.947230    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:43.048045 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:43.047923    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:43.239914 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:43.239875    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:24:44.126267 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:44.126235    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:44.201479 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:44.201446    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz"]
Jul 09 19:24:44.201959 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:44.201941    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a418c8a1-1ac0-4f5d-a599-76849ae26dc9" containerName="cleanup"
Jul 09 19:24:44.202016 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:44.201962    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a418c8a1-1ac0-4f5d-a599-76849ae26dc9" containerName="cleanup"
Jul 09 19:24:44.202055 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:44.202049    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a418c8a1-1ac0-4f5d-a599-76849ae26dc9" containerName="cleanup"
Jul 09 19:24:44.204085 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:44.204068    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz"
Jul 09 19:24:44.207134 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:44.207111    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-6645f2ee-serving-cert\""
Jul 09 19:24:44.207250 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:44.207152    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dlwh6\""
Jul 09 19:24:44.207250 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:44.207169    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 19:24:44.208561 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:44.208545    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 19:24:44.215411 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:44.215383    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz"]
Jul 09 19:24:44.218411 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:44.218387    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:44.243721 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:44.243687    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e9f0052-10cb-43f6-a3e7-32a837295388-openshift-service-ca\") pod \"maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz\" (UID: \"1e9f0052-10cb-43f6-a3e7-32a837295388\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz"
Jul 09 19:24:44.243936 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:44.243737    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e9f0052-10cb-43f6-a3e7-32a837295388-maas-api-tls\") pod \"maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz\" (UID: \"1e9f0052-10cb-43f6-a3e7-32a837295388\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz"
Jul 09 19:24:44.243936 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:44.243849    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qltk\" (UniqueName: \"kubernetes.io/projected/1e9f0052-10cb-43f6-a3e7-32a837295388-kube-api-access-6qltk\") pod \"maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz\" (UID: \"1e9f0052-10cb-43f6-a3e7-32a837295388\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz"
Jul 09 19:24:44.299587 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:44.299551    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:44.344349 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:44.344321    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e9f0052-10cb-43f6-a3e7-32a837295388-openshift-service-ca\") pod \"maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz\" (UID: \"1e9f0052-10cb-43f6-a3e7-32a837295388\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz"
Jul 09 19:24:44.344542 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:44.344366    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e9f0052-10cb-43f6-a3e7-32a837295388-maas-api-tls\") pod \"maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz\" (UID: \"1e9f0052-10cb-43f6-a3e7-32a837295388\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz"
Jul 09 19:24:44.344542 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:44.344413    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qltk\" (UniqueName: \"kubernetes.io/projected/1e9f0052-10cb-43f6-a3e7-32a837295388-kube-api-access-6qltk\") pod \"maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz\" (UID: \"1e9f0052-10cb-43f6-a3e7-32a837295388\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz"
Jul 09 19:24:44.345056 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:44.345031    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e9f0052-10cb-43f6-a3e7-32a837295388-openshift-service-ca\") pod \"maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz\" (UID: \"1e9f0052-10cb-43f6-a3e7-32a837295388\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz"
Jul 09 19:24:44.346880 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:44.346860    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e9f0052-10cb-43f6-a3e7-32a837295388-maas-api-tls\") pod \"maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz\" (UID: \"1e9f0052-10cb-43f6-a3e7-32a837295388\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz"
Jul 09 19:24:44.357785 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:44.357759    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qltk\" (UniqueName: \"kubernetes.io/projected/1e9f0052-10cb-43f6-a3e7-32a837295388-kube-api-access-6qltk\") pod \"maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz\" (UID: \"1e9f0052-10cb-43f6-a3e7-32a837295388\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz"
Jul 09 19:24:44.397050 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:44.397023    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:44.515401 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:44.515363    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz"
Jul 09 19:24:44.650286 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:44.650260    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz"]
Jul 09 19:24:44.652310 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:24:44.652285    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e9f0052_10cb_43f6_a3e7_32a837295388.slice/crio-d514c1008798d473b5fba074ed1b8dd61445b352aa1f0d6586a0764836fa4eac WatchSource:0}: Error finding container d514c1008798d473b5fba074ed1b8dd61445b352aa1f0d6586a0764836fa4eac: Status 404 returned error can't find the container with id d514c1008798d473b5fba074ed1b8dd61445b352aa1f0d6586a0764836fa4eac
Jul 09 19:24:44.653631 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:44.653616    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 19:24:44.672910 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:44.672880    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:44.791106 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:44.791070    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:44.791846 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:44.791800    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz" event={"ID":"1e9f0052-10cb-43f6-a3e7-32a837295388","Type":"ContainerStarted","Data":"d514c1008798d473b5fba074ed1b8dd61445b352aa1f0d6586a0764836fa4eac"}
Jul 09 19:24:46.537254 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:46.537228    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:46.804905 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:46.804790    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz" event={"ID":"1e9f0052-10cb-43f6-a3e7-32a837295388","Type":"ContainerStarted","Data":"509bd77533a216b8b956332b6102e58e993e05d567ec06288a81ebfcc63cd56c"}
Jul 09 19:24:46.805060 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:46.804930    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz"
Jul 09 19:24:46.825171 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:46.825118    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz" podStartSLOduration=0.958424532 podStartE2EDuration="2.825100362s" totalImagesPullingTime="1.86667583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:24:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:24:46.823937095 +0000 UTC m=+1505.209007413" watchObservedRunningTime="2026-07-09 19:24:46.825100362 +0000 UTC m=+1505.210170638"
Jul 09 19:24:49.223653 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:49.223622    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:49.419985 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:49.419949    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:49.512745 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:49.512662    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:49.553749 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:49.553718    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz"]
Jul 09 19:24:49.553970 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:49.553942    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz" podUID="1e9f0052-10cb-43f6-a3e7-32a837295388" containerName="maas-api" containerID="cri-o://509bd77533a216b8b956332b6102e58e993e05d567ec06288a81ebfcc63cd56c" gracePeriod=30
Jul 09 19:24:49.580304 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:49.580278    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:49.799666 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:49.799640    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz"
Jul 09 19:24:49.820845 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:49.820790    2577 generic.go:356] "Generic (PLEG): container finished" podID="1e9f0052-10cb-43f6-a3e7-32a837295388" containerID="509bd77533a216b8b956332b6102e58e993e05d567ec06288a81ebfcc63cd56c" exitCode=0
Jul 09 19:24:49.821077 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:49.820864    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz"
Jul 09 19:24:49.821257 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:49.820862    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz" event={"ID":"1e9f0052-10cb-43f6-a3e7-32a837295388","Type":"ContainerDied","Data":"509bd77533a216b8b956332b6102e58e993e05d567ec06288a81ebfcc63cd56c"}
Jul 09 19:24:49.821257 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:49.821197    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz" event={"ID":"1e9f0052-10cb-43f6-a3e7-32a837295388","Type":"ContainerDied","Data":"d514c1008798d473b5fba074ed1b8dd61445b352aa1f0d6586a0764836fa4eac"}
Jul 09 19:24:49.821257 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:49.821227    2577 scope.go:117] "RemoveContainer" containerID="509bd77533a216b8b956332b6102e58e993e05d567ec06288a81ebfcc63cd56c"
Jul 09 19:24:49.830016 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:49.829995    2577 scope.go:117] "RemoveContainer" containerID="509bd77533a216b8b956332b6102e58e993e05d567ec06288a81ebfcc63cd56c"
Jul 09 19:24:49.830340 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:24:49.830319    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"509bd77533a216b8b956332b6102e58e993e05d567ec06288a81ebfcc63cd56c\": container with ID starting with 509bd77533a216b8b956332b6102e58e993e05d567ec06288a81ebfcc63cd56c not found: ID does not exist" containerID="509bd77533a216b8b956332b6102e58e993e05d567ec06288a81ebfcc63cd56c"
Jul 09 19:24:49.830393 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:49.830349    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"509bd77533a216b8b956332b6102e58e993e05d567ec06288a81ebfcc63cd56c"} err="failed to get container status \"509bd77533a216b8b956332b6102e58e993e05d567ec06288a81ebfcc63cd56c\": rpc error: code = NotFound desc = could not find container \"509bd77533a216b8b956332b6102e58e993e05d567ec06288a81ebfcc63cd56c\": container with ID starting with 509bd77533a216b8b956332b6102e58e993e05d567ec06288a81ebfcc63cd56c not found: ID does not exist"
Jul 09 19:24:49.897643 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:49.897607    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e9f0052-10cb-43f6-a3e7-32a837295388-maas-api-tls\") pod \"1e9f0052-10cb-43f6-a3e7-32a837295388\" (UID: \"1e9f0052-10cb-43f6-a3e7-32a837295388\") "
Jul 09 19:24:49.897643 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:49.897651    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qltk\" (UniqueName: \"kubernetes.io/projected/1e9f0052-10cb-43f6-a3e7-32a837295388-kube-api-access-6qltk\") pod \"1e9f0052-10cb-43f6-a3e7-32a837295388\" (UID: \"1e9f0052-10cb-43f6-a3e7-32a837295388\") "
Jul 09 19:24:49.897887 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:49.897785    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e9f0052-10cb-43f6-a3e7-32a837295388-openshift-service-ca\") pod \"1e9f0052-10cb-43f6-a3e7-32a837295388\" (UID: \"1e9f0052-10cb-43f6-a3e7-32a837295388\") "
Jul 09 19:24:49.898095 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:49.898069    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e9f0052-10cb-43f6-a3e7-32a837295388-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1e9f0052-10cb-43f6-a3e7-32a837295388" (UID: "1e9f0052-10cb-43f6-a3e7-32a837295388"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:24:49.899870 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:49.899844    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e9f0052-10cb-43f6-a3e7-32a837295388-kube-api-access-6qltk" (OuterVolumeSpecName: "kube-api-access-6qltk") pod "1e9f0052-10cb-43f6-a3e7-32a837295388" (UID: "1e9f0052-10cb-43f6-a3e7-32a837295388"). InnerVolumeSpecName "kube-api-access-6qltk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:24:49.899870 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:49.899853    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e9f0052-10cb-43f6-a3e7-32a837295388-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1e9f0052-10cb-43f6-a3e7-32a837295388" (UID: "1e9f0052-10cb-43f6-a3e7-32a837295388"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:24:49.999245 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:49.999193    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e9f0052-10cb-43f6-a3e7-32a837295388-openshift-service-ca\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:24:49.999245 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:49.999239    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e9f0052-10cb-43f6-a3e7-32a837295388-maas-api-tls\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:24:49.999245 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:49.999250    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qltk\" (UniqueName: \"kubernetes.io/projected/1e9f0052-10cb-43f6-a3e7-32a837295388-kube-api-access-6qltk\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:24:50.145178 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:50.145133    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz"]
Jul 09 19:24:50.153305 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:50.153279    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-6645f2ee-7db7fcb8b4-cfbbz"]
Jul 09 19:24:50.638402 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:50.638369    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e9f0052-10cb-43f6-a3e7-32a837295388" path="/var/lib/kubelet/pods/1e9f0052-10cb-43f6-a3e7-32a837295388/volumes"
Jul 09 19:24:50.872803 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:50.872771    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:55.314881 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:55.314848    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:55.392822 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:55.392773    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:55.558302 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:55.558264    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:55.620546 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:55.620466    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:56.738031 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:56.737997    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:56.814833 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:56.814772    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h"]
Jul 09 19:24:56.815201 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:56.815187    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e9f0052-10cb-43f6-a3e7-32a837295388" containerName="maas-api"
Jul 09 19:24:56.815240 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:56.815204    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e9f0052-10cb-43f6-a3e7-32a837295388" containerName="maas-api"
Jul 09 19:24:56.815285 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:56.815277    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e9f0052-10cb-43f6-a3e7-32a837295388" containerName="maas-api"
Jul 09 19:24:56.818021 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:56.818000    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h"
Jul 09 19:24:56.821604 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:56.821576    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 19:24:56.821730 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:56.821659    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 19:24:56.821778 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:56.821585    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-525b3638-serving-cert\""
Jul 09 19:24:56.822986 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:56.822972    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dlwh6\""
Jul 09 19:24:56.831740 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:56.831715    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h"]
Jul 09 19:24:56.837559 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:56.837523    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:56.866292 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:56.866263    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaa21532-6a76-44b7-8c31-2dfb489ef231-openshift-service-ca\") pod \"maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h\" (UID: \"eaa21532-6a76-44b7-8c31-2dfb489ef231\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h"
Jul 09 19:24:56.866466 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:56.866312    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwckj\" (UniqueName: \"kubernetes.io/projected/eaa21532-6a76-44b7-8c31-2dfb489ef231-kube-api-access-fwckj\") pod \"maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h\" (UID: \"eaa21532-6a76-44b7-8c31-2dfb489ef231\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h"
Jul 09 19:24:56.866466 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:56.866333    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eaa21532-6a76-44b7-8c31-2dfb489ef231-maas-api-tls\") pod \"maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h\" (UID: \"eaa21532-6a76-44b7-8c31-2dfb489ef231\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h"
Jul 09 19:24:56.911627 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:56.911601    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:56.967645 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:56.967608    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaa21532-6a76-44b7-8c31-2dfb489ef231-openshift-service-ca\") pod \"maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h\" (UID: \"eaa21532-6a76-44b7-8c31-2dfb489ef231\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h"
Jul 09 19:24:56.967836 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:56.967680    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwckj\" (UniqueName: \"kubernetes.io/projected/eaa21532-6a76-44b7-8c31-2dfb489ef231-kube-api-access-fwckj\") pod \"maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h\" (UID: \"eaa21532-6a76-44b7-8c31-2dfb489ef231\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h"
Jul 09 19:24:56.967836 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:56.967714    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eaa21532-6a76-44b7-8c31-2dfb489ef231-maas-api-tls\") pod \"maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h\" (UID: \"eaa21532-6a76-44b7-8c31-2dfb489ef231\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h"
Jul 09 19:24:56.967924 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:24:56.967909    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-525b3638-serving-cert: secret "maas-api-e2e-ait-525b3638-serving-cert" not found
Jul 09 19:24:56.968011 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:24:56.967997    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eaa21532-6a76-44b7-8c31-2dfb489ef231-maas-api-tls podName:eaa21532-6a76-44b7-8c31-2dfb489ef231 nodeName:}" failed. No retries permitted until 2026-07-09 19:24:57.467979104 +0000 UTC m=+1515.853049362 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/eaa21532-6a76-44b7-8c31-2dfb489ef231-maas-api-tls") pod "maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h" (UID: "eaa21532-6a76-44b7-8c31-2dfb489ef231") : secret "maas-api-e2e-ait-525b3638-serving-cert" not found
Jul 09 19:24:56.968422 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:56.968398    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaa21532-6a76-44b7-8c31-2dfb489ef231-openshift-service-ca\") pod \"maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h\" (UID: \"eaa21532-6a76-44b7-8c31-2dfb489ef231\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h"
Jul 09 19:24:56.981672 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:56.981642    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwckj\" (UniqueName: \"kubernetes.io/projected/eaa21532-6a76-44b7-8c31-2dfb489ef231-kube-api-access-fwckj\") pod \"maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h\" (UID: \"eaa21532-6a76-44b7-8c31-2dfb489ef231\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h"
Jul 09 19:24:57.274997 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:57.274970    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:57.377230 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:57.377201    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:57.472057 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:57.472022    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eaa21532-6a76-44b7-8c31-2dfb489ef231-maas-api-tls\") pod \"maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h\" (UID: \"eaa21532-6a76-44b7-8c31-2dfb489ef231\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h"
Jul 09 19:24:57.474503 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:57.474468    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eaa21532-6a76-44b7-8c31-2dfb489ef231-maas-api-tls\") pod \"maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h\" (UID: \"eaa21532-6a76-44b7-8c31-2dfb489ef231\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h"
Jul 09 19:24:57.728539 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:57.728500    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h"
Jul 09 19:24:57.866168 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:57.866143    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h"]
Jul 09 19:24:57.868740 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:24:57.868714    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaa21532_6a76_44b7_8c31_2dfb489ef231.slice/crio-db8507bbe89f01a5f80d4689ee39eb0b35567d8e6a36ff63993e1c770565bc4e WatchSource:0}: Error finding container db8507bbe89f01a5f80d4689ee39eb0b35567d8e6a36ff63993e1c770565bc4e: Status 404 returned error can't find the container with id db8507bbe89f01a5f80d4689ee39eb0b35567d8e6a36ff63993e1c770565bc4e
Jul 09 19:24:58.866214 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:58.866178    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h" event={"ID":"eaa21532-6a76-44b7-8c31-2dfb489ef231","Type":"ContainerStarted","Data":"6ab4fca4e442401fd536f44ca6cd6cc8a66f30b8211f71a99c68c75068db6ecf"}
Jul 09 19:24:58.866682 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:58.866240    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h" event={"ID":"eaa21532-6a76-44b7-8c31-2dfb489ef231","Type":"ContainerStarted","Data":"db8507bbe89f01a5f80d4689ee39eb0b35567d8e6a36ff63993e1c770565bc4e"}
Jul 09 19:24:58.866682 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:58.866272    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h"
Jul 09 19:24:58.886637 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:58.886588    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h" podStartSLOduration=2.454113326 podStartE2EDuration="2.886568473s" totalImagesPullingTime="432.455147ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:24:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:24:58.884597928 +0000 UTC m=+1517.269668202" watchObservedRunningTime="2026-07-09 19:24:58.886568473 +0000 UTC m=+1517.271638788"
Jul 09 19:24:59.079517 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:59.079480    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:24:59.639605 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:24:59.639564    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:25:01.743778 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:01.743742    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:02.031227 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:02.031138    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h"]
Jul 09 19:25:02.031389 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:02.031363    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h" podUID="eaa21532-6a76-44b7-8c31-2dfb489ef231" containerName="maas-api" containerID="cri-o://6ab4fca4e442401fd536f44ca6cd6cc8a66f30b8211f71a99c68c75068db6ecf" gracePeriod=30
Jul 09 19:25:02.061344 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:02.061319    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:02.278397 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:02.278370    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h"
Jul 09 19:25:02.422558 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:02.422521    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwckj\" (UniqueName: \"kubernetes.io/projected/eaa21532-6a76-44b7-8c31-2dfb489ef231-kube-api-access-fwckj\") pod \"eaa21532-6a76-44b7-8c31-2dfb489ef231\" (UID: \"eaa21532-6a76-44b7-8c31-2dfb489ef231\") "
Jul 09 19:25:02.422558 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:02.422559    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eaa21532-6a76-44b7-8c31-2dfb489ef231-maas-api-tls\") pod \"eaa21532-6a76-44b7-8c31-2dfb489ef231\" (UID: \"eaa21532-6a76-44b7-8c31-2dfb489ef231\") "
Jul 09 19:25:02.422774 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:02.422584    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaa21532-6a76-44b7-8c31-2dfb489ef231-openshift-service-ca\") pod \"eaa21532-6a76-44b7-8c31-2dfb489ef231\" (UID: \"eaa21532-6a76-44b7-8c31-2dfb489ef231\") "
Jul 09 19:25:02.423008 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:02.422979    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eaa21532-6a76-44b7-8c31-2dfb489ef231-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "eaa21532-6a76-44b7-8c31-2dfb489ef231" (UID: "eaa21532-6a76-44b7-8c31-2dfb489ef231"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:25:02.424669 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:02.424646    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaa21532-6a76-44b7-8c31-2dfb489ef231-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "eaa21532-6a76-44b7-8c31-2dfb489ef231" (UID: "eaa21532-6a76-44b7-8c31-2dfb489ef231"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:25:02.424756 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:02.424707    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaa21532-6a76-44b7-8c31-2dfb489ef231-kube-api-access-fwckj" (OuterVolumeSpecName: "kube-api-access-fwckj") pod "eaa21532-6a76-44b7-8c31-2dfb489ef231" (UID: "eaa21532-6a76-44b7-8c31-2dfb489ef231"). InnerVolumeSpecName "kube-api-access-fwckj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:25:02.523383 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:02.523346    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwckj\" (UniqueName: \"kubernetes.io/projected/eaa21532-6a76-44b7-8c31-2dfb489ef231-kube-api-access-fwckj\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:25:02.523383 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:02.523379    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eaa21532-6a76-44b7-8c31-2dfb489ef231-maas-api-tls\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:25:02.523383 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:02.523389    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eaa21532-6a76-44b7-8c31-2dfb489ef231-openshift-service-ca\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:25:02.887422 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:02.887392    2577 generic.go:356] "Generic (PLEG): container finished" podID="eaa21532-6a76-44b7-8c31-2dfb489ef231" containerID="6ab4fca4e442401fd536f44ca6cd6cc8a66f30b8211f71a99c68c75068db6ecf" exitCode=0
Jul 09 19:25:02.887804 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:02.887440    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h"
Jul 09 19:25:02.887804 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:02.887474    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h" event={"ID":"eaa21532-6a76-44b7-8c31-2dfb489ef231","Type":"ContainerDied","Data":"6ab4fca4e442401fd536f44ca6cd6cc8a66f30b8211f71a99c68c75068db6ecf"}
Jul 09 19:25:02.887804 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:02.887524    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h" event={"ID":"eaa21532-6a76-44b7-8c31-2dfb489ef231","Type":"ContainerDied","Data":"db8507bbe89f01a5f80d4689ee39eb0b35567d8e6a36ff63993e1c770565bc4e"}
Jul 09 19:25:02.887804 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:02.887546    2577 scope.go:117] "RemoveContainer" containerID="6ab4fca4e442401fd536f44ca6cd6cc8a66f30b8211f71a99c68c75068db6ecf"
Jul 09 19:25:02.896014 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:02.895996    2577 scope.go:117] "RemoveContainer" containerID="6ab4fca4e442401fd536f44ca6cd6cc8a66f30b8211f71a99c68c75068db6ecf"
Jul 09 19:25:02.896291 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:25:02.896271    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ab4fca4e442401fd536f44ca6cd6cc8a66f30b8211f71a99c68c75068db6ecf\": container with ID starting with 6ab4fca4e442401fd536f44ca6cd6cc8a66f30b8211f71a99c68c75068db6ecf not found: ID does not exist" containerID="6ab4fca4e442401fd536f44ca6cd6cc8a66f30b8211f71a99c68c75068db6ecf"
Jul 09 19:25:02.896349 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:02.896304    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ab4fca4e442401fd536f44ca6cd6cc8a66f30b8211f71a99c68c75068db6ecf"} err="failed to get container status \"6ab4fca4e442401fd536f44ca6cd6cc8a66f30b8211f71a99c68c75068db6ecf\": rpc error: code = NotFound desc = could not find container \"6ab4fca4e442401fd536f44ca6cd6cc8a66f30b8211f71a99c68c75068db6ecf\": container with ID starting with 6ab4fca4e442401fd536f44ca6cd6cc8a66f30b8211f71a99c68c75068db6ecf not found: ID does not exist"
Jul 09 19:25:02.905617 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:02.905594    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h"]
Jul 09 19:25:02.910101 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:02.910079    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-525b3638-6b7c588b4f-qgk4h"]
Jul 09 19:25:04.638206 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:04.638109    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eaa21532-6a76-44b7-8c31-2dfb489ef231" path="/var/lib/kubelet/pods/eaa21532-6a76-44b7-8c31-2dfb489ef231/volumes"
Jul 09 19:25:07.811794 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:07.811745    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:07.909890 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:07.909855    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:08.539147 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:08.539110    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:25:10.325534 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:10.325503    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:13.909977 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:13.909939    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:13.978724 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:13.978687    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:14.351800 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:14.351714    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:14.427574 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:14.427545    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:15.219696 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:15.219656    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:15.321370 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:15.321332    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:15.458787 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:15.458752    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz"]
Jul 09 19:25:15.459239 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:15.459224    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaa21532-6a76-44b7-8c31-2dfb489ef231" containerName="maas-api"
Jul 09 19:25:15.459288 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:15.459242    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaa21532-6a76-44b7-8c31-2dfb489ef231" containerName="maas-api"
Jul 09 19:25:15.459322 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:15.459310    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="eaa21532-6a76-44b7-8c31-2dfb489ef231" containerName="maas-api"
Jul 09 19:25:15.462378 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:15.462356    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz"
Jul 09 19:25:15.465495 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:15.465477    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 19:25:15.465495 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:15.465480    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 19:25:15.466883 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:15.466864    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-f5ef04a0-serving-cert\""
Jul 09 19:25:15.466883 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:15.466869    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dlwh6\""
Jul 09 19:25:15.475063 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:15.475007    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz"]
Jul 09 19:25:15.507391 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:15.507358    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:15.549732 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:15.549696    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8d9l\" (UniqueName: \"kubernetes.io/projected/75080d48-c8eb-4937-89f5-d8a089e92fb6-kube-api-access-w8d9l\") pod \"maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz\" (UID: \"75080d48-c8eb-4937-89f5-d8a089e92fb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz"
Jul 09 19:25:15.549732 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:15.549738    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75080d48-c8eb-4937-89f5-d8a089e92fb6-openshift-service-ca\") pod \"maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz\" (UID: \"75080d48-c8eb-4937-89f5-d8a089e92fb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz"
Jul 09 19:25:15.549952 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:15.549870    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75080d48-c8eb-4937-89f5-d8a089e92fb6-maas-api-tls\") pod \"maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz\" (UID: \"75080d48-c8eb-4937-89f5-d8a089e92fb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz"
Jul 09 19:25:15.650655 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:15.650619    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75080d48-c8eb-4937-89f5-d8a089e92fb6-maas-api-tls\") pod \"maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz\" (UID: \"75080d48-c8eb-4937-89f5-d8a089e92fb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz"
Jul 09 19:25:15.650795 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:15.650734    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8d9l\" (UniqueName: \"kubernetes.io/projected/75080d48-c8eb-4937-89f5-d8a089e92fb6-kube-api-access-w8d9l\") pod \"maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz\" (UID: \"75080d48-c8eb-4937-89f5-d8a089e92fb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz"
Jul 09 19:25:15.650795 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:15.650759    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75080d48-c8eb-4937-89f5-d8a089e92fb6-openshift-service-ca\") pod \"maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz\" (UID: \"75080d48-c8eb-4937-89f5-d8a089e92fb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz"
Jul 09 19:25:15.650795 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:25:15.650759    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-f5ef04a0-serving-cert: secret "maas-api-e2e-derive-f5ef04a0-serving-cert" not found
Jul 09 19:25:15.650933 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:25:15.650863    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75080d48-c8eb-4937-89f5-d8a089e92fb6-maas-api-tls podName:75080d48-c8eb-4937-89f5-d8a089e92fb6 nodeName:}" failed. No retries permitted until 2026-07-09 19:25:16.150841611 +0000 UTC m=+1534.535911875 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/75080d48-c8eb-4937-89f5-d8a089e92fb6-maas-api-tls") pod "maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz" (UID: "75080d48-c8eb-4937-89f5-d8a089e92fb6") : secret "maas-api-e2e-derive-f5ef04a0-serving-cert" not found
Jul 09 19:25:15.651418 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:15.651400    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75080d48-c8eb-4937-89f5-d8a089e92fb6-openshift-service-ca\") pod \"maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz\" (UID: \"75080d48-c8eb-4937-89f5-d8a089e92fb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz"
Jul 09 19:25:15.660736 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:15.660704    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8d9l\" (UniqueName: \"kubernetes.io/projected/75080d48-c8eb-4937-89f5-d8a089e92fb6-kube-api-access-w8d9l\") pod \"maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz\" (UID: \"75080d48-c8eb-4937-89f5-d8a089e92fb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz"
Jul 09 19:25:15.964126 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:15.964094    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:16.057171 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:16.057137    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:16.156097 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:16.156062    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75080d48-c8eb-4937-89f5-d8a089e92fb6-maas-api-tls\") pod \"maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz\" (UID: \"75080d48-c8eb-4937-89f5-d8a089e92fb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz"
Jul 09 19:25:16.156272 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:25:16.156205    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-f5ef04a0-serving-cert: secret "maas-api-e2e-derive-f5ef04a0-serving-cert" not found
Jul 09 19:25:16.156316 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:25:16.156276    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75080d48-c8eb-4937-89f5-d8a089e92fb6-maas-api-tls podName:75080d48-c8eb-4937-89f5-d8a089e92fb6 nodeName:}" failed. No retries permitted until 2026-07-09 19:25:17.156260406 +0000 UTC m=+1535.541330663 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/75080d48-c8eb-4937-89f5-d8a089e92fb6-maas-api-tls") pod "maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz" (UID: "75080d48-c8eb-4937-89f5-d8a089e92fb6") : secret "maas-api-e2e-derive-f5ef04a0-serving-cert" not found
Jul 09 19:25:16.261237 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:16.261125    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:17.165014 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:17.164964    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75080d48-c8eb-4937-89f5-d8a089e92fb6-maas-api-tls\") pod \"maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz\" (UID: \"75080d48-c8eb-4937-89f5-d8a089e92fb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz"
Jul 09 19:25:17.167480 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:17.167456    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75080d48-c8eb-4937-89f5-d8a089e92fb6-maas-api-tls\") pod \"maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz\" (UID: \"75080d48-c8eb-4937-89f5-d8a089e92fb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz"
Jul 09 19:25:17.273377 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:17.273334    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz"
Jul 09 19:25:17.413047 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:17.412698    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz"]
Jul 09 19:25:17.415583 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:25:17.415523    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75080d48_c8eb_4937_89f5_d8a089e92fb6.slice/crio-4aa0967029ea418c7f1adadc137f2a74ceb3e334443fdc44b3f3a3124236792e WatchSource:0}: Error finding container 4aa0967029ea418c7f1adadc137f2a74ceb3e334443fdc44b3f3a3124236792e: Status 404 returned error can't find the container with id 4aa0967029ea418c7f1adadc137f2a74ceb3e334443fdc44b3f3a3124236792e
Jul 09 19:25:17.554452 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:17.554424    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:17.962120 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:17.962085    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz" event={"ID":"75080d48-c8eb-4937-89f5-d8a089e92fb6","Type":"ContainerStarted","Data":"46fc87882e6e13d1d50ffe062ae0c854a5be59dc41dbe3b6993b01893bbf58b4"}
Jul 09 19:25:17.962282 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:17.962138    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz" event={"ID":"75080d48-c8eb-4937-89f5-d8a089e92fb6","Type":"ContainerStarted","Data":"4aa0967029ea418c7f1adadc137f2a74ceb3e334443fdc44b3f3a3124236792e"}
Jul 09 19:25:17.962282 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:17.962158    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz"
Jul 09 19:25:17.982803 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:17.982747    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz" podStartSLOduration=2.51488258 podStartE2EDuration="2.982730376s" totalImagesPullingTime="467.847796ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:25:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:25:17.980891987 +0000 UTC m=+1536.365962263" watchObservedRunningTime="2026-07-09 19:25:17.982730376 +0000 UTC m=+1536.367800651"
Jul 09 19:25:19.651408 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:19.651375    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:19.882323 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:19.882216    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:19.978530 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:19.978438    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:20.094213 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:20.094177    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz"]
Jul 09 19:25:20.094389 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:20.094371    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz" podUID="75080d48-c8eb-4937-89f5-d8a089e92fb6" containerName="maas-api" containerID="cri-o://46fc87882e6e13d1d50ffe062ae0c854a5be59dc41dbe3b6993b01893bbf58b4" gracePeriod=30
Jul 09 19:25:20.123329 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:20.123305    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:20.345785 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:20.345759    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz"
Jul 09 19:25:20.498043 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:20.498008    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75080d48-c8eb-4937-89f5-d8a089e92fb6-openshift-service-ca\") pod \"75080d48-c8eb-4937-89f5-d8a089e92fb6\" (UID: \"75080d48-c8eb-4937-89f5-d8a089e92fb6\") "
Jul 09 19:25:20.498206 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:20.498115    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8d9l\" (UniqueName: \"kubernetes.io/projected/75080d48-c8eb-4937-89f5-d8a089e92fb6-kube-api-access-w8d9l\") pod \"75080d48-c8eb-4937-89f5-d8a089e92fb6\" (UID: \"75080d48-c8eb-4937-89f5-d8a089e92fb6\") "
Jul 09 19:25:20.498257 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:20.498216    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75080d48-c8eb-4937-89f5-d8a089e92fb6-maas-api-tls\") pod \"75080d48-c8eb-4937-89f5-d8a089e92fb6\" (UID: \"75080d48-c8eb-4937-89f5-d8a089e92fb6\") "
Jul 09 19:25:20.498376 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:20.498352    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75080d48-c8eb-4937-89f5-d8a089e92fb6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "75080d48-c8eb-4937-89f5-d8a089e92fb6" (UID: "75080d48-c8eb-4937-89f5-d8a089e92fb6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:25:20.498524 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:20.498509    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75080d48-c8eb-4937-89f5-d8a089e92fb6-openshift-service-ca\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:25:20.500254 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:20.500228    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75080d48-c8eb-4937-89f5-d8a089e92fb6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "75080d48-c8eb-4937-89f5-d8a089e92fb6" (UID: "75080d48-c8eb-4937-89f5-d8a089e92fb6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:25:20.500341 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:20.500255    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75080d48-c8eb-4937-89f5-d8a089e92fb6-kube-api-access-w8d9l" (OuterVolumeSpecName: "kube-api-access-w8d9l") pod "75080d48-c8eb-4937-89f5-d8a089e92fb6" (UID: "75080d48-c8eb-4937-89f5-d8a089e92fb6"). InnerVolumeSpecName "kube-api-access-w8d9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:25:20.599736 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:20.599635    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8d9l\" (UniqueName: \"kubernetes.io/projected/75080d48-c8eb-4937-89f5-d8a089e92fb6-kube-api-access-w8d9l\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:25:20.599736 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:20.599672    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75080d48-c8eb-4937-89f5-d8a089e92fb6-maas-api-tls\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:25:20.977353 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:20.977317    2577 generic.go:356] "Generic (PLEG): container finished" podID="75080d48-c8eb-4937-89f5-d8a089e92fb6" containerID="46fc87882e6e13d1d50ffe062ae0c854a5be59dc41dbe3b6993b01893bbf58b4" exitCode=0
Jul 09 19:25:20.977862 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:20.977369    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz"
Jul 09 19:25:20.977862 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:20.977394    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz" event={"ID":"75080d48-c8eb-4937-89f5-d8a089e92fb6","Type":"ContainerDied","Data":"46fc87882e6e13d1d50ffe062ae0c854a5be59dc41dbe3b6993b01893bbf58b4"}
Jul 09 19:25:20.977862 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:20.977445    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz" event={"ID":"75080d48-c8eb-4937-89f5-d8a089e92fb6","Type":"ContainerDied","Data":"4aa0967029ea418c7f1adadc137f2a74ceb3e334443fdc44b3f3a3124236792e"}
Jul 09 19:25:20.977862 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:20.977466    2577 scope.go:117] "RemoveContainer" containerID="46fc87882e6e13d1d50ffe062ae0c854a5be59dc41dbe3b6993b01893bbf58b4"
Jul 09 19:25:20.986154 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:20.986136    2577 scope.go:117] "RemoveContainer" containerID="46fc87882e6e13d1d50ffe062ae0c854a5be59dc41dbe3b6993b01893bbf58b4"
Jul 09 19:25:20.986430 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:25:20.986412    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46fc87882e6e13d1d50ffe062ae0c854a5be59dc41dbe3b6993b01893bbf58b4\": container with ID starting with 46fc87882e6e13d1d50ffe062ae0c854a5be59dc41dbe3b6993b01893bbf58b4 not found: ID does not exist" containerID="46fc87882e6e13d1d50ffe062ae0c854a5be59dc41dbe3b6993b01893bbf58b4"
Jul 09 19:25:20.986493 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:20.986440    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46fc87882e6e13d1d50ffe062ae0c854a5be59dc41dbe3b6993b01893bbf58b4"} err="failed to get container status \"46fc87882e6e13d1d50ffe062ae0c854a5be59dc41dbe3b6993b01893bbf58b4\": rpc error: code = NotFound desc = could not find container \"46fc87882e6e13d1d50ffe062ae0c854a5be59dc41dbe3b6993b01893bbf58b4\": container with ID starting with 46fc87882e6e13d1d50ffe062ae0c854a5be59dc41dbe3b6993b01893bbf58b4 not found: ID does not exist"
Jul 09 19:25:20.997245 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:20.997220    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz"]
Jul 09 19:25:21.002098 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:21.002073    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f5ef04a0-57ccc89699-zr4zz"]
Jul 09 19:25:21.917738 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:21.917705    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:22.639037 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:22.638994    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75080d48-c8eb-4937-89f5-d8a089e92fb6" path="/var/lib/kubelet/pods/75080d48-c8eb-4937-89f5-d8a089e92fb6/volumes"
Jul 09 19:25:25.825853 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:25.825792    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:25.923144 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:25.923110    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:26.320770 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:26.320737    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:26.418708 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:26.418678    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:26.520108 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:26.520078    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:27.901851 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:27.901795    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:33.773703 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:33.773661    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:33.881013 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:33.880982    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:33.980267 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:33.980234    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:34.074906 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:34.074796    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:25:34.472764 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:25:34.472718    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:26:00.438669 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:26:00.438634    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:26:06.302714 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:26:06.302676    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:26:06.375885 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:26:06.375850    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:26:06.476939 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:26:06.476902    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:26:20.272804 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:26:20.272774    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:26:22.356042 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:26:22.356009    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:26:28.249314 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:26:28.249282    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:26:28.359618 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:26:28.359584    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:26:28.456550 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:26:28.456516    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:26:39.054753 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:26:39.054678    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:26:39.774156 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:26:39.774123    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:26:45.847199 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:26:45.847165    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:26:45.959138 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:26:45.959109    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:26:46.052695 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:26:46.052667    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:26:46.152408 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:26:46.152381    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:26:46.929831 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:26:46.929778    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:26:47.031796 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:26:47.031762    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:26:47.128388 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:26:47.128353    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:26:48.712712 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:26:48.712679    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:26:49.441671 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:26:49.441635    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:26:54.659387 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:26:54.659349    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:26:54.757935 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:26:54.757905    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:26:55.418253 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:26:55.418213    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:26:58.838802 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:26:58.838767    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:27:01.263086 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:01.263046    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:01.325723 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:01.325692    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:01.510895 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:01.510863    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:01.839545 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:01.839511    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:02.093710 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:02.093619    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:04.540090 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:04.540058    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:04.601432 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:04.601398    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-35930880-777c47b6b4-rdz87"]
Jul 09 19:27:04.601796 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:04.601783    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75080d48-c8eb-4937-89f5-d8a089e92fb6" containerName="maas-api"
Jul 09 19:27:04.601866 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:04.601799    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="75080d48-c8eb-4937-89f5-d8a089e92fb6" containerName="maas-api"
Jul 09 19:27:04.601905 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:04.601891    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="75080d48-c8eb-4937-89f5-d8a089e92fb6" containerName="maas-api"
Jul 09 19:27:04.605055 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:04.605035    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-35930880-777c47b6b4-rdz87"
Jul 09 19:27:04.608123 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:04.608107    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-35930880-serving-cert\""
Jul 09 19:27:04.608321 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:04.608308    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 19:27:04.609897 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:04.609882    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dlwh6\""
Jul 09 19:27:04.609946 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:04.609900    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 19:27:04.619964 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:04.619940    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-35930880-777c47b6b4-rdz87"]
Jul 09 19:27:04.664285 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:04.664249    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:04.704760 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:04.704729    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8262f\" (UniqueName: \"kubernetes.io/projected/360d1920-33fe-4a44-a5f2-1a56c3039ff0-kube-api-access-8262f\") pod \"maas-api-e2e-mt-35930880-777c47b6b4-rdz87\" (UID: \"360d1920-33fe-4a44-a5f2-1a56c3039ff0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-35930880-777c47b6b4-rdz87"
Jul 09 19:27:04.704896 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:04.704836    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/360d1920-33fe-4a44-a5f2-1a56c3039ff0-maas-api-tls\") pod \"maas-api-e2e-mt-35930880-777c47b6b4-rdz87\" (UID: \"360d1920-33fe-4a44-a5f2-1a56c3039ff0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-35930880-777c47b6b4-rdz87"
Jul 09 19:27:04.704896 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:04.704870    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/360d1920-33fe-4a44-a5f2-1a56c3039ff0-openshift-service-ca\") pod \"maas-api-e2e-mt-35930880-777c47b6b4-rdz87\" (UID: \"360d1920-33fe-4a44-a5f2-1a56c3039ff0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-35930880-777c47b6b4-rdz87"
Jul 09 19:27:04.784977 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:04.784949    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:04.806558 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:04.806465    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8262f\" (UniqueName: \"kubernetes.io/projected/360d1920-33fe-4a44-a5f2-1a56c3039ff0-kube-api-access-8262f\") pod \"maas-api-e2e-mt-35930880-777c47b6b4-rdz87\" (UID: \"360d1920-33fe-4a44-a5f2-1a56c3039ff0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-35930880-777c47b6b4-rdz87"
Jul 09 19:27:04.806558 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:04.806526    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/360d1920-33fe-4a44-a5f2-1a56c3039ff0-maas-api-tls\") pod \"maas-api-e2e-mt-35930880-777c47b6b4-rdz87\" (UID: \"360d1920-33fe-4a44-a5f2-1a56c3039ff0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-35930880-777c47b6b4-rdz87"
Jul 09 19:27:04.806558 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:04.806550    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/360d1920-33fe-4a44-a5f2-1a56c3039ff0-openshift-service-ca\") pod \"maas-api-e2e-mt-35930880-777c47b6b4-rdz87\" (UID: \"360d1920-33fe-4a44-a5f2-1a56c3039ff0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-35930880-777c47b6b4-rdz87"
Jul 09 19:27:04.807203 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:04.807179    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/360d1920-33fe-4a44-a5f2-1a56c3039ff0-openshift-service-ca\") pod \"maas-api-e2e-mt-35930880-777c47b6b4-rdz87\" (UID: \"360d1920-33fe-4a44-a5f2-1a56c3039ff0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-35930880-777c47b6b4-rdz87"
Jul 09 19:27:04.808969 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:04.808949    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/360d1920-33fe-4a44-a5f2-1a56c3039ff0-maas-api-tls\") pod \"maas-api-e2e-mt-35930880-777c47b6b4-rdz87\" (UID: \"360d1920-33fe-4a44-a5f2-1a56c3039ff0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-35930880-777c47b6b4-rdz87"
Jul 09 19:27:04.819796 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:04.819771    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8262f\" (UniqueName: \"kubernetes.io/projected/360d1920-33fe-4a44-a5f2-1a56c3039ff0-kube-api-access-8262f\") pod \"maas-api-e2e-mt-35930880-777c47b6b4-rdz87\" (UID: \"360d1920-33fe-4a44-a5f2-1a56c3039ff0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-35930880-777c47b6b4-rdz87"
Jul 09 19:27:04.915238 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:04.915202    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-35930880-777c47b6b4-rdz87"
Jul 09 19:27:04.979286 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:04.979236    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:05.051420 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:05.051396    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-35930880-777c47b6b4-rdz87"]
Jul 09 19:27:05.053234 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:27:05.053206    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod360d1920_33fe_4a44_a5f2_1a56c3039ff0.slice/crio-5285b237b18bb99909790af7ba0b36c974b0357c68f75282063dedf8f411503b WatchSource:0}: Error finding container 5285b237b18bb99909790af7ba0b36c974b0357c68f75282063dedf8f411503b: Status 404 returned error can't find the container with id 5285b237b18bb99909790af7ba0b36c974b0357c68f75282063dedf8f411503b
Jul 09 19:27:05.245002 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:05.244953    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:05.347943 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:05.347862    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:05.470642 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:05.470607    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-35930880-777c47b6b4-rdz87" event={"ID":"360d1920-33fe-4a44-a5f2-1a56c3039ff0","Type":"ContainerStarted","Data":"5285b237b18bb99909790af7ba0b36c974b0357c68f75282063dedf8f411503b"}
Jul 09 19:27:06.477199 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:06.477164    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-35930880-777c47b6b4-rdz87" event={"ID":"360d1920-33fe-4a44-a5f2-1a56c3039ff0","Type":"ContainerStarted","Data":"8eff7dcb725a1e45ec3fed56044e15c69a15e00a645758c9f188806018882f3e"}
Jul 09 19:27:06.477596 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:06.477276    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-35930880-777c47b6b4-rdz87"
Jul 09 19:27:06.495479 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:06.495428    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-35930880-777c47b6b4-rdz87" podStartSLOduration=2.039241124 podStartE2EDuration="2.49540717s" totalImagesPullingTime="456.166046ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:27:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:27:06.494755166 +0000 UTC m=+1644.879825446" watchObservedRunningTime="2026-07-09 19:27:06.49540717 +0000 UTC m=+1644.880477495"
Jul 09 19:27:09.038441 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:09.038407    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:09.887281 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:09.887248    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:27:10.776128 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:10.776098    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:12.488236 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:12.488207    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-35930880-777c47b6b4-rdz87"
Jul 09 19:27:16.103215 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:16.103179    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:16.202201 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:16.202170    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:16.542413 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:16.542384    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:16.887471 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:16.887444    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-35930880-777c47b6b4-rdz87"]
Jul 09 19:27:16.887651 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:16.887630    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-35930880-777c47b6b4-rdz87" podUID="360d1920-33fe-4a44-a5f2-1a56c3039ff0" containerName="maas-api" containerID="cri-o://8eff7dcb725a1e45ec3fed56044e15c69a15e00a645758c9f188806018882f3e" gracePeriod=30
Jul 09 19:27:16.942570 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:16.942541    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:17.020165 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:17.020130    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:17.142736 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:17.142673    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-35930880-777c47b6b4-rdz87"
Jul 09 19:27:17.226280 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:17.226252    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8262f\" (UniqueName: \"kubernetes.io/projected/360d1920-33fe-4a44-a5f2-1a56c3039ff0-kube-api-access-8262f\") pod \"360d1920-33fe-4a44-a5f2-1a56c3039ff0\" (UID: \"360d1920-33fe-4a44-a5f2-1a56c3039ff0\") "
Jul 09 19:27:17.226450 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:17.226298    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/360d1920-33fe-4a44-a5f2-1a56c3039ff0-maas-api-tls\") pod \"360d1920-33fe-4a44-a5f2-1a56c3039ff0\" (UID: \"360d1920-33fe-4a44-a5f2-1a56c3039ff0\") "
Jul 09 19:27:17.226450 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:17.226318    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/360d1920-33fe-4a44-a5f2-1a56c3039ff0-openshift-service-ca\") pod \"360d1920-33fe-4a44-a5f2-1a56c3039ff0\" (UID: \"360d1920-33fe-4a44-a5f2-1a56c3039ff0\") "
Jul 09 19:27:17.226761 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:17.226738    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/360d1920-33fe-4a44-a5f2-1a56c3039ff0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "360d1920-33fe-4a44-a5f2-1a56c3039ff0" (UID: "360d1920-33fe-4a44-a5f2-1a56c3039ff0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:27:17.228444 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:17.228424    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/360d1920-33fe-4a44-a5f2-1a56c3039ff0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "360d1920-33fe-4a44-a5f2-1a56c3039ff0" (UID: "360d1920-33fe-4a44-a5f2-1a56c3039ff0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:27:17.228550 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:17.228473    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/360d1920-33fe-4a44-a5f2-1a56c3039ff0-kube-api-access-8262f" (OuterVolumeSpecName: "kube-api-access-8262f") pod "360d1920-33fe-4a44-a5f2-1a56c3039ff0" (UID: "360d1920-33fe-4a44-a5f2-1a56c3039ff0"). InnerVolumeSpecName "kube-api-access-8262f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:27:17.327600 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:17.327566    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8262f\" (UniqueName: \"kubernetes.io/projected/360d1920-33fe-4a44-a5f2-1a56c3039ff0-kube-api-access-8262f\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:27:17.327600 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:17.327598    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/360d1920-33fe-4a44-a5f2-1a56c3039ff0-maas-api-tls\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:27:17.327600 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:17.327607    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/360d1920-33fe-4a44-a5f2-1a56c3039ff0-openshift-service-ca\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:27:17.531784 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:17.531691    2577 generic.go:356] "Generic (PLEG): container finished" podID="360d1920-33fe-4a44-a5f2-1a56c3039ff0" containerID="8eff7dcb725a1e45ec3fed56044e15c69a15e00a645758c9f188806018882f3e" exitCode=0
Jul 09 19:27:17.531784 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:17.531737    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-35930880-777c47b6b4-rdz87"
Jul 09 19:27:17.531784 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:17.531775    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-35930880-777c47b6b4-rdz87" event={"ID":"360d1920-33fe-4a44-a5f2-1a56c3039ff0","Type":"ContainerDied","Data":"8eff7dcb725a1e45ec3fed56044e15c69a15e00a645758c9f188806018882f3e"}
Jul 09 19:27:17.532039 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:17.531852    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-35930880-777c47b6b4-rdz87" event={"ID":"360d1920-33fe-4a44-a5f2-1a56c3039ff0","Type":"ContainerDied","Data":"5285b237b18bb99909790af7ba0b36c974b0357c68f75282063dedf8f411503b"}
Jul 09 19:27:17.532039 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:17.531884    2577 scope.go:117] "RemoveContainer" containerID="8eff7dcb725a1e45ec3fed56044e15c69a15e00a645758c9f188806018882f3e"
Jul 09 19:27:17.542314 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:17.542290    2577 scope.go:117] "RemoveContainer" containerID="8eff7dcb725a1e45ec3fed56044e15c69a15e00a645758c9f188806018882f3e"
Jul 09 19:27:17.542597 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:27:17.542579    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8eff7dcb725a1e45ec3fed56044e15c69a15e00a645758c9f188806018882f3e\": container with ID starting with 8eff7dcb725a1e45ec3fed56044e15c69a15e00a645758c9f188806018882f3e not found: ID does not exist" containerID="8eff7dcb725a1e45ec3fed56044e15c69a15e00a645758c9f188806018882f3e"
Jul 09 19:27:17.542666 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:17.542604    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eff7dcb725a1e45ec3fed56044e15c69a15e00a645758c9f188806018882f3e"} err="failed to get container status \"8eff7dcb725a1e45ec3fed56044e15c69a15e00a645758c9f188806018882f3e\": rpc error: code = NotFound desc = could not find container \"8eff7dcb725a1e45ec3fed56044e15c69a15e00a645758c9f188806018882f3e\": container with ID starting with 8eff7dcb725a1e45ec3fed56044e15c69a15e00a645758c9f188806018882f3e not found: ID does not exist"
Jul 09 19:27:17.555892 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:17.555857    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-35930880-777c47b6b4-rdz87"]
Jul 09 19:27:17.564570 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:17.564535    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-35930880-777c47b6b4-rdz87"]
Jul 09 19:27:18.639002 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:18.638971    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="360d1920-33fe-4a44-a5f2-1a56c3039ff0" path="/var/lib/kubelet/pods/360d1920-33fe-4a44-a5f2-1a56c3039ff0/volumes"
Jul 09 19:27:21.041831 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:21.041781    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:27:22.853549 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:22.853515    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:22.919389 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:22.919327    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:23.147584 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:23.147534    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:23.349901 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:23.349870    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:23.496755 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:23.496670    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:23.595943 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:23.595892    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:23.728324 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:23.728286    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:29.512012 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:29.511981    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:29.623040 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:29.623008    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:29.715085 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:29.715053    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:29.867752 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:29.867671    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:32.156960 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:32.156929    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:32.258378 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:32.258349    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:36.004043 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:36.004012    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:36.131454 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:36.131420    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:42.553212 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:42.553178    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:42.653058 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:42.653004    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:42.882601 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:42.882496    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:43.208471 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:43.208432    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:43.675284 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:43.675258    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:46.608769 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:46.608742    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:46.711180 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:46.711150    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r"]
Jul 09 19:27:46.711568 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:46.711554    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="360d1920-33fe-4a44-a5f2-1a56c3039ff0" containerName="maas-api"
Jul 09 19:27:46.711645 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:46.711570    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="360d1920-33fe-4a44-a5f2-1a56c3039ff0" containerName="maas-api"
Jul 09 19:27:46.711645 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:46.711639    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="360d1920-33fe-4a44-a5f2-1a56c3039ff0" containerName="maas-api"
Jul 09 19:27:46.714398 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:46.714381    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r"
Jul 09 19:27:46.721249 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:46.721212    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dlwh6\""
Jul 09 19:27:46.721402 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:46.721265    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 19:27:46.721402 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:46.721308    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-21ee0800-serving-cert\""
Jul 09 19:27:46.721593 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:46.721566    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 19:27:46.729039 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:46.729012    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:46.732178 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:46.732157    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r"]
Jul 09 19:27:46.810050 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:46.810013    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jstrf\" (UniqueName: \"kubernetes.io/projected/a7e95cc6-a791-4075-bd21-7a4c948f2d67-kube-api-access-jstrf\") pod \"maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r\" (UID: \"a7e95cc6-a791-4075-bd21-7a4c948f2d67\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r"
Jul 09 19:27:46.810232 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:46.810074    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7e95cc6-a791-4075-bd21-7a4c948f2d67-maas-api-tls\") pod \"maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r\" (UID: \"a7e95cc6-a791-4075-bd21-7a4c948f2d67\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r"
Jul 09 19:27:46.810232 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:46.810186    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7e95cc6-a791-4075-bd21-7a4c948f2d67-openshift-service-ca\") pod \"maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r\" (UID: \"a7e95cc6-a791-4075-bd21-7a4c948f2d67\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r"
Jul 09 19:27:46.816525 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:46.816500    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:46.911261 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:46.911225    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7e95cc6-a791-4075-bd21-7a4c948f2d67-openshift-service-ca\") pod \"maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r\" (UID: \"a7e95cc6-a791-4075-bd21-7a4c948f2d67\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r"
Jul 09 19:27:46.911459 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:46.911277    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jstrf\" (UniqueName: \"kubernetes.io/projected/a7e95cc6-a791-4075-bd21-7a4c948f2d67-kube-api-access-jstrf\") pod \"maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r\" (UID: \"a7e95cc6-a791-4075-bd21-7a4c948f2d67\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r"
Jul 09 19:27:46.911459 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:46.911317    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7e95cc6-a791-4075-bd21-7a4c948f2d67-maas-api-tls\") pod \"maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r\" (UID: \"a7e95cc6-a791-4075-bd21-7a4c948f2d67\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r"
Jul 09 19:27:46.911589 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:27:46.911490    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-21ee0800-serving-cert: secret "maas-api-e2e-mt-21ee0800-serving-cert" not found
Jul 09 19:27:46.911589 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:27:46.911543    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7e95cc6-a791-4075-bd21-7a4c948f2d67-maas-api-tls podName:a7e95cc6-a791-4075-bd21-7a4c948f2d67 nodeName:}" failed. No retries permitted until 2026-07-09 19:27:47.411526819 +0000 UTC m=+1685.796597073 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a7e95cc6-a791-4075-bd21-7a4c948f2d67-maas-api-tls") pod "maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r" (UID: "a7e95cc6-a791-4075-bd21-7a4c948f2d67") : secret "maas-api-e2e-mt-21ee0800-serving-cert" not found
Jul 09 19:27:46.911902 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:46.911882    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7e95cc6-a791-4075-bd21-7a4c948f2d67-openshift-service-ca\") pod \"maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r\" (UID: \"a7e95cc6-a791-4075-bd21-7a4c948f2d67\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r"
Jul 09 19:27:46.927359 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:46.927332    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jstrf\" (UniqueName: \"kubernetes.io/projected/a7e95cc6-a791-4075-bd21-7a4c948f2d67-kube-api-access-jstrf\") pod \"maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r\" (UID: \"a7e95cc6-a791-4075-bd21-7a4c948f2d67\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r"
Jul 09 19:27:47.143243 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:47.143213    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:47.417323 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:47.417290    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7e95cc6-a791-4075-bd21-7a4c948f2d67-maas-api-tls\") pod \"maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r\" (UID: \"a7e95cc6-a791-4075-bd21-7a4c948f2d67\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r"
Jul 09 19:27:47.419904 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:47.419877    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7e95cc6-a791-4075-bd21-7a4c948f2d67-maas-api-tls\") pod \"maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r\" (UID: \"a7e95cc6-a791-4075-bd21-7a4c948f2d67\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r"
Jul 09 19:27:47.467270 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:47.467242    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:47.564398 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:47.564367    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:47.631953 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:47.631893    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r"
Jul 09 19:27:47.774458 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:47.774434    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r"]
Jul 09 19:27:47.776958 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:27:47.776929    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7e95cc6_a791_4075_bd21_7a4c948f2d67.slice/crio-996f4ae38e772f41d98fb03fc256f811b05f80e91418e6a7d5f2d4484988365f WatchSource:0}: Error finding container 996f4ae38e772f41d98fb03fc256f811b05f80e91418e6a7d5f2d4484988365f: Status 404 returned error can't find the container with id 996f4ae38e772f41d98fb03fc256f811b05f80e91418e6a7d5f2d4484988365f
Jul 09 19:27:48.685217 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:48.685183    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r" event={"ID":"a7e95cc6-a791-4075-bd21-7a4c948f2d67","Type":"ContainerStarted","Data":"552ae4d2e4dc06d2a0fa23d7567ce896a1e32c3214f2e9906a19378c51cd63ca"}
Jul 09 19:27:48.685596 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:48.685238    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r" event={"ID":"a7e95cc6-a791-4075-bd21-7a4c948f2d67","Type":"ContainerStarted","Data":"996f4ae38e772f41d98fb03fc256f811b05f80e91418e6a7d5f2d4484988365f"}
Jul 09 19:27:48.685596 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:48.685266    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r"
Jul 09 19:27:48.707034 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:48.706986    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r" podStartSLOduration=2.192065828 podStartE2EDuration="2.706968353s" totalImagesPullingTime="514.902525ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:27:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:27:48.705829003 +0000 UTC m=+1687.090899272" watchObservedRunningTime="2026-07-09 19:27:48.706968353 +0000 UTC m=+1687.092038628"
Jul 09 19:27:51.096964 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:51.096926    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:27:53.543546 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:53.543515    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:27:54.695776 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:27:54.695746    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r"
Jul 09 19:28:06.639323 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:06.639237    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp"]
Jul 09 19:28:06.643063 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:06.643039    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp"
Jul 09 19:28:06.646413 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:06.646391    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-21ee0800\"/\"openshift-service-ca.crt\""
Jul 09 19:28:06.648080 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:06.648058    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-21ee0800\"/\"kube-root-ca.crt\""
Jul 09 19:28:06.648220 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:06.648085    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-21ee0800\"/\"default-dockercfg-ttxjk\""
Jul 09 19:28:06.648220 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:06.648175    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-21ee0800\"/\"e2e-lifecycle-model-21ee0800-kserve-self-signed-certs\""
Jul 09 19:28:06.650646 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:06.650411    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp"]
Jul 09 19:28:06.665502 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:06.665468    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:28:06.700563 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:06.700530    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ea593b4-7748-4699-a7d9-f066f8760036-home\") pod \"e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp\" (UID: \"5ea593b4-7748-4699-a7d9-f066f8760036\") " pod="ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp"
Jul 09 19:28:06.700709 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:06.700632    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ea593b4-7748-4699-a7d9-f066f8760036-model-cache\") pod \"e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp\" (UID: \"5ea593b4-7748-4699-a7d9-f066f8760036\") " pod="ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp"
Jul 09 19:28:06.700772 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:06.700729    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ea593b4-7748-4699-a7d9-f066f8760036-tls-certs\") pod \"e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp\" (UID: \"5ea593b4-7748-4699-a7d9-f066f8760036\") " pod="ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp"
Jul 09 19:28:06.700886 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:06.700867    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ea593b4-7748-4699-a7d9-f066f8760036-dshm\") pod \"e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp\" (UID: \"5ea593b4-7748-4699-a7d9-f066f8760036\") " pod="ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp"
Jul 09 19:28:06.700960 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:06.700937    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ea593b4-7748-4699-a7d9-f066f8760036-tmp-dir\") pod \"e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp\" (UID: \"5ea593b4-7748-4699-a7d9-f066f8760036\") " pod="ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp"
Jul 09 19:28:06.701020 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:06.700980    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dtkh\" (UniqueName: \"kubernetes.io/projected/5ea593b4-7748-4699-a7d9-f066f8760036-kube-api-access-2dtkh\") pod \"e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp\" (UID: \"5ea593b4-7748-4699-a7d9-f066f8760036\") " pod="ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp"
Jul 09 19:28:06.802205 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:06.802176    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ea593b4-7748-4699-a7d9-f066f8760036-dshm\") pod \"e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp\" (UID: \"5ea593b4-7748-4699-a7d9-f066f8760036\") " pod="ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp"
Jul 09 19:28:06.802205 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:06.802213    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ea593b4-7748-4699-a7d9-f066f8760036-tmp-dir\") pod \"e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp\" (UID: \"5ea593b4-7748-4699-a7d9-f066f8760036\") " pod="ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp"
Jul 09 19:28:06.802473 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:06.802247    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dtkh\" (UniqueName: \"kubernetes.io/projected/5ea593b4-7748-4699-a7d9-f066f8760036-kube-api-access-2dtkh\") pod \"e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp\" (UID: \"5ea593b4-7748-4699-a7d9-f066f8760036\") " pod="ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp"
Jul 09 19:28:06.802473 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:06.802315    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ea593b4-7748-4699-a7d9-f066f8760036-home\") pod \"e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp\" (UID: \"5ea593b4-7748-4699-a7d9-f066f8760036\") " pod="ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp"
Jul 09 19:28:06.802473 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:06.802348    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ea593b4-7748-4699-a7d9-f066f8760036-model-cache\") pod \"e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp\" (UID: \"5ea593b4-7748-4699-a7d9-f066f8760036\") " pod="ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp"
Jul 09 19:28:06.802473 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:06.802394    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ea593b4-7748-4699-a7d9-f066f8760036-tls-certs\") pod \"e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp\" (UID: \"5ea593b4-7748-4699-a7d9-f066f8760036\") " pod="ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp"
Jul 09 19:28:06.802696 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:06.802656    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ea593b4-7748-4699-a7d9-f066f8760036-tmp-dir\") pod \"e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp\" (UID: \"5ea593b4-7748-4699-a7d9-f066f8760036\") " pod="ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp"
Jul 09 19:28:06.802737 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:06.802713    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ea593b4-7748-4699-a7d9-f066f8760036-home\") pod \"e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp\" (UID: \"5ea593b4-7748-4699-a7d9-f066f8760036\") " pod="ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp"
Jul 09 19:28:06.802772 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:06.802746    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ea593b4-7748-4699-a7d9-f066f8760036-model-cache\") pod \"e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp\" (UID: \"5ea593b4-7748-4699-a7d9-f066f8760036\") " pod="ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp"
Jul 09 19:28:06.804650 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:06.804630    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ea593b4-7748-4699-a7d9-f066f8760036-dshm\") pod \"e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp\" (UID: \"5ea593b4-7748-4699-a7d9-f066f8760036\") " pod="ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp"
Jul 09 19:28:06.804718 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:06.804669    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ea593b4-7748-4699-a7d9-f066f8760036-tls-certs\") pod \"e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp\" (UID: \"5ea593b4-7748-4699-a7d9-f066f8760036\") " pod="ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp"
Jul 09 19:28:06.810639 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:06.810612    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dtkh\" (UniqueName: \"kubernetes.io/projected/5ea593b4-7748-4699-a7d9-f066f8760036-kube-api-access-2dtkh\") pod \"e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp\" (UID: \"5ea593b4-7748-4699-a7d9-f066f8760036\") " pod="ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp"
Jul 09 19:28:06.954125 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:06.954036    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp"
Jul 09 19:28:07.092766 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:07.092736    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp"]
Jul 09 19:28:07.094765 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:28:07.094729    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ea593b4_7748_4699_a7d9_f066f8760036.slice/crio-402afd796bb8649e9c45430fd9b8e242b1b5e2f32eaa423270a431acb6334b95 WatchSource:0}: Error finding container 402afd796bb8649e9c45430fd9b8e242b1b5e2f32eaa423270a431acb6334b95: Status 404 returned error can't find the container with id 402afd796bb8649e9c45430fd9b8e242b1b5e2f32eaa423270a431acb6334b95
Jul 09 19:28:07.779957 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:07.779923    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp" event={"ID":"5ea593b4-7748-4699-a7d9-f066f8760036","Type":"ContainerStarted","Data":"f7b296219f1a2750d1e0acc7e6f9c2d1fdb545dfe009920ebb726830261dee77"}
Jul 09 19:28:07.780345 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:07.779968    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp" event={"ID":"5ea593b4-7748-4699-a7d9-f066f8760036","Type":"ContainerStarted","Data":"402afd796bb8649e9c45430fd9b8e242b1b5e2f32eaa423270a431acb6334b95"}
Jul 09 19:28:07.801207 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:07.801153    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp" podStartSLOduration=1.8011380350000001 podStartE2EDuration="1.801138035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:28:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:28:07.799220594 +0000 UTC m=+1706.184290881" watchObservedRunningTime="2026-07-09 19:28:07.801138035 +0000 UTC m=+1706.186208309"
Jul 09 19:28:09.942481 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:09.942446    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:28:16.954741 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:16.954682    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp"
Jul 09 19:28:16.954741 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:16.954746    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp"
Jul 09 19:28:16.967448 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:16.967420    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp"
Jul 09 19:28:17.839942 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:17.839902    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp"
Jul 09 19:28:36.343367 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:36.343325    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:28:38.789393 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:38.789352    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:28:39.122201 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:39.122106    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r"]
Jul 09 19:28:39.122453 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:39.122419    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r" podUID="a7e95cc6-a791-4075-bd21-7a4c948f2d67" containerName="maas-api" containerID="cri-o://552ae4d2e4dc06d2a0fa23d7567ce896a1e32c3214f2e9906a19378c51cd63ca" gracePeriod=30
Jul 09 19:28:39.152215 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:39.152188    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:28:39.365755 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:39.365732    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r"
Jul 09 19:28:39.422924 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:39.422885    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7e95cc6-a791-4075-bd21-7a4c948f2d67-openshift-service-ca\") pod \"a7e95cc6-a791-4075-bd21-7a4c948f2d67\" (UID: \"a7e95cc6-a791-4075-bd21-7a4c948f2d67\") "
Jul 09 19:28:39.423118 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:39.422957    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jstrf\" (UniqueName: \"kubernetes.io/projected/a7e95cc6-a791-4075-bd21-7a4c948f2d67-kube-api-access-jstrf\") pod \"a7e95cc6-a791-4075-bd21-7a4c948f2d67\" (UID: \"a7e95cc6-a791-4075-bd21-7a4c948f2d67\") "
Jul 09 19:28:39.423118 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:39.422997    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7e95cc6-a791-4075-bd21-7a4c948f2d67-maas-api-tls\") pod \"a7e95cc6-a791-4075-bd21-7a4c948f2d67\" (UID: \"a7e95cc6-a791-4075-bd21-7a4c948f2d67\") "
Jul 09 19:28:39.423270 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:39.423238    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7e95cc6-a791-4075-bd21-7a4c948f2d67-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a7e95cc6-a791-4075-bd21-7a4c948f2d67" (UID: "a7e95cc6-a791-4075-bd21-7a4c948f2d67"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:28:39.425095 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:39.425061    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7e95cc6-a791-4075-bd21-7a4c948f2d67-kube-api-access-jstrf" (OuterVolumeSpecName: "kube-api-access-jstrf") pod "a7e95cc6-a791-4075-bd21-7a4c948f2d67" (UID: "a7e95cc6-a791-4075-bd21-7a4c948f2d67"). InnerVolumeSpecName "kube-api-access-jstrf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:28:39.425095 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:39.425074    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7e95cc6-a791-4075-bd21-7a4c948f2d67-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a7e95cc6-a791-4075-bd21-7a4c948f2d67" (UID: "a7e95cc6-a791-4075-bd21-7a4c948f2d67"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:28:39.523896 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:39.523852    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jstrf\" (UniqueName: \"kubernetes.io/projected/a7e95cc6-a791-4075-bd21-7a4c948f2d67-kube-api-access-jstrf\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:28:39.523896 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:39.523891    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7e95cc6-a791-4075-bd21-7a4c948f2d67-maas-api-tls\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:28:39.523896 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:39.523902    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7e95cc6-a791-4075-bd21-7a4c948f2d67-openshift-service-ca\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:28:39.937317 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:39.937283    2577 generic.go:356] "Generic (PLEG): container finished" podID="a7e95cc6-a791-4075-bd21-7a4c948f2d67" containerID="552ae4d2e4dc06d2a0fa23d7567ce896a1e32c3214f2e9906a19378c51cd63ca" exitCode=0
Jul 09 19:28:39.937715 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:39.937328    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r"
Jul 09 19:28:39.937715 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:39.937367    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r" event={"ID":"a7e95cc6-a791-4075-bd21-7a4c948f2d67","Type":"ContainerDied","Data":"552ae4d2e4dc06d2a0fa23d7567ce896a1e32c3214f2e9906a19378c51cd63ca"}
Jul 09 19:28:39.937715 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:39.937419    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r" event={"ID":"a7e95cc6-a791-4075-bd21-7a4c948f2d67","Type":"ContainerDied","Data":"996f4ae38e772f41d98fb03fc256f811b05f80e91418e6a7d5f2d4484988365f"}
Jul 09 19:28:39.937715 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:39.937441    2577 scope.go:117] "RemoveContainer" containerID="552ae4d2e4dc06d2a0fa23d7567ce896a1e32c3214f2e9906a19378c51cd63ca"
Jul 09 19:28:39.948136 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:39.948107    2577 scope.go:117] "RemoveContainer" containerID="552ae4d2e4dc06d2a0fa23d7567ce896a1e32c3214f2e9906a19378c51cd63ca"
Jul 09 19:28:39.951382 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:28:39.951353    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"552ae4d2e4dc06d2a0fa23d7567ce896a1e32c3214f2e9906a19378c51cd63ca\": container with ID starting with 552ae4d2e4dc06d2a0fa23d7567ce896a1e32c3214f2e9906a19378c51cd63ca not found: ID does not exist" containerID="552ae4d2e4dc06d2a0fa23d7567ce896a1e32c3214f2e9906a19378c51cd63ca"
Jul 09 19:28:39.951509 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:39.951484    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"552ae4d2e4dc06d2a0fa23d7567ce896a1e32c3214f2e9906a19378c51cd63ca"} err="failed to get container status \"552ae4d2e4dc06d2a0fa23d7567ce896a1e32c3214f2e9906a19378c51cd63ca\": rpc error: code = NotFound desc = could not find container \"552ae4d2e4dc06d2a0fa23d7567ce896a1e32c3214f2e9906a19378c51cd63ca\": container with ID starting with 552ae4d2e4dc06d2a0fa23d7567ce896a1e32c3214f2e9906a19378c51cd63ca not found: ID does not exist"
Jul 09 19:28:39.961480 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:39.961452    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r"]
Jul 09 19:28:39.965788 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:39.965760    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-21ee0800-645fdbd44f-7v94r"]
Jul 09 19:28:40.638737 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:40.638702    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7e95cc6-a791-4075-bd21-7a4c948f2d67" path="/var/lib/kubelet/pods/a7e95cc6-a791-4075-bd21-7a4c948f2d67/volumes"
Jul 09 19:28:44.902556 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:44.902521    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:28:49.867596 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:49.867562    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp"]
Jul 09 19:28:49.924938 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:49.924908    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:28:50.940282 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:28:50.940248    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:29:04.888605 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:04.888541    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp" podUID="5ea593b4-7748-4699-a7d9-f066f8760036" containerName="main" containerID="cri-o://f7b296219f1a2750d1e0acc7e6f9c2d1fdb545dfe009920ebb726830261dee77" gracePeriod=45
Jul 09 19:29:05.061332 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:05.061299    2577 generic.go:356] "Generic (PLEG): container finished" podID="5ea593b4-7748-4699-a7d9-f066f8760036" containerID="f7b296219f1a2750d1e0acc7e6f9c2d1fdb545dfe009920ebb726830261dee77" exitCode=0
Jul 09 19:29:05.061467 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:05.061368    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp" event={"ID":"5ea593b4-7748-4699-a7d9-f066f8760036","Type":"ContainerDied","Data":"f7b296219f1a2750d1e0acc7e6f9c2d1fdb545dfe009920ebb726830261dee77"}
Jul 09 19:29:05.141733 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:05.141673    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp"
Jul 09 19:29:05.275940 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:05.275905    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ea593b4-7748-4699-a7d9-f066f8760036-dshm\") pod \"5ea593b4-7748-4699-a7d9-f066f8760036\" (UID: \"5ea593b4-7748-4699-a7d9-f066f8760036\") "
Jul 09 19:29:05.276110 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:05.275964    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ea593b4-7748-4699-a7d9-f066f8760036-home\") pod \"5ea593b4-7748-4699-a7d9-f066f8760036\" (UID: \"5ea593b4-7748-4699-a7d9-f066f8760036\") "
Jul 09 19:29:05.276110 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:05.275993    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ea593b4-7748-4699-a7d9-f066f8760036-tmp-dir\") pod \"5ea593b4-7748-4699-a7d9-f066f8760036\" (UID: \"5ea593b4-7748-4699-a7d9-f066f8760036\") "
Jul 09 19:29:05.276110 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:05.276044    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ea593b4-7748-4699-a7d9-f066f8760036-model-cache\") pod \"5ea593b4-7748-4699-a7d9-f066f8760036\" (UID: \"5ea593b4-7748-4699-a7d9-f066f8760036\") "
Jul 09 19:29:05.276110 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:05.276095    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ea593b4-7748-4699-a7d9-f066f8760036-tls-certs\") pod \"5ea593b4-7748-4699-a7d9-f066f8760036\" (UID: \"5ea593b4-7748-4699-a7d9-f066f8760036\") "
Jul 09 19:29:05.276341 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:05.276127    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dtkh\" (UniqueName: \"kubernetes.io/projected/5ea593b4-7748-4699-a7d9-f066f8760036-kube-api-access-2dtkh\") pod \"5ea593b4-7748-4699-a7d9-f066f8760036\" (UID: \"5ea593b4-7748-4699-a7d9-f066f8760036\") "
Jul 09 19:29:05.276341 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:05.276292    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ea593b4-7748-4699-a7d9-f066f8760036-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5ea593b4-7748-4699-a7d9-f066f8760036" (UID: "5ea593b4-7748-4699-a7d9-f066f8760036"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:29:05.276341 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:05.276304    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ea593b4-7748-4699-a7d9-f066f8760036-home" (OuterVolumeSpecName: "home") pod "5ea593b4-7748-4699-a7d9-f066f8760036" (UID: "5ea593b4-7748-4699-a7d9-f066f8760036"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:29:05.276463 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:05.276336    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ea593b4-7748-4699-a7d9-f066f8760036-model-cache" (OuterVolumeSpecName: "model-cache") pod "5ea593b4-7748-4699-a7d9-f066f8760036" (UID: "5ea593b4-7748-4699-a7d9-f066f8760036"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:29:05.276506 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:05.276482    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ea593b4-7748-4699-a7d9-f066f8760036-home\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:29:05.276545 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:05.276508    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ea593b4-7748-4699-a7d9-f066f8760036-tmp-dir\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:29:05.276545 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:05.276522    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ea593b4-7748-4699-a7d9-f066f8760036-model-cache\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:29:05.278145 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:05.278123    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ea593b4-7748-4699-a7d9-f066f8760036-dshm" (OuterVolumeSpecName: "dshm") pod "5ea593b4-7748-4699-a7d9-f066f8760036" (UID: "5ea593b4-7748-4699-a7d9-f066f8760036"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:29:05.278249 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:05.278182    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ea593b4-7748-4699-a7d9-f066f8760036-kube-api-access-2dtkh" (OuterVolumeSpecName: "kube-api-access-2dtkh") pod "5ea593b4-7748-4699-a7d9-f066f8760036" (UID: "5ea593b4-7748-4699-a7d9-f066f8760036"). InnerVolumeSpecName "kube-api-access-2dtkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:29:05.278317 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:05.278240    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ea593b4-7748-4699-a7d9-f066f8760036-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5ea593b4-7748-4699-a7d9-f066f8760036" (UID: "5ea593b4-7748-4699-a7d9-f066f8760036"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:29:05.377609 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:05.377563    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ea593b4-7748-4699-a7d9-f066f8760036-tls-certs\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:29:05.377609 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:05.377599    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dtkh\" (UniqueName: \"kubernetes.io/projected/5ea593b4-7748-4699-a7d9-f066f8760036-kube-api-access-2dtkh\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:29:05.377609 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:05.377609    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ea593b4-7748-4699-a7d9-f066f8760036-dshm\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:29:06.067676 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:06.067649    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp"
Jul 09 19:29:06.067676 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:06.067659    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp" event={"ID":"5ea593b4-7748-4699-a7d9-f066f8760036","Type":"ContainerDied","Data":"402afd796bb8649e9c45430fd9b8e242b1b5e2f32eaa423270a431acb6334b95"}
Jul 09 19:29:06.068183 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:06.067707    2577 scope.go:117] "RemoveContainer" containerID="f7b296219f1a2750d1e0acc7e6f9c2d1fdb545dfe009920ebb726830261dee77"
Jul 09 19:29:06.090892 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:06.090862    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp"]
Jul 09 19:29:06.095034 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:06.095005    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-21ee0800/e2e-lifecycle-model-21ee0800-kserve-f67b9d879-25kgp"]
Jul 09 19:29:06.642962 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:06.642926    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ea593b4-7748-4699-a7d9-f066f8760036" path="/var/lib/kubelet/pods/5ea593b4-7748-4699-a7d9-f066f8760036/volumes"
Jul 09 19:29:27.521677 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:27.521643    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:29:27.736779 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:27.736741    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:29:29.741775 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:29.741735    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:29:33.467551 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:33.467467    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:29:47.883853 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:47.883778    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:29:47.953554 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:47.953509    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:29:48.196194 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:48.196165    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:29:48.405963 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:48.405931    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:29:49.477264 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:49.477228    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:29:49.574731 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:49.574699    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:29:49.675734 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:49.675686    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:29:50.430240 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:50.430213    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:29:50.525943 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:50.525914    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:29:50.630384 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:50.630357    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:29:51.973051 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:51.973025    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:29:52.242837 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:52.242731    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:29:58.060562 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:58.060529    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:29:58.133703 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:58.133675    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:29:58.716612 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:29:58.716567    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:30:00.142292 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:00.142261    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727090-bbbd8"]
Jul 09 19:30:00.142699 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:00.142644    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7e95cc6-a791-4075-bd21-7a4c948f2d67" containerName="maas-api"
Jul 09 19:30:00.142699 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:00.142657    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7e95cc6-a791-4075-bd21-7a4c948f2d67" containerName="maas-api"
Jul 09 19:30:00.142699 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:00.142668    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ea593b4-7748-4699-a7d9-f066f8760036" containerName="main"
Jul 09 19:30:00.142699 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:00.142674    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ea593b4-7748-4699-a7d9-f066f8760036" containerName="main"
Jul 09 19:30:00.142848 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:00.142749    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7e95cc6-a791-4075-bd21-7a4c948f2d67" containerName="maas-api"
Jul 09 19:30:00.142848 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:00.142758    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ea593b4-7748-4699-a7d9-f066f8760036" containerName="main"
Jul 09 19:30:00.145790 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:00.145772    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727090-bbbd8"
Jul 09 19:30:00.149241 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:00.149219    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 19:30:00.149379 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:00.149262    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 19:30:00.149379 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:00.149287    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dlwh6\""
Jul 09 19:30:00.154801 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:00.154781    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727090-bbbd8"]
Jul 09 19:30:00.298172 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:00.298129    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b2bj\" (UniqueName: \"kubernetes.io/projected/4e040ba8-613a-45f9-9c0f-d19693524d53-kube-api-access-2b2bj\") pod \"maas-api-key-cleanup-29727090-bbbd8\" (UID: \"4e040ba8-613a-45f9-9c0f-d19693524d53\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727090-bbbd8"
Jul 09 19:30:00.399248 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:00.399151    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b2bj\" (UniqueName: \"kubernetes.io/projected/4e040ba8-613a-45f9-9c0f-d19693524d53-kube-api-access-2b2bj\") pod \"maas-api-key-cleanup-29727090-bbbd8\" (UID: \"4e040ba8-613a-45f9-9c0f-d19693524d53\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727090-bbbd8"
Jul 09 19:30:00.408638 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:00.408615    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b2bj\" (UniqueName: \"kubernetes.io/projected/4e040ba8-613a-45f9-9c0f-d19693524d53-kube-api-access-2b2bj\") pod \"maas-api-key-cleanup-29727090-bbbd8\" (UID: \"4e040ba8-613a-45f9-9c0f-d19693524d53\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727090-bbbd8"
Jul 09 19:30:00.457525 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:00.457491    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727090-bbbd8"
Jul 09 19:30:00.595310 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:00.595287    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727090-bbbd8"]
Jul 09 19:30:00.597653 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:30:00.597620    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e040ba8_613a_45f9_9c0f_d19693524d53.slice/crio-02993ee907946f708c81edddf99a586646f030874efe116f557eada560e37945 WatchSource:0}: Error finding container 02993ee907946f708c81edddf99a586646f030874efe116f557eada560e37945: Status 404 returned error can't find the container with id 02993ee907946f708c81edddf99a586646f030874efe116f557eada560e37945
Jul 09 19:30:01.340765 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:01.340731    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727090-bbbd8" event={"ID":"4e040ba8-613a-45f9-9c0f-d19693524d53","Type":"ContainerStarted","Data":"d1e55d55a9042c41183e5523bcfc0591050c449d8bb18a9faee65ef107b86ee7"}
Jul 09 19:30:01.340765 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:01.340787    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727090-bbbd8" event={"ID":"4e040ba8-613a-45f9-9c0f-d19693524d53","Type":"ContainerStarted","Data":"02993ee907946f708c81edddf99a586646f030874efe116f557eada560e37945"}
Jul 09 19:30:01.358555 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:01.358482    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727090-bbbd8" podStartSLOduration=1.358464956 podStartE2EDuration="1.358464956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:30:01.356693327 +0000 UTC m=+1819.741763614" watchObservedRunningTime="2026-07-09 19:30:01.358464956 +0000 UTC m=+1819.743535230"
Jul 09 19:30:04.559057 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:04.559022    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:30:04.634482 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:04.634448    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:30:04.777264 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:04.777233    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:30:06.749145 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:06.749107    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:30:15.316409 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:15.316377    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:30:15.653462 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:15.653431    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:30:36.600462 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:36.600424    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:30:42.294693 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:42.294657    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:30:42.361071 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:42.361041    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:30:42.653478 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:42.653447    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:30:42.963572 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:42.963493    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:30:43.062730 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:43.062702    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:30:46.463428 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:46.463399    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:30:46.558463 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:46.558432    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg"]
Jul 09 19:30:46.560342 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:46.560317    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:30:46.561788 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:46.561770    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg"
Jul 09 19:30:46.565428 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:46.565406    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-84e6af-serving-cert\""
Jul 09 19:30:46.574225 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:46.574188    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg"]
Jul 09 19:30:46.626022 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:46.625989    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a78dfb43-3c47-4628-9ecd-86140e0b4b17-openshift-service-ca\") pod \"maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg\" (UID: \"a78dfb43-3c47-4628-9ecd-86140e0b4b17\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg"
Jul 09 19:30:46.626200 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:46.626069    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a78dfb43-3c47-4628-9ecd-86140e0b4b17-maas-api-tls\") pod \"maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg\" (UID: \"a78dfb43-3c47-4628-9ecd-86140e0b4b17\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg"
Jul 09 19:30:46.626200 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:46.626117    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nlvp\" (UniqueName: \"kubernetes.io/projected/a78dfb43-3c47-4628-9ecd-86140e0b4b17-kube-api-access-2nlvp\") pod \"maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg\" (UID: \"a78dfb43-3c47-4628-9ecd-86140e0b4b17\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg"
Jul 09 19:30:46.645801 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:46.645771    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:30:46.726715 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:46.726636    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a78dfb43-3c47-4628-9ecd-86140e0b4b17-maas-api-tls\") pod \"maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg\" (UID: \"a78dfb43-3c47-4628-9ecd-86140e0b4b17\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg"
Jul 09 19:30:46.726715 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:46.726684    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nlvp\" (UniqueName: \"kubernetes.io/projected/a78dfb43-3c47-4628-9ecd-86140e0b4b17-kube-api-access-2nlvp\") pod \"maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg\" (UID: \"a78dfb43-3c47-4628-9ecd-86140e0b4b17\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg"
Jul 09 19:30:46.726916 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:46.726760    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a78dfb43-3c47-4628-9ecd-86140e0b4b17-openshift-service-ca\") pod \"maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg\" (UID: \"a78dfb43-3c47-4628-9ecd-86140e0b4b17\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg"
Jul 09 19:30:46.727395 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:46.727375    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a78dfb43-3c47-4628-9ecd-86140e0b4b17-openshift-service-ca\") pod \"maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg\" (UID: \"a78dfb43-3c47-4628-9ecd-86140e0b4b17\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg"
Jul 09 19:30:46.729066 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:46.729049    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a78dfb43-3c47-4628-9ecd-86140e0b4b17-maas-api-tls\") pod \"maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg\" (UID: \"a78dfb43-3c47-4628-9ecd-86140e0b4b17\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg"
Jul 09 19:30:46.740000 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:46.739965    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nlvp\" (UniqueName: \"kubernetes.io/projected/a78dfb43-3c47-4628-9ecd-86140e0b4b17-kube-api-access-2nlvp\") pod \"maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg\" (UID: \"a78dfb43-3c47-4628-9ecd-86140e0b4b17\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg"
Jul 09 19:30:46.797298 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:46.797264    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:30:46.872624 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:46.872589    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg"
Jul 09 19:30:47.025946 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:47.025868    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg"]
Jul 09 19:30:47.029151 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:30:47.029123    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda78dfb43_3c47_4628_9ecd_86140e0b4b17.slice/crio-20eb4af24fd2082b20914faee7134386bcb8cd3b633b842cc6817e72fd32ee09 WatchSource:0}: Error finding container 20eb4af24fd2082b20914faee7134386bcb8cd3b633b842cc6817e72fd32ee09: Status 404 returned error can't find the container with id 20eb4af24fd2082b20914faee7134386bcb8cd3b633b842cc6817e72fd32ee09
Jul 09 19:30:47.030474 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:47.030456    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 19:30:47.075475 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:47.075445    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:30:47.174726 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:47.174696    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:30:47.564198 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:47.564167    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg" event={"ID":"a78dfb43-3c47-4628-9ecd-86140e0b4b17","Type":"ContainerStarted","Data":"20eb4af24fd2082b20914faee7134386bcb8cd3b633b842cc6817e72fd32ee09"}
Jul 09 19:30:48.570297 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:48.570259    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg" event={"ID":"a78dfb43-3c47-4628-9ecd-86140e0b4b17","Type":"ContainerStarted","Data":"91e7407ee5777357b1fb4d6eb790c8a4d88bd487dcf387e57add07d91597c70e"}
Jul 09 19:30:48.570707 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:48.570543    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg"
Jul 09 19:30:48.593070 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:48.593021    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg" podStartSLOduration=2.115486591 podStartE2EDuration="2.593005558s" totalImagesPullingTime="477.518967ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:30:48.591837216 +0000 UTC m=+1866.976907488" watchObservedRunningTime="2026-07-09 19:30:48.593005558 +0000 UTC m=+1866.978075834"
Jul 09 19:30:50.869926 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:50.869894    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:30:51.193003 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:51.192969    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:30:51.512671 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:51.512584    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:30:51.681459 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:51.681425    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:30:54.340962 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:54.340931    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:30:54.447733 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:54.447695    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:30:54.447936 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:54.447913    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7"]
Jul 09 19:30:54.452095 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:54.452076    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7"
Jul 09 19:30:54.456075 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:54.456056    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-4038d9-serving-cert\""
Jul 09 19:30:54.461130 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:54.461110    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7"]
Jul 09 19:30:54.493682 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:54.493647    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37d86111-a17e-4748-b8c7-f1b1b4e26c93-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7\" (UID: \"37d86111-a17e-4748-b8c7-f1b1b4e26c93\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7"
Jul 09 19:30:54.493869 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:54.493696    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37d86111-a17e-4748-b8c7-f1b1b4e26c93-maas-api-tls\") pod \"maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7\" (UID: \"37d86111-a17e-4748-b8c7-f1b1b4e26c93\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7"
Jul 09 19:30:54.493869 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:54.493767    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dzsg\" (UniqueName: \"kubernetes.io/projected/37d86111-a17e-4748-b8c7-f1b1b4e26c93-kube-api-access-7dzsg\") pod \"maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7\" (UID: \"37d86111-a17e-4748-b8c7-f1b1b4e26c93\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7"
Jul 09 19:30:54.539448 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:54.539411    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:30:54.583861 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:54.583793    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg"
Jul 09 19:30:54.594852 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:54.594748    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37d86111-a17e-4748-b8c7-f1b1b4e26c93-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7\" (UID: \"37d86111-a17e-4748-b8c7-f1b1b4e26c93\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7"
Jul 09 19:30:54.594852 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:54.594830    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37d86111-a17e-4748-b8c7-f1b1b4e26c93-maas-api-tls\") pod \"maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7\" (UID: \"37d86111-a17e-4748-b8c7-f1b1b4e26c93\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7"
Jul 09 19:30:54.595043 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:54.594884    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dzsg\" (UniqueName: \"kubernetes.io/projected/37d86111-a17e-4748-b8c7-f1b1b4e26c93-kube-api-access-7dzsg\") pod \"maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7\" (UID: \"37d86111-a17e-4748-b8c7-f1b1b4e26c93\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7"
Jul 09 19:30:54.595043 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:30:54.594966    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-4038d9-serving-cert: secret "maas-api-e2e-inf-b-4038d9-serving-cert" not found
Jul 09 19:30:54.595132 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:30:54.595046    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37d86111-a17e-4748-b8c7-f1b1b4e26c93-maas-api-tls podName:37d86111-a17e-4748-b8c7-f1b1b4e26c93 nodeName:}" failed. No retries permitted until 2026-07-09 19:30:55.095024563 +0000 UTC m=+1873.480094833 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/37d86111-a17e-4748-b8c7-f1b1b4e26c93-maas-api-tls") pod "maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7" (UID: "37d86111-a17e-4748-b8c7-f1b1b4e26c93") : secret "maas-api-e2e-inf-b-4038d9-serving-cert" not found
Jul 09 19:30:54.595436 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:54.595418    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37d86111-a17e-4748-b8c7-f1b1b4e26c93-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7\" (UID: \"37d86111-a17e-4748-b8c7-f1b1b4e26c93\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7"
Jul 09 19:30:54.612770 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:54.612730    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dzsg\" (UniqueName: \"kubernetes.io/projected/37d86111-a17e-4748-b8c7-f1b1b4e26c93-kube-api-access-7dzsg\") pod \"maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7\" (UID: \"37d86111-a17e-4748-b8c7-f1b1b4e26c93\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7"
Jul 09 19:30:54.655051 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:54.655016    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:30:54.707759 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:54.707730    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:30:54.977832 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:54.977782    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:30:55.077638 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:55.077606    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:30:55.099849 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:55.099805    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37d86111-a17e-4748-b8c7-f1b1b4e26c93-maas-api-tls\") pod \"maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7\" (UID: \"37d86111-a17e-4748-b8c7-f1b1b4e26c93\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7"
Jul 09 19:30:55.102282 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:55.102258    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37d86111-a17e-4748-b8c7-f1b1b4e26c93-maas-api-tls\") pod \"maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7\" (UID: \"37d86111-a17e-4748-b8c7-f1b1b4e26c93\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7"
Jul 09 19:30:55.364187 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:55.364074    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7"
Jul 09 19:30:55.501885 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:55.501861    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7"]
Jul 09 19:30:55.504230 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:30:55.504197    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37d86111_a17e_4748_b8c7_f1b1b4e26c93.slice/crio-2ef5ef64de32ff51f841a734a5543e26fc8c39ea67e724d59825691f4645142f WatchSource:0}: Error finding container 2ef5ef64de32ff51f841a734a5543e26fc8c39ea67e724d59825691f4645142f: Status 404 returned error can't find the container with id 2ef5ef64de32ff51f841a734a5543e26fc8c39ea67e724d59825691f4645142f
Jul 09 19:30:55.610073 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:55.610041    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7" event={"ID":"37d86111-a17e-4748-b8c7-f1b1b4e26c93","Type":"ContainerStarted","Data":"2ef5ef64de32ff51f841a734a5543e26fc8c39ea67e724d59825691f4645142f"}
Jul 09 19:30:56.616517 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:56.616477    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7" event={"ID":"37d86111-a17e-4748-b8c7-f1b1b4e26c93","Type":"ContainerStarted","Data":"8dff8d03fa8291dcd238df08889dd7133625e2ec2ed5c6c789514d2c19fdced4"}
Jul 09 19:30:56.616904 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:56.616655    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7"
Jul 09 19:30:56.639150 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:56.639090    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7" podStartSLOduration=2.27651844 podStartE2EDuration="2.639073769s" totalImagesPullingTime="362.555329ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:30:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:30:56.637322705 +0000 UTC m=+1875.022392983" watchObservedRunningTime="2026-07-09 19:30:56.639073769 +0000 UTC m=+1875.024144044"
Jul 09 19:30:58.858080 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:30:58.858040    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:31:00.010900 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:00.010865    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727090-bbbd8"]
Jul 09 19:31:00.011292 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:00.011105    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727090-bbbd8" podUID="4e040ba8-613a-45f9-9c0f-d19693524d53" containerName="cleanup" containerID="cri-o://d1e55d55a9042c41183e5523bcfc0591050c449d8bb18a9faee65ef107b86ee7" gracePeriod=30
Jul 09 19:31:02.627022 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:02.626995    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7"
Jul 09 19:31:05.140022 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:05.139935    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:31:07.785170 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:07.785139    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:31:07.888795 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:07.888760    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:31:15.650624 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:15.650587    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6"]
Jul 09 19:31:15.653910 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:15.653887    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6"
Jul 09 19:31:15.657086 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:15.657063    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-84e6af\"/\"openshift-service-ca.crt\""
Jul 09 19:31:15.658824 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:15.658790    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-84e6af\"/\"test-model-84e6af-kserve-self-signed-certs\""
Jul 09 19:31:15.658931 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:15.658857    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-84e6af\"/\"kube-root-ca.crt\""
Jul 09 19:31:15.658931 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:15.658903    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-84e6af\"/\"default-dockercfg-9mdbz\""
Jul 09 19:31:15.663986 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:15.663963    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6"]
Jul 09 19:31:15.754244 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:15.754209    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:31:15.803421 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:15.803385    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed2428d1-32d4-403f-a729-df388e939f80-home\") pod \"test-model-84e6af-kserve-6dddbdd5d9-82vh6\" (UID: \"ed2428d1-32d4-403f-a729-df388e939f80\") " pod="ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6"
Jul 09 19:31:15.803598 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:15.803431    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed2428d1-32d4-403f-a729-df388e939f80-tmp-dir\") pod \"test-model-84e6af-kserve-6dddbdd5d9-82vh6\" (UID: \"ed2428d1-32d4-403f-a729-df388e939f80\") " pod="ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6"
Jul 09 19:31:15.803598 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:15.803505    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed2428d1-32d4-403f-a729-df388e939f80-dshm\") pod \"test-model-84e6af-kserve-6dddbdd5d9-82vh6\" (UID: \"ed2428d1-32d4-403f-a729-df388e939f80\") " pod="ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6"
Jul 09 19:31:15.803598 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:15.803545    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed2428d1-32d4-403f-a729-df388e939f80-tls-certs\") pod \"test-model-84e6af-kserve-6dddbdd5d9-82vh6\" (UID: \"ed2428d1-32d4-403f-a729-df388e939f80\") " pod="ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6"
Jul 09 19:31:15.803598 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:15.803589    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp5sr\" (UniqueName: \"kubernetes.io/projected/ed2428d1-32d4-403f-a729-df388e939f80-kube-api-access-mp5sr\") pod \"test-model-84e6af-kserve-6dddbdd5d9-82vh6\" (UID: \"ed2428d1-32d4-403f-a729-df388e939f80\") " pod="ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6"
Jul 09 19:31:15.803787 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:15.803642    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed2428d1-32d4-403f-a729-df388e939f80-model-cache\") pod \"test-model-84e6af-kserve-6dddbdd5d9-82vh6\" (UID: \"ed2428d1-32d4-403f-a729-df388e939f80\") " pod="ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6"
Jul 09 19:31:15.854974 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:15.854945    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:31:15.904412 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:15.904314    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed2428d1-32d4-403f-a729-df388e939f80-tmp-dir\") pod \"test-model-84e6af-kserve-6dddbdd5d9-82vh6\" (UID: \"ed2428d1-32d4-403f-a729-df388e939f80\") " pod="ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6"
Jul 09 19:31:15.904412 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:15.904380    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed2428d1-32d4-403f-a729-df388e939f80-dshm\") pod \"test-model-84e6af-kserve-6dddbdd5d9-82vh6\" (UID: \"ed2428d1-32d4-403f-a729-df388e939f80\") " pod="ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6"
Jul 09 19:31:15.904412 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:15.904413    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed2428d1-32d4-403f-a729-df388e939f80-tls-certs\") pod \"test-model-84e6af-kserve-6dddbdd5d9-82vh6\" (UID: \"ed2428d1-32d4-403f-a729-df388e939f80\") " pod="ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6"
Jul 09 19:31:15.904696 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:15.904481    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp5sr\" (UniqueName: \"kubernetes.io/projected/ed2428d1-32d4-403f-a729-df388e939f80-kube-api-access-mp5sr\") pod \"test-model-84e6af-kserve-6dddbdd5d9-82vh6\" (UID: \"ed2428d1-32d4-403f-a729-df388e939f80\") " pod="ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6"
Jul 09 19:31:15.904696 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:15.904551    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed2428d1-32d4-403f-a729-df388e939f80-model-cache\") pod \"test-model-84e6af-kserve-6dddbdd5d9-82vh6\" (UID: \"ed2428d1-32d4-403f-a729-df388e939f80\") " pod="ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6"
Jul 09 19:31:15.904696 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:15.904595    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed2428d1-32d4-403f-a729-df388e939f80-home\") pod \"test-model-84e6af-kserve-6dddbdd5d9-82vh6\" (UID: \"ed2428d1-32d4-403f-a729-df388e939f80\") " pod="ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6"
Jul 09 19:31:15.904877 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:15.904714    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed2428d1-32d4-403f-a729-df388e939f80-tmp-dir\") pod \"test-model-84e6af-kserve-6dddbdd5d9-82vh6\" (UID: \"ed2428d1-32d4-403f-a729-df388e939f80\") " pod="ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6"
Jul 09 19:31:15.904988 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:15.904966    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed2428d1-32d4-403f-a729-df388e939f80-model-cache\") pod \"test-model-84e6af-kserve-6dddbdd5d9-82vh6\" (UID: \"ed2428d1-32d4-403f-a729-df388e939f80\") " pod="ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6"
Jul 09 19:31:15.905048 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:15.904994    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed2428d1-32d4-403f-a729-df388e939f80-home\") pod \"test-model-84e6af-kserve-6dddbdd5d9-82vh6\" (UID: \"ed2428d1-32d4-403f-a729-df388e939f80\") " pod="ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6"
Jul 09 19:31:15.906734 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:15.906715    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed2428d1-32d4-403f-a729-df388e939f80-dshm\") pod \"test-model-84e6af-kserve-6dddbdd5d9-82vh6\" (UID: \"ed2428d1-32d4-403f-a729-df388e939f80\") " pod="ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6"
Jul 09 19:31:15.907041 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:15.907023    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed2428d1-32d4-403f-a729-df388e939f80-tls-certs\") pod \"test-model-84e6af-kserve-6dddbdd5d9-82vh6\" (UID: \"ed2428d1-32d4-403f-a729-df388e939f80\") " pod="ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6"
Jul 09 19:31:15.913603 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:15.913579    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp5sr\" (UniqueName: \"kubernetes.io/projected/ed2428d1-32d4-403f-a729-df388e939f80-kube-api-access-mp5sr\") pod \"test-model-84e6af-kserve-6dddbdd5d9-82vh6\" (UID: \"ed2428d1-32d4-403f-a729-df388e939f80\") " pod="ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6"
Jul 09 19:31:15.963463 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:15.963426    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6"
Jul 09 19:31:16.111842 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:16.111796    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6"]
Jul 09 19:31:16.113423 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:31:16.113396    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded2428d1_32d4_403f_a729_df388e939f80.slice/crio-04a84680d0535f7ce26e0e91a5bde0a04156a944a4410e73e09cefe8768cd093 WatchSource:0}: Error finding container 04a84680d0535f7ce26e0e91a5bde0a04156a944a4410e73e09cefe8768cd093: Status 404 returned error can't find the container with id 04a84680d0535f7ce26e0e91a5bde0a04156a944a4410e73e09cefe8768cd093
Jul 09 19:31:16.719168 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:16.719135    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6" event={"ID":"ed2428d1-32d4-403f-a729-df388e939f80","Type":"ContainerStarted","Data":"03d7abd328a51cad33d4ee56bcce2b20c3eb439c9ce62bbb141e989d12645b68"}
Jul 09 19:31:16.719599 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:16.719175    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6" event={"ID":"ed2428d1-32d4-403f-a729-df388e939f80","Type":"ContainerStarted","Data":"04a84680d0535f7ce26e0e91a5bde0a04156a944a4410e73e09cefe8768cd093"}
Jul 09 19:31:16.738525 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:16.738459    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6" podStartSLOduration=1.738444131 podStartE2EDuration="1.738444131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:31:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:31:16.738298531 +0000 UTC m=+1895.123368808" watchObservedRunningTime="2026-07-09 19:31:16.738444131 +0000 UTC m=+1895.123514422"
Jul 09 19:31:19.146049 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:19.146016    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:31:25.964493 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:25.964453    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6"
Jul 09 19:31:25.964493 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:25.964506    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6"
Jul 09 19:31:25.977241 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:25.977209    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6"
Jul 09 19:31:26.780001 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:26.779972    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6"
Jul 09 19:31:30.185749 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:30.185722    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727090-bbbd8"
Jul 09 19:31:30.347531 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:30.347438    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2b2bj\" (UniqueName: \"kubernetes.io/projected/4e040ba8-613a-45f9-9c0f-d19693524d53-kube-api-access-2b2bj\") pod \"4e040ba8-613a-45f9-9c0f-d19693524d53\" (UID: \"4e040ba8-613a-45f9-9c0f-d19693524d53\") "
Jul 09 19:31:30.349456 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:30.349431    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e040ba8-613a-45f9-9c0f-d19693524d53-kube-api-access-2b2bj" (OuterVolumeSpecName: "kube-api-access-2b2bj") pod "4e040ba8-613a-45f9-9c0f-d19693524d53" (UID: "4e040ba8-613a-45f9-9c0f-d19693524d53"). InnerVolumeSpecName "kube-api-access-2b2bj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:31:30.448748 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:30.448713    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2b2bj\" (UniqueName: \"kubernetes.io/projected/4e040ba8-613a-45f9-9c0f-d19693524d53-kube-api-access-2b2bj\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:31:30.452077 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:30.452043    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:31:30.788871 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:30.788834    2577 generic.go:356] "Generic (PLEG): container finished" podID="4e040ba8-613a-45f9-9c0f-d19693524d53" containerID="d1e55d55a9042c41183e5523bcfc0591050c449d8bb18a9faee65ef107b86ee7" exitCode=137
Jul 09 19:31:30.789035 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:30.788897    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727090-bbbd8"
Jul 09 19:31:30.789035 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:30.788913    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727090-bbbd8" event={"ID":"4e040ba8-613a-45f9-9c0f-d19693524d53","Type":"ContainerDied","Data":"d1e55d55a9042c41183e5523bcfc0591050c449d8bb18a9faee65ef107b86ee7"}
Jul 09 19:31:30.789035 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:30.788965    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727090-bbbd8" event={"ID":"4e040ba8-613a-45f9-9c0f-d19693524d53","Type":"ContainerDied","Data":"02993ee907946f708c81edddf99a586646f030874efe116f557eada560e37945"}
Jul 09 19:31:30.789035 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:30.788988    2577 scope.go:117] "RemoveContainer" containerID="d1e55d55a9042c41183e5523bcfc0591050c449d8bb18a9faee65ef107b86ee7"
Jul 09 19:31:30.797780 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:30.797760    2577 scope.go:117] "RemoveContainer" containerID="d1e55d55a9042c41183e5523bcfc0591050c449d8bb18a9faee65ef107b86ee7"
Jul 09 19:31:30.798128 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:31:30.798102    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1e55d55a9042c41183e5523bcfc0591050c449d8bb18a9faee65ef107b86ee7\": container with ID starting with d1e55d55a9042c41183e5523bcfc0591050c449d8bb18a9faee65ef107b86ee7 not found: ID does not exist" containerID="d1e55d55a9042c41183e5523bcfc0591050c449d8bb18a9faee65ef107b86ee7"
Jul 09 19:31:30.798187 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:30.798133    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1e55d55a9042c41183e5523bcfc0591050c449d8bb18a9faee65ef107b86ee7"} err="failed to get container status \"d1e55d55a9042c41183e5523bcfc0591050c449d8bb18a9faee65ef107b86ee7\": rpc error: code = NotFound desc = could not find container \"d1e55d55a9042c41183e5523bcfc0591050c449d8bb18a9faee65ef107b86ee7\": container with ID starting with d1e55d55a9042c41183e5523bcfc0591050c449d8bb18a9faee65ef107b86ee7 not found: ID does not exist"
Jul 09 19:31:30.808886 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:30.808859    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727090-bbbd8"]
Jul 09 19:31:30.814294 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:30.814271    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727090-bbbd8"]
Jul 09 19:31:32.638910 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:32.638879    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e040ba8-613a-45f9-9c0f-d19693524d53" path="/var/lib/kubelet/pods/4e040ba8-613a-45f9-9c0f-d19693524d53/volumes"
Jul 09 19:31:49.687687 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:49.687652    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:31:50.417308 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:50.417271    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:31:55.047078 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:31:55.047045    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:32:07.539931 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:07.539894    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6"]
Jul 09 19:32:07.565540 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:07.565507    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:32:08.493562 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:08.493516    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:32:08.643646 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:08.643618    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:32:09.095521 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:09.095492    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:32:09.217766 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:09.217738    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:32:09.318001 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:09.317969    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:32:09.457125 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:09.457093    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg"]
Jul 09 19:32:09.457351 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:09.457328    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg" podUID="a78dfb43-3c47-4628-9ecd-86140e0b4b17" containerName="maas-api" containerID="cri-o://91e7407ee5777357b1fb4d6eb790c8a4d88bd487dcf387e57add07d91597c70e" gracePeriod=30
Jul 09 19:32:09.479198 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:09.479175    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:32:09.578293 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:09.578251    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg" podUID="a78dfb43-3c47-4628-9ecd-86140e0b4b17" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.45:8443/health\": dial tcp 10.134.0.45:8443: connect: connection refused"
Jul 09 19:32:09.715078 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:09.715015    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg"
Jul 09 19:32:09.737261 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:09.737231    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nlvp\" (UniqueName: \"kubernetes.io/projected/a78dfb43-3c47-4628-9ecd-86140e0b4b17-kube-api-access-2nlvp\") pod \"a78dfb43-3c47-4628-9ecd-86140e0b4b17\" (UID: \"a78dfb43-3c47-4628-9ecd-86140e0b4b17\") "
Jul 09 19:32:09.737459 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:09.737359    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a78dfb43-3c47-4628-9ecd-86140e0b4b17-maas-api-tls\") pod \"a78dfb43-3c47-4628-9ecd-86140e0b4b17\" (UID: \"a78dfb43-3c47-4628-9ecd-86140e0b4b17\") "
Jul 09 19:32:09.737524 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:09.737456    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a78dfb43-3c47-4628-9ecd-86140e0b4b17-openshift-service-ca\") pod \"a78dfb43-3c47-4628-9ecd-86140e0b4b17\" (UID: \"a78dfb43-3c47-4628-9ecd-86140e0b4b17\") "
Jul 09 19:32:09.737877 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:09.737845    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a78dfb43-3c47-4628-9ecd-86140e0b4b17-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a78dfb43-3c47-4628-9ecd-86140e0b4b17" (UID: "a78dfb43-3c47-4628-9ecd-86140e0b4b17"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:32:09.739572 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:09.739537    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a78dfb43-3c47-4628-9ecd-86140e0b4b17-kube-api-access-2nlvp" (OuterVolumeSpecName: "kube-api-access-2nlvp") pod "a78dfb43-3c47-4628-9ecd-86140e0b4b17" (UID: "a78dfb43-3c47-4628-9ecd-86140e0b4b17"). InnerVolumeSpecName "kube-api-access-2nlvp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:32:09.739712 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:09.739666    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a78dfb43-3c47-4628-9ecd-86140e0b4b17-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a78dfb43-3c47-4628-9ecd-86140e0b4b17" (UID: "a78dfb43-3c47-4628-9ecd-86140e0b4b17"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:32:09.839009 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:09.838972    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a78dfb43-3c47-4628-9ecd-86140e0b4b17-openshift-service-ca\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:32:09.839009 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:09.839002    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nlvp\" (UniqueName: \"kubernetes.io/projected/a78dfb43-3c47-4628-9ecd-86140e0b4b17-kube-api-access-2nlvp\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:32:09.839009 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:09.839012    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a78dfb43-3c47-4628-9ecd-86140e0b4b17-maas-api-tls\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:32:09.989597 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:09.989505    2577 generic.go:356] "Generic (PLEG): container finished" podID="a78dfb43-3c47-4628-9ecd-86140e0b4b17" containerID="91e7407ee5777357b1fb4d6eb790c8a4d88bd487dcf387e57add07d91597c70e" exitCode=0
Jul 09 19:32:09.989597 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:09.989551    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg"
Jul 09 19:32:09.989844 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:09.989595    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg" event={"ID":"a78dfb43-3c47-4628-9ecd-86140e0b4b17","Type":"ContainerDied","Data":"91e7407ee5777357b1fb4d6eb790c8a4d88bd487dcf387e57add07d91597c70e"}
Jul 09 19:32:09.989844 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:09.989650    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg" event={"ID":"a78dfb43-3c47-4628-9ecd-86140e0b4b17","Type":"ContainerDied","Data":"20eb4af24fd2082b20914faee7134386bcb8cd3b633b842cc6817e72fd32ee09"}
Jul 09 19:32:09.989844 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:09.989675    2577 scope.go:117] "RemoveContainer" containerID="91e7407ee5777357b1fb4d6eb790c8a4d88bd487dcf387e57add07d91597c70e"
Jul 09 19:32:09.998889 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:09.998869    2577 scope.go:117] "RemoveContainer" containerID="91e7407ee5777357b1fb4d6eb790c8a4d88bd487dcf387e57add07d91597c70e"
Jul 09 19:32:09.999147 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:32:09.999129    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91e7407ee5777357b1fb4d6eb790c8a4d88bd487dcf387e57add07d91597c70e\": container with ID starting with 91e7407ee5777357b1fb4d6eb790c8a4d88bd487dcf387e57add07d91597c70e not found: ID does not exist" containerID="91e7407ee5777357b1fb4d6eb790c8a4d88bd487dcf387e57add07d91597c70e"
Jul 09 19:32:09.999194 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:09.999157    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91e7407ee5777357b1fb4d6eb790c8a4d88bd487dcf387e57add07d91597c70e"} err="failed to get container status \"91e7407ee5777357b1fb4d6eb790c8a4d88bd487dcf387e57add07d91597c70e\": rpc error: code = NotFound desc = could not find container \"91e7407ee5777357b1fb4d6eb790c8a4d88bd487dcf387e57add07d91597c70e\": container with ID starting with 91e7407ee5777357b1fb4d6eb790c8a4d88bd487dcf387e57add07d91597c70e not found: ID does not exist"
Jul 09 19:32:10.017147 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:10.017115    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg"]
Jul 09 19:32:10.021152 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:10.021128    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-84e6af-6b9c76689b-mntsg"]
Jul 09 19:32:10.638900 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:10.638851    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a78dfb43-3c47-4628-9ecd-86140e0b4b17" path="/var/lib/kubelet/pods/a78dfb43-3c47-4628-9ecd-86140e0b4b17/volumes"
Jul 09 19:32:13.738404 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:13.738365    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:32:14.172289 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:14.172257    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:32:15.656445 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:15.656412    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:32:22.561551 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:22.561500    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6" podUID="ed2428d1-32d4-403f-a729-df388e939f80" containerName="main" containerID="cri-o://03d7abd328a51cad33d4ee56bcce2b20c3eb439c9ce62bbb141e989d12645b68" gracePeriod=45
Jul 09 19:32:22.815256 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:22.815195    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6"
Jul 09 19:32:22.865035 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:22.865006    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed2428d1-32d4-403f-a729-df388e939f80-dshm\") pod \"ed2428d1-32d4-403f-a729-df388e939f80\" (UID: \"ed2428d1-32d4-403f-a729-df388e939f80\") "
Jul 09 19:32:22.865227 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:22.865046    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed2428d1-32d4-403f-a729-df388e939f80-tmp-dir\") pod \"ed2428d1-32d4-403f-a729-df388e939f80\" (UID: \"ed2428d1-32d4-403f-a729-df388e939f80\") "
Jul 09 19:32:22.865227 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:22.865085    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed2428d1-32d4-403f-a729-df388e939f80-tls-certs\") pod \"ed2428d1-32d4-403f-a729-df388e939f80\" (UID: \"ed2428d1-32d4-403f-a729-df388e939f80\") "
Jul 09 19:32:22.865227 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:22.865107    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mp5sr\" (UniqueName: \"kubernetes.io/projected/ed2428d1-32d4-403f-a729-df388e939f80-kube-api-access-mp5sr\") pod \"ed2428d1-32d4-403f-a729-df388e939f80\" (UID: \"ed2428d1-32d4-403f-a729-df388e939f80\") "
Jul 09 19:32:22.865227 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:22.865135    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed2428d1-32d4-403f-a729-df388e939f80-model-cache\") pod \"ed2428d1-32d4-403f-a729-df388e939f80\" (UID: \"ed2428d1-32d4-403f-a729-df388e939f80\") "
Jul 09 19:32:22.865227 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:22.865210    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed2428d1-32d4-403f-a729-df388e939f80-home\") pod \"ed2428d1-32d4-403f-a729-df388e939f80\" (UID: \"ed2428d1-32d4-403f-a729-df388e939f80\") "
Jul 09 19:32:22.865472 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:22.865419    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed2428d1-32d4-403f-a729-df388e939f80-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ed2428d1-32d4-403f-a729-df388e939f80" (UID: "ed2428d1-32d4-403f-a729-df388e939f80"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:32:22.865516 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:22.865492    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed2428d1-32d4-403f-a729-df388e939f80-model-cache" (OuterVolumeSpecName: "model-cache") pod "ed2428d1-32d4-403f-a729-df388e939f80" (UID: "ed2428d1-32d4-403f-a729-df388e939f80"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:32:22.865516 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:22.865503    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed2428d1-32d4-403f-a729-df388e939f80-home" (OuterVolumeSpecName: "home") pod "ed2428d1-32d4-403f-a729-df388e939f80" (UID: "ed2428d1-32d4-403f-a729-df388e939f80"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:32:22.865602 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:22.865572    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed2428d1-32d4-403f-a729-df388e939f80-tmp-dir\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:32:22.865602 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:22.865589    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed2428d1-32d4-403f-a729-df388e939f80-model-cache\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:32:22.865602 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:22.865601    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed2428d1-32d4-403f-a729-df388e939f80-home\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:32:22.867407 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:22.867382    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed2428d1-32d4-403f-a729-df388e939f80-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ed2428d1-32d4-403f-a729-df388e939f80" (UID: "ed2428d1-32d4-403f-a729-df388e939f80"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:32:22.867603 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:22.867584    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed2428d1-32d4-403f-a729-df388e939f80-dshm" (OuterVolumeSpecName: "dshm") pod "ed2428d1-32d4-403f-a729-df388e939f80" (UID: "ed2428d1-32d4-403f-a729-df388e939f80"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:32:22.867663 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:22.867601    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed2428d1-32d4-403f-a729-df388e939f80-kube-api-access-mp5sr" (OuterVolumeSpecName: "kube-api-access-mp5sr") pod "ed2428d1-32d4-403f-a729-df388e939f80" (UID: "ed2428d1-32d4-403f-a729-df388e939f80"). InnerVolumeSpecName "kube-api-access-mp5sr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:32:22.966246 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:22.966197    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed2428d1-32d4-403f-a729-df388e939f80-dshm\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:32:22.966246 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:22.966240    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed2428d1-32d4-403f-a729-df388e939f80-tls-certs\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:32:22.966246 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:22.966254    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mp5sr\" (UniqueName: \"kubernetes.io/projected/ed2428d1-32d4-403f-a729-df388e939f80-kube-api-access-mp5sr\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:32:23.055557 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:23.055519    2577 generic.go:356] "Generic (PLEG): container finished" podID="ed2428d1-32d4-403f-a729-df388e939f80" containerID="03d7abd328a51cad33d4ee56bcce2b20c3eb439c9ce62bbb141e989d12645b68" exitCode=0
Jul 09 19:32:23.055751 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:23.055561    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6"
Jul 09 19:32:23.055751 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:23.055594    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6" event={"ID":"ed2428d1-32d4-403f-a729-df388e939f80","Type":"ContainerDied","Data":"03d7abd328a51cad33d4ee56bcce2b20c3eb439c9ce62bbb141e989d12645b68"}
Jul 09 19:32:23.055751 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:23.055636    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6" event={"ID":"ed2428d1-32d4-403f-a729-df388e939f80","Type":"ContainerDied","Data":"04a84680d0535f7ce26e0e91a5bde0a04156a944a4410e73e09cefe8768cd093"}
Jul 09 19:32:23.055751 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:23.055655    2577 scope.go:117] "RemoveContainer" containerID="03d7abd328a51cad33d4ee56bcce2b20c3eb439c9ce62bbb141e989d12645b68"
Jul 09 19:32:23.064712 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:23.064693    2577 scope.go:117] "RemoveContainer" containerID="03d7abd328a51cad33d4ee56bcce2b20c3eb439c9ce62bbb141e989d12645b68"
Jul 09 19:32:23.065013 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:32:23.064994    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03d7abd328a51cad33d4ee56bcce2b20c3eb439c9ce62bbb141e989d12645b68\": container with ID starting with 03d7abd328a51cad33d4ee56bcce2b20c3eb439c9ce62bbb141e989d12645b68 not found: ID does not exist" containerID="03d7abd328a51cad33d4ee56bcce2b20c3eb439c9ce62bbb141e989d12645b68"
Jul 09 19:32:23.065072 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:23.065022    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03d7abd328a51cad33d4ee56bcce2b20c3eb439c9ce62bbb141e989d12645b68"} err="failed to get container status \"03d7abd328a51cad33d4ee56bcce2b20c3eb439c9ce62bbb141e989d12645b68\": rpc error: code = NotFound desc = could not find container \"03d7abd328a51cad33d4ee56bcce2b20c3eb439c9ce62bbb141e989d12645b68\": container with ID starting with 03d7abd328a51cad33d4ee56bcce2b20c3eb439c9ce62bbb141e989d12645b68 not found: ID does not exist"
Jul 09 19:32:23.085032 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:23.084915    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6"]
Jul 09 19:32:23.087781 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:23.087753    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-84e6af/test-model-84e6af-kserve-6dddbdd5d9-82vh6"]
Jul 09 19:32:24.638250 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:24.638217    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed2428d1-32d4-403f-a729-df388e939f80" path="/var/lib/kubelet/pods/ed2428d1-32d4-403f-a729-df388e939f80/volumes"
Jul 09 19:32:43.255252 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:43.255216    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:32:43.355936 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:43.355904    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:32:51.063362 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:51.063330    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:32:51.329133 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:51.329042    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:32:51.557291 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:51.557256    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:32:51.712611 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:51.712579    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:32:52.120899 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:52.120799    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:32:52.263370 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:52.263332    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:32:52.364863 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:52.364826    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:32:52.495193 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:52.495156    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7"]
Jul 09 19:32:52.495449 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:52.495423    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7" podUID="37d86111-a17e-4748-b8c7-f1b1b4e26c93" containerName="maas-api" containerID="cri-o://8dff8d03fa8291dcd238df08889dd7133625e2ec2ed5c6c789514d2c19fdced4" gracePeriod=30
Jul 09 19:32:52.530832 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:52.530782    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:32:52.622681 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:52.622635    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7" podUID="37d86111-a17e-4748-b8c7-f1b1b4e26c93" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.46:8443/health\": dial tcp 10.134.0.46:8443: connect: connection refused"
Jul 09 19:32:53.745987 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:53.745959    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7"
Jul 09 19:32:53.857159 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:53.857071    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37d86111-a17e-4748-b8c7-f1b1b4e26c93-maas-api-tls\") pod \"37d86111-a17e-4748-b8c7-f1b1b4e26c93\" (UID: \"37d86111-a17e-4748-b8c7-f1b1b4e26c93\") "
Jul 09 19:32:53.857341 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:53.857168    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37d86111-a17e-4748-b8c7-f1b1b4e26c93-openshift-service-ca\") pod \"37d86111-a17e-4748-b8c7-f1b1b4e26c93\" (UID: \"37d86111-a17e-4748-b8c7-f1b1b4e26c93\") "
Jul 09 19:32:53.857341 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:53.857188    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dzsg\" (UniqueName: \"kubernetes.io/projected/37d86111-a17e-4748-b8c7-f1b1b4e26c93-kube-api-access-7dzsg\") pod \"37d86111-a17e-4748-b8c7-f1b1b4e26c93\" (UID: \"37d86111-a17e-4748-b8c7-f1b1b4e26c93\") "
Jul 09 19:32:53.857537 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:53.857502    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37d86111-a17e-4748-b8c7-f1b1b4e26c93-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "37d86111-a17e-4748-b8c7-f1b1b4e26c93" (UID: "37d86111-a17e-4748-b8c7-f1b1b4e26c93"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:32:53.859263 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:53.859234    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37d86111-a17e-4748-b8c7-f1b1b4e26c93-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "37d86111-a17e-4748-b8c7-f1b1b4e26c93" (UID: "37d86111-a17e-4748-b8c7-f1b1b4e26c93"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:32:53.859263 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:53.859252    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37d86111-a17e-4748-b8c7-f1b1b4e26c93-kube-api-access-7dzsg" (OuterVolumeSpecName: "kube-api-access-7dzsg") pod "37d86111-a17e-4748-b8c7-f1b1b4e26c93" (UID: "37d86111-a17e-4748-b8c7-f1b1b4e26c93"). InnerVolumeSpecName "kube-api-access-7dzsg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:32:53.958306 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:53.958271    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37d86111-a17e-4748-b8c7-f1b1b4e26c93-maas-api-tls\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:32:53.958306 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:53.958302    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37d86111-a17e-4748-b8c7-f1b1b4e26c93-openshift-service-ca\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:32:53.958306 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:53.958312    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dzsg\" (UniqueName: \"kubernetes.io/projected/37d86111-a17e-4748-b8c7-f1b1b4e26c93-kube-api-access-7dzsg\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:32:54.211649 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:54.211614    2577 generic.go:356] "Generic (PLEG): container finished" podID="37d86111-a17e-4748-b8c7-f1b1b4e26c93" containerID="8dff8d03fa8291dcd238df08889dd7133625e2ec2ed5c6c789514d2c19fdced4" exitCode=0
Jul 09 19:32:54.211864 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:54.211666    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7"
Jul 09 19:32:54.211864 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:54.211691    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7" event={"ID":"37d86111-a17e-4748-b8c7-f1b1b4e26c93","Type":"ContainerDied","Data":"8dff8d03fa8291dcd238df08889dd7133625e2ec2ed5c6c789514d2c19fdced4"}
Jul 09 19:32:54.211864 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:54.211745    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7" event={"ID":"37d86111-a17e-4748-b8c7-f1b1b4e26c93","Type":"ContainerDied","Data":"2ef5ef64de32ff51f841a734a5543e26fc8c39ea67e724d59825691f4645142f"}
Jul 09 19:32:54.211864 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:54.211767    2577 scope.go:117] "RemoveContainer" containerID="8dff8d03fa8291dcd238df08889dd7133625e2ec2ed5c6c789514d2c19fdced4"
Jul 09 19:32:54.221264 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:54.221246    2577 scope.go:117] "RemoveContainer" containerID="8dff8d03fa8291dcd238df08889dd7133625e2ec2ed5c6c789514d2c19fdced4"
Jul 09 19:32:54.221534 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:32:54.221515    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dff8d03fa8291dcd238df08889dd7133625e2ec2ed5c6c789514d2c19fdced4\": container with ID starting with 8dff8d03fa8291dcd238df08889dd7133625e2ec2ed5c6c789514d2c19fdced4 not found: ID does not exist" containerID="8dff8d03fa8291dcd238df08889dd7133625e2ec2ed5c6c789514d2c19fdced4"
Jul 09 19:32:54.221605 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:54.221541    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dff8d03fa8291dcd238df08889dd7133625e2ec2ed5c6c789514d2c19fdced4"} err="failed to get container status \"8dff8d03fa8291dcd238df08889dd7133625e2ec2ed5c6c789514d2c19fdced4\": rpc error: code = NotFound desc = could not find container \"8dff8d03fa8291dcd238df08889dd7133625e2ec2ed5c6c789514d2c19fdced4\": container with ID starting with 8dff8d03fa8291dcd238df08889dd7133625e2ec2ed5c6c789514d2c19fdced4 not found: ID does not exist"
Jul 09 19:32:54.234135 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:54.234101    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7"]
Jul 09 19:32:54.240227 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:54.240206    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4038d9-77dcf76989-vlbp7"]
Jul 09 19:32:54.639007 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:54.638977    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37d86111-a17e-4748-b8c7-f1b1b4e26c93" path="/var/lib/kubelet/pods/37d86111-a17e-4748-b8c7-f1b1b4e26c93/volumes"
Jul 09 19:32:55.836508 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:55.836478    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:32:57.971931 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:57.971895    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:32:58.050833 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:58.050777    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:32:58.250574 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:58.250490    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:32:58.482409 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:58.482379    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:32:58.848241 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:58.848210    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:32:59.182965 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:59.182931    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:32:59.501098 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:32:59.501017    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:02.022951 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.022920    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:02.086648 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.086617    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp"]
Jul 09 19:33:02.087014 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.087001    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed2428d1-32d4-403f-a729-df388e939f80" containerName="main"
Jul 09 19:33:02.087061 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.087016    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed2428d1-32d4-403f-a729-df388e939f80" containerName="main"
Jul 09 19:33:02.087061 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.087032    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37d86111-a17e-4748-b8c7-f1b1b4e26c93" containerName="maas-api"
Jul 09 19:33:02.087061 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.087038    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="37d86111-a17e-4748-b8c7-f1b1b4e26c93" containerName="maas-api"
Jul 09 19:33:02.087061 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.087047    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e040ba8-613a-45f9-9c0f-d19693524d53" containerName="cleanup"
Jul 09 19:33:02.087061 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.087052    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e040ba8-613a-45f9-9c0f-d19693524d53" containerName="cleanup"
Jul 09 19:33:02.087207 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.087067    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a78dfb43-3c47-4628-9ecd-86140e0b4b17" containerName="maas-api"
Jul 09 19:33:02.087207 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.087072    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a78dfb43-3c47-4628-9ecd-86140e0b4b17" containerName="maas-api"
Jul 09 19:33:02.087207 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.087130    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e040ba8-613a-45f9-9c0f-d19693524d53" containerName="cleanup"
Jul 09 19:33:02.087207 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.087139    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed2428d1-32d4-403f-a729-df388e939f80" containerName="main"
Jul 09 19:33:02.087207 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.087145    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="37d86111-a17e-4748-b8c7-f1b1b4e26c93" containerName="maas-api"
Jul 09 19:33:02.087207 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.087152    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a78dfb43-3c47-4628-9ecd-86140e0b4b17" containerName="maas-api"
Jul 09 19:33:02.091463 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.091443    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp"
Jul 09 19:33:02.094582 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.094551    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 19:33:02.094713 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.094633    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dlwh6\""
Jul 09 19:33:02.096130 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.096113    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-96cd7e-serving-cert\""
Jul 09 19:33:02.096229 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.096121    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 19:33:02.101099 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.101071    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp"]
Jul 09 19:33:02.112505 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.112476    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:02.138012 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.137970    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8590bc9-8224-49ad-bd83-716be31ece26-maas-api-tls\") pod \"maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp\" (UID: \"c8590bc9-8224-49ad-bd83-716be31ece26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp"
Jul 09 19:33:02.138194 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.138060    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwrsc\" (UniqueName: \"kubernetes.io/projected/c8590bc9-8224-49ad-bd83-716be31ece26-kube-api-access-kwrsc\") pod \"maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp\" (UID: \"c8590bc9-8224-49ad-bd83-716be31ece26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp"
Jul 09 19:33:02.138194 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.138095    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8590bc9-8224-49ad-bd83-716be31ece26-openshift-service-ca\") pod \"maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp\" (UID: \"c8590bc9-8224-49ad-bd83-716be31ece26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp"
Jul 09 19:33:02.213082 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.213049    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:02.239282 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.239247    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8590bc9-8224-49ad-bd83-716be31ece26-maas-api-tls\") pod \"maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp\" (UID: \"c8590bc9-8224-49ad-bd83-716be31ece26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp"
Jul 09 19:33:02.239426 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.239327    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwrsc\" (UniqueName: \"kubernetes.io/projected/c8590bc9-8224-49ad-bd83-716be31ece26-kube-api-access-kwrsc\") pod \"maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp\" (UID: \"c8590bc9-8224-49ad-bd83-716be31ece26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp"
Jul 09 19:33:02.239426 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.239362    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8590bc9-8224-49ad-bd83-716be31ece26-openshift-service-ca\") pod \"maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp\" (UID: \"c8590bc9-8224-49ad-bd83-716be31ece26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp"
Jul 09 19:33:02.239426 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:33:02.239406    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-96cd7e-serving-cert: secret "maas-api-e2e-api-a-96cd7e-serving-cert" not found
Jul 09 19:33:02.239530 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:33:02.239486    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8590bc9-8224-49ad-bd83-716be31ece26-maas-api-tls podName:c8590bc9-8224-49ad-bd83-716be31ece26 nodeName:}" failed. No retries permitted until 2026-07-09 19:33:02.739465089 +0000 UTC m=+2001.124535345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c8590bc9-8224-49ad-bd83-716be31ece26-maas-api-tls") pod "maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp" (UID: "c8590bc9-8224-49ad-bd83-716be31ece26") : secret "maas-api-e2e-api-a-96cd7e-serving-cert" not found
Jul 09 19:33:02.240096 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.240077    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8590bc9-8224-49ad-bd83-716be31ece26-openshift-service-ca\") pod \"maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp\" (UID: \"c8590bc9-8224-49ad-bd83-716be31ece26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp"
Jul 09 19:33:02.250004 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.249970    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwrsc\" (UniqueName: \"kubernetes.io/projected/c8590bc9-8224-49ad-bd83-716be31ece26-kube-api-access-kwrsc\") pod \"maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp\" (UID: \"c8590bc9-8224-49ad-bd83-716be31ece26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp"
Jul 09 19:33:02.336412 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.336332    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:02.743824 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.743764    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8590bc9-8224-49ad-bd83-716be31ece26-maas-api-tls\") pod \"maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp\" (UID: \"c8590bc9-8224-49ad-bd83-716be31ece26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp"
Jul 09 19:33:02.746396 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.746368    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8590bc9-8224-49ad-bd83-716be31ece26-maas-api-tls\") pod \"maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp\" (UID: \"c8590bc9-8224-49ad-bd83-716be31ece26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp"
Jul 09 19:33:02.807655 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.807627    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:02.910049 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:02.910019    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:03.003308 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:03.003217    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp"
Jul 09 19:33:03.145725 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:03.145700    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp"]
Jul 09 19:33:03.147992 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:33:03.147961    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8590bc9_8224_49ad_bd83_716be31ece26.slice/crio-d1c5dda5f9fdda320dd2df87c0b616d5b729a5ac6312a305f049aaacb424cdc3 WatchSource:0}: Error finding container d1c5dda5f9fdda320dd2df87c0b616d5b729a5ac6312a305f049aaacb424cdc3: Status 404 returned error can't find the container with id d1c5dda5f9fdda320dd2df87c0b616d5b729a5ac6312a305f049aaacb424cdc3
Jul 09 19:33:03.256529 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:03.256438    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp" event={"ID":"c8590bc9-8224-49ad-bd83-716be31ece26","Type":"ContainerStarted","Data":"d1c5dda5f9fdda320dd2df87c0b616d5b729a5ac6312a305f049aaacb424cdc3"}
Jul 09 19:33:04.262859 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:04.262803    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp" event={"ID":"c8590bc9-8224-49ad-bd83-716be31ece26","Type":"ContainerStarted","Data":"dd0697cb13571421d3f0a0d3d5e3558e8f485910012a92c4f97276093fc40b35"}
Jul 09 19:33:04.263247 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:04.262946    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp"
Jul 09 19:33:04.305168 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:04.305114    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp" podStartSLOduration=1.899273065 podStartE2EDuration="2.305096954s" totalImagesPullingTime="405.823889ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:33:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:33:04.297919016 +0000 UTC m=+2002.682989304" watchObservedRunningTime="2026-07-09 19:33:04.305096954 +0000 UTC m=+2002.690167228"
Jul 09 19:33:06.448013 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:06.447981    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:06.901003 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:06.900975    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:07.202674 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:07.202582    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:07.430868 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:07.430838    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:09.964044 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:09.964009    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:10.045395 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:10.045359    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6"]
Jul 09 19:33:10.049057 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:10.049036    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6"
Jul 09 19:33:10.052074 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:10.052052    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-9694bb-serving-cert\""
Jul 09 19:33:10.061093 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:10.061067    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6"]
Jul 09 19:33:10.069059 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:10.069024    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:10.119370 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:10.119336    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h44h\" (UniqueName: \"kubernetes.io/projected/cbad815f-bae7-4e7d-b17c-fe214b5ecfe8-kube-api-access-2h44h\") pod \"maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6\" (UID: \"cbad815f-bae7-4e7d-b17c-fe214b5ecfe8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6"
Jul 09 19:33:10.119557 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:10.119448    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbad815f-bae7-4e7d-b17c-fe214b5ecfe8-openshift-service-ca\") pod \"maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6\" (UID: \"cbad815f-bae7-4e7d-b17c-fe214b5ecfe8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6"
Jul 09 19:33:10.119557 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:10.119479    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbad815f-bae7-4e7d-b17c-fe214b5ecfe8-maas-api-tls\") pod \"maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6\" (UID: \"cbad815f-bae7-4e7d-b17c-fe214b5ecfe8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6"
Jul 09 19:33:10.177238 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:10.177207    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:33:10.179852 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:10.179827    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:10.220384 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:10.220285    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbad815f-bae7-4e7d-b17c-fe214b5ecfe8-openshift-service-ca\") pod \"maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6\" (UID: \"cbad815f-bae7-4e7d-b17c-fe214b5ecfe8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6"
Jul 09 19:33:10.220384 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:10.220336    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbad815f-bae7-4e7d-b17c-fe214b5ecfe8-maas-api-tls\") pod \"maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6\" (UID: \"cbad815f-bae7-4e7d-b17c-fe214b5ecfe8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6"
Jul 09 19:33:10.220601 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:10.220401    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h44h\" (UniqueName: \"kubernetes.io/projected/cbad815f-bae7-4e7d-b17c-fe214b5ecfe8-kube-api-access-2h44h\") pod \"maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6\" (UID: \"cbad815f-bae7-4e7d-b17c-fe214b5ecfe8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6"
Jul 09 19:33:10.220601 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:33:10.220499    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-9694bb-serving-cert: secret "maas-api-e2e-api-b-9694bb-serving-cert" not found
Jul 09 19:33:10.220601 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:33:10.220560    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbad815f-bae7-4e7d-b17c-fe214b5ecfe8-maas-api-tls podName:cbad815f-bae7-4e7d-b17c-fe214b5ecfe8 nodeName:}" failed. No retries permitted until 2026-07-09 19:33:10.720542549 +0000 UTC m=+2009.105612802 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cbad815f-bae7-4e7d-b17c-fe214b5ecfe8-maas-api-tls") pod "maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6" (UID: "cbad815f-bae7-4e7d-b17c-fe214b5ecfe8") : secret "maas-api-e2e-api-b-9694bb-serving-cert" not found
Jul 09 19:33:10.221006 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:10.220983    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbad815f-bae7-4e7d-b17c-fe214b5ecfe8-openshift-service-ca\") pod \"maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6\" (UID: \"cbad815f-bae7-4e7d-b17c-fe214b5ecfe8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6"
Jul 09 19:33:10.231122 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:10.231100    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h44h\" (UniqueName: \"kubernetes.io/projected/cbad815f-bae7-4e7d-b17c-fe214b5ecfe8-kube-api-access-2h44h\") pod \"maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6\" (UID: \"cbad815f-bae7-4e7d-b17c-fe214b5ecfe8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6"
Jul 09 19:33:10.273976 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:10.273944    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp"
Jul 09 19:33:10.573915 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:10.573798    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:10.725579 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:10.725549    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbad815f-bae7-4e7d-b17c-fe214b5ecfe8-maas-api-tls\") pod \"maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6\" (UID: \"cbad815f-bae7-4e7d-b17c-fe214b5ecfe8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6"
Jul 09 19:33:10.728151 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:10.728121    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbad815f-bae7-4e7d-b17c-fe214b5ecfe8-maas-api-tls\") pod \"maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6\" (UID: \"cbad815f-bae7-4e7d-b17c-fe214b5ecfe8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6"
Jul 09 19:33:10.855943 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:10.855801    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:10.950829 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:10.950777    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:10.959786 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:10.959766    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6"
Jul 09 19:33:11.095698 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:11.095673    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6"]
Jul 09 19:33:11.097994 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:33:11.097965    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbad815f_bae7_4e7d_b17c_fe214b5ecfe8.slice/crio-5109d14b52601532b2c02813c08552ce1ed0b7b17843dd64ebc3ea5b8329d596 WatchSource:0}: Error finding container 5109d14b52601532b2c02813c08552ce1ed0b7b17843dd64ebc3ea5b8329d596: Status 404 returned error can't find the container with id 5109d14b52601532b2c02813c08552ce1ed0b7b17843dd64ebc3ea5b8329d596
Jul 09 19:33:11.300876 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:11.300843    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6" event={"ID":"cbad815f-bae7-4e7d-b17c-fe214b5ecfe8","Type":"ContainerStarted","Data":"5109d14b52601532b2c02813c08552ce1ed0b7b17843dd64ebc3ea5b8329d596"}
Jul 09 19:33:12.307013 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:12.306972    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6" event={"ID":"cbad815f-bae7-4e7d-b17c-fe214b5ecfe8","Type":"ContainerStarted","Data":"18bc8c87bc662def31377b577bb50e4cfc6dff784dc5e6edbd38a4e50d9362c0"}
Jul 09 19:33:12.307400 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:12.307051    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6"
Jul 09 19:33:12.324379 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:12.324327    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6" podStartSLOduration=1.8875518100000002 podStartE2EDuration="2.324311511s" totalImagesPullingTime="436.759701ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:33:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:33:12.323017696 +0000 UTC m=+2010.708087983" watchObservedRunningTime="2026-07-09 19:33:12.324311511 +0000 UTC m=+2010.709381785"
Jul 09 19:33:14.412117 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:14.412085    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:18.317321 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:18.317291    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6"
Jul 09 19:33:22.434843 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:22.434767    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:23.056216 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:23.056181    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:23.147049 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:23.147018    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:23.147839 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:23.147800    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp"]
Jul 09 19:33:23.148100 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:23.148054    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp" podUID="c8590bc9-8224-49ad-bd83-716be31ece26" containerName="maas-api" containerID="cri-o://dd0697cb13571421d3f0a0d3d5e3558e8f485910012a92c4f97276093fc40b35" gracePeriod=30
Jul 09 19:33:23.246802 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:23.246771    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:23.247784 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:23.247762    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:33:23.362397 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:23.362368    2577 generic.go:356] "Generic (PLEG): container finished" podID="c8590bc9-8224-49ad-bd83-716be31ece26" containerID="dd0697cb13571421d3f0a0d3d5e3558e8f485910012a92c4f97276093fc40b35" exitCode=0
Jul 09 19:33:23.362569 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:23.362449    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp" event={"ID":"c8590bc9-8224-49ad-bd83-716be31ece26","Type":"ContainerDied","Data":"dd0697cb13571421d3f0a0d3d5e3558e8f485910012a92c4f97276093fc40b35"}
Jul 09 19:33:23.405880 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:23.405855    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp"
Jul 09 19:33:23.552569 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:23.552535    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwrsc\" (UniqueName: \"kubernetes.io/projected/c8590bc9-8224-49ad-bd83-716be31ece26-kube-api-access-kwrsc\") pod \"c8590bc9-8224-49ad-bd83-716be31ece26\" (UID: \"c8590bc9-8224-49ad-bd83-716be31ece26\") "
Jul 09 19:33:23.553078 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:23.552615    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8590bc9-8224-49ad-bd83-716be31ece26-maas-api-tls\") pod \"c8590bc9-8224-49ad-bd83-716be31ece26\" (UID: \"c8590bc9-8224-49ad-bd83-716be31ece26\") "
Jul 09 19:33:23.553078 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:23.552637    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8590bc9-8224-49ad-bd83-716be31ece26-openshift-service-ca\") pod \"c8590bc9-8224-49ad-bd83-716be31ece26\" (UID: \"c8590bc9-8224-49ad-bd83-716be31ece26\") "
Jul 09 19:33:23.553078 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:23.553027    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8590bc9-8224-49ad-bd83-716be31ece26-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c8590bc9-8224-49ad-bd83-716be31ece26" (UID: "c8590bc9-8224-49ad-bd83-716be31ece26"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:33:23.554694 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:23.554666    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8590bc9-8224-49ad-bd83-716be31ece26-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c8590bc9-8224-49ad-bd83-716be31ece26" (UID: "c8590bc9-8224-49ad-bd83-716be31ece26"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:33:23.554783 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:23.554740    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8590bc9-8224-49ad-bd83-716be31ece26-kube-api-access-kwrsc" (OuterVolumeSpecName: "kube-api-access-kwrsc") pod "c8590bc9-8224-49ad-bd83-716be31ece26" (UID: "c8590bc9-8224-49ad-bd83-716be31ece26"). InnerVolumeSpecName "kube-api-access-kwrsc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:33:23.653604 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:23.653578    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwrsc\" (UniqueName: \"kubernetes.io/projected/c8590bc9-8224-49ad-bd83-716be31ece26-kube-api-access-kwrsc\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:33:23.653604 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:23.653605    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c8590bc9-8224-49ad-bd83-716be31ece26-maas-api-tls\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:33:23.653845 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:23.653615    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c8590bc9-8224-49ad-bd83-716be31ece26-openshift-service-ca\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:33:24.368976 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:24.368949    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp"
Jul 09 19:33:24.369183 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:24.368986    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp" event={"ID":"c8590bc9-8224-49ad-bd83-716be31ece26","Type":"ContainerDied","Data":"d1c5dda5f9fdda320dd2df87c0b616d5b729a5ac6312a305f049aaacb424cdc3"}
Jul 09 19:33:24.369183 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:24.369047    2577 scope.go:117] "RemoveContainer" containerID="dd0697cb13571421d3f0a0d3d5e3558e8f485910012a92c4f97276093fc40b35"
Jul 09 19:33:24.392393 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:24.392357    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp"]
Jul 09 19:33:24.397555 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:24.397527    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-96cd7e-69b9c5b747-6bpfp"]
Jul 09 19:33:24.639170 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:24.639139    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8590bc9-8224-49ad-bd83-716be31ece26" path="/var/lib/kubelet/pods/c8590bc9-8224-49ad-bd83-716be31ece26/volumes"
Jul 09 19:33:28.997329 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:28.997292    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:29.098954 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:29.098921    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:29.263013 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:29.262891    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:29.494643 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:29.494611    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:29.645842 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:29.645805    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:30.064958 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:30.064873    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:30.153907 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:30.153860    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:30.284764 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:30.284731    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:30.376241 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:30.376157    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6"]
Jul 09 19:33:30.376394 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:30.376373    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6" podUID="cbad815f-bae7-4e7d-b17c-fe214b5ecfe8" containerName="maas-api" containerID="cri-o://18bc8c87bc662def31377b577bb50e4cfc6dff784dc5e6edbd38a4e50d9362c0" gracePeriod=30
Jul 09 19:33:30.416482 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:30.416449    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:30.631828 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:30.631749    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6"
Jul 09 19:33:30.722233 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:30.722204    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2h44h\" (UniqueName: \"kubernetes.io/projected/cbad815f-bae7-4e7d-b17c-fe214b5ecfe8-kube-api-access-2h44h\") pod \"cbad815f-bae7-4e7d-b17c-fe214b5ecfe8\" (UID: \"cbad815f-bae7-4e7d-b17c-fe214b5ecfe8\") "
Jul 09 19:33:30.722432 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:30.722270    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbad815f-bae7-4e7d-b17c-fe214b5ecfe8-maas-api-tls\") pod \"cbad815f-bae7-4e7d-b17c-fe214b5ecfe8\" (UID: \"cbad815f-bae7-4e7d-b17c-fe214b5ecfe8\") "
Jul 09 19:33:30.722432 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:30.722322    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbad815f-bae7-4e7d-b17c-fe214b5ecfe8-openshift-service-ca\") pod \"cbad815f-bae7-4e7d-b17c-fe214b5ecfe8\" (UID: \"cbad815f-bae7-4e7d-b17c-fe214b5ecfe8\") "
Jul 09 19:33:30.722694 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:30.722670    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbad815f-bae7-4e7d-b17c-fe214b5ecfe8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cbad815f-bae7-4e7d-b17c-fe214b5ecfe8" (UID: "cbad815f-bae7-4e7d-b17c-fe214b5ecfe8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:33:30.724403 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:30.724375    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbad815f-bae7-4e7d-b17c-fe214b5ecfe8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cbad815f-bae7-4e7d-b17c-fe214b5ecfe8" (UID: "cbad815f-bae7-4e7d-b17c-fe214b5ecfe8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:33:30.724494 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:30.724426    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbad815f-bae7-4e7d-b17c-fe214b5ecfe8-kube-api-access-2h44h" (OuterVolumeSpecName: "kube-api-access-2h44h") pod "cbad815f-bae7-4e7d-b17c-fe214b5ecfe8" (UID: "cbad815f-bae7-4e7d-b17c-fe214b5ecfe8"). InnerVolumeSpecName "kube-api-access-2h44h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:33:30.824111 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:30.824068    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2h44h\" (UniqueName: \"kubernetes.io/projected/cbad815f-bae7-4e7d-b17c-fe214b5ecfe8-kube-api-access-2h44h\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:33:30.824111 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:30.824104    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbad815f-bae7-4e7d-b17c-fe214b5ecfe8-maas-api-tls\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:33:30.824111 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:30.824114    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbad815f-bae7-4e7d-b17c-fe214b5ecfe8-openshift-service-ca\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:33:31.402803 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:31.402767    2577 generic.go:356] "Generic (PLEG): container finished" podID="cbad815f-bae7-4e7d-b17c-fe214b5ecfe8" containerID="18bc8c87bc662def31377b577bb50e4cfc6dff784dc5e6edbd38a4e50d9362c0" exitCode=0
Jul 09 19:33:31.403259 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:31.402832    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6"
Jul 09 19:33:31.403259 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:31.402859    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6" event={"ID":"cbad815f-bae7-4e7d-b17c-fe214b5ecfe8","Type":"ContainerDied","Data":"18bc8c87bc662def31377b577bb50e4cfc6dff784dc5e6edbd38a4e50d9362c0"}
Jul 09 19:33:31.403259 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:31.402921    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6" event={"ID":"cbad815f-bae7-4e7d-b17c-fe214b5ecfe8","Type":"ContainerDied","Data":"5109d14b52601532b2c02813c08552ce1ed0b7b17843dd64ebc3ea5b8329d596"}
Jul 09 19:33:31.403259 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:31.402951    2577 scope.go:117] "RemoveContainer" containerID="18bc8c87bc662def31377b577bb50e4cfc6dff784dc5e6edbd38a4e50d9362c0"
Jul 09 19:33:31.412531 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:31.412510    2577 scope.go:117] "RemoveContainer" containerID="18bc8c87bc662def31377b577bb50e4cfc6dff784dc5e6edbd38a4e50d9362c0"
Jul 09 19:33:31.412853 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:33:31.412826    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18bc8c87bc662def31377b577bb50e4cfc6dff784dc5e6edbd38a4e50d9362c0\": container with ID starting with 18bc8c87bc662def31377b577bb50e4cfc6dff784dc5e6edbd38a4e50d9362c0 not found: ID does not exist" containerID="18bc8c87bc662def31377b577bb50e4cfc6dff784dc5e6edbd38a4e50d9362c0"
Jul 09 19:33:31.412949 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:31.412862    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18bc8c87bc662def31377b577bb50e4cfc6dff784dc5e6edbd38a4e50d9362c0"} err="failed to get container status \"18bc8c87bc662def31377b577bb50e4cfc6dff784dc5e6edbd38a4e50d9362c0\": rpc error: code = NotFound desc = could not find container \"18bc8c87bc662def31377b577bb50e4cfc6dff784dc5e6edbd38a4e50d9362c0\": container with ID starting with 18bc8c87bc662def31377b577bb50e4cfc6dff784dc5e6edbd38a4e50d9362c0 not found: ID does not exist"
Jul 09 19:33:31.427096 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:31.427036    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6"]
Jul 09 19:33:31.436359 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:31.436331    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9694bb-7d8db596b8-pmbd6"]
Jul 09 19:33:32.638826 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:32.638778    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbad815f-bae7-4e7d-b17c-fe214b5ecfe8" path="/var/lib/kubelet/pods/cbad815f-bae7-4e7d-b17c-fe214b5ecfe8/volumes"
Jul 09 19:33:34.037495 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:34.037460    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:33:36.307195 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:36.307153    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:36.369015 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:36.368983    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:36.568148 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:36.568053    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:36.794369 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:36.794335    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:37.716600 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:37.716568    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:37.817577 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:37.817549    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:40.079336 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:40.079307    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:40.160725 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:40.160695    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg"]
Jul 09 19:33:40.161111 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:40.161098    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8590bc9-8224-49ad-bd83-716be31ece26" containerName="maas-api"
Jul 09 19:33:40.161162 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:40.161113    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8590bc9-8224-49ad-bd83-716be31ece26" containerName="maas-api"
Jul 09 19:33:40.161162 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:40.161125    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbad815f-bae7-4e7d-b17c-fe214b5ecfe8" containerName="maas-api"
Jul 09 19:33:40.161162 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:40.161131    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbad815f-bae7-4e7d-b17c-fe214b5ecfe8" containerName="maas-api"
Jul 09 19:33:40.161255 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:40.161201    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8590bc9-8224-49ad-bd83-716be31ece26" containerName="maas-api"
Jul 09 19:33:40.161255 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:40.161212    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbad815f-bae7-4e7d-b17c-fe214b5ecfe8" containerName="maas-api"
Jul 09 19:33:40.165975 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:40.165953    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg"
Jul 09 19:33:40.169027 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:40.169002    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-c8412b-serving-cert\""
Jul 09 19:33:40.169156 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:40.169101    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 19:33:40.170381 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:40.170339    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dlwh6\""
Jul 09 19:33:40.170536 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:40.170435    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 19:33:40.174358 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:40.174004    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg"]
Jul 09 19:33:40.174556 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:40.174538    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:40.215899 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:40.215859    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nt8w\" (UniqueName: \"kubernetes.io/projected/90b29ceb-1f2b-473c-93b7-1f89e82bcd8b-kube-api-access-7nt8w\") pod \"maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg\" (UID: \"90b29ceb-1f2b-473c-93b7-1f89e82bcd8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg"
Jul 09 19:33:40.216074 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:40.215936    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90b29ceb-1f2b-473c-93b7-1f89e82bcd8b-maas-api-tls\") pod \"maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg\" (UID: \"90b29ceb-1f2b-473c-93b7-1f89e82bcd8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg"
Jul 09 19:33:40.216074 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:40.215971    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90b29ceb-1f2b-473c-93b7-1f89e82bcd8b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg\" (UID: \"90b29ceb-1f2b-473c-93b7-1f89e82bcd8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg"
Jul 09 19:33:40.248112 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:40.248086    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:40.316665 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:40.316626    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90b29ceb-1f2b-473c-93b7-1f89e82bcd8b-maas-api-tls\") pod \"maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg\" (UID: \"90b29ceb-1f2b-473c-93b7-1f89e82bcd8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg"
Jul 09 19:33:40.316855 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:40.316679    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90b29ceb-1f2b-473c-93b7-1f89e82bcd8b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg\" (UID: \"90b29ceb-1f2b-473c-93b7-1f89e82bcd8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg"
Jul 09 19:33:40.316855 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:40.316725    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nt8w\" (UniqueName: \"kubernetes.io/projected/90b29ceb-1f2b-473c-93b7-1f89e82bcd8b-kube-api-access-7nt8w\") pod \"maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg\" (UID: \"90b29ceb-1f2b-473c-93b7-1f89e82bcd8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg"
Jul 09 19:33:40.316855 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:33:40.316773    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-c8412b-serving-cert: secret "maas-api-e2e-shared-a-c8412b-serving-cert" not found
Jul 09 19:33:40.316981 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:33:40.316874    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90b29ceb-1f2b-473c-93b7-1f89e82bcd8b-maas-api-tls podName:90b29ceb-1f2b-473c-93b7-1f89e82bcd8b nodeName:}" failed. No retries permitted until 2026-07-09 19:33:40.816856479 +0000 UTC m=+2039.201926733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/90b29ceb-1f2b-473c-93b7-1f89e82bcd8b-maas-api-tls") pod "maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg" (UID: "90b29ceb-1f2b-473c-93b7-1f89e82bcd8b") : secret "maas-api-e2e-shared-a-c8412b-serving-cert" not found
Jul 09 19:33:40.317401 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:40.317383    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90b29ceb-1f2b-473c-93b7-1f89e82bcd8b-openshift-service-ca\") pod \"maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg\" (UID: \"90b29ceb-1f2b-473c-93b7-1f89e82bcd8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg"
Jul 09 19:33:40.326425 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:40.326395    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nt8w\" (UniqueName: \"kubernetes.io/projected/90b29ceb-1f2b-473c-93b7-1f89e82bcd8b-kube-api-access-7nt8w\") pod \"maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg\" (UID: \"90b29ceb-1f2b-473c-93b7-1f89e82bcd8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg"
Jul 09 19:33:40.428552 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:40.428518    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:40.753096 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:40.753004    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:40.821498 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:40.821455    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90b29ceb-1f2b-473c-93b7-1f89e82bcd8b-maas-api-tls\") pod \"maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg\" (UID: \"90b29ceb-1f2b-473c-93b7-1f89e82bcd8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg"
Jul 09 19:33:40.823919 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:40.823888    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90b29ceb-1f2b-473c-93b7-1f89e82bcd8b-maas-api-tls\") pod \"maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg\" (UID: \"90b29ceb-1f2b-473c-93b7-1f89e82bcd8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg"
Jul 09 19:33:40.850379 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:40.850347    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:41.078044 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:41.077952    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg"
Jul 09 19:33:41.236023 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:41.235994    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg"]
Jul 09 19:33:41.238186 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:33:41.238156    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90b29ceb_1f2b_473c_93b7_1f89e82bcd8b.slice/crio-72867aeb1b413aba877ff060603b4f38f21fa701a0b618e505199248381c6243 WatchSource:0}: Error finding container 72867aeb1b413aba877ff060603b4f38f21fa701a0b618e505199248381c6243: Status 404 returned error can't find the container with id 72867aeb1b413aba877ff060603b4f38f21fa701a0b618e505199248381c6243
Jul 09 19:33:41.459388 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:41.459355    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg" event={"ID":"90b29ceb-1f2b-473c-93b7-1f89e82bcd8b","Type":"ContainerStarted","Data":"72867aeb1b413aba877ff060603b4f38f21fa701a0b618e505199248381c6243"}
Jul 09 19:33:42.465528 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:42.465491    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg" event={"ID":"90b29ceb-1f2b-473c-93b7-1f89e82bcd8b","Type":"ContainerStarted","Data":"1b47ac076deb049947c6aed16ff88804030e30a132deedb328420c3437b4b648"}
Jul 09 19:33:42.465938 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:42.465597    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg"
Jul 09 19:33:42.483370 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:42.483315    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg" podStartSLOduration=2.10362383 podStartE2EDuration="2.483295915s" totalImagesPullingTime="379.672085ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:33:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:33:42.482192238 +0000 UTC m=+2040.867262514" watchObservedRunningTime="2026-07-09 19:33:42.483295915 +0000 UTC m=+2040.868366189"
Jul 09 19:33:44.556047 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:44.555980    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:44.882438 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:44.882354    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:45.209727 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:45.209691    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:45.443488 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:45.443452    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:45.739599 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:45.739564    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:33:48.124364 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:48.124303    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:48.216006 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:48.215968    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:48.221678 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:48.221648    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl"]
Jul 09 19:33:48.225479 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:48.225455    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl"
Jul 09 19:33:48.228679 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:48.228657    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-a94244-serving-cert\""
Jul 09 19:33:48.237504 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:48.237479    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl"]
Jul 09 19:33:48.290415 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:48.290381    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57r54\" (UniqueName: \"kubernetes.io/projected/0e1f609a-2e89-4273-bbf0-6f942991b49e-kube-api-access-57r54\") pod \"maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl\" (UID: \"0e1f609a-2e89-4273-bbf0-6f942991b49e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl"
Jul 09 19:33:48.290596 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:48.290464    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e1f609a-2e89-4273-bbf0-6f942991b49e-maas-api-tls\") pod \"maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl\" (UID: \"0e1f609a-2e89-4273-bbf0-6f942991b49e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl"
Jul 09 19:33:48.290596 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:48.290537    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e1f609a-2e89-4273-bbf0-6f942991b49e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl\" (UID: \"0e1f609a-2e89-4273-bbf0-6f942991b49e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl"
Jul 09 19:33:48.317244 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:48.317214    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:48.391114 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:48.391078    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57r54\" (UniqueName: \"kubernetes.io/projected/0e1f609a-2e89-4273-bbf0-6f942991b49e-kube-api-access-57r54\") pod \"maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl\" (UID: \"0e1f609a-2e89-4273-bbf0-6f942991b49e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl"
Jul 09 19:33:48.391315 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:48.391150    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e1f609a-2e89-4273-bbf0-6f942991b49e-maas-api-tls\") pod \"maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl\" (UID: \"0e1f609a-2e89-4273-bbf0-6f942991b49e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl"
Jul 09 19:33:48.391315 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:48.391195    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e1f609a-2e89-4273-bbf0-6f942991b49e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl\" (UID: \"0e1f609a-2e89-4273-bbf0-6f942991b49e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl"
Jul 09 19:33:48.391869 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:48.391847    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e1f609a-2e89-4273-bbf0-6f942991b49e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl\" (UID: \"0e1f609a-2e89-4273-bbf0-6f942991b49e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl"
Jul 09 19:33:48.393694 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:48.393670    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e1f609a-2e89-4273-bbf0-6f942991b49e-maas-api-tls\") pod \"maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl\" (UID: \"0e1f609a-2e89-4273-bbf0-6f942991b49e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl"
Jul 09 19:33:48.405954 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:48.405923    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57r54\" (UniqueName: \"kubernetes.io/projected/0e1f609a-2e89-4273-bbf0-6f942991b49e-kube-api-access-57r54\") pod \"maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl\" (UID: \"0e1f609a-2e89-4273-bbf0-6f942991b49e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl"
Jul 09 19:33:48.415010 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:48.414986    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:48.477126 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:48.477097    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg"
Jul 09 19:33:48.537466 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:48.537427    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl"
Jul 09 19:33:48.692872 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:48.692848    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl"]
Jul 09 19:33:48.695179 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:33:48.695156    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e1f609a_2e89_4273_bbf0_6f942991b49e.slice/crio-cccd744e48da6938a5a5914e50f36d0e34cc0966ba266e5e13edadb8deac0bd4 WatchSource:0}: Error finding container cccd744e48da6938a5a5914e50f36d0e34cc0966ba266e5e13edadb8deac0bd4: Status 404 returned error can't find the container with id cccd744e48da6938a5a5914e50f36d0e34cc0966ba266e5e13edadb8deac0bd4
Jul 09 19:33:49.012340 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:49.012260    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:49.114180 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:49.114147    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:49.503819 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:49.503782    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl" event={"ID":"0e1f609a-2e89-4273-bbf0-6f942991b49e","Type":"ContainerStarted","Data":"22cf0a42cb9c711080980b33513bb12a79475dda0804a3c9c639b1e32d563356"}
Jul 09 19:33:49.504209 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:49.503856    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl" event={"ID":"0e1f609a-2e89-4273-bbf0-6f942991b49e","Type":"ContainerStarted","Data":"cccd744e48da6938a5a5914e50f36d0e34cc0966ba266e5e13edadb8deac0bd4"}
Jul 09 19:33:49.504209 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:49.504023    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl"
Jul 09 19:33:49.522717 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:49.522636    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl" podStartSLOduration=1.058418671 podStartE2EDuration="1.522614178s" totalImagesPullingTime="464.195507ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:33:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:33:49.521107599 +0000 UTC m=+2047.906177874" watchObservedRunningTime="2026-07-09 19:33:49.522614178 +0000 UTC m=+2047.907684457"
Jul 09 19:33:52.700907 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:52.700874    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:33:55.517884 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:55.517857    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl"
Jul 09 19:33:58.043005 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:33:58.042973    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:34:01.453493 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:01.453459    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:34:01.554414 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:01.554382    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:34:09.830997 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:09.830925    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:34:09.932361 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:09.932329    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:34:15.709136 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:15.709099    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:34:15.758084 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:15.758051    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:34:23.246514 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:23.246474    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst"]
Jul 09 19:34:23.250078 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:23.250061    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst"
Jul 09 19:34:23.254420 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:23.254398    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c8412b\"/\"default-dockercfg-2j4nj\""
Jul 09 19:34:23.254420 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:23.254404    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-c8412b\"/\"openshift-service-ca.crt\""
Jul 09 19:34:23.254679 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:23.254413    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-c8412b\"/\"kube-root-ca.crt\""
Jul 09 19:34:23.254679 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:23.254435    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c8412b\"/\"auth-test-model-c8412b-kserve-self-signed-certs\""
Jul 09 19:34:23.259107 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:23.259089    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst"]
Jul 09 19:34:23.330298 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:23.330263    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-home\") pod \"auth-test-model-c8412b-kserve-587b5c85cf-2vfst\" (UID: \"2bf20c57-53b0-4787-ba7b-8f4efe689ed4\") " pod="ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst"
Jul 09 19:34:23.330298 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:23.330296    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-dshm\") pod \"auth-test-model-c8412b-kserve-587b5c85cf-2vfst\" (UID: \"2bf20c57-53b0-4787-ba7b-8f4efe689ed4\") " pod="ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst"
Jul 09 19:34:23.330548 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:23.330317    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9kq9\" (UniqueName: \"kubernetes.io/projected/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-kube-api-access-v9kq9\") pod \"auth-test-model-c8412b-kserve-587b5c85cf-2vfst\" (UID: \"2bf20c57-53b0-4787-ba7b-8f4efe689ed4\") " pod="ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst"
Jul 09 19:34:23.330548 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:23.330429    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-tls-certs\") pod \"auth-test-model-c8412b-kserve-587b5c85cf-2vfst\" (UID: \"2bf20c57-53b0-4787-ba7b-8f4efe689ed4\") " pod="ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst"
Jul 09 19:34:23.330548 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:23.330462    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-tmp-dir\") pod \"auth-test-model-c8412b-kserve-587b5c85cf-2vfst\" (UID: \"2bf20c57-53b0-4787-ba7b-8f4efe689ed4\") " pod="ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst"
Jul 09 19:34:23.330655 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:23.330575    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-model-cache\") pod \"auth-test-model-c8412b-kserve-587b5c85cf-2vfst\" (UID: \"2bf20c57-53b0-4787-ba7b-8f4efe689ed4\") " pod="ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst"
Jul 09 19:34:23.331681 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:23.331652    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:34:23.431260 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:23.431220    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-home\") pod \"auth-test-model-c8412b-kserve-587b5c85cf-2vfst\" (UID: \"2bf20c57-53b0-4787-ba7b-8f4efe689ed4\") " pod="ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst"
Jul 09 19:34:23.431260 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:23.431260    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-dshm\") pod \"auth-test-model-c8412b-kserve-587b5c85cf-2vfst\" (UID: \"2bf20c57-53b0-4787-ba7b-8f4efe689ed4\") " pod="ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst"
Jul 09 19:34:23.431523 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:23.431278    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9kq9\" (UniqueName: \"kubernetes.io/projected/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-kube-api-access-v9kq9\") pod \"auth-test-model-c8412b-kserve-587b5c85cf-2vfst\" (UID: \"2bf20c57-53b0-4787-ba7b-8f4efe689ed4\") " pod="ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst"
Jul 09 19:34:23.431523 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:23.431341    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-tls-certs\") pod \"auth-test-model-c8412b-kserve-587b5c85cf-2vfst\" (UID: \"2bf20c57-53b0-4787-ba7b-8f4efe689ed4\") " pod="ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst"
Jul 09 19:34:23.431523 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:23.431372    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-tmp-dir\") pod \"auth-test-model-c8412b-kserve-587b5c85cf-2vfst\" (UID: \"2bf20c57-53b0-4787-ba7b-8f4efe689ed4\") " pod="ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst"
Jul 09 19:34:23.431523 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:23.431440    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-model-cache\") pod \"auth-test-model-c8412b-kserve-587b5c85cf-2vfst\" (UID: \"2bf20c57-53b0-4787-ba7b-8f4efe689ed4\") " pod="ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst"
Jul 09 19:34:23.431742 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:23.431690    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-home\") pod \"auth-test-model-c8412b-kserve-587b5c85cf-2vfst\" (UID: \"2bf20c57-53b0-4787-ba7b-8f4efe689ed4\") " pod="ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst"
Jul 09 19:34:23.431844 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:23.431744    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-tmp-dir\") pod \"auth-test-model-c8412b-kserve-587b5c85cf-2vfst\" (UID: \"2bf20c57-53b0-4787-ba7b-8f4efe689ed4\") " pod="ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst"
Jul 09 19:34:23.431844 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:23.431788    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-model-cache\") pod \"auth-test-model-c8412b-kserve-587b5c85cf-2vfst\" (UID: \"2bf20c57-53b0-4787-ba7b-8f4efe689ed4\") " pod="ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst"
Jul 09 19:34:23.433520 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:23.433503    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-dshm\") pod \"auth-test-model-c8412b-kserve-587b5c85cf-2vfst\" (UID: \"2bf20c57-53b0-4787-ba7b-8f4efe689ed4\") " pod="ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst"
Jul 09 19:34:23.433786 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:23.433764    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-tls-certs\") pod \"auth-test-model-c8412b-kserve-587b5c85cf-2vfst\" (UID: \"2bf20c57-53b0-4787-ba7b-8f4efe689ed4\") " pod="ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst"
Jul 09 19:34:23.439591 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:23.439567    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9kq9\" (UniqueName: \"kubernetes.io/projected/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-kube-api-access-v9kq9\") pod \"auth-test-model-c8412b-kserve-587b5c85cf-2vfst\" (UID: \"2bf20c57-53b0-4787-ba7b-8f4efe689ed4\") " pod="ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst"
Jul 09 19:34:23.561784 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:23.561682    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst"
Jul 09 19:34:23.699218 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:23.699192    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst"]
Jul 09 19:34:23.702155 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:34:23.702120    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2bf20c57_53b0_4787_ba7b_8f4efe689ed4.slice/crio-453714cafcb537f2b1f6b80dfd855afb5344092ab99b36849ca019b4f6764594 WatchSource:0}: Error finding container 453714cafcb537f2b1f6b80dfd855afb5344092ab99b36849ca019b4f6764594: Status 404 returned error can't find the container with id 453714cafcb537f2b1f6b80dfd855afb5344092ab99b36849ca019b4f6764594
Jul 09 19:34:24.677092 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:24.677054    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst" event={"ID":"2bf20c57-53b0-4787-ba7b-8f4efe689ed4","Type":"ContainerStarted","Data":"36e6818ea1680fd317890bf90ef8eae780fd18f2a15ec586db1661ef57884c3b"}
Jul 09 19:34:24.677092 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:24.677099    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst" event={"ID":"2bf20c57-53b0-4787-ba7b-8f4efe689ed4","Type":"ContainerStarted","Data":"453714cafcb537f2b1f6b80dfd855afb5344092ab99b36849ca019b4f6764594"}
Jul 09 19:34:24.694347 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:24.694290    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst" podStartSLOduration=1.694275873 podStartE2EDuration="1.694275873s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:34:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:34:24.693883513 +0000 UTC m=+2083.078953788" watchObservedRunningTime="2026-07-09 19:34:24.694275873 +0000 UTC m=+2083.079346138"
Jul 09 19:34:26.640171 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:26.640140    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:34:33.562275 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:33.562240    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst"
Jul 09 19:34:33.562662 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:33.562293    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst"
Jul 09 19:34:33.574454 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:33.574420    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst"
Jul 09 19:34:33.733214 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:33.733183    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst"
Jul 09 19:34:40.550107 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:40.550057    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:34:44.839878 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:34:44.839840    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:35:07.453612 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:35:07.453574    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:35:26.841571 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:35:26.841535    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:35:43.940498 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:35:43.940461    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:35:57.214618 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:35:57.214577    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:35:57.272047 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:35:57.272012    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:36:01.238642 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:36:01.238604    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:36:12.044684 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:36:12.044641    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:36:12.093595 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:36:12.093529    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:36:19.445363 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:36:19.445327    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:36:36.233157 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:36:36.233123    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:36:51.830247 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:36:51.830208    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:36:54.631975 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:36:54.631939    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:37:07.104152 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:07.104072    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst"]
Jul 09 19:37:07.121101 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:07.121067    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:37:07.974982 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:07.974948    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:37:10.939712 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:10.939678    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:37:13.246263 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:13.246233    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg"]
Jul 09 19:37:13.249950 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:13.249927    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg"
Jul 09 19:37:13.252779 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:13.252756    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c8412b\"/\"sub-test-model-c8412b-kserve-self-signed-certs\""
Jul 09 19:37:13.260341 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:13.260314    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg"]
Jul 09 19:37:13.281065 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:13.281021    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:37:13.368257 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:13.368220    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17dfb478-cf11-4411-bddd-c026fdf99656-model-cache\") pod \"sub-test-model-c8412b-kserve-794d6c59c9-gpjwg\" (UID: \"17dfb478-cf11-4411-bddd-c026fdf99656\") " pod="ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg"
Jul 09 19:37:13.368436 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:13.368309    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17dfb478-cf11-4411-bddd-c026fdf99656-dshm\") pod \"sub-test-model-c8412b-kserve-794d6c59c9-gpjwg\" (UID: \"17dfb478-cf11-4411-bddd-c026fdf99656\") " pod="ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg"
Jul 09 19:37:13.368436 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:13.368341    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17dfb478-cf11-4411-bddd-c026fdf99656-home\") pod \"sub-test-model-c8412b-kserve-794d6c59c9-gpjwg\" (UID: \"17dfb478-cf11-4411-bddd-c026fdf99656\") " pod="ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg"
Jul 09 19:37:13.368436 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:13.368368    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17dfb478-cf11-4411-bddd-c026fdf99656-tls-certs\") pod \"sub-test-model-c8412b-kserve-794d6c59c9-gpjwg\" (UID: \"17dfb478-cf11-4411-bddd-c026fdf99656\") " pod="ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg"
Jul 09 19:37:13.368436 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:13.368390    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17dfb478-cf11-4411-bddd-c026fdf99656-tmp-dir\") pod \"sub-test-model-c8412b-kserve-794d6c59c9-gpjwg\" (UID: \"17dfb478-cf11-4411-bddd-c026fdf99656\") " pod="ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg"
Jul 09 19:37:13.368436 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:13.368422    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b44cj\" (UniqueName: \"kubernetes.io/projected/17dfb478-cf11-4411-bddd-c026fdf99656-kube-api-access-b44cj\") pod \"sub-test-model-c8412b-kserve-794d6c59c9-gpjwg\" (UID: \"17dfb478-cf11-4411-bddd-c026fdf99656\") " pod="ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg"
Jul 09 19:37:13.469782 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:13.469742    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17dfb478-cf11-4411-bddd-c026fdf99656-model-cache\") pod \"sub-test-model-c8412b-kserve-794d6c59c9-gpjwg\" (UID: \"17dfb478-cf11-4411-bddd-c026fdf99656\") " pod="ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg"
Jul 09 19:37:13.469946 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:13.469853    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17dfb478-cf11-4411-bddd-c026fdf99656-dshm\") pod \"sub-test-model-c8412b-kserve-794d6c59c9-gpjwg\" (UID: \"17dfb478-cf11-4411-bddd-c026fdf99656\") " pod="ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg"
Jul 09 19:37:13.469946 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:13.469881    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17dfb478-cf11-4411-bddd-c026fdf99656-home\") pod \"sub-test-model-c8412b-kserve-794d6c59c9-gpjwg\" (UID: \"17dfb478-cf11-4411-bddd-c026fdf99656\") " pod="ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg"
Jul 09 19:37:13.469946 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:13.469921    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17dfb478-cf11-4411-bddd-c026fdf99656-tls-certs\") pod \"sub-test-model-c8412b-kserve-794d6c59c9-gpjwg\" (UID: \"17dfb478-cf11-4411-bddd-c026fdf99656\") " pod="ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg"
Jul 09 19:37:13.470062 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:13.469956    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17dfb478-cf11-4411-bddd-c026fdf99656-tmp-dir\") pod \"sub-test-model-c8412b-kserve-794d6c59c9-gpjwg\" (UID: \"17dfb478-cf11-4411-bddd-c026fdf99656\") " pod="ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg"
Jul 09 19:37:13.470062 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:13.470003    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b44cj\" (UniqueName: \"kubernetes.io/projected/17dfb478-cf11-4411-bddd-c026fdf99656-kube-api-access-b44cj\") pod \"sub-test-model-c8412b-kserve-794d6c59c9-gpjwg\" (UID: \"17dfb478-cf11-4411-bddd-c026fdf99656\") " pod="ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg"
Jul 09 19:37:13.470246 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:13.470223    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17dfb478-cf11-4411-bddd-c026fdf99656-model-cache\") pod \"sub-test-model-c8412b-kserve-794d6c59c9-gpjwg\" (UID: \"17dfb478-cf11-4411-bddd-c026fdf99656\") " pod="ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg"
Jul 09 19:37:13.470299 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:13.470256    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17dfb478-cf11-4411-bddd-c026fdf99656-home\") pod \"sub-test-model-c8412b-kserve-794d6c59c9-gpjwg\" (UID: \"17dfb478-cf11-4411-bddd-c026fdf99656\") " pod="ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg"
Jul 09 19:37:13.470336 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:13.470298    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17dfb478-cf11-4411-bddd-c026fdf99656-tmp-dir\") pod \"sub-test-model-c8412b-kserve-794d6c59c9-gpjwg\" (UID: \"17dfb478-cf11-4411-bddd-c026fdf99656\") " pod="ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg"
Jul 09 19:37:13.472223 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:13.472197    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17dfb478-cf11-4411-bddd-c026fdf99656-dshm\") pod \"sub-test-model-c8412b-kserve-794d6c59c9-gpjwg\" (UID: \"17dfb478-cf11-4411-bddd-c026fdf99656\") " pod="ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg"
Jul 09 19:37:13.472322 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:13.472298    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17dfb478-cf11-4411-bddd-c026fdf99656-tls-certs\") pod \"sub-test-model-c8412b-kserve-794d6c59c9-gpjwg\" (UID: \"17dfb478-cf11-4411-bddd-c026fdf99656\") " pod="ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg"
Jul 09 19:37:13.478288 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:13.478263    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b44cj\" (UniqueName: \"kubernetes.io/projected/17dfb478-cf11-4411-bddd-c026fdf99656-kube-api-access-b44cj\") pod \"sub-test-model-c8412b-kserve-794d6c59c9-gpjwg\" (UID: \"17dfb478-cf11-4411-bddd-c026fdf99656\") " pod="ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg"
Jul 09 19:37:13.560611 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:13.560523    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg"
Jul 09 19:37:13.694344 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:13.694283    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg"]
Jul 09 19:37:13.697029 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:37:13.697001    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17dfb478_cf11_4411_bddd_c026fdf99656.slice/crio-1380a41c59ce8365c54360577d597ff06a5ea3b7f5b8464764da6374494ad3b3 WatchSource:0}: Error finding container 1380a41c59ce8365c54360577d597ff06a5ea3b7f5b8464764da6374494ad3b3: Status 404 returned error can't find the container with id 1380a41c59ce8365c54360577d597ff06a5ea3b7f5b8464764da6374494ad3b3
Jul 09 19:37:14.530002 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:14.529961    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg" event={"ID":"17dfb478-cf11-4411-bddd-c026fdf99656","Type":"ContainerStarted","Data":"a8f15f0e71150358da761bbcdb589202c03c476f975c42fbce48e99a75e8f1b3"}
Jul 09 19:37:14.530383 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:14.530008    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg" event={"ID":"17dfb478-cf11-4411-bddd-c026fdf99656","Type":"ContainerStarted","Data":"1380a41c59ce8365c54360577d597ff06a5ea3b7f5b8464764da6374494ad3b3"}
Jul 09 19:37:14.548588 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:14.548535    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg" podStartSLOduration=1.548517986 podStartE2EDuration="1.548517986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:37:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:37:14.547627576 +0000 UTC m=+2252.932697851" watchObservedRunningTime="2026-07-09 19:37:14.548517986 +0000 UTC m=+2252.933588297"
Jul 09 19:37:22.124803 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:22.124760    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst" podUID="2bf20c57-53b0-4787-ba7b-8f4efe689ed4" containerName="main" containerID="cri-o://36e6818ea1680fd317890bf90ef8eae780fd18f2a15ec586db1661ef57884c3b" gracePeriod=45
Jul 09 19:37:22.377886 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:22.377802    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst"
Jul 09 19:37:22.470018 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:22.469985    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-dshm\") pod \"2bf20c57-53b0-4787-ba7b-8f4efe689ed4\" (UID: \"2bf20c57-53b0-4787-ba7b-8f4efe689ed4\") "
Jul 09 19:37:22.470018 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:22.470020    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-home\") pod \"2bf20c57-53b0-4787-ba7b-8f4efe689ed4\" (UID: \"2bf20c57-53b0-4787-ba7b-8f4efe689ed4\") "
Jul 09 19:37:22.470286 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:22.470072    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-tls-certs\") pod \"2bf20c57-53b0-4787-ba7b-8f4efe689ed4\" (UID: \"2bf20c57-53b0-4787-ba7b-8f4efe689ed4\") "
Jul 09 19:37:22.470286 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:22.470102    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-tmp-dir\") pod \"2bf20c57-53b0-4787-ba7b-8f4efe689ed4\" (UID: \"2bf20c57-53b0-4787-ba7b-8f4efe689ed4\") "
Jul 09 19:37:22.470286 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:22.470266    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-model-cache\") pod \"2bf20c57-53b0-4787-ba7b-8f4efe689ed4\" (UID: \"2bf20c57-53b0-4787-ba7b-8f4efe689ed4\") "
Jul 09 19:37:22.470443 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:22.470302    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-home" (OuterVolumeSpecName: "home") pod "2bf20c57-53b0-4787-ba7b-8f4efe689ed4" (UID: "2bf20c57-53b0-4787-ba7b-8f4efe689ed4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:37:22.470443 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:22.470361    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9kq9\" (UniqueName: \"kubernetes.io/projected/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-kube-api-access-v9kq9\") pod \"2bf20c57-53b0-4787-ba7b-8f4efe689ed4\" (UID: \"2bf20c57-53b0-4787-ba7b-8f4efe689ed4\") "
Jul 09 19:37:22.470443 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:22.470358    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2bf20c57-53b0-4787-ba7b-8f4efe689ed4" (UID: "2bf20c57-53b0-4787-ba7b-8f4efe689ed4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:37:22.470564 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:22.470518    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-model-cache" (OuterVolumeSpecName: "model-cache") pod "2bf20c57-53b0-4787-ba7b-8f4efe689ed4" (UID: "2bf20c57-53b0-4787-ba7b-8f4efe689ed4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:37:22.470753 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:22.470728    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-model-cache\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:37:22.470844 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:22.470753    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-home\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:37:22.470844 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:22.470766    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-tmp-dir\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:37:22.472394 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:22.472374    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2bf20c57-53b0-4787-ba7b-8f4efe689ed4" (UID: "2bf20c57-53b0-4787-ba7b-8f4efe689ed4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:37:22.472498 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:22.472403    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-dshm" (OuterVolumeSpecName: "dshm") pod "2bf20c57-53b0-4787-ba7b-8f4efe689ed4" (UID: "2bf20c57-53b0-4787-ba7b-8f4efe689ed4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:37:22.472498 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:22.472480    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-kube-api-access-v9kq9" (OuterVolumeSpecName: "kube-api-access-v9kq9") pod "2bf20c57-53b0-4787-ba7b-8f4efe689ed4" (UID: "2bf20c57-53b0-4787-ba7b-8f4efe689ed4"). InnerVolumeSpecName "kube-api-access-v9kq9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:37:22.571321 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:22.571289    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9kq9\" (UniqueName: \"kubernetes.io/projected/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-kube-api-access-v9kq9\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:37:22.571321 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:22.571315    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-dshm\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:37:22.571321 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:22.571324    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bf20c57-53b0-4787-ba7b-8f4efe689ed4-tls-certs\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:37:22.574982 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:22.574956    2577 generic.go:356] "Generic (PLEG): container finished" podID="2bf20c57-53b0-4787-ba7b-8f4efe689ed4" containerID="36e6818ea1680fd317890bf90ef8eae780fd18f2a15ec586db1661ef57884c3b" exitCode=0
Jul 09 19:37:22.575132 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:22.574997    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst"
Jul 09 19:37:22.575132 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:22.575044    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst" event={"ID":"2bf20c57-53b0-4787-ba7b-8f4efe689ed4","Type":"ContainerDied","Data":"36e6818ea1680fd317890bf90ef8eae780fd18f2a15ec586db1661ef57884c3b"}
Jul 09 19:37:22.575132 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:22.575089    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst" event={"ID":"2bf20c57-53b0-4787-ba7b-8f4efe689ed4","Type":"ContainerDied","Data":"453714cafcb537f2b1f6b80dfd855afb5344092ab99b36849ca019b4f6764594"}
Jul 09 19:37:22.575132 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:22.575110    2577 scope.go:117] "RemoveContainer" containerID="36e6818ea1680fd317890bf90ef8eae780fd18f2a15ec586db1661ef57884c3b"
Jul 09 19:37:22.584800 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:22.584784    2577 scope.go:117] "RemoveContainer" containerID="36e6818ea1680fd317890bf90ef8eae780fd18f2a15ec586db1661ef57884c3b"
Jul 09 19:37:22.585067 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:37:22.585048    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36e6818ea1680fd317890bf90ef8eae780fd18f2a15ec586db1661ef57884c3b\": container with ID starting with 36e6818ea1680fd317890bf90ef8eae780fd18f2a15ec586db1661ef57884c3b not found: ID does not exist" containerID="36e6818ea1680fd317890bf90ef8eae780fd18f2a15ec586db1661ef57884c3b"
Jul 09 19:37:22.585132 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:22.585075    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36e6818ea1680fd317890bf90ef8eae780fd18f2a15ec586db1661ef57884c3b"} err="failed to get container status \"36e6818ea1680fd317890bf90ef8eae780fd18f2a15ec586db1661ef57884c3b\": rpc error: code = NotFound desc = could not find container \"36e6818ea1680fd317890bf90ef8eae780fd18f2a15ec586db1661ef57884c3b\": container with ID starting with 36e6818ea1680fd317890bf90ef8eae780fd18f2a15ec586db1661ef57884c3b not found: ID does not exist"
Jul 09 19:37:22.598717 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:22.598691    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst"]
Jul 09 19:37:22.608997 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:22.608973    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-c8412b/auth-test-model-c8412b-kserve-587b5c85cf-2vfst"]
Jul 09 19:37:22.640069 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:22.640032    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bf20c57-53b0-4787-ba7b-8f4efe689ed4" path="/var/lib/kubelet/pods/2bf20c57-53b0-4787-ba7b-8f4efe689ed4/volumes"
Jul 09 19:37:23.560782 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:23.560745    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg"
Jul 09 19:37:23.561259 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:23.560802    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg"
Jul 09 19:37:23.573709 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:23.573683    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg"
Jul 09 19:37:23.592439 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:23.592407    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg"
Jul 09 19:37:28.938407 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:28.938375    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:37:30.256280 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:30.256246    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:37:43.948486 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:43.948441    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:37:44.128594 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:44.128557    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:37:44.229727 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:44.229634    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:37:56.444006 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:37:56.443964    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:38:15.744535 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:15.744491    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg"]
Jul 09 19:38:15.771525 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:15.771485    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:38:16.754931 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:16.754897    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:38:20.946555 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:20.946520    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:38:30.694861 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:30.694830    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:38:30.765206 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:30.765160    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg" podUID="17dfb478-cf11-4411-bddd-c026fdf99656" containerName="main" containerID="cri-o://a8f15f0e71150358da761bbcdb589202c03c476f975c42fbce48e99a75e8f1b3" gracePeriod=45
Jul 09 19:38:30.908462 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:30.908429    2577 generic.go:356] "Generic (PLEG): container finished" podID="17dfb478-cf11-4411-bddd-c026fdf99656" containerID="a8f15f0e71150358da761bbcdb589202c03c476f975c42fbce48e99a75e8f1b3" exitCode=0
Jul 09 19:38:30.908657 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:30.908484    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg" event={"ID":"17dfb478-cf11-4411-bddd-c026fdf99656","Type":"ContainerDied","Data":"a8f15f0e71150358da761bbcdb589202c03c476f975c42fbce48e99a75e8f1b3"}
Jul 09 19:38:31.026398 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:31.026370    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg"
Jul 09 19:38:31.135662 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:31.135625    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17dfb478-cf11-4411-bddd-c026fdf99656-home\") pod \"17dfb478-cf11-4411-bddd-c026fdf99656\" (UID: \"17dfb478-cf11-4411-bddd-c026fdf99656\") "
Jul 09 19:38:31.135662 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:31.135672    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b44cj\" (UniqueName: \"kubernetes.io/projected/17dfb478-cf11-4411-bddd-c026fdf99656-kube-api-access-b44cj\") pod \"17dfb478-cf11-4411-bddd-c026fdf99656\" (UID: \"17dfb478-cf11-4411-bddd-c026fdf99656\") "
Jul 09 19:38:31.135939 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:31.135700    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17dfb478-cf11-4411-bddd-c026fdf99656-tls-certs\") pod \"17dfb478-cf11-4411-bddd-c026fdf99656\" (UID: \"17dfb478-cf11-4411-bddd-c026fdf99656\") "
Jul 09 19:38:31.135939 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:31.135730    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17dfb478-cf11-4411-bddd-c026fdf99656-model-cache\") pod \"17dfb478-cf11-4411-bddd-c026fdf99656\" (UID: \"17dfb478-cf11-4411-bddd-c026fdf99656\") "
Jul 09 19:38:31.135939 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:31.135776    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17dfb478-cf11-4411-bddd-c026fdf99656-dshm\") pod \"17dfb478-cf11-4411-bddd-c026fdf99656\" (UID: \"17dfb478-cf11-4411-bddd-c026fdf99656\") "
Jul 09 19:38:31.135939 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:31.135792    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17dfb478-cf11-4411-bddd-c026fdf99656-tmp-dir\") pod \"17dfb478-cf11-4411-bddd-c026fdf99656\" (UID: \"17dfb478-cf11-4411-bddd-c026fdf99656\") "
Jul 09 19:38:31.136161 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:31.135949    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17dfb478-cf11-4411-bddd-c026fdf99656-home" (OuterVolumeSpecName: "home") pod "17dfb478-cf11-4411-bddd-c026fdf99656" (UID: "17dfb478-cf11-4411-bddd-c026fdf99656"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:38:31.136161 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:31.136096    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17dfb478-cf11-4411-bddd-c026fdf99656-model-cache" (OuterVolumeSpecName: "model-cache") pod "17dfb478-cf11-4411-bddd-c026fdf99656" (UID: "17dfb478-cf11-4411-bddd-c026fdf99656"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:38:31.136284 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:31.136179    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17dfb478-cf11-4411-bddd-c026fdf99656-home\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:38:31.136284 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:31.136172    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17dfb478-cf11-4411-bddd-c026fdf99656-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "17dfb478-cf11-4411-bddd-c026fdf99656" (UID: "17dfb478-cf11-4411-bddd-c026fdf99656"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:38:31.137999 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:31.137974    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17dfb478-cf11-4411-bddd-c026fdf99656-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "17dfb478-cf11-4411-bddd-c026fdf99656" (UID: "17dfb478-cf11-4411-bddd-c026fdf99656"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:38:31.137999 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:31.137983    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17dfb478-cf11-4411-bddd-c026fdf99656-dshm" (OuterVolumeSpecName: "dshm") pod "17dfb478-cf11-4411-bddd-c026fdf99656" (UID: "17dfb478-cf11-4411-bddd-c026fdf99656"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:38:31.138152 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:31.137999    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17dfb478-cf11-4411-bddd-c026fdf99656-kube-api-access-b44cj" (OuterVolumeSpecName: "kube-api-access-b44cj") pod "17dfb478-cf11-4411-bddd-c026fdf99656" (UID: "17dfb478-cf11-4411-bddd-c026fdf99656"). InnerVolumeSpecName "kube-api-access-b44cj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:38:31.237694 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:31.237653    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17dfb478-cf11-4411-bddd-c026fdf99656-dshm\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:38:31.237694 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:31.237703    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17dfb478-cf11-4411-bddd-c026fdf99656-tmp-dir\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:38:31.237941 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:31.237715    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b44cj\" (UniqueName: \"kubernetes.io/projected/17dfb478-cf11-4411-bddd-c026fdf99656-kube-api-access-b44cj\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:38:31.237941 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:31.237723    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17dfb478-cf11-4411-bddd-c026fdf99656-tls-certs\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:38:31.237941 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:31.237731    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17dfb478-cf11-4411-bddd-c026fdf99656-model-cache\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:38:31.914685 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:31.914645    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg" event={"ID":"17dfb478-cf11-4411-bddd-c026fdf99656","Type":"ContainerDied","Data":"1380a41c59ce8365c54360577d597ff06a5ea3b7f5b8464764da6374494ad3b3"}
Jul 09 19:38:31.915150 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:31.914701    2577 scope.go:117] "RemoveContainer" containerID="a8f15f0e71150358da761bbcdb589202c03c476f975c42fbce48e99a75e8f1b3"
Jul 09 19:38:31.915150 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:31.914664    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg"
Jul 09 19:38:31.937837 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:31.937792    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg"]
Jul 09 19:38:31.944215 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:31.944184    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-c8412b/sub-test-model-c8412b-kserve-794d6c59c9-gpjwg"]
Jul 09 19:38:32.639170 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:32.639131    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17dfb478-cf11-4411-bddd-c026fdf99656" path="/var/lib/kubelet/pods/17dfb478-cf11-4411-bddd-c026fdf99656/volumes"
Jul 09 19:38:36.740795 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:36.740713    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:38:52.822048 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:52.822012    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv"]
Jul 09 19:38:52.822515 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:52.822440    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bf20c57-53b0-4787-ba7b-8f4efe689ed4" containerName="main"
Jul 09 19:38:52.822515 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:52.822452    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bf20c57-53b0-4787-ba7b-8f4efe689ed4" containerName="main"
Jul 09 19:38:52.822515 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:52.822471    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17dfb478-cf11-4411-bddd-c026fdf99656" containerName="main"
Jul 09 19:38:52.822515 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:52.822477    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="17dfb478-cf11-4411-bddd-c026fdf99656" containerName="main"
Jul 09 19:38:52.822651 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:52.822550    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="17dfb478-cf11-4411-bddd-c026fdf99656" containerName="main"
Jul 09 19:38:52.822651 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:52.822563    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bf20c57-53b0-4787-ba7b-8f4efe689ed4" containerName="main"
Jul 09 19:38:52.825650 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:52.825631    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv"
Jul 09 19:38:52.829316 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:52.829293    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a94244\"/\"openshift-service-ca.crt\""
Jul 09 19:38:52.831373 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:52.831337    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a94244\"/\"rate-test-model-a94244-kserve-self-signed-certs\""
Jul 09 19:38:52.831373 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:52.831347    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a94244\"/\"kube-root-ca.crt\""
Jul 09 19:38:52.831574 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:52.831427    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a94244\"/\"default-dockercfg-pxj7q\""
Jul 09 19:38:52.847090 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:52.847054    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95836a85-9f9c-413c-bb10-b62e47115a75-tls-certs\") pod \"rate-test-model-a94244-kserve-85ff676bc5-p4krv\" (UID: \"95836a85-9f9c-413c-bb10-b62e47115a75\") " pod="ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv"
Jul 09 19:38:52.847290 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:52.847113    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95836a85-9f9c-413c-bb10-b62e47115a75-tmp-dir\") pod \"rate-test-model-a94244-kserve-85ff676bc5-p4krv\" (UID: \"95836a85-9f9c-413c-bb10-b62e47115a75\") " pod="ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv"
Jul 09 19:38:52.847290 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:52.847180    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95836a85-9f9c-413c-bb10-b62e47115a75-model-cache\") pod \"rate-test-model-a94244-kserve-85ff676bc5-p4krv\" (UID: \"95836a85-9f9c-413c-bb10-b62e47115a75\") " pod="ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv"
Jul 09 19:38:52.847290 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:52.847221    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fg5m\" (UniqueName: \"kubernetes.io/projected/95836a85-9f9c-413c-bb10-b62e47115a75-kube-api-access-4fg5m\") pod \"rate-test-model-a94244-kserve-85ff676bc5-p4krv\" (UID: \"95836a85-9f9c-413c-bb10-b62e47115a75\") " pod="ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv"
Jul 09 19:38:52.847290 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:52.847268    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95836a85-9f9c-413c-bb10-b62e47115a75-dshm\") pod \"rate-test-model-a94244-kserve-85ff676bc5-p4krv\" (UID: \"95836a85-9f9c-413c-bb10-b62e47115a75\") " pod="ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv"
Jul 09 19:38:52.847514 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:52.847301    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95836a85-9f9c-413c-bb10-b62e47115a75-home\") pod \"rate-test-model-a94244-kserve-85ff676bc5-p4krv\" (UID: \"95836a85-9f9c-413c-bb10-b62e47115a75\") " pod="ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv"
Jul 09 19:38:52.848464 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:52.848440    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv"]
Jul 09 19:38:52.895248 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:52.895193    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:38:52.948369 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:52.948328    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95836a85-9f9c-413c-bb10-b62e47115a75-dshm\") pod \"rate-test-model-a94244-kserve-85ff676bc5-p4krv\" (UID: \"95836a85-9f9c-413c-bb10-b62e47115a75\") " pod="ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv"
Jul 09 19:38:52.948369 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:52.948370    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95836a85-9f9c-413c-bb10-b62e47115a75-home\") pod \"rate-test-model-a94244-kserve-85ff676bc5-p4krv\" (UID: \"95836a85-9f9c-413c-bb10-b62e47115a75\") " pod="ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv"
Jul 09 19:38:52.948642 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:52.948423    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95836a85-9f9c-413c-bb10-b62e47115a75-tls-certs\") pod \"rate-test-model-a94244-kserve-85ff676bc5-p4krv\" (UID: \"95836a85-9f9c-413c-bb10-b62e47115a75\") " pod="ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv"
Jul 09 19:38:52.948642 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:52.948445    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95836a85-9f9c-413c-bb10-b62e47115a75-tmp-dir\") pod \"rate-test-model-a94244-kserve-85ff676bc5-p4krv\" (UID: \"95836a85-9f9c-413c-bb10-b62e47115a75\") " pod="ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv"
Jul 09 19:38:52.948642 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:52.948485    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95836a85-9f9c-413c-bb10-b62e47115a75-model-cache\") pod \"rate-test-model-a94244-kserve-85ff676bc5-p4krv\" (UID: \"95836a85-9f9c-413c-bb10-b62e47115a75\") " pod="ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv"
Jul 09 19:38:52.948642 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:52.948514    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fg5m\" (UniqueName: \"kubernetes.io/projected/95836a85-9f9c-413c-bb10-b62e47115a75-kube-api-access-4fg5m\") pod \"rate-test-model-a94244-kserve-85ff676bc5-p4krv\" (UID: \"95836a85-9f9c-413c-bb10-b62e47115a75\") " pod="ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv"
Jul 09 19:38:52.948934 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:52.948911    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95836a85-9f9c-413c-bb10-b62e47115a75-tmp-dir\") pod \"rate-test-model-a94244-kserve-85ff676bc5-p4krv\" (UID: \"95836a85-9f9c-413c-bb10-b62e47115a75\") " pod="ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv"
Jul 09 19:38:52.948992 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:52.948915    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95836a85-9f9c-413c-bb10-b62e47115a75-home\") pod \"rate-test-model-a94244-kserve-85ff676bc5-p4krv\" (UID: \"95836a85-9f9c-413c-bb10-b62e47115a75\") " pod="ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv"
Jul 09 19:38:52.948992 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:52.948963    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95836a85-9f9c-413c-bb10-b62e47115a75-model-cache\") pod \"rate-test-model-a94244-kserve-85ff676bc5-p4krv\" (UID: \"95836a85-9f9c-413c-bb10-b62e47115a75\") " pod="ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv"
Jul 09 19:38:52.950668 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:52.950647    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95836a85-9f9c-413c-bb10-b62e47115a75-dshm\") pod \"rate-test-model-a94244-kserve-85ff676bc5-p4krv\" (UID: \"95836a85-9f9c-413c-bb10-b62e47115a75\") " pod="ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv"
Jul 09 19:38:52.950987 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:52.950970    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95836a85-9f9c-413c-bb10-b62e47115a75-tls-certs\") pod \"rate-test-model-a94244-kserve-85ff676bc5-p4krv\" (UID: \"95836a85-9f9c-413c-bb10-b62e47115a75\") " pod="ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv"
Jul 09 19:38:52.957471 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:52.957447    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fg5m\" (UniqueName: \"kubernetes.io/projected/95836a85-9f9c-413c-bb10-b62e47115a75-kube-api-access-4fg5m\") pod \"rate-test-model-a94244-kserve-85ff676bc5-p4krv\" (UID: \"95836a85-9f9c-413c-bb10-b62e47115a75\") " pod="ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv"
Jul 09 19:38:53.135490 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:53.135455    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv"
Jul 09 19:38:53.276985 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:53.276956    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv"]
Jul 09 19:38:53.279314 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:38:53.279285    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95836a85_9f9c_413c_bb10_b62e47115a75.slice/crio-7caef2eaa1cf47eb9ce75a5309affc5f209c8cec576eec94e459b20179a24d54 WatchSource:0}: Error finding container 7caef2eaa1cf47eb9ce75a5309affc5f209c8cec576eec94e459b20179a24d54: Status 404 returned error can't find the container with id 7caef2eaa1cf47eb9ce75a5309affc5f209c8cec576eec94e459b20179a24d54
Jul 09 19:38:54.029040 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:54.029003    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv" event={"ID":"95836a85-9f9c-413c-bb10-b62e47115a75","Type":"ContainerStarted","Data":"187980e21ae300c3ec77b790829abf7588cadd80a7ccaf34f4a7530357b2c40d"}
Jul 09 19:38:54.029040 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:54.029046    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv" event={"ID":"95836a85-9f9c-413c-bb10-b62e47115a75","Type":"ContainerStarted","Data":"7caef2eaa1cf47eb9ce75a5309affc5f209c8cec576eec94e459b20179a24d54"}
Jul 09 19:38:54.048009 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:54.047957    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv" podStartSLOduration=2.04793884 podStartE2EDuration="2.04793884s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:38:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:38:54.047483849 +0000 UTC m=+2352.432554125" watchObservedRunningTime="2026-07-09 19:38:54.04793884 +0000 UTC m=+2352.433009114"
Jul 09 19:38:57.550253 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:38:57.550217    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:39:02.133094 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:02.133058    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:39:02.237032 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:02.236996    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:39:03.135906 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:03.135872    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv"
Jul 09 19:39:03.136295 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:03.135923    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv"
Jul 09 19:39:03.148824 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:03.148785    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv"
Jul 09 19:39:04.093305 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:04.093275    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv"
Jul 09 19:39:10.726844 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:10.726779    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:39:10.821939 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:10.821904    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:39:18.552527 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:18.552488    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:39:33.839067 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:33.839030    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:39:40.175989 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:40.175959    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:39:41.056627 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:41.056589    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv"]
Jul 09 19:39:41.083286 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:41.083259    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:39:42.003629 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:42.003596    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7365-139637666959152"]
Jul 09 19:39:42.007484 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:42.007467    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7365-139637666959152"
Jul 09 19:39:42.010660 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:42.010632    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-xmm4p\""
Jul 09 19:39:42.013000 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:42.012979    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7365-139637666959152"]
Jul 09 19:39:42.148658 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:42.148596    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlv88\" (UniqueName: \"kubernetes.io/projected/4cff9eb0-22fe-437b-8f39-bb502b454889-kube-api-access-wlv88\") pod \"test-curl-7365-139637666959152\" (UID: \"4cff9eb0-22fe-437b-8f39-bb502b454889\") " pod="openshift-ingress/test-curl-7365-139637666959152"
Jul 09 19:39:42.250315 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:42.250272    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlv88\" (UniqueName: \"kubernetes.io/projected/4cff9eb0-22fe-437b-8f39-bb502b454889-kube-api-access-wlv88\") pod \"test-curl-7365-139637666959152\" (UID: \"4cff9eb0-22fe-437b-8f39-bb502b454889\") " pod="openshift-ingress/test-curl-7365-139637666959152"
Jul 09 19:39:42.259314 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:42.259252    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlv88\" (UniqueName: \"kubernetes.io/projected/4cff9eb0-22fe-437b-8f39-bb502b454889-kube-api-access-wlv88\") pod \"test-curl-7365-139637666959152\" (UID: \"4cff9eb0-22fe-437b-8f39-bb502b454889\") " pod="openshift-ingress/test-curl-7365-139637666959152"
Jul 09 19:39:42.318188 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:42.318149    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7365-139637666959152"
Jul 09 19:39:42.452470 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:42.452438    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7365-139637666959152"]
Jul 09 19:39:42.455730 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:39:42.455702    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4cff9eb0_22fe_437b_8f39_bb502b454889.slice/crio-a435872dbc3240fef1c76324f24c31d9d53a5697dce20a16b76dcec62789ce18 WatchSource:0}: Error finding container a435872dbc3240fef1c76324f24c31d9d53a5697dce20a16b76dcec62789ce18: Status 404 returned error can't find the container with id a435872dbc3240fef1c76324f24c31d9d53a5697dce20a16b76dcec62789ce18
Jul 09 19:39:42.457167 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:42.457151    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 19:39:43.275195 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:43.275163    2577 generic.go:356] "Generic (PLEG): container finished" podID="4cff9eb0-22fe-437b-8f39-bb502b454889" containerID="c666eab810fc551f36c9340130ec7cf6f96f6b8783177eae5b61fad6dc5fac98" exitCode=0
Jul 09 19:39:43.275508 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:43.275234    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7365-139637666959152" event={"ID":"4cff9eb0-22fe-437b-8f39-bb502b454889","Type":"ContainerDied","Data":"c666eab810fc551f36c9340130ec7cf6f96f6b8783177eae5b61fad6dc5fac98"}
Jul 09 19:39:43.275508 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:43.275277    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7365-139637666959152" event={"ID":"4cff9eb0-22fe-437b-8f39-bb502b454889","Type":"ContainerStarted","Data":"a435872dbc3240fef1c76324f24c31d9d53a5697dce20a16b76dcec62789ce18"}
Jul 09 19:39:44.428781 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:44.428753    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7365-139637666959152"
Jul 09 19:39:44.451105 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:44.451080    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7365-139637666959152_4cff9eb0-22fe-437b-8f39-bb502b454889/test-curl-7365-139637666959152/0.log"
Jul 09 19:39:44.475386 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:44.475349    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7365-139637666959152"]
Jul 09 19:39:44.479237 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:44.479210    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7365-139637666959152"]
Jul 09 19:39:44.574992 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:44.574907    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlv88\" (UniqueName: \"kubernetes.io/projected/4cff9eb0-22fe-437b-8f39-bb502b454889-kube-api-access-wlv88\") pod \"4cff9eb0-22fe-437b-8f39-bb502b454889\" (UID: \"4cff9eb0-22fe-437b-8f39-bb502b454889\") "
Jul 09 19:39:44.577110 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:44.577074    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cff9eb0-22fe-437b-8f39-bb502b454889-kube-api-access-wlv88" (OuterVolumeSpecName: "kube-api-access-wlv88") pod "4cff9eb0-22fe-437b-8f39-bb502b454889" (UID: "4cff9eb0-22fe-437b-8f39-bb502b454889"). InnerVolumeSpecName "kube-api-access-wlv88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:39:44.639401 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:44.639363    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cff9eb0-22fe-437b-8f39-bb502b454889" path="/var/lib/kubelet/pods/4cff9eb0-22fe-437b-8f39-bb502b454889/volumes"
Jul 09 19:39:44.675670 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:44.675632    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlv88\" (UniqueName: \"kubernetes.io/projected/4cff9eb0-22fe-437b-8f39-bb502b454889-kube-api-access-wlv88\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:39:45.286123 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:45.286094    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7365-139637666959152"
Jul 09 19:39:45.286333 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:45.286140    2577 scope.go:117] "RemoveContainer" containerID="c666eab810fc551f36c9340130ec7cf6f96f6b8783177eae5b61fad6dc5fac98"
Jul 09 19:39:47.525724 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:47.525685    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7365-139637668018048"]
Jul 09 19:39:47.526145 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:47.526110    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cff9eb0-22fe-437b-8f39-bb502b454889" containerName="test-curl-7365-139637666959152"
Jul 09 19:39:47.526145 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:47.526122    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cff9eb0-22fe-437b-8f39-bb502b454889" containerName="test-curl-7365-139637666959152"
Jul 09 19:39:47.526218 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:47.526211    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cff9eb0-22fe-437b-8f39-bb502b454889" containerName="test-curl-7365-139637666959152"
Jul 09 19:39:47.530705 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:47.530688    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7365-139637668018048"
Jul 09 19:39:47.534212 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:47.534189    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-xmm4p\""
Jul 09 19:39:47.535484 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:47.535457    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7365-139637668018048"]
Jul 09 19:39:47.703741 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:47.703705    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcbw9\" (UniqueName: \"kubernetes.io/projected/a4c9f9cf-5ac2-404f-a4b7-2109f938a850-kube-api-access-dcbw9\") pod \"test-curl-7365-139637668018048\" (UID: \"a4c9f9cf-5ac2-404f-a4b7-2109f938a850\") " pod="openshift-ingress/test-curl-7365-139637668018048"
Jul 09 19:39:47.805218 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:47.805123    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcbw9\" (UniqueName: \"kubernetes.io/projected/a4c9f9cf-5ac2-404f-a4b7-2109f938a850-kube-api-access-dcbw9\") pod \"test-curl-7365-139637668018048\" (UID: \"a4c9f9cf-5ac2-404f-a4b7-2109f938a850\") " pod="openshift-ingress/test-curl-7365-139637668018048"
Jul 09 19:39:47.814130 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:47.814094    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcbw9\" (UniqueName: \"kubernetes.io/projected/a4c9f9cf-5ac2-404f-a4b7-2109f938a850-kube-api-access-dcbw9\") pod \"test-curl-7365-139637668018048\" (UID: \"a4c9f9cf-5ac2-404f-a4b7-2109f938a850\") " pod="openshift-ingress/test-curl-7365-139637668018048"
Jul 09 19:39:47.842106 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:47.842074    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7365-139637668018048"
Jul 09 19:39:47.980270 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:47.980244    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7365-139637668018048"]
Jul 09 19:39:47.982251 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:39:47.982217    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4c9f9cf_5ac2_404f_a4b7_2109f938a850.slice/crio-a40e4955b8f851084cb15ac17ef1eb75b02f5fa66e8aa61cf4d4bb5b00090070 WatchSource:0}: Error finding container a40e4955b8f851084cb15ac17ef1eb75b02f5fa66e8aa61cf4d4bb5b00090070: Status 404 returned error can't find the container with id a40e4955b8f851084cb15ac17ef1eb75b02f5fa66e8aa61cf4d4bb5b00090070
Jul 09 19:39:48.302134 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:48.302105    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7365-139637668018048" event={"ID":"a4c9f9cf-5ac2-404f-a4b7-2109f938a850","Type":"ContainerStarted","Data":"a40e4955b8f851084cb15ac17ef1eb75b02f5fa66e8aa61cf4d4bb5b00090070"}
Jul 09 19:39:49.311195 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:49.311162    2577 generic.go:356] "Generic (PLEG): container finished" podID="a4c9f9cf-5ac2-404f-a4b7-2109f938a850" containerID="d5c349b16ab9b6263881e1de6d1a5324b7bb658628eae05bf8893305b1a3a797" exitCode=0
Jul 09 19:39:49.311638 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:49.311241    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7365-139637668018048" event={"ID":"a4c9f9cf-5ac2-404f-a4b7-2109f938a850","Type":"ContainerDied","Data":"d5c349b16ab9b6263881e1de6d1a5324b7bb658628eae05bf8893305b1a3a797"}
Jul 09 19:39:50.463871 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:50.463845    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7365-139637668018048"
Jul 09 19:39:50.483882 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:50.483833    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7365-139637668018048_a4c9f9cf-5ac2-404f-a4b7-2109f938a850/test-curl-7365-139637668018048/0.log"
Jul 09 19:39:50.507024 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:50.506994    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7365-139637668018048"]
Jul 09 19:39:50.510003 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:50.509977    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7365-139637668018048"]
Jul 09 19:39:50.638182 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:50.638152    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcbw9\" (UniqueName: \"kubernetes.io/projected/a4c9f9cf-5ac2-404f-a4b7-2109f938a850-kube-api-access-dcbw9\") pod \"a4c9f9cf-5ac2-404f-a4b7-2109f938a850\" (UID: \"a4c9f9cf-5ac2-404f-a4b7-2109f938a850\") "
Jul 09 19:39:50.640606 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:50.640573    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4c9f9cf-5ac2-404f-a4b7-2109f938a850-kube-api-access-dcbw9" (OuterVolumeSpecName: "kube-api-access-dcbw9") pod "a4c9f9cf-5ac2-404f-a4b7-2109f938a850" (UID: "a4c9f9cf-5ac2-404f-a4b7-2109f938a850"). InnerVolumeSpecName "kube-api-access-dcbw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:39:50.641247 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:50.641221    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4c9f9cf-5ac2-404f-a4b7-2109f938a850" path="/var/lib/kubelet/pods/a4c9f9cf-5ac2-404f-a4b7-2109f938a850/volumes"
Jul 09 19:39:50.739241 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:50.739206    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcbw9\" (UniqueName: \"kubernetes.io/projected/a4c9f9cf-5ac2-404f-a4b7-2109f938a850-kube-api-access-dcbw9\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:39:51.323127 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:51.323097    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7365-139637668018048"
Jul 09 19:39:51.323127 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:51.323112    2577 scope.go:117] "RemoveContainer" containerID="d5c349b16ab9b6263881e1de6d1a5324b7bb658628eae05bf8893305b1a3a797"
Jul 09 19:39:52.235659 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:52.235628    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:39:53.506788 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:53.506752    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7365-139637668019056"]
Jul 09 19:39:53.507212 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:53.507198    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4c9f9cf-5ac2-404f-a4b7-2109f938a850" containerName="test-curl-7365-139637668018048"
Jul 09 19:39:53.507270 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:53.507214    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4c9f9cf-5ac2-404f-a4b7-2109f938a850" containerName="test-curl-7365-139637668018048"
Jul 09 19:39:53.507312 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:53.507303    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4c9f9cf-5ac2-404f-a4b7-2109f938a850" containerName="test-curl-7365-139637668018048"
Jul 09 19:39:53.511758 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:53.511739    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7365-139637668019056"
Jul 09 19:39:53.514786 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:53.514754    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-xmm4p\""
Jul 09 19:39:53.516507 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:53.516482    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7365-139637668019056"]
Jul 09 19:39:53.566090 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:53.566046    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk57z\" (UniqueName: \"kubernetes.io/projected/5d2fa207-459e-4efe-a111-6dca7fe8fe1b-kube-api-access-lk57z\") pod \"test-curl-7365-139637668019056\" (UID: \"5d2fa207-459e-4efe-a111-6dca7fe8fe1b\") " pod="openshift-ingress/test-curl-7365-139637668019056"
Jul 09 19:39:53.666962 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:53.666906    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk57z\" (UniqueName: \"kubernetes.io/projected/5d2fa207-459e-4efe-a111-6dca7fe8fe1b-kube-api-access-lk57z\") pod \"test-curl-7365-139637668019056\" (UID: \"5d2fa207-459e-4efe-a111-6dca7fe8fe1b\") " pod="openshift-ingress/test-curl-7365-139637668019056"
Jul 09 19:39:53.675035 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:53.674999    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk57z\" (UniqueName: \"kubernetes.io/projected/5d2fa207-459e-4efe-a111-6dca7fe8fe1b-kube-api-access-lk57z\") pod \"test-curl-7365-139637668019056\" (UID: \"5d2fa207-459e-4efe-a111-6dca7fe8fe1b\") " pod="openshift-ingress/test-curl-7365-139637668019056"
Jul 09 19:39:53.822371 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:53.822280    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7365-139637668019056"
Jul 09 19:39:53.959860 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:53.959834    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7365-139637668019056"]
Jul 09 19:39:53.961772 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:39:53.961744    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d2fa207_459e_4efe_a111_6dca7fe8fe1b.slice/crio-adee41d98a0cd23aee96315c1a30f51efe935f5cbbe7fab7e0522db67bfde10f WatchSource:0}: Error finding container adee41d98a0cd23aee96315c1a30f51efe935f5cbbe7fab7e0522db67bfde10f: Status 404 returned error can't find the container with id adee41d98a0cd23aee96315c1a30f51efe935f5cbbe7fab7e0522db67bfde10f
Jul 09 19:39:54.342452 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:54.342423    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7365-139637668019056" event={"ID":"5d2fa207-459e-4efe-a111-6dca7fe8fe1b","Type":"ContainerStarted","Data":"d997b09bd5f798fd2e857f6ff25ce0604da1e9dd80d036af81465174fb946ae2"}
Jul 09 19:39:54.342602 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:54.342470    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7365-139637668019056" event={"ID":"5d2fa207-459e-4efe-a111-6dca7fe8fe1b","Type":"ContainerStarted","Data":"adee41d98a0cd23aee96315c1a30f51efe935f5cbbe7fab7e0522db67bfde10f"}
Jul 09 19:39:54.357519 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:54.357473    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/test-curl-7365-139637668019056" podStartSLOduration=1.0759608489999999 podStartE2EDuration="1.357456197s" totalImagesPullingTime="281.495348ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:39:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:39:54.356850604 +0000 UTC m=+2412.741920879" watchObservedRunningTime="2026-07-09 19:39:54.357456197 +0000 UTC m=+2412.742526518"
Jul 09 19:39:54.454259 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:54.454226    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7365-139637668019056_5d2fa207-459e-4efe-a111-6dca7fe8fe1b/test-curl-7365-139637668019056/0.log"
Jul 09 19:39:55.348621 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:55.348590    2577 generic.go:356] "Generic (PLEG): container finished" podID="5d2fa207-459e-4efe-a111-6dca7fe8fe1b" containerID="d997b09bd5f798fd2e857f6ff25ce0604da1e9dd80d036af81465174fb946ae2" exitCode=0
Jul 09 19:39:55.349055 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:55.348648    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7365-139637668019056" event={"ID":"5d2fa207-459e-4efe-a111-6dca7fe8fe1b","Type":"ContainerDied","Data":"d997b09bd5f798fd2e857f6ff25ce0604da1e9dd80d036af81465174fb946ae2"}
Jul 09 19:39:56.076952 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.076913    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv" podUID="95836a85-9f9c-413c-bb10-b62e47115a75" containerName="main" containerID="cri-o://187980e21ae300c3ec77b790829abf7588cadd80a7ccaf34f4a7530357b2c40d" gracePeriod=45
Jul 09 19:39:56.340513 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.340448    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv"
Jul 09 19:39:56.357402 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.357361    2577 generic.go:356] "Generic (PLEG): container finished" podID="95836a85-9f9c-413c-bb10-b62e47115a75" containerID="187980e21ae300c3ec77b790829abf7588cadd80a7ccaf34f4a7530357b2c40d" exitCode=0
Jul 09 19:39:56.358179 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.357828    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv"
Jul 09 19:39:56.358323 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.357849    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv" event={"ID":"95836a85-9f9c-413c-bb10-b62e47115a75","Type":"ContainerDied","Data":"187980e21ae300c3ec77b790829abf7588cadd80a7ccaf34f4a7530357b2c40d"}
Jul 09 19:39:56.358323 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.358226    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv" event={"ID":"95836a85-9f9c-413c-bb10-b62e47115a75","Type":"ContainerDied","Data":"7caef2eaa1cf47eb9ce75a5309affc5f209c8cec576eec94e459b20179a24d54"}
Jul 09 19:39:56.358323 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.358264    2577 scope.go:117] "RemoveContainer" containerID="187980e21ae300c3ec77b790829abf7588cadd80a7ccaf34f4a7530357b2c40d"
Jul 09 19:39:56.380920 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.380890    2577 scope.go:117] "RemoveContainer" containerID="187980e21ae300c3ec77b790829abf7588cadd80a7ccaf34f4a7530357b2c40d"
Jul 09 19:39:56.381324 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:39:56.381289    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"187980e21ae300c3ec77b790829abf7588cadd80a7ccaf34f4a7530357b2c40d\": container with ID starting with 187980e21ae300c3ec77b790829abf7588cadd80a7ccaf34f4a7530357b2c40d not found: ID does not exist" containerID="187980e21ae300c3ec77b790829abf7588cadd80a7ccaf34f4a7530357b2c40d"
Jul 09 19:39:56.381428 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.381336    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"187980e21ae300c3ec77b790829abf7588cadd80a7ccaf34f4a7530357b2c40d"} err="failed to get container status \"187980e21ae300c3ec77b790829abf7588cadd80a7ccaf34f4a7530357b2c40d\": rpc error: code = NotFound desc = could not find container \"187980e21ae300c3ec77b790829abf7588cadd80a7ccaf34f4a7530357b2c40d\": container with ID starting with 187980e21ae300c3ec77b790829abf7588cadd80a7ccaf34f4a7530357b2c40d not found: ID does not exist"
Jul 09 19:39:56.394430 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.394398    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95836a85-9f9c-413c-bb10-b62e47115a75-model-cache\") pod \"95836a85-9f9c-413c-bb10-b62e47115a75\" (UID: \"95836a85-9f9c-413c-bb10-b62e47115a75\") "
Jul 09 19:39:56.394627 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.394501    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95836a85-9f9c-413c-bb10-b62e47115a75-tmp-dir\") pod \"95836a85-9f9c-413c-bb10-b62e47115a75\" (UID: \"95836a85-9f9c-413c-bb10-b62e47115a75\") "
Jul 09 19:39:56.394627 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.394563    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95836a85-9f9c-413c-bb10-b62e47115a75-tls-certs\") pod \"95836a85-9f9c-413c-bb10-b62e47115a75\" (UID: \"95836a85-9f9c-413c-bb10-b62e47115a75\") "
Jul 09 19:39:56.394627 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.394617    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95836a85-9f9c-413c-bb10-b62e47115a75-dshm\") pod \"95836a85-9f9c-413c-bb10-b62e47115a75\" (UID: \"95836a85-9f9c-413c-bb10-b62e47115a75\") "
Jul 09 19:39:56.394769 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.394660    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fg5m\" (UniqueName: \"kubernetes.io/projected/95836a85-9f9c-413c-bb10-b62e47115a75-kube-api-access-4fg5m\") pod \"95836a85-9f9c-413c-bb10-b62e47115a75\" (UID: \"95836a85-9f9c-413c-bb10-b62e47115a75\") "
Jul 09 19:39:56.394769 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.394705    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95836a85-9f9c-413c-bb10-b62e47115a75-home\") pod \"95836a85-9f9c-413c-bb10-b62e47115a75\" (UID: \"95836a85-9f9c-413c-bb10-b62e47115a75\") "
Jul 09 19:39:56.394769 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.394702    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95836a85-9f9c-413c-bb10-b62e47115a75-model-cache" (OuterVolumeSpecName: "model-cache") pod "95836a85-9f9c-413c-bb10-b62e47115a75" (UID: "95836a85-9f9c-413c-bb10-b62e47115a75"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:39:56.394902 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.394837    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95836a85-9f9c-413c-bb10-b62e47115a75-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "95836a85-9f9c-413c-bb10-b62e47115a75" (UID: "95836a85-9f9c-413c-bb10-b62e47115a75"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:39:56.395081 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.395056    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95836a85-9f9c-413c-bb10-b62e47115a75-home" (OuterVolumeSpecName: "home") pod "95836a85-9f9c-413c-bb10-b62e47115a75" (UID: "95836a85-9f9c-413c-bb10-b62e47115a75"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:39:56.395161 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.395104    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95836a85-9f9c-413c-bb10-b62e47115a75-model-cache\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:39:56.395161 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.395125    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95836a85-9f9c-413c-bb10-b62e47115a75-tmp-dir\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:39:56.397012 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.396987    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95836a85-9f9c-413c-bb10-b62e47115a75-dshm" (OuterVolumeSpecName: "dshm") pod "95836a85-9f9c-413c-bb10-b62e47115a75" (UID: "95836a85-9f9c-413c-bb10-b62e47115a75"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:39:56.397165 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.397142    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95836a85-9f9c-413c-bb10-b62e47115a75-kube-api-access-4fg5m" (OuterVolumeSpecName: "kube-api-access-4fg5m") pod "95836a85-9f9c-413c-bb10-b62e47115a75" (UID: "95836a85-9f9c-413c-bb10-b62e47115a75"). InnerVolumeSpecName "kube-api-access-4fg5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:39:56.397211 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.397182    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95836a85-9f9c-413c-bb10-b62e47115a75-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "95836a85-9f9c-413c-bb10-b62e47115a75" (UID: "95836a85-9f9c-413c-bb10-b62e47115a75"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:39:56.495891 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.495860    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95836a85-9f9c-413c-bb10-b62e47115a75-dshm\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:39:56.495891 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.495890    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fg5m\" (UniqueName: \"kubernetes.io/projected/95836a85-9f9c-413c-bb10-b62e47115a75-kube-api-access-4fg5m\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:39:56.496094 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.495904    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95836a85-9f9c-413c-bb10-b62e47115a75-home\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:39:56.496094 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.495918    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95836a85-9f9c-413c-bb10-b62e47115a75-tls-certs\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:39:56.505488 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.505464    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7365-139637668019056"
Jul 09 19:39:56.538257 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.538220    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7365-139637668019056"]
Jul 09 19:39:56.540182 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.540158    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7365-139637668019056"]
Jul 09 19:39:56.597037 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.596945    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lk57z\" (UniqueName: \"kubernetes.io/projected/5d2fa207-459e-4efe-a111-6dca7fe8fe1b-kube-api-access-lk57z\") pod \"5d2fa207-459e-4efe-a111-6dca7fe8fe1b\" (UID: \"5d2fa207-459e-4efe-a111-6dca7fe8fe1b\") "
Jul 09 19:39:56.599045 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.599021    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d2fa207-459e-4efe-a111-6dca7fe8fe1b-kube-api-access-lk57z" (OuterVolumeSpecName: "kube-api-access-lk57z") pod "5d2fa207-459e-4efe-a111-6dca7fe8fe1b" (UID: "5d2fa207-459e-4efe-a111-6dca7fe8fe1b"). InnerVolumeSpecName "kube-api-access-lk57z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:39:56.639950 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.639914    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d2fa207-459e-4efe-a111-6dca7fe8fe1b" path="/var/lib/kubelet/pods/5d2fa207-459e-4efe-a111-6dca7fe8fe1b/volumes"
Jul 09 19:39:56.659318 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.659290    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7365-139637668019056"]
Jul 09 19:39:56.659733 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.659714    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d2fa207-459e-4efe-a111-6dca7fe8fe1b" containerName="test-curl-7365-139637668019056"
Jul 09 19:39:56.659733 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.659733    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d2fa207-459e-4efe-a111-6dca7fe8fe1b" containerName="test-curl-7365-139637668019056"
Jul 09 19:39:56.659927 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.659754    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95836a85-9f9c-413c-bb10-b62e47115a75" containerName="main"
Jul 09 19:39:56.659927 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.659760    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="95836a85-9f9c-413c-bb10-b62e47115a75" containerName="main"
Jul 09 19:39:56.659927 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.659845    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d2fa207-459e-4efe-a111-6dca7fe8fe1b" containerName="test-curl-7365-139637668019056"
Jul 09 19:39:56.659927 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.659857    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="95836a85-9f9c-413c-bb10-b62e47115a75" containerName="main"
Jul 09 19:39:56.662915 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.662896    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7365-139637668019056"
Jul 09 19:39:56.668768 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.668738    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7365-139637668019056"]
Jul 09 19:39:56.678002 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.677977    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv"]
Jul 09 19:39:56.684134 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.684112    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a94244/rate-test-model-a94244-kserve-85ff676bc5-p4krv"]
Jul 09 19:39:56.697678 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.697636    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjmf4\" (UniqueName: \"kubernetes.io/projected/471a4a1e-f8bd-427e-9ff5-7e86b7a50842-kube-api-access-fjmf4\") pod \"test-curl-7365-139637668019056\" (UID: \"471a4a1e-f8bd-427e-9ff5-7e86b7a50842\") " pod="openshift-ingress/test-curl-7365-139637668019056"
Jul 09 19:39:56.697876 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.697859    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lk57z\" (UniqueName: \"kubernetes.io/projected/5d2fa207-459e-4efe-a111-6dca7fe8fe1b-kube-api-access-lk57z\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:39:56.798799 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.798747    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjmf4\" (UniqueName: \"kubernetes.io/projected/471a4a1e-f8bd-427e-9ff5-7e86b7a50842-kube-api-access-fjmf4\") pod \"test-curl-7365-139637668019056\" (UID: \"471a4a1e-f8bd-427e-9ff5-7e86b7a50842\") " pod="openshift-ingress/test-curl-7365-139637668019056"
Jul 09 19:39:56.808667 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.808639    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjmf4\" (UniqueName: \"kubernetes.io/projected/471a4a1e-f8bd-427e-9ff5-7e86b7a50842-kube-api-access-fjmf4\") pod \"test-curl-7365-139637668019056\" (UID: \"471a4a1e-f8bd-427e-9ff5-7e86b7a50842\") " pod="openshift-ingress/test-curl-7365-139637668019056"
Jul 09 19:39:56.973378 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:56.973336    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7365-139637668019056"
Jul 09 19:39:57.107595 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:57.107569    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7365-139637668019056"]
Jul 09 19:39:57.109249 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:39:57.109222    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod471a4a1e_f8bd_427e_9ff5_7e86b7a50842.slice/crio-687a115ef54b689ab559dd5caa90acef4345832de0890b2d3343b1ff5f8ff8f9 WatchSource:0}: Error finding container 687a115ef54b689ab559dd5caa90acef4345832de0890b2d3343b1ff5f8ff8f9: Status 404 returned error can't find the container with id 687a115ef54b689ab559dd5caa90acef4345832de0890b2d3343b1ff5f8ff8f9
Jul 09 19:39:57.365664 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:57.365585    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7365-139637668019056"
Jul 09 19:39:57.365664 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:57.365609    2577 scope.go:117] "RemoveContainer" containerID="d997b09bd5f798fd2e857f6ff25ce0604da1e9dd80d036af81465174fb946ae2"
Jul 09 19:39:57.366792 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:57.366768    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7365-139637668019056" event={"ID":"471a4a1e-f8bd-427e-9ff5-7e86b7a50842","Type":"ContainerStarted","Data":"687a115ef54b689ab559dd5caa90acef4345832de0890b2d3343b1ff5f8ff8f9"}
Jul 09 19:39:58.373725 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:58.373689    2577 generic.go:356] "Generic (PLEG): container finished" podID="471a4a1e-f8bd-427e-9ff5-7e86b7a50842" containerID="3675fe37a1ea5343d955b7cc157a2f207eb9dd8d2f22fa651033d7a2b533fc98" exitCode=0
Jul 09 19:39:58.374173 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:58.373779    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7365-139637668019056" event={"ID":"471a4a1e-f8bd-427e-9ff5-7e86b7a50842","Type":"ContainerDied","Data":"3675fe37a1ea5343d955b7cc157a2f207eb9dd8d2f22fa651033d7a2b533fc98"}
Jul 09 19:39:58.639035 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:58.638999    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95836a85-9f9c-413c-bb10-b62e47115a75" path="/var/lib/kubelet/pods/95836a85-9f9c-413c-bb10-b62e47115a75/volumes"
Jul 09 19:39:59.527504 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:59.527476    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7365-139637668019056"
Jul 09 19:39:59.551639 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:59.551613    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7365-139637668019056_471a4a1e-f8bd-427e-9ff5-7e86b7a50842/test-curl-7365-139637668019056/0.log"
Jul 09 19:39:59.576352 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:59.576326    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7365-139637668019056"]
Jul 09 19:39:59.581186 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:59.581160    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7365-139637668019056"]
Jul 09 19:39:59.627700 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:59.627672    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjmf4\" (UniqueName: \"kubernetes.io/projected/471a4a1e-f8bd-427e-9ff5-7e86b7a50842-kube-api-access-fjmf4\") pod \"471a4a1e-f8bd-427e-9ff5-7e86b7a50842\" (UID: \"471a4a1e-f8bd-427e-9ff5-7e86b7a50842\") "
Jul 09 19:39:59.629777 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:59.629713    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/471a4a1e-f8bd-427e-9ff5-7e86b7a50842-kube-api-access-fjmf4" (OuterVolumeSpecName: "kube-api-access-fjmf4") pod "471a4a1e-f8bd-427e-9ff5-7e86b7a50842" (UID: "471a4a1e-f8bd-427e-9ff5-7e86b7a50842"). InnerVolumeSpecName "kube-api-access-fjmf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:39:59.728797 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:59.728760    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjmf4\" (UniqueName: \"kubernetes.io/projected/471a4a1e-f8bd-427e-9ff5-7e86b7a50842-kube-api-access-fjmf4\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:39:59.819470 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:39:59.819439    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:40:00.233623 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:00.233594    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:40:00.346985 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:00.346952    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:40:00.385438 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:00.385411    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="687a115ef54b689ab559dd5caa90acef4345832de0890b2d3343b1ff5f8ff8f9"
Jul 09 19:40:00.385438 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:00.385433    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7365-139637668019056"
Jul 09 19:40:00.395875 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:40:00.395840    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7365-139637668019056\" is forbidden: User \"system:node:ip-10-0-137-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-137-233.ec2.internal' and this object" podUID="471a4a1e-f8bd-427e-9ff5-7e86b7a50842" pod="openshift-ingress/test-curl-7365-139637668019056"
Jul 09 19:40:00.446953 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:00.446911    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:40:00.608441 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:00.608360    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg"]
Jul 09 19:40:00.608919 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:00.608617    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg" podUID="90b29ceb-1f2b-473c-93b7-1f89e82bcd8b" containerName="maas-api" containerID="cri-o://1b47ac076deb049947c6aed16ff88804030e30a132deedb328420c3437b4b648" gracePeriod=30
Jul 09 19:40:00.611398 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:40:00.611366    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7365-139637668019056\" is forbidden: User \"system:node:ip-10-0-137-233.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-137-233.ec2.internal' and this object" podUID="471a4a1e-f8bd-427e-9ff5-7e86b7a50842" pod="openshift-ingress/test-curl-7365-139637668019056"
Jul 09 19:40:00.638913 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:00.638883    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="471a4a1e-f8bd-427e-9ff5-7e86b7a50842" path="/var/lib/kubelet/pods/471a4a1e-f8bd-427e-9ff5-7e86b7a50842/volumes"
Jul 09 19:40:00.655551 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:00.655525    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:40:00.861546 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:00.861484    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg"
Jul 09 19:40:00.941994 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:00.941959    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nt8w\" (UniqueName: \"kubernetes.io/projected/90b29ceb-1f2b-473c-93b7-1f89e82bcd8b-kube-api-access-7nt8w\") pod \"90b29ceb-1f2b-473c-93b7-1f89e82bcd8b\" (UID: \"90b29ceb-1f2b-473c-93b7-1f89e82bcd8b\") "
Jul 09 19:40:00.942162 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:00.942149    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90b29ceb-1f2b-473c-93b7-1f89e82bcd8b-maas-api-tls\") pod \"90b29ceb-1f2b-473c-93b7-1f89e82bcd8b\" (UID: \"90b29ceb-1f2b-473c-93b7-1f89e82bcd8b\") "
Jul 09 19:40:00.942209 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:00.942170    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90b29ceb-1f2b-473c-93b7-1f89e82bcd8b-openshift-service-ca\") pod \"90b29ceb-1f2b-473c-93b7-1f89e82bcd8b\" (UID: \"90b29ceb-1f2b-473c-93b7-1f89e82bcd8b\") "
Jul 09 19:40:00.942607 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:00.942580    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90b29ceb-1f2b-473c-93b7-1f89e82bcd8b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "90b29ceb-1f2b-473c-93b7-1f89e82bcd8b" (UID: "90b29ceb-1f2b-473c-93b7-1f89e82bcd8b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:40:00.944043 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:00.944016    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90b29ceb-1f2b-473c-93b7-1f89e82bcd8b-kube-api-access-7nt8w" (OuterVolumeSpecName: "kube-api-access-7nt8w") pod "90b29ceb-1f2b-473c-93b7-1f89e82bcd8b" (UID: "90b29ceb-1f2b-473c-93b7-1f89e82bcd8b"). InnerVolumeSpecName "kube-api-access-7nt8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:40:00.944146 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:00.944122    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90b29ceb-1f2b-473c-93b7-1f89e82bcd8b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "90b29ceb-1f2b-473c-93b7-1f89e82bcd8b" (UID: "90b29ceb-1f2b-473c-93b7-1f89e82bcd8b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:40:01.043598 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:01.043553    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7nt8w\" (UniqueName: \"kubernetes.io/projected/90b29ceb-1f2b-473c-93b7-1f89e82bcd8b-kube-api-access-7nt8w\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:40:01.043598 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:01.043587    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90b29ceb-1f2b-473c-93b7-1f89e82bcd8b-maas-api-tls\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:40:01.043598 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:01.043597    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90b29ceb-1f2b-473c-93b7-1f89e82bcd8b-openshift-service-ca\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:40:01.392133 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:01.392092    2577 generic.go:356] "Generic (PLEG): container finished" podID="90b29ceb-1f2b-473c-93b7-1f89e82bcd8b" containerID="1b47ac076deb049947c6aed16ff88804030e30a132deedb328420c3437b4b648" exitCode=0
Jul 09 19:40:01.392313 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:01.392140    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg"
Jul 09 19:40:01.392313 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:01.392152    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg" event={"ID":"90b29ceb-1f2b-473c-93b7-1f89e82bcd8b","Type":"ContainerDied","Data":"1b47ac076deb049947c6aed16ff88804030e30a132deedb328420c3437b4b648"}
Jul 09 19:40:01.392313 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:01.392194    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg" event={"ID":"90b29ceb-1f2b-473c-93b7-1f89e82bcd8b","Type":"ContainerDied","Data":"72867aeb1b413aba877ff060603b4f38f21fa701a0b618e505199248381c6243"}
Jul 09 19:40:01.392313 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:01.392214    2577 scope.go:117] "RemoveContainer" containerID="1b47ac076deb049947c6aed16ff88804030e30a132deedb328420c3437b4b648"
Jul 09 19:40:01.401602 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:01.401584    2577 scope.go:117] "RemoveContainer" containerID="1b47ac076deb049947c6aed16ff88804030e30a132deedb328420c3437b4b648"
Jul 09 19:40:01.401910 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:40:01.401891    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b47ac076deb049947c6aed16ff88804030e30a132deedb328420c3437b4b648\": container with ID starting with 1b47ac076deb049947c6aed16ff88804030e30a132deedb328420c3437b4b648 not found: ID does not exist" containerID="1b47ac076deb049947c6aed16ff88804030e30a132deedb328420c3437b4b648"
Jul 09 19:40:01.401975 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:01.401921    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b47ac076deb049947c6aed16ff88804030e30a132deedb328420c3437b4b648"} err="failed to get container status \"1b47ac076deb049947c6aed16ff88804030e30a132deedb328420c3437b4b648\": rpc error: code = NotFound desc = could not find container \"1b47ac076deb049947c6aed16ff88804030e30a132deedb328420c3437b4b648\": container with ID starting with 1b47ac076deb049947c6aed16ff88804030e30a132deedb328420c3437b4b648 not found: ID does not exist"
Jul 09 19:40:01.417580 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:01.417552    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg"]
Jul 09 19:40:01.425215 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:01.425188    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c8412b-56bbcf986-kpjvg"]
Jul 09 19:40:02.639070 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:02.639034    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90b29ceb-1f2b-473c-93b7-1f89e82bcd8b" path="/var/lib/kubelet/pods/90b29ceb-1f2b-473c-93b7-1f89e82bcd8b/volumes"
Jul 09 19:40:03.046308 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:03.046217    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:40:06.068405 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:06.068313    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:40:06.135794 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:06.135766    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:40:06.345300 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:06.345214    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:40:06.552654 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:06.552618    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:40:06.717328 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:06.717293    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:40:07.116532 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:07.116446    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:40:07.217479 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:07.217450    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:40:07.347755 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:07.347714    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl"]
Jul 09 19:40:07.348032 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:07.347980    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl" podUID="0e1f609a-2e89-4273-bbf0-6f942991b49e" containerName="maas-api" containerID="cri-o://22cf0a42cb9c711080980b33513bb12a79475dda0804a3c9c639b1e32d563356" gracePeriod=30
Jul 09 19:40:07.379694 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:07.379608    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:40:07.803346 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:07.803320    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl"
Jul 09 19:40:07.912836 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:07.912713    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e1f609a-2e89-4273-bbf0-6f942991b49e-maas-api-tls\") pod \"0e1f609a-2e89-4273-bbf0-6f942991b49e\" (UID: \"0e1f609a-2e89-4273-bbf0-6f942991b49e\") "
Jul 09 19:40:07.912836 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:07.912785    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57r54\" (UniqueName: \"kubernetes.io/projected/0e1f609a-2e89-4273-bbf0-6f942991b49e-kube-api-access-57r54\") pod \"0e1f609a-2e89-4273-bbf0-6f942991b49e\" (UID: \"0e1f609a-2e89-4273-bbf0-6f942991b49e\") "
Jul 09 19:40:07.913077 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:07.912887    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e1f609a-2e89-4273-bbf0-6f942991b49e-openshift-service-ca\") pod \"0e1f609a-2e89-4273-bbf0-6f942991b49e\" (UID: \"0e1f609a-2e89-4273-bbf0-6f942991b49e\") "
Jul 09 19:40:07.913265 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:07.913235    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e1f609a-2e89-4273-bbf0-6f942991b49e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0e1f609a-2e89-4273-bbf0-6f942991b49e" (UID: "0e1f609a-2e89-4273-bbf0-6f942991b49e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:40:07.915009 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:07.914981    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e1f609a-2e89-4273-bbf0-6f942991b49e-kube-api-access-57r54" (OuterVolumeSpecName: "kube-api-access-57r54") pod "0e1f609a-2e89-4273-bbf0-6f942991b49e" (UID: "0e1f609a-2e89-4273-bbf0-6f942991b49e"). InnerVolumeSpecName "kube-api-access-57r54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:40:07.915087 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:07.915012    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e1f609a-2e89-4273-bbf0-6f942991b49e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0e1f609a-2e89-4273-bbf0-6f942991b49e" (UID: "0e1f609a-2e89-4273-bbf0-6f942991b49e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:40:08.013706 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:08.013673    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e1f609a-2e89-4273-bbf0-6f942991b49e-maas-api-tls\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:40:08.013706 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:08.013704    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57r54\" (UniqueName: \"kubernetes.io/projected/0e1f609a-2e89-4273-bbf0-6f942991b49e-kube-api-access-57r54\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:40:08.013934 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:08.013718    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e1f609a-2e89-4273-bbf0-6f942991b49e-openshift-service-ca\") on node \"ip-10-0-137-233.ec2.internal\" DevicePath \"\""
Jul 09 19:40:08.429539 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:08.429505    2577 generic.go:356] "Generic (PLEG): container finished" podID="0e1f609a-2e89-4273-bbf0-6f942991b49e" containerID="22cf0a42cb9c711080980b33513bb12a79475dda0804a3c9c639b1e32d563356" exitCode=0
Jul 09 19:40:08.429942 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:08.429558    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl"
Jul 09 19:40:08.429942 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:08.429576    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl" event={"ID":"0e1f609a-2e89-4273-bbf0-6f942991b49e","Type":"ContainerDied","Data":"22cf0a42cb9c711080980b33513bb12a79475dda0804a3c9c639b1e32d563356"}
Jul 09 19:40:08.429942 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:08.429642    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl" event={"ID":"0e1f609a-2e89-4273-bbf0-6f942991b49e","Type":"ContainerDied","Data":"cccd744e48da6938a5a5914e50f36d0e34cc0966ba266e5e13edadb8deac0bd4"}
Jul 09 19:40:08.429942 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:08.429662    2577 scope.go:117] "RemoveContainer" containerID="22cf0a42cb9c711080980b33513bb12a79475dda0804a3c9c639b1e32d563356"
Jul 09 19:40:08.439153 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:08.439134    2577 scope.go:117] "RemoveContainer" containerID="22cf0a42cb9c711080980b33513bb12a79475dda0804a3c9c639b1e32d563356"
Jul 09 19:40:08.439405 ip-10-0-137-233 kubenswrapper[2577]: E0709 19:40:08.439384    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22cf0a42cb9c711080980b33513bb12a79475dda0804a3c9c639b1e32d563356\": container with ID starting with 22cf0a42cb9c711080980b33513bb12a79475dda0804a3c9c639b1e32d563356 not found: ID does not exist" containerID="22cf0a42cb9c711080980b33513bb12a79475dda0804a3c9c639b1e32d563356"
Jul 09 19:40:08.439465 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:08.439418    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22cf0a42cb9c711080980b33513bb12a79475dda0804a3c9c639b1e32d563356"} err="failed to get container status \"22cf0a42cb9c711080980b33513bb12a79475dda0804a3c9c639b1e32d563356\": rpc error: code = NotFound desc = could not find container \"22cf0a42cb9c711080980b33513bb12a79475dda0804a3c9c639b1e32d563356\": container with ID starting with 22cf0a42cb9c711080980b33513bb12a79475dda0804a3c9c639b1e32d563356 not found: ID does not exist"
Jul 09 19:40:08.451461 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:08.451440    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl"]
Jul 09 19:40:08.454951 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:08.454928    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a94244-55854d9b8c-5m8gl"]
Jul 09 19:40:08.638871 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:08.638838    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e1f609a-2e89-4273-bbf0-6f942991b49e" path="/var/lib/kubelet/pods/0e1f609a-2e89-4273-bbf0-6f942991b49e/volumes"
Jul 09 19:40:13.055417 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:13.055386    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:40:13.255795 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:13.255755    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:40:13.357057 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:13.356970    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:40:13.578360 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:13.578325    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:40:16.930015 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:16.929980    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-68679"]
Jul 09 19:40:19.553857 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:19.553831    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-779db88bb-xhp8b_92045a2d-ff6b-411b-a596-2ac71e27d975/copy-manifests/0.log"
Jul 09 19:40:19.561760 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:19.561739    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-779db88bb-xhp8b_92045a2d-ff6b-411b-a596-2ac71e27d975/manager/0.log"
Jul 09 19:40:21.650767 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:21.650739    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-cljhs_e0fba050-da7d-49c0-8088-d77da7b61bdc/kuadrant-console-plugin/0.log"
Jul 09 19:40:22.016666 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:22.016580    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-68679_397e40eb-bc0c-40a1-8dfb-33ac81d17ea9/limitador/0.log"
Jul 09 19:40:22.711094 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:22.711063    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b6c4d4-g6hzz_ba524d40-a1a2-4b64-bb5d-8722dd385d19/kube-auth-proxy/0.log"
Jul 09 19:40:24.067300 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:24.067273    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-fj26l_42dc2b34-0007-4cb7-990e-733e83c863ac/main/0.log"
Jul 09 19:40:24.178990 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:24.178966    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-4mdps_7e40fccb-82dd-47f8-b045-db5416d30d72/main/0.log"
Jul 09 19:40:27.807835 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:27.807771    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vtw49/must-gather-j98jk"]
Jul 09 19:40:27.808212 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:27.808182    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90b29ceb-1f2b-473c-93b7-1f89e82bcd8b" containerName="maas-api"
Jul 09 19:40:27.808212 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:27.808195    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="90b29ceb-1f2b-473c-93b7-1f89e82bcd8b" containerName="maas-api"
Jul 09 19:40:27.808212 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:27.808205    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e1f609a-2e89-4273-bbf0-6f942991b49e" containerName="maas-api"
Jul 09 19:40:27.808212 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:27.808210    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e1f609a-2e89-4273-bbf0-6f942991b49e" containerName="maas-api"
Jul 09 19:40:27.808364 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:27.808223    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="471a4a1e-f8bd-427e-9ff5-7e86b7a50842" containerName="test-curl-7365-139637668019056"
Jul 09 19:40:27.808364 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:27.808232    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="471a4a1e-f8bd-427e-9ff5-7e86b7a50842" containerName="test-curl-7365-139637668019056"
Jul 09 19:40:27.808364 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:27.808293    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="90b29ceb-1f2b-473c-93b7-1f89e82bcd8b" containerName="maas-api"
Jul 09 19:40:27.808364 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:27.808300    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e1f609a-2e89-4273-bbf0-6f942991b49e" containerName="maas-api"
Jul 09 19:40:27.808364 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:27.808306    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="471a4a1e-f8bd-427e-9ff5-7e86b7a50842" containerName="test-curl-7365-139637668019056"
Jul 09 19:40:27.811368 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:27.811351    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vtw49/must-gather-j98jk"
Jul 09 19:40:27.814668 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:27.814642    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vtw49\"/\"kube-root-ca.crt\""
Jul 09 19:40:27.814668 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:27.814656    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vtw49\"/\"default-dockercfg-8sjz6\""
Jul 09 19:40:27.814921 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:27.814642    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vtw49\"/\"openshift-service-ca.crt\""
Jul 09 19:40:27.818539 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:27.818515    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vtw49/must-gather-j98jk"]
Jul 09 19:40:27.825512 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:27.825489    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:40:27.911243 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:27.911202    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2582f80c-3779-4274-8e68-bc80197592b9-must-gather-output\") pod \"must-gather-j98jk\" (UID: \"2582f80c-3779-4274-8e68-bc80197592b9\") " pod="openshift-must-gather-vtw49/must-gather-j98jk"
Jul 09 19:40:27.911436 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:27.911329    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdndg\" (UniqueName: \"kubernetes.io/projected/2582f80c-3779-4274-8e68-bc80197592b9-kube-api-access-sdndg\") pod \"must-gather-j98jk\" (UID: \"2582f80c-3779-4274-8e68-bc80197592b9\") " pod="openshift-must-gather-vtw49/must-gather-j98jk"
Jul 09 19:40:27.922665 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:27.922626    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:40:28.012060 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:28.012017    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdndg\" (UniqueName: \"kubernetes.io/projected/2582f80c-3779-4274-8e68-bc80197592b9-kube-api-access-sdndg\") pod \"must-gather-j98jk\" (UID: \"2582f80c-3779-4274-8e68-bc80197592b9\") " pod="openshift-must-gather-vtw49/must-gather-j98jk"
Jul 09 19:40:28.012240 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:28.012112    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2582f80c-3779-4274-8e68-bc80197592b9-must-gather-output\") pod \"must-gather-j98jk\" (UID: \"2582f80c-3779-4274-8e68-bc80197592b9\") " pod="openshift-must-gather-vtw49/must-gather-j98jk"
Jul 09 19:40:28.012402 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:28.012386    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2582f80c-3779-4274-8e68-bc80197592b9-must-gather-output\") pod \"must-gather-j98jk\" (UID: \"2582f80c-3779-4274-8e68-bc80197592b9\") " pod="openshift-must-gather-vtw49/must-gather-j98jk"
Jul 09 19:40:28.021571 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:28.021536    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdndg\" (UniqueName: \"kubernetes.io/projected/2582f80c-3779-4274-8e68-bc80197592b9-kube-api-access-sdndg\") pod \"must-gather-j98jk\" (UID: \"2582f80c-3779-4274-8e68-bc80197592b9\") " pod="openshift-must-gather-vtw49/must-gather-j98jk"
Jul 09 19:40:28.121883 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:28.121764    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vtw49/must-gather-j98jk"
Jul 09 19:40:28.280238 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:28.280087    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vtw49/must-gather-j98jk"]
Jul 09 19:40:28.282567 ip-10-0-137-233 kubenswrapper[2577]: W0709 19:40:28.282539    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2582f80c_3779_4274_8e68_bc80197592b9.slice/crio-12963b9c7a504e6ff7e450ecdff2dd9d5c27a1d2da2e2c0c772e6b0ffac75a37 WatchSource:0}: Error finding container 12963b9c7a504e6ff7e450ecdff2dd9d5c27a1d2da2e2c0c772e6b0ffac75a37: Status 404 returned error can't find the container with id 12963b9c7a504e6ff7e450ecdff2dd9d5c27a1d2da2e2c0c772e6b0ffac75a37
Jul 09 19:40:28.532053 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:28.532019    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vtw49/must-gather-j98jk" event={"ID":"2582f80c-3779-4274-8e68-bc80197592b9","Type":"ContainerStarted","Data":"12963b9c7a504e6ff7e450ecdff2dd9d5c27a1d2da2e2c0c772e6b0ffac75a37"}
Jul 09 19:40:29.542721 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:29.542677    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vtw49/must-gather-j98jk" event={"ID":"2582f80c-3779-4274-8e68-bc80197592b9","Type":"ContainerStarted","Data":"87d7ea7bdc6f0961354fbae44711e297cca490bbcefb4b67c93eeabe616ae8af"}
Jul 09 19:40:29.543258 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:29.542730    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vtw49/must-gather-j98jk" event={"ID":"2582f80c-3779-4274-8e68-bc80197592b9","Type":"ContainerStarted","Data":"740bbef8f796181fe396a4164595f29de2458e55c5bb08eca53388c69998bff7"}
Jul 09 19:40:29.560861 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:29.560776    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vtw49/must-gather-j98jk" podStartSLOduration=1.834723766 podStartE2EDuration="2.560752259s" totalImagesPullingTime="726.028493ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:40:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:40:29.559172305 +0000 UTC m=+2447.944242582" watchObservedRunningTime="2026-07-09 19:40:29.560752259 +0000 UTC m=+2447.945822534"
Jul 09 19:40:30.568141 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:30.568111    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-b5s6c_67dae793-bded-46b5-8237-b38edbebdc47/global-pull-secret-syncer/0.log"
Jul 09 19:40:30.602256 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:30.602224    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log" limit=1024
Jul 09 19:40:30.662840 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:30.662782    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-d9whc_456dc88f-d993-4b79-9193-62ee943ea3e6/konnectivity-agent/0.log"
Jul 09 19:40:30.790288 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:30.790259    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-233.ec2.internal_dfaa49bed4f018674f19ee2e2bb3d341/haproxy/0.log"
Jul 09 19:40:35.158634 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:35.158603    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-cljhs_e0fba050-da7d-49c0-8088-d77da7b61bdc/kuadrant-console-plugin/0.log"
Jul 09 19:40:35.389413 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:35.389385    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-68679_397e40eb-bc0c-40a1-8dfb-33ac81d17ea9/limitador/0.log"
Jul 09 19:40:37.134008 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:37.133919    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba94276e-4b28-40d0-bd8d-c7e6b628adf9/alertmanager/0.log"
Jul 09 19:40:37.163206 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:37.163179    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba94276e-4b28-40d0-bd8d-c7e6b628adf9/config-reloader/0.log"
Jul 09 19:40:37.185147 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:37.185107    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba94276e-4b28-40d0-bd8d-c7e6b628adf9/kube-rbac-proxy-web/0.log"
Jul 09 19:40:37.208432 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:37.208373    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba94276e-4b28-40d0-bd8d-c7e6b628adf9/kube-rbac-proxy/0.log"
Jul 09 19:40:37.233492 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:37.233463    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba94276e-4b28-40d0-bd8d-c7e6b628adf9/kube-rbac-proxy-metric/0.log"
Jul 09 19:40:37.255140 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:37.255095    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba94276e-4b28-40d0-bd8d-c7e6b628adf9/prom-label-proxy/0.log"
Jul 09 19:40:37.278095 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:37.278062    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ba94276e-4b28-40d0-bd8d-c7e6b628adf9/init-config-reloader/0.log"
Jul 09 19:40:37.345211 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:37.345184    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-pdx9m_393d0b99-20db-49d4-bb50-bef80c86563d/kube-state-metrics/0.log"
Jul 09 19:40:37.369473 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:37.369436    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-pdx9m_393d0b99-20db-49d4-bb50-bef80c86563d/kube-rbac-proxy-main/0.log"
Jul 09 19:40:37.393689 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:37.393607    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-pdx9m_393d0b99-20db-49d4-bb50-bef80c86563d/kube-rbac-proxy-self/0.log"
Jul 09 19:40:37.424217 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:37.424158    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-578847dcdd-vqskg_7687faf4-d297-4618-9243-35897a1bc2ec/metrics-server/0.log"
Jul 09 19:40:37.454584 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:37.454554    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-q2pgk_750b5f41-0adb-44a3-a504-88fe8cd67cf9/monitoring-plugin/0.log"
Jul 09 19:40:37.678637 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:37.678518    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qrrl7_2d925277-c169-430e-9535-1a3da7490d86/node-exporter/0.log"
Jul 09 19:40:37.701789 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:37.701732    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qrrl7_2d925277-c169-430e-9535-1a3da7490d86/kube-rbac-proxy/0.log"
Jul 09 19:40:37.746069 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:37.746042    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qrrl7_2d925277-c169-430e-9535-1a3da7490d86/init-textfile/0.log"
Jul 09 19:40:37.775833 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:37.775339    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-7wwbk_82b57efd-d3d6-4e60-9102-88fea9ebadb4/kube-rbac-proxy-main/0.log"
Jul 09 19:40:37.821057 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:37.821027    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-7wwbk_82b57efd-d3d6-4e60-9102-88fea9ebadb4/kube-rbac-proxy-self/0.log"
Jul 09 19:40:37.846035 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:37.846009    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-7wwbk_82b57efd-d3d6-4e60-9102-88fea9ebadb4/openshift-state-metrics/0.log"
Jul 09 19:40:37.905099 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:37.905074    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_45eb820c-c11f-460e-8a80-19ef30f80904/prometheus/0.log"
Jul 09 19:40:37.931237 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:37.931143    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_45eb820c-c11f-460e-8a80-19ef30f80904/config-reloader/0.log"
Jul 09 19:40:37.956225 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:37.956203    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_45eb820c-c11f-460e-8a80-19ef30f80904/thanos-sidecar/0.log"
Jul 09 19:40:37.977347 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:37.977322    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_45eb820c-c11f-460e-8a80-19ef30f80904/kube-rbac-proxy-web/0.log"
Jul 09 19:40:38.005410 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:38.005387    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_45eb820c-c11f-460e-8a80-19ef30f80904/kube-rbac-proxy/0.log"
Jul 09 19:40:38.035168 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:38.035143    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_45eb820c-c11f-460e-8a80-19ef30f80904/kube-rbac-proxy-thanos/0.log"
Jul 09 19:40:38.064249 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:38.064167    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_45eb820c-c11f-460e-8a80-19ef30f80904/init-config-reloader/0.log"
Jul 09 19:40:38.095910 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:38.095849    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-4q5hf_a0c5f69b-404c-40af-a042-fca5220650d4/prometheus-operator/0.log"
Jul 09 19:40:38.117706 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:38.117680    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-4q5hf_a0c5f69b-404c-40af-a042-fca5220650d4/kube-rbac-proxy/0.log"
Jul 09 19:40:38.156139 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:38.156104    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-z8lcw_5fea6453-32c0-46c4-b1d8-2728f9485896/prometheus-operator-admission-webhook/0.log"
Jul 09 19:40:38.201384 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:38.200983    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f658749c7-tlc54_e1ef83f0-4839-495e-8519-ac044a394c8a/telemeter-client/0.log"
Jul 09 19:40:38.237374 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:38.237196    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f658749c7-tlc54_e1ef83f0-4839-495e-8519-ac044a394c8a/reload/0.log"
Jul 09 19:40:38.274191 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:38.274165    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f658749c7-tlc54_e1ef83f0-4839-495e-8519-ac044a394c8a/kube-rbac-proxy/0.log"
Jul 09 19:40:38.315700 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:38.315671    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69544d7d48-zd6h4_7aeef437-26b0-411d-b8c0-4878ea3036d1/thanos-query/0.log"
Jul 09 19:40:38.344676 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:38.344648    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69544d7d48-zd6h4_7aeef437-26b0-411d-b8c0-4878ea3036d1/kube-rbac-proxy-web/0.log"
Jul 09 19:40:38.367002 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:38.366977    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69544d7d48-zd6h4_7aeef437-26b0-411d-b8c0-4878ea3036d1/kube-rbac-proxy/0.log"
Jul 09 19:40:38.392153 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:38.392111    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69544d7d48-zd6h4_7aeef437-26b0-411d-b8c0-4878ea3036d1/prom-label-proxy/0.log"
Jul 09 19:40:38.414942 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:38.414913    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69544d7d48-zd6h4_7aeef437-26b0-411d-b8c0-4878ea3036d1/kube-rbac-proxy-rules/0.log"
Jul 09 19:40:38.441954 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:38.441921    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69544d7d48-zd6h4_7aeef437-26b0-411d-b8c0-4878ea3036d1/kube-rbac-proxy-metrics/0.log"
Jul 09 19:40:40.994068 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:40.994029    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7b78b8cc99-4q2gk_7dd99ffd-f285-4149-ab43-ab4f8ef8e152/console/0.log"
Jul 09 19:40:41.130190 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:41.130128    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vtw49/perf-node-gather-daemonset-9z5st"]
Jul 09 19:40:41.138410 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:41.138376    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-9z5st"
Jul 09 19:40:41.142972 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:41.142939    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vtw49/perf-node-gather-daemonset-9z5st"]
Jul 09 19:40:41.265518 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:41.265443    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/06291587-3df4-454d-abfe-c64e77c12049-podres\") pod \"perf-node-gather-daemonset-9z5st\" (UID: \"06291587-3df4-454d-abfe-c64e77c12049\") " pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-9z5st"
Jul 09 19:40:41.265518 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:41.265500    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06291587-3df4-454d-abfe-c64e77c12049-sys\") pod \"perf-node-gather-daemonset-9z5st\" (UID: \"06291587-3df4-454d-abfe-c64e77c12049\") " pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-9z5st"
Jul 09 19:40:41.265733 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:41.265530    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/06291587-3df4-454d-abfe-c64e77c12049-lib-modules\") pod \"perf-node-gather-daemonset-9z5st\" (UID: \"06291587-3df4-454d-abfe-c64e77c12049\") " pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-9z5st"
Jul 09 19:40:41.265733 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:41.265587    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5jcq\" (UniqueName: \"kubernetes.io/projected/06291587-3df4-454d-abfe-c64e77c12049-kube-api-access-b5jcq\") pod \"perf-node-gather-daemonset-9z5st\" (UID: \"06291587-3df4-454d-abfe-c64e77c12049\") " pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-9z5st"
Jul 09 19:40:41.265733 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:41.265606    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/06291587-3df4-454d-abfe-c64e77c12049-proc\") pod \"perf-node-gather-daemonset-9z5st\" (UID: \"06291587-3df4-454d-abfe-c64e77c12049\") " pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-9z5st"
Jul 09 19:40:41.367282 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:41.367231    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/06291587-3df4-454d-abfe-c64e77c12049-podres\") pod \"perf-node-gather-daemonset-9z5st\" (UID: \"06291587-3df4-454d-abfe-c64e77c12049\") " pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-9z5st"
Jul 09 19:40:41.367473 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:41.367302    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06291587-3df4-454d-abfe-c64e77c12049-sys\") pod \"perf-node-gather-daemonset-9z5st\" (UID: \"06291587-3df4-454d-abfe-c64e77c12049\") " pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-9z5st"
Jul 09 19:40:41.367473 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:41.367328    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/06291587-3df4-454d-abfe-c64e77c12049-lib-modules\") pod \"perf-node-gather-daemonset-9z5st\" (UID: \"06291587-3df4-454d-abfe-c64e77c12049\") " pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-9z5st"
Jul 09 19:40:41.367473 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:41.367397    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5jcq\" (UniqueName: \"kubernetes.io/projected/06291587-3df4-454d-abfe-c64e77c12049-kube-api-access-b5jcq\") pod \"perf-node-gather-daemonset-9z5st\" (UID: \"06291587-3df4-454d-abfe-c64e77c12049\") " pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-9z5st"
Jul 09 19:40:41.367473 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:41.367430    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/06291587-3df4-454d-abfe-c64e77c12049-proc\") pod \"perf-node-gather-daemonset-9z5st\" (UID: \"06291587-3df4-454d-abfe-c64e77c12049\") " pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-9z5st"
Jul 09 19:40:41.367689 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:41.367426    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06291587-3df4-454d-abfe-c64e77c12049-sys\") pod \"perf-node-gather-daemonset-9z5st\" (UID: \"06291587-3df4-454d-abfe-c64e77c12049\") " pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-9z5st"
Jul 09 19:40:41.367689 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:41.367508    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/06291587-3df4-454d-abfe-c64e77c12049-lib-modules\") pod \"perf-node-gather-daemonset-9z5st\" (UID: \"06291587-3df4-454d-abfe-c64e77c12049\") " pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-9z5st"
Jul 09 19:40:41.367689 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:41.367426    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/06291587-3df4-454d-abfe-c64e77c12049-podres\") pod \"perf-node-gather-daemonset-9z5st\" (UID: \"06291587-3df4-454d-abfe-c64e77c12049\") " pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-9z5st"
Jul 09 19:40:41.367689 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:41.367564    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/06291587-3df4-454d-abfe-c64e77c12049-proc\") pod \"perf-node-gather-daemonset-9z5st\" (UID: \"06291587-3df4-454d-abfe-c64e77c12049\") " pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-9z5st"
Jul 09 19:40:41.376522 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:41.376486    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5jcq\" (UniqueName: \"kubernetes.io/projected/06291587-3df4-454d-abfe-c64e77c12049-kube-api-access-b5jcq\") pod \"perf-node-gather-daemonset-9z5st\" (UID: \"06291587-3df4-454d-abfe-c64e77c12049\") " pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-9z5st"
Jul 09 19:40:41.455085 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:41.454829    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-9z5st"
Jul 09 19:40:41.649154 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:41.649122    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vtw49/perf-node-gather-daemonset-9z5st"]
Jul 09 19:40:42.667051 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:42.667019    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-9z5st" event={"ID":"06291587-3df4-454d-abfe-c64e77c12049","Type":"ContainerStarted","Data":"cf8e055ddeffc38235a3e736716a7385508d64fd5d57be6f10478cb1837e7bf1"}
Jul 09 19:40:42.667492 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:42.667078    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-9z5st" event={"ID":"06291587-3df4-454d-abfe-c64e77c12049","Type":"ContainerStarted","Data":"b5e2edaede0c6d7994793b6a7e8adaf7ea3269dd08bd21891c047db16579bf7c"}
Jul 09 19:40:42.667492 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:42.667209    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-9z5st"
Jul 09 19:40:42.685582 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:42.685509    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-9z5st" podStartSLOduration=1.68548583 podStartE2EDuration="1.68548583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 19:40:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:40:42.683258498 +0000 UTC m=+2461.068328785" watchObservedRunningTime="2026-07-09 19:40:42.68548583 +0000 UTC m=+2461.070556106"
Jul 09 19:40:42.865655 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:42.865634    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6r97q_cc39b910-2f78-4b07-ba5c-9d50cf43eeb5/dns/0.log"
Jul 09 19:40:42.888038 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:42.888012    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6r97q_cc39b910-2f78-4b07-ba5c-9d50cf43eeb5/kube-rbac-proxy/0.log"
Jul 09 19:40:42.960059 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:42.959976    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-d4hjs_e98f3c45-8551-4810-a45c-deebf91e11dc/dns-node-resolver/0.log"
Jul 09 19:40:43.603462 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:43.603427    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vbqbv_605a56fa-674a-44cd-a987-bc27d0fbd80d/node-ca/0.log"
Jul 09 19:40:44.625138 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:44.625109    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b6c4d4-g6hzz_ba524d40-a1a2-4b64-bb5d-8722dd385d19/kube-auth-proxy/0.log"
Jul 09 19:40:45.454431 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:45.454404    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h46tv_1644ac58-9a6f-4faf-9f0e-183cdd63caaa/serve-healthcheck-canary/0.log"
Jul 09 19:40:46.129833 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:46.129796    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wlvmd_5469e145-df2f-4d92-bf40-e232c79e9858/kube-rbac-proxy/0.log"
Jul 09 19:40:46.152593 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:46.152566    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wlvmd_5469e145-df2f-4d92-bf40-e232c79e9858/exporter/0.log"
Jul 09 19:40:46.176012 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:46.175979    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wlvmd_5469e145-df2f-4d92-bf40-e232c79e9858/extractor/0.log"
Jul 09 19:40:48.688797 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:48.688770    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vtw49/perf-node-gather-daemonset-9z5st"
Jul 09 19:40:48.760785 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:48.760753    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-779db88bb-xhp8b_92045a2d-ff6b-411b-a596-2ac71e27d975/manager/0.log"
Jul 09 19:40:48.781911 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:48.781879    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-779db88bb-xhp8b_92045a2d-ff6b-411b-a596-2ac71e27d975/copy-manifests/0.log"
Jul 09 19:40:50.075362 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:50.075334    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8ff7d7b96-rhjhz_a0ae800a-a0cd-483a-903a-05e5a2ca09f2/manager/0.log"
Jul 09 19:40:51.750556 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:51.750532    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b6c4d4-g6hzz_ba524d40-a1a2-4b64-bb5d-8722dd385d19/kube-auth-proxy/0.log"
Jul 09 19:40:53.285034 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:53.285009    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b6c4d4-g6hzz_ba524d40-a1a2-4b64-bb5d-8722dd385d19/kube-auth-proxy/0.log"
Jul 09 19:40:56.923009 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:56.922978    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pfhlb_2d7a4519-2a09-4b32-9aba-6caa03ed8d37/kube-multus-additional-cni-plugins/0.log"
Jul 09 19:40:56.946973 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:56.946945    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pfhlb_2d7a4519-2a09-4b32-9aba-6caa03ed8d37/egress-router-binary-copy/0.log"
Jul 09 19:40:56.968917 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:56.968888    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pfhlb_2d7a4519-2a09-4b32-9aba-6caa03ed8d37/cni-plugins/0.log"
Jul 09 19:40:56.990297 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:56.990276    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pfhlb_2d7a4519-2a09-4b32-9aba-6caa03ed8d37/bond-cni-plugin/0.log"
Jul 09 19:40:57.011965 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:57.011925    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pfhlb_2d7a4519-2a09-4b32-9aba-6caa03ed8d37/routeoverride-cni/0.log"
Jul 09 19:40:57.032788 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:57.032758    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pfhlb_2d7a4519-2a09-4b32-9aba-6caa03ed8d37/whereabouts-cni-bincopy/0.log"
Jul 09 19:40:57.053607 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:57.053574    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pfhlb_2d7a4519-2a09-4b32-9aba-6caa03ed8d37/whereabouts-cni/0.log"
Jul 09 19:40:57.249219 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:57.249142    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gtbdq_6ad86949-d001-4b0c-9a59-cebf82ee6604/kube-multus/0.log"
Jul 09 19:40:57.382483 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:57.382456    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-svvql_979b4064-b4f4-40b8-86f7-cf21c0a62580/network-metrics-daemon/0.log"
Jul 09 19:40:57.401797 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:57.401772    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-svvql_979b4064-b4f4-40b8-86f7-cf21c0a62580/kube-rbac-proxy/0.log"
Jul 09 19:40:58.512465 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:58.512396    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw97f_89f43e21-1536-46e8-b2d6-f0dd1584613c/ovn-controller/0.log"
Jul 09 19:40:58.533653 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:58.533626    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw97f_89f43e21-1536-46e8-b2d6-f0dd1584613c/ovn-acl-logging/0.log"
Jul 09 19:40:58.555503 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:58.555477    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw97f_89f43e21-1536-46e8-b2d6-f0dd1584613c/kube-rbac-proxy-node/0.log"
Jul 09 19:40:58.575631 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:58.575607    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw97f_89f43e21-1536-46e8-b2d6-f0dd1584613c/kube-rbac-proxy-ovn-metrics/0.log"
Jul 09 19:40:58.596214 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:58.596182    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw97f_89f43e21-1536-46e8-b2d6-f0dd1584613c/northd/0.log"
Jul 09 19:40:58.615727 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:58.615700    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw97f_89f43e21-1536-46e8-b2d6-f0dd1584613c/nbdb/0.log"
Jul 09 19:40:58.635944 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:58.635912    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw97f_89f43e21-1536-46e8-b2d6-f0dd1584613c/sbdb/0.log"
Jul 09 19:40:58.692607 ip-10-0-137-233 kubenswrapper[2577]: I0709 19:40:58.692574    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bw97f_89f43e21-1536-46e8-b2d6-f0dd1584613c/ovnkube-controller/0.log"